2026-03-05 21:37:38.146827 | Job console starting 2026-03-05 21:37:38.199704 | Updating git repos 2026-03-05 21:37:38.252041 | Cloning repos into workspace 2026-03-05 21:37:38.356227 | Restoring repo states 2026-03-05 21:37:38.364211 | Merging changes 2026-03-05 21:37:38.848033 | Checking out repos 2026-03-05 21:37:40.487981 | Preparing playbooks 2026-03-05 21:37:48.558402 | Running Ansible setup 2026-03-05 21:37:54.916862 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 21:37:55.563310 | 2026-03-05 21:37:55.563462 | PLAY [localhost] 2026-03-05 21:37:55.572342 | 2026-03-05 21:37:55.572416 | TASK [Gathering Facts] 2026-03-05 21:37:56.395177 | localhost | ok 2026-03-05 21:37:56.408017 | 2026-03-05 21:37:56.408196 | TASK [Setup log path fact] 2026-03-05 21:37:56.428802 | localhost | ok 2026-03-05 21:37:56.458515 | 2026-03-05 21:37:56.458591 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 21:37:56.488461 | localhost | ok 2026-03-05 21:37:56.496150 | 2026-03-05 21:37:56.496217 | TASK [emit-job-header : Print job information] 2026-03-05 21:37:56.536310 | # Job Information 2026-03-05 21:37:56.536452 | Ansible Version: 2.16.16 2026-03-05 21:37:56.536497 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-03-05 21:37:56.536528 | Pipeline: check 2026-03-05 21:37:56.536556 | Executor: 0a8996d2b663 2026-03-05 21:37:56.536583 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/94 2026-03-05 21:37:56.536614 | Event ID: 73f33530-18d7-11f1-9201-aa96ba466095 2026-03-05 21:37:56.540160 | 2026-03-05 21:37:56.540253 | LOOP [emit-job-header : Print node information] 2026-03-05 21:37:56.633621 | localhost | ok: 2026-03-05 21:37:56.633958 | localhost | # Node Information 2026-03-05 21:37:56.634023 | localhost | Inventory Hostname: mon1 2026-03-05 21:37:56.634071 | localhost | Hostname: np0000157952 2026-03-05 21:37:56.634115 | localhost | Username: zuul 2026-03-05 21:37:56.634171 | localhost | Distro: Ubuntu 24.04 2026-03-05 21:37:56.634216 | localhost | Provider: yul1 2026-03-05 21:37:56.634260 | localhost | Region: ca-ymq-1 2026-03-05 21:37:56.634301 | localhost | Label: ubuntu-noble 2026-03-05 21:37:56.634342 | localhost | Product Name: OpenStack Nova 2026-03-05 21:37:56.634384 | localhost | Interface IP: 162.253.55.227 2026-03-05 21:37:56.681100 | localhost | ok: 2026-03-05 21:37:56.681237 | localhost | # Node Information 2026-03-05 21:37:56.681301 | localhost | Inventory Hostname: osd1 2026-03-05 21:37:56.681418 | localhost | Hostname: np0000157953 2026-03-05 21:37:56.681478 | localhost | Username: zuul 2026-03-05 21:37:56.681524 | localhost | Distro: Ubuntu 24.04 2026-03-05 21:37:56.681617 | localhost | Provider: yul1 2026-03-05 21:37:56.681671 | localhost | Region: ca-ymq-1 2026-03-05 21:37:56.681718 | localhost | Label: ubuntu-noble 2026-03-05 21:37:56.681763 | localhost | Product Name: OpenStack Nova 2026-03-05 21:37:56.681809 | localhost | Interface IP: 162.253.55.62 2026-03-05 21:37:56.700111 | 2026-03-05 21:37:56.740636 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-05 21:37:57.283307 | localhost -> localhost | changed 2026-03-05 21:37:57.291000 | 2026-03-05 21:37:57.291094 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-05 21:37:58.156086 | localhost -> localhost | changed 2026-03-05 21:37:58.166051 | 2026-03-05 21:37:58.166107 | PLAY [all] 2026-03-05 21:37:58.175146 | 2026-03-05 21:37:58.175211 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-05 21:37:58.407846 | mon1 -> localhost | ok 2026-03-05 21:37:58.413967 | 2026-03-05 21:37:58.414034 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-05 21:37:58.448537 | mon1 | ok 2026-03-05 21:37:58.546818 | osd1 | ok 2026-03-05 21:37:58.574309 | mon1 | included: /var/lib/zuul/builds/8a661fb75e9742d59970ed217a4ef46f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 21:37:58.574566 | osd1 | included: /var/lib/zuul/builds/8a661fb75e9742d59970ed217a4ef46f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 21:37:58.594092 | 2026-03-05 21:37:58.594352 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-05 21:37:59.912573 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-05 21:37:59.912748 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/8a661fb75e9742d59970ed217a4ef46f/work/8a661fb75e9742d59970ed217a4ef46f_id_rsa 2026-03-05 21:37:59.912780 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/8a661fb75e9742d59970ed217a4ef46f/work/8a661fb75e9742d59970ed217a4ef46f_id_rsa.pub 2026-03-05 21:37:59.912804 | mon1 -> localhost | The key fingerprint is: 2026-03-05 21:37:59.912827 | mon1 -> localhost | SHA256:ZzrfU3qlS8lF/loIqMN7vRDHX1nHW2Gig1KLnBAJIms zuul-build-sshkey 2026-03-05 21:37:59.912849 | mon1 -> localhost | The key's randomart image is: 2026-03-05 21:37:59.912870 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-05 21:37:59.912890 | mon1 -> localhost | |.. ..oo . . o | 2026-03-05 21:37:59.912911 | mon1 -> localhost | |... .o + o . o..| 2026-03-05 21:37:59.912931 | mon1 -> localhost | |.E = o o *| 2026-03-05 21:37:59.912952 | mon1 -> localhost | |. . o. o*| 2026-03-05 21:37:59.913053 | mon1 -> localhost | | S = + o+| 2026-03-05 21:37:59.913087 | mon1 -> localhost | | . = o +.=o| 2026-03-05 21:37:59.913108 | mon1 -> localhost | | * .. o*oo| 2026-03-05 21:37:59.913129 | mon1 -> localhost | | =.o+.oo | 2026-03-05 21:37:59.913149 | mon1 -> localhost | | ... o+o. | 2026-03-05 21:37:59.913169 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-05 21:37:59.913219 | mon1 -> localhost | ok: Runtime: 0:00:00.910351 2026-03-05 21:37:59.921139 | 2026-03-05 21:37:59.921210 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-05 21:37:59.951371 | mon1 | ok 2026-03-05 21:37:59.955829 | osd1 | ok 2026-03-05 21:37:59.969207 | mon1 | included: /var/lib/zuul/builds/8a661fb75e9742d59970ed217a4ef46f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 21:37:59.969256 | osd1 | included: /var/lib/zuul/builds/8a661fb75e9742d59970ed217a4ef46f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 21:37:59.979687 | 2026-03-05 21:37:59.979749 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-05 21:38:00.003004 | mon1 | skipping: Conditional result was False 2026-03-05 21:38:00.014186 | osd1 | skipping: Conditional result was False 2026-03-05 21:38:00.023523 | 2026-03-05 21:38:00.023616 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-05 21:38:00.548817 | osd1 | changed 2026-03-05 21:38:00.586704 | mon1 | changed 2026-03-05 21:38:00.592083 | 2026-03-05 21:38:00.592147 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-05 21:38:00.829918 | mon1 | ok 2026-03-05 21:38:00.836207 | osd1 | ok 2026-03-05 21:38:00.842407 | 2026-03-05 21:38:00.842491 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-05 21:38:01.384228 | mon1 | changed 2026-03-05 21:38:01.414743 | osd1 | changed 2026-03-05 21:38:01.422866 | 2026-03-05 21:38:01.422958 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-05 21:38:02.038030 | mon1 | changed 2026-03-05 21:38:02.047836 | osd1 | changed 2026-03-05 21:38:02.054505 | 2026-03-05 21:38:02.054576 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-05 21:38:02.078900 | mon1 | skipping: Conditional result was False 2026-03-05 21:38:02.089943 | osd1 | skipping: Conditional result was False 2026-03-05 21:38:02.100495 | 2026-03-05 21:38:02.100563 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-05 21:38:02.408690 | mon1 -> localhost | changed 2026-03-05 21:38:02.439048 | 2026-03-05 21:38:02.439207 | TASK [add-build-sshkey : Add back temp key] 2026-03-05 21:38:02.765118 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/8a661fb75e9742d59970ed217a4ef46f/work/8a661fb75e9742d59970ed217a4ef46f_id_rsa (zuul-build-sshkey) 2026-03-05 21:38:02.765373 | mon1 -> localhost | ok: Runtime: 0:00:00.014045 2026-03-05 21:38:02.773277 | 2026-03-05 21:38:02.773411 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-05 21:38:03.076333 | mon1 | ok 2026-03-05 21:38:03.083808 | osd1 | ok 2026-03-05 21:38:03.090402 | 2026-03-05 21:38:03.090472 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-05 21:38:03.117545 | mon1 | skipping: Conditional result was False 2026-03-05 21:38:03.128657 | osd1 | skipping: Conditional result was False 2026-03-05 21:38:03.148895 | 2026-03-05 21:38:03.149037 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-05 21:38:03.462727 | mon1 | ok 2026-03-05 21:38:03.469718 | osd1 | ok 2026-03-05 21:38:03.476185 | 2026-03-05 21:38:03.476258 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-05 21:38:04.247515 | mon1 | Output suppressed because no_log was given 2026-03-05 21:38:04.277117 | osd1 | Output suppressed because no_log was given 2026-03-05 21:38:04.299766 | 2026-03-05 21:38:04.299902 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-05 21:38:04.522136 | mon1 | ok: "logs" 2026-03-05 21:38:04.522758 | mon1 | ok: All items complete 2026-03-05 21:38:04.522831 | 2026-03-05 21:38:04.530210 | osd1 | ok: "logs" 2026-03-05 21:38:04.722451 | mon1 | ok: "artifacts" 2026-03-05 21:38:04.741047 | osd1 | ok: "artifacts" 2026-03-05 21:38:04.921670 | mon1 | ok: "docs" 2026-03-05 21:38:04.930179 | osd1 | ok: "docs" 2026-03-05 21:38:04.940479 | 2026-03-05 21:38:04.940609 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-05 21:38:05.158391 | mon1 | changed: "logs" 2026-03-05 21:38:05.158678 | mon1 | ok: All items complete 2026-03-05 21:38:05.158726 | 2026-03-05 21:38:05.179724 | osd1 | changed: "logs" 2026-03-05 21:38:05.359646 | mon1 | changed: "artifacts" 2026-03-05 21:38:05.814662 | osd1 | changed: "artifacts" 2026-03-05 21:38:05.824260 | mon1 | changed: "docs" 2026-03-05 21:38:05.831196 | osd1 | changed: "docs" 2026-03-05 21:38:05.850813 | 2026-03-05 21:38:05.850908 | PLAY RECAP 2026-03-05 21:38:05.850952 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:38:05.850980 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 21:38:05.851005 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 21:38:05.851024 | 2026-03-05 21:38:05.958251 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 21:38:05.961266 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 21:38:06.545519 | 2026-03-05 21:38:06.545637 | PLAY [all] 2026-03-05 21:38:06.557334 | 2026-03-05 21:38:06.557411 | TASK [setup-uv : Extract archive] 2026-03-05 21:38:08.903059 | mon1 | changed 2026-03-05 21:38:08.963895 | osd1 | changed 2026-03-05 21:38:08.969724 | 2026-03-05 21:38:08.969802 | TASK [setup-uv : Print version] 2026-03-05 21:38:09.426980 | osd1 | uv 0.8.13 2026-03-05 21:38:09.420724 | mon1 | uv 0.8.13 2026-03-05 21:38:09.545882 | mon1 | ok: Runtime: 0:00:00.019996 2026-03-05 21:38:09.556799 | osd1 | ok: Runtime: 0:00:00.017322 2026-03-05 21:38:09.568019 | 2026-03-05 21:38:09.568076 | PLAY RECAP 2026-03-05 21:38:09.568121 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:38:09.568153 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:38:09.568173 | 2026-03-05 21:38:09.671087 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 21:38:09.676325 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 21:38:10.231460 | 2026-03-05 21:38:10.231590 | PLAY [all] 2026-03-05 21:38:10.242823 | 2026-03-05 21:38:10.242898 | TASK [Copy inventory file for Zuul] 2026-03-05 21:38:11.292824 | mon1 | changed 2026-03-05 21:38:11.298622 | 2026-03-05 21:38:11.298692 | TASK [Switch "ansible_host" to private IP] 2026-03-05 21:38:11.673211 | mon1 | changed: 2 replacements made 2026-03-05 21:38:11.679097 | 2026-03-05 21:38:11.679165 | TASK [Run Molecule scenario] 2026-03-05 21:38:12.158782 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-03-05 21:38:12.158923 | mon1 | Creating virtual environment at: .venv 2026-03-05 21:38:12.524867 | mon1 | Downloading pygments (1.2MiB) 2026-03-05 21:38:12.528662 | mon1 | Downloading cryptography (4.3MiB) 2026-03-05 21:38:12.529428 | mon1 | Downloading netaddr (2.2MiB) 2026-03-05 21:38:12.536850 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-05 21:38:12.721024 | mon1 | Downloading netaddr 2026-03-05 21:38:12.731485 | mon1 | Downloading cryptography 2026-03-05 21:38:12.787050 | mon1 | Downloading pygments 2026-03-05 21:38:12.952988 | mon1 | Downloading ansible-core 2026-03-05 21:38:13.000078 | mon1 | Installed 37 packages in 46ms 2026-03-05 21:38:13.793408 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-05 21:38:13.793498 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-05 21:38:14.421877 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-05 21:38:14.421988 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-05 21:38:26.013821 | mon1 | INFO [default > dependency] Executing 2026-03-05 21:38:26.014024 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-05 21:38:26.014276 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-05 21:38:26.014402 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-05 21:38:26.021277 | mon1 | INFO [default > cleanup] Executing 2026-03-05 21:38:26.021620 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:38:26.028222 | mon1 | INFO [default > destroy] Executing 2026-03-05 21:38:26.028285 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 21:38:26.028389 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 21:38:26.034978 | mon1 | INFO [default > syntax] Executing 2026-03-05 21:38:27.086841 | mon1 | 2026-03-05 21:38:27.087124 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-05 21:38:27.141471 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-05 21:38:27.151726 | mon1 | INFO [default > create] Executing 2026-03-05 21:38:27.153300 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:38:27.159172 | mon1 | INFO [default > prepare] Executing 2026-03-05 21:38:27.968545 | mon1 | 2026-03-05 21:38:27.968768 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-05 21:38:27.969022 | mon1 | 2026-03-05 21:38:27.969369 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:38:27.969618 | mon1 | Thursday 05 March 2026 21:38:27 +0000 (0:00:00.035) 0:00:00.035 ******** 2026-03-05 21:38:29.231503 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:38:29.231627 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:38:29.231786 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:38:29.231940 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:38:29.232107 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:38:30.252851 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:38:30.253108 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:38:30.253429 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:38:30.253688 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:38:30.253952 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:38:30.262311 | mon1 | ok: [mon1] 2026-03-05 21:38:30.262496 | mon1 | ok: [osd1] 2026-03-05 21:38:30.262712 | mon1 | 2026-03-05 21:38:30.262955 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-05 21:38:30.263198 | mon1 | Thursday 05 March 2026 21:38:30 +0000 (0:00:02.294) 0:00:02.330 ******** 2026-03-05 21:38:32.096537 | mon1 | changed: [mon1] 2026-03-05 21:38:32.096738 | mon1 | changed: [osd1] 2026-03-05 21:38:32.096957 | mon1 | 2026-03-05 21:38:32.097190 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-05 21:38:32.097465 | mon1 | Thursday 05 March 2026 21:38:32 +0000 (0:00:01.833) 0:00:04.163 ******** 2026-03-05 21:38:32.419631 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-05 21:38:32.419780 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-05 21:38:32.419953 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-05 21:38:32.434287 | mon1 | changed: [mon1] 2026-03-05 21:38:32.434971 | mon1 | changed: [osd1] 2026-03-05 21:38:32.435012 | mon1 | 2026-03-05 21:38:32.435019 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-05 21:38:32.435025 | mon1 | Thursday 05 March 2026 21:38:32 +0000 (0:00:00.338) 0:00:04.502 ******** 2026-03-05 21:38:38.771431 | mon1 | changed: [osd1] 2026-03-05 21:38:38.771523 | mon1 | changed: [mon1] 2026-03-05 21:38:38.771530 | mon1 | 2026-03-05 21:38:38.771641 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-05 21:38:38.771866 | mon1 | 2026-03-05 21:38:38.772130 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:38:38.772408 | mon1 | Thursday 05 March 2026 21:38:38 +0000 (0:00:06.336) 0:00:10.838 ******** 2026-03-05 21:38:39.589627 | mon1 | ok: [osd1] 2026-03-05 21:38:39.589704 | mon1 | 2026-03-05 21:38:39.589871 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-05 21:38:39.590049 | mon1 | Thursday 05 March 2026 21:38:39 +0000 (0:00:00.818) 0:00:11.657 ******** 2026-03-05 21:38:58.774882 | mon1 | changed: [osd1] 2026-03-05 21:38:58.776073 | mon1 | 2026-03-05 21:38:58.776097 | mon1 | TASK [Start up service] ******************************************************** 2026-03-05 21:38:58.776113 | mon1 | Thursday 05 March 2026 21:38:58 +0000 (0:00:19.184) 0:00:30.841 ******** 2026-03-05 21:38:59.436358 | mon1 | ok: [osd1] 2026-03-05 21:38:59.436548 | mon1 | 2026-03-05 21:38:59.436835 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-05 21:38:59.437077 | mon1 | Thursday 05 March 2026 21:38:59 +0000 (0:00:00.661) 0:00:31.503 ******** 2026-03-05 21:38:59.783462 | mon1 | ok: [osd1] 2026-03-05 21:38:59.783670 | mon1 | 2026-03-05 21:38:59.783918 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-05 21:38:59.784207 | mon1 | Thursday 05 March 2026 21:38:59 +0000 (0:00:00.347) 0:00:31.850 ******** 2026-03-05 21:39:00.545267 | mon1 | changed: [osd1] 2026-03-05 21:39:00.545641 | mon1 | 2026-03-05 21:39:00.546029 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-05 21:39:00.546378 | mon1 | Thursday 05 March 2026 21:39:00 +0000 (0:00:00.761) 0:00:32.612 ******** 2026-03-05 21:39:00.798702 | mon1 | ok: [osd1] 2026-03-05 21:39:00.798934 | mon1 | 2026-03-05 21:39:00.799201 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-05 21:39:00.799491 | mon1 | Thursday 05 March 2026 21:39:00 +0000 (0:00:00.253) 0:00:32.866 ******** 2026-03-05 21:39:00.827032 | mon1 | skipping: [osd1] 2026-03-05 21:39:00.827279 | mon1 | 2026-03-05 21:39:00.827549 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-05 21:39:00.827797 | mon1 | Thursday 05 March 2026 21:39:00 +0000 (0:00:00.028) 0:00:32.895 ******** 2026-03-05 21:39:01.498167 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:39:01.498440 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:39:01.498680 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:39:01.498900 | mon1 | 2026-03-05 21:39:01.499147 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-05 21:39:01.499485 | mon1 | Thursday 05 March 2026 21:39:01 +0000 (0:00:00.670) 0:00:33.565 ******** 2026-03-05 21:39:02.250325 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:39:02.250590 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:39:02.250872 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:39:02.251106 | mon1 | 2026-03-05 21:39:02.251396 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-05 21:39:02.251651 | mon1 | Thursday 05 March 2026 21:39:02 +0000 (0:00:00.752) 0:00:34.317 ******** 2026-03-05 21:39:03.055975 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:39:03.056177 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:39:03.056453 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:39:03.056681 | mon1 | 2026-03-05 21:39:03.056931 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-05 21:39:03.057186 | mon1 | Thursday 05 March 2026 21:39:03 +0000 (0:00:00.805) 0:00:35.123 ******** 2026-03-05 21:39:05.537756 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:39:05.537855 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:39:05.540281 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:39:05.540303 | mon1 | 2026-03-05 21:39:05.540316 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-05 21:39:05.540332 | mon1 | Thursday 05 March 2026 21:39:05 +0000 (0:00:02.481) 0:00:37.604 ******** 2026-03-05 21:39:06.852653 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-05 21:39:06.853117 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-05 21:39:06.853480 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-05 21:39:06.853791 | mon1 | 2026-03-05 21:39:06.854102 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:39:06.854654 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 21:39:06.854995 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-05 21:39:06.855316 | mon1 | 2026-03-05 21:39:06.855608 | mon1 | 2026-03-05 21:39:06.855911 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:39:06.856294 | mon1 | Thursday 05 March 2026 21:39:06 +0000 (0:00:01.315) 0:00:38.920 ******** 2026-03-05 21:39:06.856703 | mon1 | =============================================================================== 2026-03-05 21:39:06.857088 | mon1 | Install depedencies ---------------------------------------------------- 19.18s 2026-03-05 21:39:06.857348 | mon1 | Update apt cache -------------------------------------------------------- 6.34s 2026-03-05 21:39:06.857548 | mon1 | Create a volume group for each loop device ------------------------------ 2.48s 2026-03-05 21:39:06.857743 | mon1 | Gathering Facts --------------------------------------------------------- 2.29s 2026-03-05 21:39:06.857933 | mon1 | Configure short hostname ------------------------------------------------ 1.83s 2026-03-05 21:39:06.858130 | mon1 | Create a logical volume for each loop device ---------------------------- 1.32s 2026-03-05 21:39:06.858345 | mon1 | Gathering Facts --------------------------------------------------------- 0.82s 2026-03-05 21:39:06.858541 | mon1 | Start loop devices ------------------------------------------------------ 0.81s 2026-03-05 21:39:06.858731 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.76s 2026-03-05 21:39:06.858927 | mon1 | Set permissions on loopback devices ------------------------------------- 0.75s 2026-03-05 21:39:06.859124 | mon1 | Create devices for Ceph ------------------------------------------------- 0.67s 2026-03-05 21:39:06.859371 | mon1 | Start up service -------------------------------------------------------- 0.66s 2026-03-05 21:39:06.859631 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.35s 2026-03-05 21:39:06.859885 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.34s 2026-03-05 21:39:06.860090 | mon1 | Get list of all loopback devices ---------------------------------------- 0.25s 2026-03-05 21:39:06.860330 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-03-05 21:39:06.954035 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-05 21:39:06.965271 | mon1 | INFO [default > converge] Executing 2026-03-05 21:39:07.982452 | mon1 | 2026-03-05 21:39:07.982874 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 21:39:07.983173 | mon1 | 2026-03-05 21:39:07.983526 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:39:07.983851 | mon1 | Thursday 05 March 2026 21:39:07 +0000 (0:00:00.052) 0:00:00.052 ******** 2026-03-05 21:39:09.036845 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:39:09.037061 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:39:09.037259 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:39:09.037435 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:39:09.037598 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:39:09.049988 | mon1 | ok: [mon1] 2026-03-05 21:39:09.050145 | mon1 | 2026-03-05 21:39:09.050334 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:39:09.050501 | mon1 | Thursday 05 March 2026 21:39:09 +0000 (0:00:01.067) 0:00:01.120 ******** 2026-03-05 21:39:09.415920 | mon1 | ok: [mon1] 2026-03-05 21:39:09.416292 | mon1 | 2026-03-05 21:39:09.416623 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:39:09.416927 | mon1 | Thursday 05 March 2026 21:39:09 +0000 (0:00:00.365) 0:00:01.485 ******** 2026-03-05 21:39:09.457585 | mon1 | skipping: [mon1] 2026-03-05 21:39:09.458398 | mon1 | 2026-03-05 21:39:09.458416 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:39:09.458424 | mon1 | Thursday 05 March 2026 21:39:09 +0000 (0:00:00.041) 0:00:01.527 ******** 2026-03-05 21:39:09.819808 | mon1 | changed: [mon1] 2026-03-05 21:39:09.819969 | mon1 | 2026-03-05 21:39:09.820220 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:39:09.820486 | mon1 | Thursday 05 March 2026 21:39:09 +0000 (0:00:00.361) 0:00:01.889 ******** 2026-03-05 21:39:09.925391 | mon1 | ok: [mon1] => { 2026-03-05 21:39:09.925815 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:39:09.926046 | mon1 | } 2026-03-05 21:39:09.926293 | mon1 | 2026-03-05 21:39:09.926541 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:39:09.926779 | mon1 | Thursday 05 March 2026 21:39:09 +0000 (0:00:00.105) 0:00:01.995 ******** 2026-03-05 21:39:10.627281 | mon1 | changed: [mon1] 2026-03-05 21:39:10.627358 | mon1 | 2026-03-05 21:39:10.627370 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:39:10.627380 | mon1 | Thursday 05 March 2026 21:39:10 +0000 (0:00:00.700) 0:00:02.696 ******** 2026-03-05 21:39:10.680893 | mon1 | skipping: [mon1] 2026-03-05 21:39:10.680970 | mon1 | 2026-03-05 21:39:10.681208 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:39:10.681266 | mon1 | Thursday 05 March 2026 21:39:10 +0000 (0:00:00.053) 0:00:02.750 ******** 2026-03-05 21:39:10.733852 | mon1 | skipping: [mon1] 2026-03-05 21:39:10.733906 | mon1 | 2026-03-05 21:39:10.734187 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:39:10.734221 | mon1 | Thursday 05 March 2026 21:39:10 +0000 (0:00:00.053) 0:00:02.803 ******** 2026-03-05 21:39:10.991922 | mon1 | ok: [mon1] 2026-03-05 21:39:10.991982 | mon1 | 2026-03-05 21:39:10.991992 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:39:10.992002 | mon1 | Thursday 05 March 2026 21:39:10 +0000 (0:00:00.257) 0:00:03.060 ******** 2026-03-05 21:39:12.108407 | mon1 | ok: [mon1] 2026-03-05 21:39:12.108503 | mon1 | 2026-03-05 21:39:12.109151 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:39:12.109200 | mon1 | Thursday 05 March 2026 21:39:12 +0000 (0:00:01.116) 0:00:04.177 ******** 2026-03-05 21:39:12.327280 | mon1 | ok: [mon1] => { 2026-03-05 21:39:12.327341 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:39:12.327387 | mon1 | } 2026-03-05 21:39:12.327397 | mon1 | 2026-03-05 21:39:12.327407 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:39:12.327416 | mon1 | Thursday 05 March 2026 21:39:12 +0000 (0:00:00.217) 0:00:04.395 ******** 2026-03-05 21:39:13.218441 | mon1 | changed: [mon1] 2026-03-05 21:39:13.218545 | mon1 | 2026-03-05 21:39:13.218559 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:39:13.218571 | mon1 | Thursday 05 March 2026 21:39:13 +0000 (0:00:00.890) 0:00:05.286 ******** 2026-03-05 21:39:16.475130 | mon1 | changed: [mon1] 2026-03-05 21:39:16.475900 | mon1 | 2026-03-05 21:39:16.475973 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:39:16.475988 | mon1 | Thursday 05 March 2026 21:39:16 +0000 (0:00:03.254) 0:00:08.541 ******** 2026-03-05 21:39:16.509093 | mon1 | skipping: [mon1] 2026-03-05 21:39:16.509380 | mon1 | 2026-03-05 21:39:16.509512 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:39:16.509789 | mon1 | Thursday 05 March 2026 21:39:16 +0000 (0:00:00.037) 0:00:08.578 ******** 2026-03-05 21:39:16.545416 | mon1 | skipping: [mon1] 2026-03-05 21:39:16.545633 | mon1 | 2026-03-05 21:39:16.545892 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:39:16.546145 | mon1 | Thursday 05 March 2026 21:39:16 +0000 (0:00:00.036) 0:00:08.615 ******** 2026-03-05 21:39:16.579701 | mon1 | skipping: [mon1] 2026-03-05 21:39:16.579956 | mon1 | 2026-03-05 21:39:16.580211 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:39:16.580531 | mon1 | Thursday 05 March 2026 21:39:16 +0000 (0:00:00.034) 0:00:08.649 ******** 2026-03-05 21:39:24.304526 | mon1 | changed: [mon1] 2026-03-05 21:39:24.304713 | mon1 | 2026-03-05 21:39:24.304976 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:39:24.305230 | mon1 | Thursday 05 March 2026 21:39:24 +0000 (0:00:07.724) 0:00:16.374 ******** 2026-03-05 21:39:25.008869 | mon1 | changed: [mon1] 2026-03-05 21:39:25.008949 | mon1 | 2026-03-05 21:39:25.009120 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:39:25.009325 | mon1 | Thursday 05 March 2026 21:39:25 +0000 (0:00:00.703) 0:00:17.078 ******** 2026-03-05 21:39:26.161515 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:39:26.161644 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:39:26.161816 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:39:26.162156 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:39:26.162497 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:39:26.162738 | mon1 | 2026-03-05 21:39:26.163104 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:39:26.163390 | mon1 | Thursday 05 March 2026 21:39:26 +0000 (0:00:01.153) 0:00:18.231 ******** 2026-03-05 21:39:26.882413 | mon1 | changed: [mon1] 2026-03-05 21:39:26.882483 | mon1 | 2026-03-05 21:39:26.882509 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:39:26.882810 | mon1 | Thursday 05 March 2026 21:39:26 +0000 (0:00:00.712) 0:00:18.943 ******** 2026-03-05 21:39:26.883107 | mon1 | 2026-03-05 21:39:26.883448 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:39:26.883738 | mon1 | Thursday 05 March 2026 21:39:26 +0000 (0:00:00.008) 0:00:18.951 ******** 2026-03-05 21:39:27.977460 | mon1 | ok: [mon1] 2026-03-05 21:39:27.977789 | mon1 | 2026-03-05 21:39:27.978206 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 21:39:27.978608 | mon1 | Thursday 05 March 2026 21:39:27 +0000 (0:00:01.095) 0:00:20.047 ******** 2026-03-05 21:39:28.560278 | mon1 | changed: [mon1] 2026-03-05 21:39:28.560350 | mon1 | 2026-03-05 21:39:28.560355 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:39:28.560550 | mon1 | Thursday 05 March 2026 21:39:28 +0000 (0:00:00.582) 0:00:20.629 ******** 2026-03-05 21:39:29.268681 | mon1 | changed: [mon1] 2026-03-05 21:39:29.269159 | mon1 | 2026-03-05 21:39:29.269558 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:39:29.269899 | mon1 | Thursday 05 March 2026 21:39:29 +0000 (0:00:00.709) 0:00:21.338 ******** 2026-03-05 21:39:29.535751 | mon1 | ok: [mon1] 2026-03-05 21:39:29.535826 | mon1 | 2026-03-05 21:39:29.536118 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:39:29.536154 | mon1 | Thursday 05 March 2026 21:39:29 +0000 (0:00:00.267) 0:00:21.605 ******** 2026-03-05 21:39:29.609384 | mon1 | ok: [mon1] => { 2026-03-05 21:39:29.609480 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:39:29.610479 | mon1 | } 2026-03-05 21:39:29.610535 | mon1 | 2026-03-05 21:39:29.610546 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:39:29.610556 | mon1 | Thursday 05 March 2026 21:39:29 +0000 (0:00:00.073) 0:00:21.678 ******** 2026-03-05 21:39:30.972105 | mon1 | changed: [mon1] 2026-03-05 21:39:30.972926 | mon1 | 2026-03-05 21:39:30.972989 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:39:30.973001 | mon1 | Thursday 05 March 2026 21:39:30 +0000 (0:00:01.360) 0:00:23.039 ******** 2026-03-05 21:39:35.561400 | mon1 | changed: [mon1] 2026-03-05 21:39:35.561467 | mon1 | 2026-03-05 21:39:35.561478 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:39:35.561488 | mon1 | Thursday 05 March 2026 21:39:35 +0000 (0:00:04.590) 0:00:27.629 ******** 2026-03-05 21:39:36.565717 | mon1 | ok: [mon1] 2026-03-05 21:39:36.565781 | mon1 | 2026-03-05 21:39:36.567361 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:39:36.567414 | mon1 | Thursday 05 March 2026 21:39:36 +0000 (0:00:01.004) 0:00:28.634 ******** 2026-03-05 21:39:36.956755 | mon1 | changed: [mon1] 2026-03-05 21:39:36.957021 | mon1 | 2026-03-05 21:39:36.957372 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:39:36.957656 | mon1 | Thursday 05 March 2026 21:39:36 +0000 (0:00:00.389) 0:00:29.023 ******** 2026-03-05 21:39:37.535191 | mon1 | changed: [mon1] 2026-03-05 21:39:37.535567 | mon1 | 2026-03-05 21:39:37.535958 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:39:37.536309 | mon1 | Thursday 05 March 2026 21:39:37 +0000 (0:00:00.581) 0:00:29.604 ******** 2026-03-05 21:39:38.229359 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 21:39:38.229400 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:39:38.229407 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:39:38.229413 | mon1 | 2026-03-05 21:39:38.229418 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:39:38.229424 | mon1 | Thursday 05 March 2026 21:39:38 +0000 (0:00:00.693) 0:00:30.298 ******** 2026-03-05 21:39:38.788763 | mon1 | changed: [mon1] 2026-03-05 21:39:38.788811 | mon1 | 2026-03-05 21:39:38.788816 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:39:38.788824 | mon1 | Thursday 05 March 2026 21:39:38 +0000 (0:00:00.558) 0:00:30.856 ******** 2026-03-05 21:39:39.348697 | mon1 | changed: [mon1] 2026-03-05 21:39:39.348753 | mon1 | 2026-03-05 21:39:39.349385 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:39:39.349424 | mon1 | Thursday 05 March 2026 21:39:39 +0000 (0:00:00.554) 0:00:31.410 ******** 2026-03-05 21:39:39.349429 | mon1 | 2026-03-05 21:39:39.349434 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:39:39.349438 | mon1 | Thursday 05 March 2026 21:39:39 +0000 (0:00:00.007) 0:00:31.418 ******** 2026-03-05 21:39:40.208449 | mon1 | ok: [mon1] 2026-03-05 21:39:40.208569 | mon1 | 2026-03-05 21:39:40.208595 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 21:39:40.208926 | mon1 | Thursday 05 March 2026 21:39:40 +0000 (0:00:00.859) 0:00:32.277 ******** 2026-03-05 21:39:41.142368 | mon1 | changed: [mon1] 2026-03-05 21:39:41.142456 | mon1 | 2026-03-05 21:39:41.142955 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:39:41.143017 | mon1 | Thursday 05 March 2026 21:39:41 +0000 (0:00:00.933) 0:00:33.211 ******** 2026-03-05 21:39:41.865107 | mon1 | changed: [mon1] 2026-03-05 21:39:41.865166 | mon1 | 2026-03-05 21:39:41.865180 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:39:41.865192 | mon1 | Thursday 05 March 2026 21:39:41 +0000 (0:00:00.721) 0:00:33.933 ******** 2026-03-05 21:39:41.925454 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 21:39:41.925534 | mon1 | 2026-03-05 21:39:41.925561 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:39:41.925823 | mon1 | Thursday 05 March 2026 21:39:41 +0000 (0:00:00.061) 0:00:33.994 ******** 2026-03-05 21:39:59.715632 | mon1 | changed: [mon1] 2026-03-05 21:39:59.715727 | mon1 | 2026-03-05 21:39:59.715967 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:39:59.715986 | mon1 | Thursday 05 March 2026 21:39:59 +0000 (0:00:17.790) 0:00:51.785 ******** 2026-03-05 21:40:00.506082 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-03-05 21:40:00.506120 | mon1 | ok: [mon1] => (item=ssh) 2026-03-05 21:40:00.506912 | mon1 | 2026-03-05 21:40:00.506974 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:40:00.506988 | mon1 | Thursday 05 March 2026 21:40:00 +0000 (0:00:00.790) 0:00:52.575 ******** 2026-03-05 21:40:00.868882 | mon1 | changed: [mon1] 2026-03-05 21:40:00.868920 | mon1 | 2026-03-05 21:40:00.868930 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:40:00.869013 | mon1 | Thursday 05 March 2026 21:40:00 +0000 (0:00:00.362) 0:00:52.938 ******** 2026-03-05 21:40:01.104765 | mon1 | ok: [mon1] 2026-03-05 21:40:01.104822 | mon1 | 2026-03-05 21:40:01.105061 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:40:01.105095 | mon1 | Thursday 05 March 2026 21:40:01 +0000 (0:00:00.235) 0:00:53.174 ******** 2026-03-05 21:40:01.698379 | mon1 | changed: [mon1] 2026-03-05 21:40:01.698433 | mon1 | 2026-03-05 21:40:01.698447 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:40:01.698622 | mon1 | Thursday 05 March 2026 21:40:01 +0000 (0:00:00.593) 0:00:53.767 ******** 2026-03-05 21:40:02.076039 | mon1 | changed: [mon1] 2026-03-05 21:40:02.076166 | mon1 | 2026-03-05 21:40:02.076396 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:40:02.076551 | mon1 | Thursday 05 March 2026 21:40:02 +0000 (0:00:00.378) 0:00:54.146 ******** 2026-03-05 21:40:02.202876 | mon1 | ok: [mon1] 2026-03-05 21:40:02.203045 | mon1 | 2026-03-05 21:40:02.203268 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:40:02.203499 | mon1 | Thursday 05 March 2026 21:40:02 +0000 (0:00:00.126) 0:00:54.272 ******** 2026-03-05 21:40:02.463567 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:40:02.463742 | mon1 | 2026-03-05 21:40:02.464080 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:40:02.464366 | mon1 | Thursday 05 March 2026 21:40:02 +0000 (0:00:00.260) 0:00:54.533 ******** 2026-03-05 21:40:02.517059 | mon1 | ok: [mon1] 2026-03-05 21:40:02.517171 | mon1 | 2026-03-05 21:40:02.517354 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:40:02.517509 | mon1 | Thursday 05 March 2026 21:40:02 +0000 (0:00:00.053) 0:00:54.587 ******** 2026-03-05 21:40:02.669007 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-03-05 21:40:02.669198 | mon1 | 2026-03-05 21:40:02.669502 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-05 21:40:02.669756 | mon1 | Thursday 05 March 2026 21:40:02 +0000 (0:00:00.151) 0:00:54.739 ******** 2026-03-05 21:40:02.987678 | mon1 | changed: [mon1] 2026-03-05 21:40:02.987735 | mon1 | 2026-03-05 21:40:02.988339 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-05 21:40:02.988394 | mon1 | Thursday 05 March 2026 21:40:02 +0000 (0:00:00.317) 0:00:55.057 ******** 2026-03-05 21:40:03.741334 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-05 21:40:03.741380 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-05 21:40:03.742490 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-05 21:40:03.742525 | mon1 | 2026-03-05 21:40:03.742537 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-05 21:40:03.742547 | mon1 | Thursday 05 March 2026 21:40:03 +0000 (0:00:00.754) 0:00:55.811 ******** 2026-03-05 21:42:14.023726 | mon1 | ok: [mon1] 2026-03-05 21:42:14.023801 | mon1 | 2026-03-05 21:42:14.023888 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-05 21:42:14.024002 | mon1 | Thursday 05 March 2026 21:42:14 +0000 (0:02:10.281) 0:03:06.092 ******** 2026-03-05 21:42:14.296795 | mon1 | changed: [mon1] 2026-03-05 21:42:14.296855 | mon1 | 2026-03-05 21:42:14.296868 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-05 21:42:14.296880 | mon1 | Thursday 05 March 2026 21:42:14 +0000 (0:00:00.272) 0:03:06.365 ******** 2026-03-05 21:42:14.343329 | mon1 | ok: [mon1] 2026-03-05 21:42:14.343387 | mon1 | 2026-03-05 21:42:14.343718 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:42:14.344040 | mon1 | Thursday 05 March 2026 21:42:14 +0000 (0:00:00.046) 0:03:06.412 ******** 2026-03-05 21:42:14.424711 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:42:14.424754 | mon1 | 2026-03-05 21:42:14.425033 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:42:14.425064 | mon1 | Thursday 05 March 2026 21:42:14 +0000 (0:00:00.081) 0:03:06.494 ******** 2026-03-05 21:42:20.183594 | mon1 | ok: [mon1] 2026-03-05 21:42:20.183647 | mon1 | 2026-03-05 21:42:20.183653 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:42:20.183659 | mon1 | Thursday 05 March 2026 21:42:20 +0000 (0:00:05.757) 0:03:12.251 ******** 2026-03-05 21:42:20.242333 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:42:20.242395 | mon1 | 2026-03-05 21:42:20.242409 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:42:20.242421 | mon1 | Thursday 05 March 2026 21:42:20 +0000 (0:00:00.059) 0:03:12.311 ******** 2026-03-05 21:42:20.675535 | mon1 | ok: [mon1] 2026-03-05 21:42:20.675595 | mon1 | 2026-03-05 21:42:20.675611 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:42:20.675785 | mon1 | Thursday 05 March 2026 21:42:20 +0000 (0:00:00.433) 0:03:12.744 ******** 2026-03-05 21:42:28.801557 | mon1 | ok: [mon1] 2026-03-05 21:42:28.801669 | mon1 | 2026-03-05 21:42:28.801860 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:42:28.802025 | mon1 | Thursday 05 March 2026 21:42:28 +0000 (0:00:08.126) 0:03:20.871 ******** 2026-03-05 21:42:42.025165 | mon1 | changed: [mon1] 2026-03-05 21:42:42.025294 | mon1 | 2026-03-05 21:42:42.025310 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:42:42.025324 | mon1 | Thursday 05 March 2026 21:42:42 +0000 (0:00:13.222) 0:03:34.094 ******** 2026-03-05 21:42:56.622431 | mon1 | ok: [mon1] 2026-03-05 21:42:56.622534 | mon1 | 2026-03-05 21:42:56.622555 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:42:56.622717 | mon1 | Thursday 05 March 2026 21:42:56 +0000 (0:00:14.596) 0:03:48.691 ******** 2026-03-05 21:42:56.690389 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:42:56.690447 | mon1 | 2026-03-05 21:42:56.690884 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:42:56.690929 | mon1 | Thursday 05 March 2026 21:42:56 +0000 (0:00:00.068) 0:03:48.759 ******** 2026-03-05 21:42:56.740720 | mon1 | skipping: [mon1] 2026-03-05 21:42:56.740767 | mon1 | 2026-03-05 21:42:56.741034 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:42:56.741063 | mon1 | Thursday 05 March 2026 21:42:56 +0000 (0:00:00.050) 0:03:48.810 ******** 2026-03-05 21:42:56.792381 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 21:42:56.792449 | mon1 | skipping: [mon1] 2026-03-05 21:42:56.792460 | mon1 | 2026-03-05 21:42:56.792469 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:42:56.792479 | mon1 | Thursday 05 March 2026 21:42:56 +0000 (0:00:00.051) 0:03:48.861 ******** 2026-03-05 21:42:57.103776 | mon1 | ok: [mon1] 2026-03-05 21:42:57.106326 | mon1 | 2026-03-05 21:42:57.106370 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:42:57.106377 | mon1 | Thursday 05 March 2026 21:42:57 +0000 (0:00:00.310) 0:03:49.172 ******** 2026-03-05 21:43:04.185123 | mon1 | ok: [mon1] 2026-03-05 21:43:04.185160 | mon1 | 2026-03-05 21:43:04.185166 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:43:04.185172 | mon1 | Thursday 05 March 2026 21:43:04 +0000 (0:00:07.082) 0:03:56.254 ******** 2026-03-05 21:43:16.925588 | mon1 | changed: [mon1] 2026-03-05 21:43:16.925635 | mon1 | 2026-03-05 21:43:16.925642 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:43:16.925648 | mon1 | Thursday 05 March 2026 21:43:16 +0000 (0:00:12.738) 0:04:08.993 ******** 2026-03-05 21:43:23.530847 | mon1 | ok: [mon1] 2026-03-05 21:43:23.530920 | mon1 | 2026-03-05 21:43:23.530934 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:43:23.530947 | mon1 | Thursday 05 March 2026 21:43:23 +0000 (0:00:06.605) 0:04:15.598 ******** 2026-03-05 21:43:31.740689 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:43:31.740728 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 21:43:31.740734 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 21:43:31.740739 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 21:43:31.740745 | mon1 | 2026-03-05 21:43:31.740750 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:43:31.740756 | mon1 | 2026-03-05 21:43:31.740761 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:43:31.740767 | mon1 | Thursday 05 March 2026 21:43:31 +0000 (0:00:08.208) 0:04:23.807 ******** 2026-03-05 21:43:32.892955 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:43:32.896080 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:43:32.896101 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:43:32.896109 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:43:32.896116 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:43:32.908773 | mon1 | ok: [osd1] 2026-03-05 21:43:32.908788 | mon1 | 2026-03-05 21:43:32.908794 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:43:32.908799 | mon1 | Thursday 05 March 2026 21:43:32 +0000 (0:00:01.169) 0:04:24.977 ******** 2026-03-05 21:43:33.148624 | mon1 | ok: [osd1] 2026-03-05 21:43:33.148790 | mon1 | 2026-03-05 21:43:33.148948 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:43:33.149094 | mon1 | Thursday 05 March 2026 21:43:33 +0000 (0:00:00.240) 0:04:25.217 ******** 2026-03-05 21:43:33.189448 | mon1 | skipping: [osd1] 2026-03-05 21:43:33.189593 | mon1 | 2026-03-05 21:43:33.191809 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:43:33.191834 | mon1 | Thursday 05 March 2026 21:43:33 +0000 (0:00:00.042) 0:04:25.260 ******** 2026-03-05 21:43:33.437895 | mon1 | changed: [osd1] 2026-03-05 21:43:33.438061 | mon1 | 2026-03-05 21:43:33.438207 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:43:33.438375 | mon1 | Thursday 05 March 2026 21:43:33 +0000 (0:00:00.248) 0:04:25.508 ******** 2026-03-05 21:43:33.492801 | mon1 | ok: [osd1] => { 2026-03-05 21:43:33.495340 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:43:33.495354 | mon1 | } 2026-03-05 21:43:33.495358 | mon1 | 2026-03-05 21:43:33.495362 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:43:33.495367 | mon1 | Thursday 05 March 2026 21:43:33 +0000 (0:00:00.054) 0:04:25.563 ******** 2026-03-05 21:43:34.127542 | mon1 | changed: [osd1] 2026-03-05 21:43:34.127906 | mon1 | 2026-03-05 21:43:34.128301 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:43:34.128698 | mon1 | Thursday 05 March 2026 21:43:34 +0000 (0:00:00.634) 0:04:26.197 ******** 2026-03-05 21:43:34.172736 | mon1 | skipping: [osd1] 2026-03-05 21:43:34.173045 | mon1 | 2026-03-05 21:43:34.173420 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:43:34.173776 | mon1 | Thursday 05 March 2026 21:43:34 +0000 (0:00:00.045) 0:04:26.243 ******** 2026-03-05 21:43:34.217552 | mon1 | skipping: [osd1] 2026-03-05 21:43:34.217864 | mon1 | 2026-03-05 21:43:34.218268 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:43:34.218603 | mon1 | Thursday 05 March 2026 21:43:34 +0000 (0:00:00.044) 0:04:26.287 ******** 2026-03-05 21:43:34.464799 | mon1 | ok: [osd1] 2026-03-05 21:43:34.465192 | mon1 | 2026-03-05 21:43:34.465601 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:43:34.465942 | mon1 | Thursday 05 March 2026 21:43:34 +0000 (0:00:00.247) 0:04:26.535 ******** 2026-03-05 21:43:35.458912 | mon1 | ok: [osd1] 2026-03-05 21:43:35.459322 | mon1 | 2026-03-05 21:43:35.459660 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:43:35.459970 | mon1 | Thursday 05 March 2026 21:43:35 +0000 (0:00:00.993) 0:04:27.528 ******** 2026-03-05 21:43:35.536868 | mon1 | ok: [osd1] => { 2026-03-05 21:43:35.537310 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:43:35.537631 | mon1 | } 2026-03-05 21:43:35.537922 | mon1 | 2026-03-05 21:43:35.538310 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:43:35.538647 | mon1 | Thursday 05 March 2026 21:43:35 +0000 (0:00:00.077) 0:04:27.606 ******** 2026-03-05 21:43:36.406153 | mon1 | changed: [osd1] 2026-03-05 21:43:36.406527 | mon1 | 2026-03-05 21:43:36.406856 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:43:36.407164 | mon1 | Thursday 05 March 2026 21:43:36 +0000 (0:00:00.869) 0:04:28.476 ******** 2026-03-05 21:43:39.279870 | mon1 | changed: [osd1] 2026-03-05 21:43:39.280278 | mon1 | 2026-03-05 21:43:39.280895 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:43:39.280918 | mon1 | Thursday 05 March 2026 21:43:39 +0000 (0:00:02.873) 0:04:31.349 ******** 2026-03-05 21:43:39.314017 | mon1 | skipping: [osd1] 2026-03-05 21:43:39.314056 | mon1 | 2026-03-05 21:43:39.314062 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:43:39.314068 | mon1 | Thursday 05 March 2026 21:43:39 +0000 (0:00:00.031) 0:04:31.381 ******** 2026-03-05 21:43:39.344852 | mon1 | skipping: [osd1] 2026-03-05 21:43:39.344874 | mon1 | 2026-03-05 21:43:39.344881 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:43:39.344886 | mon1 | Thursday 05 March 2026 21:43:39 +0000 (0:00:00.031) 0:04:31.412 ******** 2026-03-05 21:43:39.374787 | mon1 | skipping: [osd1] 2026-03-05 21:43:39.374813 | mon1 | 2026-03-05 21:43:39.374819 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:43:39.374837 | mon1 | Thursday 05 March 2026 21:43:39 +0000 (0:00:00.032) 0:04:31.444 ******** 2026-03-05 21:43:46.922948 | mon1 | changed: [osd1] 2026-03-05 21:43:46.923034 | mon1 | 2026-03-05 21:43:46.923139 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:43:46.923259 | mon1 | Thursday 05 March 2026 21:43:46 +0000 (0:00:07.548) 0:04:38.993 ******** 2026-03-05 21:43:47.508764 | mon1 | changed: [osd1] 2026-03-05 21:43:47.508837 | mon1 | 2026-03-05 21:43:47.508988 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:43:47.509141 | mon1 | Thursday 05 March 2026 21:43:47 +0000 (0:00:00.584) 0:04:39.577 ******** 2026-03-05 21:43:48.617655 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:43:48.617726 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:43:48.617867 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:43:48.617997 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:43:48.618115 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:43:48.618221 | mon1 | 2026-03-05 21:43:48.618352 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:43:48.618467 | mon1 | Thursday 05 March 2026 21:43:48 +0000 (0:00:01.109) 0:04:40.687 ******** 2026-03-05 21:43:49.278616 | mon1 | changed: [osd1] 2026-03-05 21:43:49.278687 | mon1 | 2026-03-05 21:43:49.278808 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:43:49.278920 | mon1 | Thursday 05 March 2026 21:43:49 +0000 (0:00:00.652) 0:04:41.340 ******** 2026-03-05 21:43:49.279034 | mon1 | 2026-03-05 21:43:49.279168 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:43:49.279288 | mon1 | Thursday 05 March 2026 21:43:49 +0000 (0:00:00.006) 0:04:41.346 ******** 2026-03-05 21:43:50.185952 | mon1 | ok: [osd1] 2026-03-05 21:43:50.186008 | mon1 | 2026-03-05 21:43:50.186202 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 21:43:50.186272 | mon1 | Thursday 05 March 2026 21:43:50 +0000 (0:00:00.909) 0:04:42.256 ******** 2026-03-05 21:43:50.771634 | mon1 | changed: [osd1] 2026-03-05 21:43:50.771672 | mon1 | 2026-03-05 21:43:50.771678 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:43:50.771684 | mon1 | Thursday 05 March 2026 21:43:50 +0000 (0:00:00.583) 0:04:42.839 ******** 2026-03-05 21:43:51.489927 | mon1 | changed: [osd1] 2026-03-05 21:43:51.489982 | mon1 | 2026-03-05 21:43:51.490000 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:43:51.490016 | mon1 | Thursday 05 March 2026 21:43:51 +0000 (0:00:00.718) 0:04:43.557 ******** 2026-03-05 21:43:51.739799 | mon1 | ok: [osd1] 2026-03-05 21:43:51.739966 | mon1 | 2026-03-05 21:43:51.740119 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:43:51.740284 | mon1 | Thursday 05 March 2026 21:43:51 +0000 (0:00:00.250) 0:04:43.807 ******** 2026-03-05 21:43:51.804515 | mon1 | ok: [osd1] => { 2026-03-05 21:43:51.804551 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:43:51.804558 | mon1 | } 2026-03-05 21:43:51.804563 | mon1 | 2026-03-05 21:43:51.804576 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:43:51.804582 | mon1 | Thursday 05 March 2026 21:43:51 +0000 (0:00:00.065) 0:04:43.873 ******** 2026-03-05 21:43:52.849937 | mon1 | changed: [osd1] 2026-03-05 21:43:52.849972 | mon1 | 2026-03-05 21:43:52.849978 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:43:52.849984 | mon1 | Thursday 05 March 2026 21:43:52 +0000 (0:00:01.044) 0:04:44.918 ******** 2026-03-05 21:43:57.454481 | mon1 | changed: [osd1] 2026-03-05 21:43:57.454727 | mon1 | 2026-03-05 21:43:57.454881 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:43:57.455027 | mon1 | Thursday 05 March 2026 21:43:57 +0000 (0:00:04.606) 0:04:49.524 ******** 2026-03-05 21:43:58.380744 | mon1 | ok: [osd1] 2026-03-05 21:43:58.381135 | mon1 | 2026-03-05 21:43:58.381518 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:43:58.381998 | mon1 | Thursday 05 March 2026 21:43:58 +0000 (0:00:00.925) 0:04:50.450 ******** 2026-03-05 21:43:58.696310 | mon1 | changed: [osd1] 2026-03-05 21:43:58.696372 | mon1 | 2026-03-05 21:43:58.696616 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:43:58.696627 | mon1 | Thursday 05 March 2026 21:43:58 +0000 (0:00:00.316) 0:04:50.766 ******** 2026-03-05 21:43:59.276321 | mon1 | changed: [osd1] 2026-03-05 21:43:59.276380 | mon1 | 2026-03-05 21:43:59.276391 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:43:59.276401 | mon1 | Thursday 05 March 2026 21:43:59 +0000 (0:00:00.577) 0:04:51.344 ******** 2026-03-05 21:43:59.960447 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 21:43:59.960527 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:43:59.961407 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:43:59.961465 | mon1 | 2026-03-05 21:43:59.961476 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:43:59.961659 | mon1 | Thursday 05 March 2026 21:43:59 +0000 (0:00:00.684) 0:04:52.029 ******** 2026-03-05 21:44:00.538751 | mon1 | changed: [osd1] 2026-03-05 21:44:00.539342 | mon1 | 2026-03-05 21:44:00.539382 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:44:00.539396 | mon1 | Thursday 05 March 2026 21:44:00 +0000 (0:00:00.578) 0:04:52.608 ******** 2026-03-05 21:44:01.109526 | mon1 | changed: [osd1] 2026-03-05 21:44:01.109579 | mon1 | 2026-03-05 21:44:01.109590 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:44:01.110613 | mon1 | Thursday 05 March 2026 21:44:01 +0000 (0:00:00.564) 0:04:53.172 ******** 2026-03-05 21:44:01.110646 | mon1 | 2026-03-05 21:44:01.110657 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:44:01.110666 | mon1 | Thursday 05 March 2026 21:44:01 +0000 (0:00:00.006) 0:04:53.178 ******** 2026-03-05 21:44:02.045372 | mon1 | ok: [osd1] 2026-03-05 21:44:02.045422 | mon1 | 2026-03-05 21:44:02.045441 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 21:44:02.045610 | mon1 | Thursday 05 March 2026 21:44:02 +0000 (0:00:00.935) 0:04:54.114 ******** 2026-03-05 21:44:02.896365 | mon1 | changed: [osd1] 2026-03-05 21:44:02.896434 | mon1 | 2026-03-05 21:44:02.896948 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:44:02.897000 | mon1 | Thursday 05 March 2026 21:44:02 +0000 (0:00:00.849) 0:04:54.964 ******** 2026-03-05 21:44:03.582623 | mon1 | changed: [osd1] 2026-03-05 21:44:03.582685 | mon1 | 2026-03-05 21:44:03.583293 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:44:03.583331 | mon1 | Thursday 05 March 2026 21:44:03 +0000 (0:00:00.686) 0:04:55.651 ******** 2026-03-05 21:44:03.633390 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 21:44:03.633420 | mon1 | 2026-03-05 21:44:03.633429 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:44:03.633438 | mon1 | Thursday 05 March 2026 21:44:03 +0000 (0:00:00.050) 0:04:55.701 ******** 2026-03-05 21:44:04.776657 | mon1 | ok: [osd1] 2026-03-05 21:44:04.776717 | mon1 | 2026-03-05 21:44:04.776728 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:44:04.776738 | mon1 | Thursday 05 March 2026 21:44:04 +0000 (0:00:01.143) 0:04:56.845 ******** 2026-03-05 21:44:05.579403 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-03-05 21:44:05.579490 | mon1 | ok: [osd1] => (item=ssh) 2026-03-05 21:44:05.579502 | mon1 | 2026-03-05 21:44:05.579511 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:44:05.579521 | mon1 | Thursday 05 March 2026 21:44:05 +0000 (0:00:00.803) 0:04:57.648 ******** 2026-03-05 21:44:05.964378 | mon1 | changed: [osd1] 2026-03-05 21:44:05.964446 | mon1 | 2026-03-05 21:44:05.964990 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:44:05.965036 | mon1 | Thursday 05 March 2026 21:44:05 +0000 (0:00:00.384) 0:04:58.033 ******** 2026-03-05 21:44:06.197866 | mon1 | ok: [osd1] 2026-03-05 21:44:06.197921 | mon1 | 2026-03-05 21:44:06.197932 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:44:06.197941 | mon1 | Thursday 05 March 2026 21:44:06 +0000 (0:00:00.233) 0:04:58.266 ******** 2026-03-05 21:44:06.571796 | mon1 | changed: [osd1] 2026-03-05 21:44:06.571842 | mon1 | 2026-03-05 21:44:06.571852 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:44:06.571875 | mon1 | Thursday 05 March 2026 21:44:06 +0000 (0:00:00.373) 0:04:58.640 ******** 2026-03-05 21:44:06.827145 | mon1 | changed: [osd1] 2026-03-05 21:44:06.827201 | mon1 | 2026-03-05 21:44:06.827212 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:44:06.827222 | mon1 | Thursday 05 March 2026 21:44:06 +0000 (0:00:00.255) 0:04:58.895 ******** 2026-03-05 21:44:07.111343 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 21:44:07.111400 | mon1 | 2026-03-05 21:44:07.111501 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:44:07.111755 | mon1 | Thursday 05 March 2026 21:44:07 +0000 (0:00:00.284) 0:04:59.180 ******** 2026-03-05 21:44:07.158091 | mon1 | ok: [osd1] 2026-03-05 21:44:07.158332 | mon1 | 2026-03-05 21:44:07.158615 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:44:07.158863 | mon1 | Thursday 05 March 2026 21:44:07 +0000 (0:00:00.047) 0:04:59.228 ******** 2026-03-05 21:44:07.221103 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 21:44:07.221352 | mon1 | 2026-03-05 21:44:07.221652 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:44:07.221857 | mon1 | Thursday 05 March 2026 21:44:07 +0000 (0:00:00.063) 0:04:59.291 ******** 2026-03-05 21:44:13.816084 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:44:13.816293 | mon1 | 2026-03-05 21:44:13.816536 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:44:13.816764 | mon1 | Thursday 05 March 2026 21:44:13 +0000 (0:00:06.594) 0:05:05.886 ******** 2026-03-05 21:44:13.872653 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 21:44:13.872829 | mon1 | 2026-03-05 21:44:13.873107 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:44:13.873392 | mon1 | Thursday 05 March 2026 21:44:13 +0000 (0:00:00.056) 0:05:05.942 ******** 2026-03-05 21:44:14.195296 | mon1 | changed: [osd1] 2026-03-05 21:44:14.195627 | mon1 | 2026-03-05 21:44:14.195964 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:44:14.196288 | mon1 | Thursday 05 March 2026 21:44:14 +0000 (0:00:00.322) 0:05:06.265 ******** 2026-03-05 21:44:25.339347 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:44:25.339410 | mon1 | 2026-03-05 21:44:25.339430 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:44:25.339737 | mon1 | Thursday 05 March 2026 21:44:25 +0000 (0:00:11.143) 0:05:17.408 ******** 2026-03-05 21:44:27.007872 | mon1 | ok: [osd1] 2026-03-05 21:44:27.007935 | mon1 | 2026-03-05 21:44:27.007949 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:44:27.007961 | mon1 | Thursday 05 March 2026 21:44:27 +0000 (0:00:01.667) 0:05:19.076 ******** 2026-03-05 21:45:06.780881 | mon1 | ok: [osd1] 2026-03-05 21:45:06.780951 | mon1 | 2026-03-05 21:45:06.780965 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:45:06.781003 | mon1 | Thursday 05 March 2026 21:45:06 +0000 (0:00:39.773) 0:05:58.849 ******** 2026-03-05 21:46:55.408344 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 21:46:55.408417 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 21:46:55.408431 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 21:46:55.408443 | mon1 | 2026-03-05 21:46:55.408461 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:46:55.408695 | mon1 | Thursday 05 March 2026 21:46:55 +0000 (0:01:48.626) 0:07:47.476 ******** 2026-03-05 21:47:01.991820 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:47:01.991893 | mon1 | 2026-03-05 21:47:01.991907 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:47:01.991920 | mon1 | Thursday 05 March 2026 21:47:01 +0000 (0:00:06.583) 0:07:54.060 ******** 2026-03-05 21:47:08.517982 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:47:08.518052 | mon1 | 2026-03-05 21:47:08.518066 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:47:08.518078 | mon1 | Thursday 05 March 2026 21:47:08 +0000 (0:00:06.525) 0:08:00.586 ******** 2026-03-05 21:47:08.579683 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 21:47:08.579729 | mon1 | 2026-03-05 21:47:08.579743 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:47:08.579755 | mon1 | Thursday 05 March 2026 21:47:08 +0000 (0:00:00.062) 0:08:00.648 ******** 2026-03-05 21:47:08.659491 | mon1 | ok: [osd1] 2026-03-05 21:47:08.659540 | mon1 | 2026-03-05 21:47:08.659549 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:47:08.659558 | mon1 | Thursday 05 March 2026 21:47:08 +0000 (0:00:00.079) 0:08:00.728 ******** 2026-03-05 21:47:15.193388 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:47:15.193434 | mon1 | 2026-03-05 21:47:15.193443 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:47:15.193451 | mon1 | Thursday 05 March 2026 21:47:15 +0000 (0:00:06.533) 0:08:07.261 ******** 2026-03-05 21:47:15.242307 | mon1 | ok: [osd1] 2026-03-05 21:47:15.242355 | mon1 | 2026-03-05 21:47:15.242924 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:47:15.242993 | mon1 | Thursday 05 March 2026 21:47:15 +0000 (0:00:00.049) 0:08:07.311 ******** 2026-03-05 21:47:15.281963 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:47:15.282194 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:47:15.282466 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:47:15.282696 | mon1 | skipping: [osd1] 2026-03-05 21:47:15.282913 | mon1 | 2026-03-05 21:47:15.283161 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:47:15.283528 | mon1 | Thursday 05 March 2026 21:47:15 +0000 (0:00:00.040) 0:08:07.351 ******** 2026-03-05 21:47:15.318841 | mon1 | skipping: [osd1] 2026-03-05 21:47:15.319031 | mon1 | 2026-03-05 21:47:15.319345 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:47:15.319605 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 21:47:15.319854 | mon1 | osd1 : ok=53 changed=23 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 21:47:15.320075 | mon1 | 2026-03-05 21:47:15.320320 | mon1 | 2026-03-05 21:47:15.320559 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:47:15.320825 | mon1 | Thursday 05 March 2026 21:47:15 +0000 (0:00:00.037) 0:08:07.389 ******** 2026-03-05 21:47:15.321067 | mon1 | =============================================================================== 2026-03-05 21:47:15.321319 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 130.28s 2026-03-05 21:47:15.321552 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 108.63s 2026-03-05 21:47:15.321812 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 39.77s 2026-03-05 21:47:15.322028 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 17.79s 2026-03-05 21:47:15.322284 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.60s 2026-03-05 21:47:15.322535 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 13.22s 2026-03-05 21:47:15.322784 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.74s 2026-03-05 21:47:15.323047 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 11.14s 2026-03-05 21:47:15.323785 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.21s 2026-03-05 21:47:15.324022 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 8.13s 2026-03-05 21:47:15.324269 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.72s 2026-03-05 21:47:15.324531 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.55s 2026-03-05 21:47:15.324783 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.08s 2026-03-05 21:47:15.325010 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.61s 2026-03-05 21:47:15.325288 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.59s 2026-03-05 21:47:15.325533 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.58s 2026-03-05 21:47:15.325779 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.53s 2026-03-05 21:47:15.326010 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.53s 2026-03-05 21:47:15.326257 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.76s 2026-03-05 21:47:15.326525 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.61s 2026-03-05 21:47:15.405538 | mon1 | INFO [default > converge] Executed: Successful 2026-03-05 21:47:15.415375 | mon1 | INFO [default > idempotence] Executing 2026-03-05 21:47:16.348870 | mon1 | 2026-03-05 21:47:16.349169 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 21:47:16.349503 | mon1 | 2026-03-05 21:47:16.349794 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:47:16.350080 | mon1 | Thursday 05 March 2026 21:47:16 +0000 (0:00:00.051) 0:00:00.051 ******** 2026-03-05 21:47:17.531264 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:47:17.531520 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:47:17.531773 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:47:17.532029 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:47:17.532309 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:47:17.544747 | mon1 | ok: [mon1] 2026-03-05 21:47:17.545045 | mon1 | 2026-03-05 21:47:17.545332 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:47:17.545569 | mon1 | Thursday 05 March 2026 21:47:17 +0000 (0:00:01.195) 0:00:01.247 ******** 2026-03-05 21:47:17.892939 | mon1 | ok: [mon1] 2026-03-05 21:47:17.893142 | mon1 | 2026-03-05 21:47:17.893440 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:47:17.893718 | mon1 | Thursday 05 March 2026 21:47:17 +0000 (0:00:00.347) 0:00:01.595 ******** 2026-03-05 21:47:17.932423 | mon1 | skipping: [mon1] 2026-03-05 21:47:17.932652 | mon1 | 2026-03-05 21:47:17.932915 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:47:17.933159 | mon1 | Thursday 05 March 2026 21:47:17 +0000 (0:00:00.039) 0:00:01.635 ******** 2026-03-05 21:47:18.287029 | mon1 | ok: [mon1] 2026-03-05 21:47:18.287322 | mon1 | 2026-03-05 21:47:18.287688 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:47:18.287983 | mon1 | Thursday 05 March 2026 21:47:18 +0000 (0:00:00.354) 0:00:01.989 ******** 2026-03-05 21:47:18.362079 | mon1 | ok: [mon1] => { 2026-03-05 21:47:18.362375 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:47:18.362638 | mon1 | } 2026-03-05 21:47:18.362888 | mon1 | 2026-03-05 21:47:18.363202 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:47:18.363507 | mon1 | Thursday 05 March 2026 21:47:18 +0000 (0:00:00.074) 0:00:02.064 ******** 2026-03-05 21:47:18.845040 | mon1 | ok: [mon1] 2026-03-05 21:47:18.845395 | mon1 | 2026-03-05 21:47:18.845808 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:47:18.846150 | mon1 | Thursday 05 March 2026 21:47:18 +0000 (0:00:00.482) 0:00:02.547 ******** 2026-03-05 21:47:18.892457 | mon1 | skipping: [mon1] 2026-03-05 21:47:18.892666 | mon1 | 2026-03-05 21:47:18.892928 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:47:18.893181 | mon1 | Thursday 05 March 2026 21:47:18 +0000 (0:00:00.047) 0:00:02.595 ******** 2026-03-05 21:47:18.938613 | mon1 | skipping: [mon1] 2026-03-05 21:47:18.938827 | mon1 | 2026-03-05 21:47:18.939085 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:47:18.939443 | mon1 | Thursday 05 March 2026 21:47:18 +0000 (0:00:00.046) 0:00:02.641 ******** 2026-03-05 21:47:19.193496 | mon1 | ok: [mon1] 2026-03-05 21:47:19.193696 | mon1 | 2026-03-05 21:47:19.194056 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:47:19.194353 | mon1 | Thursday 05 March 2026 21:47:19 +0000 (0:00:00.254) 0:00:02.896 ******** 2026-03-05 21:47:20.304333 | mon1 | ok: [mon1] 2026-03-05 21:47:20.304401 | mon1 | 2026-03-05 21:47:20.304979 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:47:20.305023 | mon1 | Thursday 05 March 2026 21:47:20 +0000 (0:00:01.110) 0:00:04.006 ******** 2026-03-05 21:47:20.504279 | mon1 | ok: [mon1] => { 2026-03-05 21:47:20.504322 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:47:20.504328 | mon1 | } 2026-03-05 21:47:20.504334 | mon1 | 2026-03-05 21:47:20.504340 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:47:20.504346 | mon1 | Thursday 05 March 2026 21:47:20 +0000 (0:00:00.199) 0:00:04.206 ******** 2026-03-05 21:47:21.022201 | mon1 | ok: [mon1] 2026-03-05 21:47:21.022281 | mon1 | 2026-03-05 21:47:21.022296 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:47:21.022307 | mon1 | Thursday 05 March 2026 21:47:21 +0000 (0:00:00.516) 0:00:04.722 ******** 2026-03-05 21:47:23.433733 | mon1 | ok: [mon1] 2026-03-05 21:47:23.433785 | mon1 | 2026-03-05 21:47:23.433798 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:47:23.433811 | mon1 | Thursday 05 March 2026 21:47:23 +0000 (0:00:02.412) 0:00:07.135 ******** 2026-03-05 21:47:23.472295 | mon1 | skipping: [mon1] 2026-03-05 21:47:23.472332 | mon1 | 2026-03-05 21:47:23.472784 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:47:23.472837 | mon1 | Thursday 05 March 2026 21:47:23 +0000 (0:00:00.036) 0:00:07.172 ******** 2026-03-05 21:47:23.505580 | mon1 | skipping: [mon1] 2026-03-05 21:47:23.505614 | mon1 | 2026-03-05 21:47:23.505627 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:47:23.505640 | mon1 | Thursday 05 March 2026 21:47:23 +0000 (0:00:00.034) 0:00:07.207 ******** 2026-03-05 21:47:23.538753 | mon1 | skipping: [mon1] 2026-03-05 21:47:23.538815 | mon1 | 2026-03-05 21:47:23.538828 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:47:23.538840 | mon1 | Thursday 05 March 2026 21:47:23 +0000 (0:00:00.033) 0:00:07.240 ******** 2026-03-05 21:47:24.471170 | mon1 | ok: [mon1] 2026-03-05 21:47:24.471205 | mon1 | 2026-03-05 21:47:24.471227 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:47:24.471253 | mon1 | Thursday 05 March 2026 21:47:24 +0000 (0:00:00.932) 0:00:08.172 ******** 2026-03-05 21:47:25.006675 | mon1 | ok: [mon1] 2026-03-05 21:47:25.006727 | mon1 | 2026-03-05 21:47:25.006738 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:47:25.006748 | mon1 | Thursday 05 March 2026 21:47:25 +0000 (0:00:00.535) 0:00:08.708 ******** 2026-03-05 21:47:26.113361 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:47:26.113441 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:47:26.113931 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:47:26.113988 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:47:26.114980 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:47:26.114996 | mon1 | 2026-03-05 21:47:26.115000 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:47:26.115314 | mon1 | Thursday 05 March 2026 21:47:26 +0000 (0:00:01.107) 0:00:09.815 ******** 2026-03-05 21:47:26.752690 | mon1 | ok: [mon1] 2026-03-05 21:47:26.752760 | mon1 | 2026-03-05 21:47:26.754275 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:47:26.754293 | mon1 | Thursday 05 March 2026 21:47:26 +0000 (0:00:00.631) 0:00:10.446 ******** 2026-03-05 21:47:26.754299 | mon1 | 2026-03-05 21:47:26.754304 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:47:26.754308 | mon1 | Thursday 05 March 2026 21:47:26 +0000 (0:00:00.008) 0:00:10.455 ******** 2026-03-05 21:47:27.415665 | mon1 | ok: [mon1] 2026-03-05 21:47:27.415710 | mon1 | 2026-03-05 21:47:27.415829 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:47:27.415949 | mon1 | Thursday 05 March 2026 21:47:27 +0000 (0:00:00.663) 0:00:11.118 ******** 2026-03-05 21:47:27.662395 | mon1 | ok: [mon1] 2026-03-05 21:47:27.662456 | mon1 | 2026-03-05 21:47:27.662962 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:47:27.663011 | mon1 | Thursday 05 March 2026 21:47:27 +0000 (0:00:00.246) 0:00:11.364 ******** 2026-03-05 21:47:27.741318 | mon1 | ok: [mon1] => { 2026-03-05 21:47:27.741378 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:47:27.741601 | mon1 | } 2026-03-05 21:47:27.741883 | mon1 | 2026-03-05 21:47:27.742196 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:47:27.742537 | mon1 | Thursday 05 March 2026 21:47:27 +0000 (0:00:00.078) 0:00:11.443 ******** 2026-03-05 21:47:28.157228 | mon1 | ok: [mon1] 2026-03-05 21:47:28.158120 | mon1 | 2026-03-05 21:47:28.158140 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:47:28.158150 | mon1 | Thursday 05 March 2026 21:47:28 +0000 (0:00:00.416) 0:00:11.859 ******** 2026-03-05 21:47:31.336408 | mon1 | ok: [mon1] 2026-03-05 21:47:31.336468 | mon1 | 2026-03-05 21:47:31.336480 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:47:31.336653 | mon1 | Thursday 05 March 2026 21:47:31 +0000 (0:00:03.178) 0:00:15.038 ******** 2026-03-05 21:47:32.293079 | mon1 | ok: [mon1] 2026-03-05 21:47:32.293403 | mon1 | 2026-03-05 21:47:32.293707 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:47:32.293966 | mon1 | Thursday 05 March 2026 21:47:32 +0000 (0:00:00.956) 0:00:15.995 ******** 2026-03-05 21:47:32.631377 | mon1 | ok: [mon1] 2026-03-05 21:47:32.631446 | mon1 | 2026-03-05 21:47:32.632082 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:47:32.632106 | mon1 | Thursday 05 March 2026 21:47:32 +0000 (0:00:00.338) 0:00:16.333 ******** 2026-03-05 21:47:33.173323 | mon1 | ok: [mon1] 2026-03-05 21:47:33.173372 | mon1 | 2026-03-05 21:47:33.173516 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:47:33.173740 | mon1 | Thursday 05 March 2026 21:47:33 +0000 (0:00:00.540) 0:00:16.874 ******** 2026-03-05 21:47:33.853397 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 21:47:33.853441 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:47:33.854268 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:47:33.854276 | mon1 | 2026-03-05 21:47:33.854281 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:47:33.854536 | mon1 | Thursday 05 March 2026 21:47:33 +0000 (0:00:00.680) 0:00:17.554 ******** 2026-03-05 21:47:34.383770 | mon1 | ok: [mon1] 2026-03-05 21:47:34.383804 | mon1 | 2026-03-05 21:47:34.383809 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:47:34.383928 | mon1 | Thursday 05 March 2026 21:47:34 +0000 (0:00:00.530) 0:00:18.084 ******** 2026-03-05 21:47:34.897675 | mon1 | ok: [mon1] 2026-03-05 21:47:34.897763 | mon1 | 2026-03-05 21:47:34.898467 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:47:34.898505 | mon1 | Thursday 05 March 2026 21:47:34 +0000 (0:00:00.507) 0:00:18.592 ******** 2026-03-05 21:47:34.898510 | mon1 | 2026-03-05 21:47:34.898515 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:47:34.898519 | mon1 | Thursday 05 March 2026 21:47:34 +0000 (0:00:00.007) 0:00:18.600 ******** 2026-03-05 21:47:35.339664 | mon1 | ok: [mon1] 2026-03-05 21:47:35.339723 | mon1 | 2026-03-05 21:47:35.339962 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:47:35.339988 | mon1 | Thursday 05 March 2026 21:47:35 +0000 (0:00:00.442) 0:00:19.042 ******** 2026-03-05 21:47:35.397930 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 21:47:35.398014 | mon1 | 2026-03-05 21:47:35.398026 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:47:35.398037 | mon1 | Thursday 05 March 2026 21:47:35 +0000 (0:00:00.056) 0:00:19.099 ******** 2026-03-05 21:47:36.344638 | mon1 | ok: [mon1] 2026-03-05 21:47:36.344706 | mon1 | 2026-03-05 21:47:36.344842 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:47:36.344982 | mon1 | Thursday 05 March 2026 21:47:36 +0000 (0:00:00.946) 0:00:20.045 ******** 2026-03-05 21:47:37.124328 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-03-05 21:47:37.124373 | mon1 | ok: [mon1] => (item=ssh) 2026-03-05 21:47:37.124853 | mon1 | 2026-03-05 21:47:37.124868 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:47:37.125055 | mon1 | Thursday 05 March 2026 21:47:37 +0000 (0:00:00.779) 0:00:20.825 ******** 2026-03-05 21:47:37.920766 | mon1 | ok: [mon1] 2026-03-05 21:47:37.920843 | mon1 | 2026-03-05 21:47:37.920873 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:47:37.920891 | mon1 | Thursday 05 March 2026 21:47:37 +0000 (0:00:00.796) 0:00:21.621 ******** 2026-03-05 21:47:38.166001 | mon1 | ok: [mon1] 2026-03-05 21:47:38.166063 | mon1 | 2026-03-05 21:47:38.166078 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:47:38.166093 | mon1 | Thursday 05 March 2026 21:47:38 +0000 (0:00:00.245) 0:00:21.867 ******** 2026-03-05 21:47:38.615737 | mon1 | ok: [mon1] 2026-03-05 21:47:38.615792 | mon1 | 2026-03-05 21:47:38.615806 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:47:38.615819 | mon1 | Thursday 05 March 2026 21:47:38 +0000 (0:00:00.450) 0:00:22.317 ******** 2026-03-05 21:47:38.982359 | mon1 | ok: [mon1] 2026-03-05 21:47:38.982417 | mon1 | 2026-03-05 21:47:38.983039 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:47:38.983091 | mon1 | Thursday 05 March 2026 21:47:38 +0000 (0:00:00.367) 0:00:22.684 ******** 2026-03-05 21:47:39.063704 | mon1 | ok: [mon1] 2026-03-05 21:47:39.063746 | mon1 | 2026-03-05 21:47:39.064023 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:47:39.064052 | mon1 | Thursday 05 March 2026 21:47:39 +0000 (0:00:00.081) 0:00:22.765 ******** 2026-03-05 21:47:39.343583 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:47:39.343628 | mon1 | 2026-03-05 21:47:39.343635 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:47:39.343641 | mon1 | Thursday 05 March 2026 21:47:39 +0000 (0:00:00.279) 0:00:23.044 ******** 2026-03-05 21:47:39.390524 | mon1 | ok: [mon1] 2026-03-05 21:47:39.390568 | mon1 | 2026-03-05 21:47:39.390573 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:47:39.390578 | mon1 | Thursday 05 March 2026 21:47:39 +0000 (0:00:00.047) 0:00:23.092 ******** 2026-03-05 21:47:39.429760 | mon1 | skipping: [mon1] 2026-03-05 21:47:39.429839 | mon1 | 2026-03-05 21:47:39.429852 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:47:39.429998 | mon1 | Thursday 05 March 2026 21:47:39 +0000 (0:00:00.038) 0:00:23.131 ******** 2026-03-05 21:47:39.507261 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:47:39.507295 | mon1 | 2026-03-05 21:47:39.507302 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:47:39.507308 | mon1 | Thursday 05 March 2026 21:47:39 +0000 (0:00:00.077) 0:00:23.209 ******** 2026-03-05 21:47:46.198361 | mon1 | ok: [mon1] 2026-03-05 21:47:46.199320 | mon1 | 2026-03-05 21:47:46.199380 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:47:46.199393 | mon1 | Thursday 05 March 2026 21:47:46 +0000 (0:00:06.690) 0:00:29.900 ******** 2026-03-05 21:47:46.254315 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:47:46.254364 | mon1 | 2026-03-05 21:47:46.254378 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:47:46.254540 | mon1 | Thursday 05 March 2026 21:47:46 +0000 (0:00:00.055) 0:00:29.956 ******** 2026-03-05 21:47:46.696678 | mon1 | ok: [mon1] 2026-03-05 21:47:46.696748 | mon1 | 2026-03-05 21:47:46.696989 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:47:46.697025 | mon1 | Thursday 05 March 2026 21:47:46 +0000 (0:00:00.442) 0:00:30.398 ******** 2026-03-05 21:47:53.797655 | mon1 | ok: [mon1] 2026-03-05 21:47:53.797735 | mon1 | 2026-03-05 21:47:53.797843 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:47:53.797955 | mon1 | Thursday 05 March 2026 21:47:53 +0000 (0:00:07.100) 0:00:37.499 ******** 2026-03-05 21:48:00.478335 | mon1 | ok: [mon1] 2026-03-05 21:48:00.478395 | mon1 | 2026-03-05 21:48:00.478410 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:48:00.478423 | mon1 | Thursday 05 March 2026 21:48:00 +0000 (0:00:06.681) 0:00:44.180 ******** 2026-03-05 21:48:15.141378 | mon1 | ok: [mon1] 2026-03-05 21:48:15.141464 | mon1 | 2026-03-05 21:48:15.141868 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:48:15.142211 | mon1 | Thursday 05 March 2026 21:48:15 +0000 (0:00:14.662) 0:00:58.842 ******** 2026-03-05 21:48:15.210552 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:48:15.210789 | mon1 | 2026-03-05 21:48:15.211059 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:48:15.211356 | mon1 | Thursday 05 March 2026 21:48:15 +0000 (0:00:00.070) 0:00:58.913 ******** 2026-03-05 21:48:15.265482 | mon1 | skipping: [mon1] 2026-03-05 21:48:15.265693 | mon1 | 2026-03-05 21:48:15.265974 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:48:15.266219 | mon1 | Thursday 05 March 2026 21:48:15 +0000 (0:00:00.054) 0:00:58.968 ******** 2026-03-05 21:48:15.318425 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 21:48:15.318496 | mon1 | skipping: [mon1] 2026-03-05 21:48:15.318510 | mon1 | 2026-03-05 21:48:15.318523 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:48:15.318535 | mon1 | Thursday 05 March 2026 21:48:15 +0000 (0:00:00.051) 0:00:59.019 ******** 2026-03-05 21:48:15.651283 | mon1 | ok: [mon1] 2026-03-05 21:48:15.652381 | mon1 | 2026-03-05 21:48:15.652442 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:48:15.652454 | mon1 | Thursday 05 March 2026 21:48:15 +0000 (0:00:00.333) 0:00:59.353 ******** 2026-03-05 21:48:22.719322 | mon1 | ok: [mon1] 2026-03-05 21:48:22.719598 | mon1 | 2026-03-05 21:48:22.720010 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:48:22.720410 | mon1 | Thursday 05 March 2026 21:48:22 +0000 (0:00:07.068) 0:01:06.421 ******** 2026-03-05 21:48:29.238616 | mon1 | ok: [mon1] 2026-03-05 21:48:29.238846 | mon1 | 2026-03-05 21:48:29.239123 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:48:29.239430 | mon1 | Thursday 05 March 2026 21:48:29 +0000 (0:00:06.519) 0:01:12.941 ******** 2026-03-05 21:48:35.811829 | mon1 | ok: [mon1] 2026-03-05 21:48:35.812029 | mon1 | 2026-03-05 21:48:35.812336 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:48:35.812572 | mon1 | Thursday 05 March 2026 21:48:35 +0000 (0:00:06.573) 0:01:19.514 ******** 2026-03-05 21:48:44.116295 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:48:44.116376 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 21:48:44.117123 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 21:48:44.117161 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 21:48:44.117167 | mon1 | 2026-03-05 21:48:44.117173 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:48:44.117179 | mon1 | 2026-03-05 21:48:44.117184 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:48:44.117189 | mon1 | Thursday 05 March 2026 21:48:44 +0000 (0:00:08.304) 0:01:27.819 ******** 2026-03-05 21:48:45.347900 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:48:45.348895 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:48:45.348928 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:48:45.348941 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:48:45.348953 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:48:45.363830 | mon1 | ok: [osd1] 2026-03-05 21:48:45.363909 | mon1 | 2026-03-05 21:48:45.363936 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:48:45.363953 | mon1 | Thursday 05 March 2026 21:48:45 +0000 (0:00:01.245) 0:01:29.065 ******** 2026-03-05 21:48:45.612890 | mon1 | ok: [osd1] 2026-03-05 21:48:45.612949 | mon1 | 2026-03-05 21:48:45.612963 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:48:45.612976 | mon1 | Thursday 05 March 2026 21:48:45 +0000 (0:00:00.249) 0:01:29.314 ******** 2026-03-05 21:48:45.654410 | mon1 | skipping: [osd1] 2026-03-05 21:48:45.654503 | mon1 | 2026-03-05 21:48:45.654526 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:48:45.654770 | mon1 | Thursday 05 March 2026 21:48:45 +0000 (0:00:00.042) 0:01:29.356 ******** 2026-03-05 21:48:45.935769 | mon1 | ok: [osd1] 2026-03-05 21:48:45.935854 | mon1 | 2026-03-05 21:48:45.938337 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:48:45.938369 | mon1 | Thursday 05 March 2026 21:48:45 +0000 (0:00:00.281) 0:01:29.637 ******** 2026-03-05 21:48:46.010659 | mon1 | ok: [osd1] => { 2026-03-05 21:48:46.010841 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:48:46.010985 | mon1 | } 2026-03-05 21:48:46.011120 | mon1 | 2026-03-05 21:48:46.011290 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:48:46.011439 | mon1 | Thursday 05 March 2026 21:48:46 +0000 (0:00:00.074) 0:01:29.712 ******** 2026-03-05 21:48:46.395220 | mon1 | ok: [osd1] 2026-03-05 21:48:46.396412 | mon1 | 2026-03-05 21:48:46.396570 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:48:46.396732 | mon1 | Thursday 05 March 2026 21:48:46 +0000 (0:00:00.385) 0:01:30.097 ******** 2026-03-05 21:48:46.439996 | mon1 | skipping: [osd1] 2026-03-05 21:48:46.440160 | mon1 | 2026-03-05 21:48:46.440367 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:48:46.440519 | mon1 | Thursday 05 March 2026 21:48:46 +0000 (0:00:00.045) 0:01:30.143 ******** 2026-03-05 21:48:46.488827 | mon1 | skipping: [osd1] 2026-03-05 21:48:46.489156 | mon1 | 2026-03-05 21:48:46.489516 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:48:46.489851 | mon1 | Thursday 05 March 2026 21:48:46 +0000 (0:00:00.047) 0:01:30.190 ******** 2026-03-05 21:48:46.740945 | mon1 | ok: [osd1] 2026-03-05 21:48:46.741335 | mon1 | 2026-03-05 21:48:46.741668 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:48:46.741998 | mon1 | Thursday 05 March 2026 21:48:46 +0000 (0:00:00.252) 0:01:30.443 ******** 2026-03-05 21:48:47.756680 | mon1 | ok: [osd1] 2026-03-05 21:48:47.756747 | mon1 | 2026-03-05 21:48:47.756977 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:48:47.757005 | mon1 | Thursday 05 March 2026 21:48:47 +0000 (0:00:01.015) 0:01:31.458 ******** 2026-03-05 21:48:47.952534 | mon1 | ok: [osd1] => { 2026-03-05 21:48:47.952578 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:48:47.952584 | mon1 | } 2026-03-05 21:48:47.952589 | mon1 | 2026-03-05 21:48:47.952593 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:48:47.952598 | mon1 | Thursday 05 March 2026 21:48:47 +0000 (0:00:00.195) 0:01:31.654 ******** 2026-03-05 21:48:48.472871 | mon1 | ok: [osd1] 2026-03-05 21:48:48.472932 | mon1 | 2026-03-05 21:48:48.472943 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:48:48.472952 | mon1 | Thursday 05 March 2026 21:48:48 +0000 (0:00:00.519) 0:01:32.173 ******** 2026-03-05 21:48:50.753383 | mon1 | ok: [osd1] 2026-03-05 21:48:50.754335 | mon1 | 2026-03-05 21:48:50.754355 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:48:50.754363 | mon1 | Thursday 05 March 2026 21:48:50 +0000 (0:00:02.281) 0:01:34.455 ******** 2026-03-05 21:48:50.785124 | mon1 | skipping: [osd1] 2026-03-05 21:48:50.785142 | mon1 | 2026-03-05 21:48:50.785147 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:48:50.785153 | mon1 | Thursday 05 March 2026 21:48:50 +0000 (0:00:00.032) 0:01:34.487 ******** 2026-03-05 21:48:50.816394 | mon1 | skipping: [osd1] 2026-03-05 21:48:50.816462 | mon1 | 2026-03-05 21:48:50.816878 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:48:50.816922 | mon1 | Thursday 05 March 2026 21:48:50 +0000 (0:00:00.030) 0:01:34.518 ******** 2026-03-05 21:48:50.847747 | mon1 | skipping: [osd1] 2026-03-05 21:48:50.847811 | mon1 | 2026-03-05 21:48:50.848039 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:48:50.848079 | mon1 | Thursday 05 March 2026 21:48:50 +0000 (0:00:00.031) 0:01:34.550 ******** 2026-03-05 21:48:52.027654 | mon1 | ok: [osd1] 2026-03-05 21:48:52.027721 | mon1 | 2026-03-05 21:48:52.027827 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:48:52.027930 | mon1 | Thursday 05 March 2026 21:48:52 +0000 (0:00:01.180) 0:01:35.730 ******** 2026-03-05 21:48:52.574796 | mon1 | ok: [osd1] 2026-03-05 21:48:52.574853 | mon1 | 2026-03-05 21:48:52.574867 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:48:52.574880 | mon1 | Thursday 05 March 2026 21:48:52 +0000 (0:00:00.545) 0:01:36.275 ******** 2026-03-05 21:48:53.685377 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:48:53.685419 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:48:53.685425 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:48:53.685443 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:48:53.685447 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:48:53.685451 | mon1 | 2026-03-05 21:48:53.685646 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:48:53.685934 | mon1 | Thursday 05 March 2026 21:48:53 +0000 (0:00:01.110) 0:01:37.385 ******** 2026-03-05 21:48:54.316326 | mon1 | ok: [osd1] 2026-03-05 21:48:54.316400 | mon1 | 2026-03-05 21:48:54.317467 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:48:54.317510 | mon1 | Thursday 05 March 2026 21:48:54 +0000 (0:00:00.625) 0:01:38.011 ******** 2026-03-05 21:48:54.317515 | mon1 | 2026-03-05 21:48:54.317519 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:48:54.317655 | mon1 | Thursday 05 March 2026 21:48:54 +0000 (0:00:00.006) 0:01:38.017 ******** 2026-03-05 21:48:54.763321 | mon1 | ok: [osd1] 2026-03-05 21:48:54.763387 | mon1 | 2026-03-05 21:48:54.763941 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:48:54.763985 | mon1 | Thursday 05 March 2026 21:48:54 +0000 (0:00:00.447) 0:01:38.465 ******** 2026-03-05 21:48:55.020273 | mon1 | ok: [osd1] 2026-03-05 21:48:55.020315 | mon1 | 2026-03-05 21:48:55.020320 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:48:55.020541 | mon1 | Thursday 05 March 2026 21:48:55 +0000 (0:00:00.256) 0:01:38.722 ******** 2026-03-05 21:48:55.093200 | mon1 | ok: [osd1] => { 2026-03-05 21:48:55.093623 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:48:55.093932 | mon1 | } 2026-03-05 21:48:55.094215 | mon1 | 2026-03-05 21:48:55.094574 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:48:55.094895 | mon1 | Thursday 05 March 2026 21:48:55 +0000 (0:00:00.072) 0:01:38.794 ******** 2026-03-05 21:48:55.530671 | mon1 | ok: [osd1] 2026-03-05 21:48:55.530749 | mon1 | 2026-03-05 21:48:55.531019 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:48:55.531047 | mon1 | Thursday 05 March 2026 21:48:55 +0000 (0:00:00.438) 0:01:39.233 ******** 2026-03-05 21:48:58.819316 | mon1 | ok: [osd1] 2026-03-05 21:48:58.819369 | mon1 | 2026-03-05 21:48:58.819802 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:48:58.819860 | mon1 | Thursday 05 March 2026 21:48:58 +0000 (0:00:03.288) 0:01:42.521 ******** 2026-03-05 21:48:59.960336 | mon1 | ok: [osd1] 2026-03-05 21:48:59.960393 | mon1 | 2026-03-05 21:48:59.960407 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:48:59.960710 | mon1 | Thursday 05 March 2026 21:48:59 +0000 (0:00:01.140) 0:01:43.662 ******** 2026-03-05 21:49:00.195832 | mon1 | ok: [osd1] 2026-03-05 21:49:00.195882 | mon1 | 2026-03-05 21:49:00.195896 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:49:00.195908 | mon1 | Thursday 05 March 2026 21:49:00 +0000 (0:00:00.234) 0:01:43.897 ******** 2026-03-05 21:49:00.739836 | mon1 | ok: [osd1] 2026-03-05 21:49:00.739897 | mon1 | 2026-03-05 21:49:00.739911 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:49:00.739923 | mon1 | Thursday 05 March 2026 21:49:00 +0000 (0:00:00.544) 0:01:44.441 ******** 2026-03-05 21:49:01.421328 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 21:49:01.421366 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:49:01.421746 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:49:01.421765 | mon1 | 2026-03-05 21:49:01.422295 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:49:01.422314 | mon1 | Thursday 05 March 2026 21:49:01 +0000 (0:00:00.681) 0:01:45.122 ******** 2026-03-05 21:49:01.958952 | mon1 | ok: [osd1] 2026-03-05 21:49:01.959003 | mon1 | 2026-03-05 21:49:01.959008 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:49:01.959013 | mon1 | Thursday 05 March 2026 21:49:01 +0000 (0:00:00.538) 0:01:45.660 ******** 2026-03-05 21:49:02.539380 | mon1 | ok: [osd1] 2026-03-05 21:49:02.539442 | mon1 | 2026-03-05 21:49:02.540378 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:49:02.540412 | mon1 | Thursday 05 March 2026 21:49:02 +0000 (0:00:00.574) 0:01:46.234 ******** 2026-03-05 21:49:02.540422 | mon1 | 2026-03-05 21:49:02.540432 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:49:02.540660 | mon1 | Thursday 05 March 2026 21:49:02 +0000 (0:00:00.006) 0:01:46.241 ******** 2026-03-05 21:49:02.980852 | mon1 | ok: [osd1] 2026-03-05 21:49:02.981038 | mon1 | 2026-03-05 21:49:02.981317 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:49:02.981601 | mon1 | Thursday 05 March 2026 21:49:02 +0000 (0:00:00.442) 0:01:46.683 ******** 2026-03-05 21:49:03.029321 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 21:49:03.029522 | mon1 | 2026-03-05 21:49:03.029769 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:49:03.030021 | mon1 | Thursday 05 March 2026 21:49:03 +0000 (0:00:00.048) 0:01:46.732 ******** 2026-03-05 21:49:04.156765 | mon1 | ok: [osd1] 2026-03-05 21:49:04.156953 | mon1 | 2026-03-05 21:49:04.157210 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:49:04.157499 | mon1 | Thursday 05 March 2026 21:49:04 +0000 (0:00:01.127) 0:01:47.859 ******** 2026-03-05 21:49:04.962067 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-03-05 21:49:04.962194 | mon1 | ok: [osd1] => (item=ssh) 2026-03-05 21:49:04.962507 | mon1 | 2026-03-05 21:49:04.962760 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:49:04.963001 | mon1 | Thursday 05 March 2026 21:49:04 +0000 (0:00:00.805) 0:01:48.664 ******** 2026-03-05 21:49:05.325440 | mon1 | ok: [osd1] 2026-03-05 21:49:05.325516 | mon1 | 2026-03-05 21:49:05.325531 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:49:05.325544 | mon1 | Thursday 05 March 2026 21:49:05 +0000 (0:00:00.362) 0:01:49.026 ******** 2026-03-05 21:49:05.569764 | mon1 | ok: [osd1] 2026-03-05 21:49:05.571339 | mon1 | 2026-03-05 21:49:05.571408 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:49:05.571419 | mon1 | Thursday 05 March 2026 21:49:05 +0000 (0:00:00.245) 0:01:49.272 ******** 2026-03-05 21:49:05.877435 | mon1 | ok: [osd1] 2026-03-05 21:49:05.877496 | mon1 | 2026-03-05 21:49:05.877506 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:49:05.877514 | mon1 | Thursday 05 March 2026 21:49:05 +0000 (0:00:00.306) 0:01:49.578 ******** 2026-03-05 21:49:06.124738 | mon1 | ok: [osd1] 2026-03-05 21:49:06.124827 | mon1 | 2026-03-05 21:49:06.124845 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:49:06.124983 | mon1 | Thursday 05 March 2026 21:49:06 +0000 (0:00:00.247) 0:01:49.826 ******** 2026-03-05 21:49:06.394384 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 21:49:06.394457 | mon1 | 2026-03-05 21:49:06.394827 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:49:06.394916 | mon1 | Thursday 05 March 2026 21:49:06 +0000 (0:00:00.269) 0:01:50.096 ******** 2026-03-05 21:49:06.461402 | mon1 | ok: [osd1] 2026-03-05 21:49:06.461481 | mon1 | 2026-03-05 21:49:06.461874 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:49:06.461933 | mon1 | Thursday 05 March 2026 21:49:06 +0000 (0:00:00.067) 0:01:50.163 ******** 2026-03-05 21:49:06.526371 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 21:49:06.526427 | mon1 | 2026-03-05 21:49:06.526667 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:49:06.526778 | mon1 | Thursday 05 March 2026 21:49:06 +0000 (0:00:00.064) 0:01:50.228 ******** 2026-03-05 21:49:13.057633 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:49:13.058124 | mon1 | 2026-03-05 21:49:13.058166 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:49:13.058175 | mon1 | Thursday 05 March 2026 21:49:13 +0000 (0:00:06.532) 0:01:56.760 ******** 2026-03-05 21:49:13.112652 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 21:49:13.112697 | mon1 | 2026-03-05 21:49:13.112709 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:49:13.112722 | mon1 | Thursday 05 March 2026 21:49:13 +0000 (0:00:00.053) 0:01:56.814 ******** 2026-03-05 21:49:13.449808 | mon1 | ok: [osd1] 2026-03-05 21:49:13.449859 | mon1 | 2026-03-05 21:49:13.449873 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:49:13.449886 | mon1 | Thursday 05 March 2026 21:49:13 +0000 (0:00:00.337) 0:01:57.151 ******** 2026-03-05 21:49:20.554002 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:49:20.554089 | mon1 | 2026-03-05 21:49:20.554189 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:49:20.554334 | mon1 | Thursday 05 March 2026 21:49:20 +0000 (0:00:07.103) 0:02:04.255 ******** 2026-03-05 21:49:26.142104 | mon1 | ok: [osd1] 2026-03-05 21:49:26.142155 | mon1 | 2026-03-05 21:49:26.142161 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:49:26.142167 | mon1 | Thursday 05 March 2026 21:49:26 +0000 (0:00:05.588) 0:02:09.843 ******** 2026-03-05 21:49:49.193559 | mon1 | ok: [osd1] 2026-03-05 21:49:49.193612 | mon1 | 2026-03-05 21:49:49.193621 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:49:49.193788 | mon1 | Thursday 05 March 2026 21:49:49 +0000 (0:00:23.051) 0:02:32.895 ******** 2026-03-05 21:49:49.260237 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 21:49:49.260280 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 21:49:49.260286 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 21:49:49.260291 | mon1 | skipping: [osd1] 2026-03-05 21:49:49.260297 | mon1 | 2026-03-05 21:49:49.260633 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:49:49.260665 | mon1 | Thursday 05 March 2026 21:49:49 +0000 (0:00:00.065) 0:02:32.961 ******** 2026-03-05 21:49:55.880790 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:49:55.880850 | mon1 | 2026-03-05 21:49:55.880864 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:49:55.880876 | mon1 | Thursday 05 March 2026 21:49:55 +0000 (0:00:06.621) 0:02:39.582 ******** 2026-03-05 21:50:02.577844 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:50:02.577925 | mon1 | 2026-03-05 21:50:02.577944 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:50:02.578087 | mon1 | Thursday 05 March 2026 21:50:02 +0000 (0:00:06.696) 0:02:46.279 ******** 2026-03-05 21:50:02.647974 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 21:50:02.648010 | mon1 | 2026-03-05 21:50:02.648743 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:50:02.648895 | mon1 | Thursday 05 March 2026 21:50:02 +0000 (0:00:00.069) 0:02:46.348 ******** 2026-03-05 21:50:02.693606 | mon1 | ok: [osd1] 2026-03-05 21:50:02.693647 | mon1 | 2026-03-05 21:50:02.693660 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:50:02.693672 | mon1 | Thursday 05 March 2026 21:50:02 +0000 (0:00:00.046) 0:02:46.395 ******** 2026-03-05 21:50:09.262408 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:50:09.262527 | mon1 | 2026-03-05 21:50:09.263017 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:50:09.263079 | mon1 | Thursday 05 March 2026 21:50:09 +0000 (0:00:06.569) 0:02:52.964 ******** 2026-03-05 21:50:09.309405 | mon1 | ok: [osd1] 2026-03-05 21:50:09.309476 | mon1 | 2026-03-05 21:50:09.309488 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:50:09.309506 | mon1 | Thursday 05 March 2026 21:50:09 +0000 (0:00:00.046) 0:02:53.011 ******** 2026-03-05 21:50:09.352713 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:50:09.352779 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:50:09.353397 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:50:09.353458 | mon1 | skipping: [osd1] 2026-03-05 21:50:09.353463 | mon1 | 2026-03-05 21:50:09.353467 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:50:09.353472 | mon1 | Thursday 05 March 2026 21:50:09 +0000 (0:00:00.044) 0:02:53.055 ******** 2026-03-05 21:50:09.389306 | mon1 | skipping: [osd1] 2026-03-05 21:50:09.389362 | mon1 | 2026-03-05 21:50:09.389390 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:50:09.389400 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 21:50:09.389409 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 21:50:09.389418 | mon1 | 2026-03-05 21:50:09.389426 | mon1 | 2026-03-05 21:50:09.389435 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:50:09.389443 | mon1 | Thursday 05 March 2026 21:50:09 +0000 (0:00:00.033) 0:02:53.089 ******** 2026-03-05 21:50:09.389452 | mon1 | =============================================================================== 2026-03-05 21:50:09.389564 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 23.05s 2026-03-05 21:50:09.389870 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.66s 2026-03-05 21:50:09.390176 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.30s 2026-03-05 21:50:09.390509 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.10s 2026-03-05 21:50:09.390820 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.10s 2026-03-05 21:50:09.391136 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.07s 2026-03-05 21:50:09.391471 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.70s 2026-03-05 21:50:09.391788 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.69s 2026-03-05 21:50:09.392091 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.68s 2026-03-05 21:50:09.392419 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.62s 2026-03-05 21:50:09.392729 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.57s 2026-03-05 21:50:09.393025 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.57s 2026-03-05 21:50:09.393359 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.53s 2026-03-05 21:50:09.393691 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.52s 2026-03-05 21:50:09.393994 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.59s 2026-03-05 21:50:09.394324 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.29s 2026-03-05 21:50:09.394635 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.18s 2026-03-05 21:50:09.394937 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.41s 2026-03-05 21:50:09.395265 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.28s 2026-03-05 21:50:09.395581 | mon1 | Gathering Facts --------------------------------------------------------- 1.25s 2026-03-05 21:50:09.531819 | mon1 | INFO [default > idempotence] Executed: Successful 2026-03-05 21:50:09.542381 | mon1 | INFO [default > side_effect] Executing 2026-03-05 21:50:09.542772 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:50:09.548448 | mon1 | INFO [default > verify] Executing 2026-03-05 21:50:10.287615 | mon1 | 2026-03-05 21:50:10.287979 | mon1 | PLAY [Verify] ****************************************************************** 2026-03-05 21:50:10.288292 | mon1 | 2026-03-05 21:50:10.288605 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:50:10.288907 | mon1 | Thursday 05 March 2026 21:50:10 +0000 (0:00:00.008) 0:00:00.008 ******** 2026-03-05 21:50:11.506964 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:50:11.507384 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:50:11.507698 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:50:11.507995 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:50:11.508350 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:50:11.518111 | mon1 | ok: [mon1] 2026-03-05 21:50:11.518436 | mon1 | 2026-03-05 21:50:11.518741 | mon1 | TASK [Get cluster health status] *********************************************** 2026-03-05 21:50:11.519040 | mon1 | Thursday 05 March 2026 21:50:11 +0000 (0:00:01.230) 0:00:01.238 ******** 2026-03-05 21:50:22.206304 | mon1 | ok: [mon1] 2026-03-05 21:50:22.206726 | mon1 | 2026-03-05 21:50:22.207087 | mon1 | TASK [Print cluster health status] ********************************************* 2026-03-05 21:50:22.207508 | mon1 | Thursday 05 March 2026 21:50:22 +0000 (0:00:10.687) 0:00:11.925 ******** 2026-03-05 21:50:22.248307 | mon1 | ok: [mon1] => { 2026-03-05 21:50:22.248344 | mon1 | "_ceph_health": { 2026-03-05 21:50:22.248357 | mon1 | "changed": false, 2026-03-05 21:50:22.248368 | mon1 | "cmd": [ 2026-03-05 21:50:22.248380 | mon1 | "cephadm", 2026-03-05 21:50:22.248391 | mon1 | "shell", 2026-03-05 21:50:22.248402 | mon1 | "--", 2026-03-05 21:50:22.248418 | mon1 | "ceph", 2026-03-05 21:50:22.248625 | mon1 | "health" 2026-03-05 21:50:22.248887 | mon1 | ], 2026-03-05 21:50:22.249130 | mon1 | "delta": "0:00:10.349463", 2026-03-05 21:50:22.249431 | mon1 | "end": "2026-03-05 21:50:22.164593", 2026-03-05 21:50:22.249677 | mon1 | "failed": false, 2026-03-05 21:50:22.249919 | mon1 | "msg": "", 2026-03-05 21:50:22.250153 | mon1 | "rc": 0, 2026-03-05 21:50:22.250449 | mon1 | "start": "2026-03-05 21:50:11.815130", 2026-03-05 21:50:22.250731 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-03-05 21:50:22.250977 | mon1 | "stderr_lines": [ 2026-03-05 21:50:22.251229 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-05 21:50:22.251561 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-03-05 21:50:22.251801 | mon1 | ], 2026-03-05 21:50:22.252050 | mon1 | "stdout": "HEALTH_OK", 2026-03-05 21:50:22.252321 | mon1 | "stdout_lines": [ 2026-03-05 21:50:22.252589 | mon1 | "HEALTH_OK" 2026-03-05 21:50:22.252847 | mon1 | ] 2026-03-05 21:50:22.253084 | mon1 | } 2026-03-05 21:50:22.253362 | mon1 | } 2026-03-05 21:50:22.253613 | mon1 | 2026-03-05 21:50:22.253865 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-05 21:50:22.254121 | mon1 | Thursday 05 March 2026 21:50:22 +0000 (0:00:00.041) 0:00:11.967 ******** 2026-03-05 21:50:22.282843 | mon1 | ok: [mon1] => { 2026-03-05 21:50:22.283055 | mon1 | "changed": false, 2026-03-05 21:50:22.283330 | mon1 | "msg": "All assertions passed" 2026-03-05 21:50:22.283585 | mon1 | } 2026-03-05 21:50:22.283814 | mon1 | 2026-03-05 21:50:22.284081 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-03-05 21:50:22.284370 | mon1 | Thursday 05 March 2026 21:50:22 +0000 (0:00:00.036) 0:00:12.003 ******** 2026-03-05 21:50:29.210752 | mon1 | changed: [mon1] 2026-03-05 21:50:29.210809 | mon1 | 2026-03-05 21:50:29.210837 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-03-05 21:50:29.210850 | mon1 | Thursday 05 March 2026 21:50:29 +0000 (0:00:06.926) 0:00:18.929 ******** 2026-03-05 21:50:31.961332 | mon1 | changed: [mon1] 2026-03-05 21:50:31.961381 | mon1 | 2026-03-05 21:50:31.961932 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-05 21:50:31.961991 | mon1 | Thursday 05 March 2026 21:50:31 +0000 (0:00:02.751) 0:00:21.681 ******** 2026-03-05 21:50:33.346781 | mon1 | ok: [mon1] 2026-03-05 21:50:33.346888 | mon1 | 2026-03-05 21:50:33.347207 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-03-05 21:50:33.347257 | mon1 | Thursday 05 March 2026 21:50:33 +0000 (0:00:01.385) 0:00:23.066 ******** 2026-03-05 21:50:33.383446 | mon1 | ok: [mon1] => { 2026-03-05 21:50:33.384307 | mon1 | "changed": false, 2026-03-05 21:50:33.384346 | mon1 | "msg": "All assertions passed" 2026-03-05 21:50:33.384359 | mon1 | } 2026-03-05 21:50:33.384371 | mon1 | 2026-03-05 21:50:33.384383 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:50:33.384395 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 21:50:33.384407 | mon1 | 2026-03-05 21:50:33.384418 | mon1 | 2026-03-05 21:50:33.384435 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:50:33.385484 | mon1 | Thursday 05 March 2026 21:50:33 +0000 (0:00:00.037) 0:00:23.104 ******** 2026-03-05 21:50:33.385524 | mon1 | =============================================================================== 2026-03-05 21:50:33.385530 | mon1 | Get cluster health status ---------------------------------------------- 10.69s 2026-03-05 21:50:33.385537 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.93s 2026-03-05 21:50:33.385542 | mon1 | Create a test Ceph key -------------------------------------------------- 2.75s 2026-03-05 21:50:33.385547 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.39s 2026-03-05 21:50:33.385552 | mon1 | Gathering Facts --------------------------------------------------------- 1.23s 2026-03-05 21:50:33.385558 | mon1 | Print cluster health status --------------------------------------------- 0.04s 2026-03-05 21:50:33.385563 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-03-05 21:50:33.385568 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.04s 2026-03-05 21:50:33.458441 | mon1 | INFO [default > verify] Executed: Successful 2026-03-05 21:50:33.468888 | mon1 | INFO [default > cleanup] Executing 2026-03-05 21:50:33.469261 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:50:33.474907 | mon1 | INFO [default > destroy] Executing 2026-03-05 21:50:33.474994 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 21:50:33.475100 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 21:50:33.475424 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-05 21:50:33.760025 | mon1 | ok: Runtime: 0:12:21.464828 2026-03-05 21:50:33.774414 | 2026-03-05 21:50:33.774546 | PLAY RECAP 2026-03-05 21:50:33.774609 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:50:33.774634 | 2026-03-05 21:50:33.924419 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 21:50:33.929179 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:50:34.567925 | 2026-03-05 21:50:34.568083 | PLAY [all] 2026-03-05 21:50:34.582958 | 2026-03-05 21:50:34.583058 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-05 21:50:34.643173 | mon1 | ok 2026-03-05 21:50:34.648579 | osd1 | ok 2026-03-05 21:50:34.654471 | 2026-03-05 21:50:34.654548 | TASK [fetch-output : Set log path for single node] 2026-03-05 21:50:34.682082 | mon1 | skipping: Conditional result was False 2026-03-05 21:50:34.693386 | osd1 | skipping: Conditional result was False 2026-03-05 21:50:34.705889 | 2026-03-05 21:50:34.705982 | LOOP [fetch-output : Ensure local output dirs] 2026-03-05 21:50:35.090000 | mon1 -> localhost | changed: "/var/lib/zuul/builds/8a661fb75e9742d59970ed217a4ef46f/work/logs/mon1" 2026-03-05 21:50:35.092155 | osd1 -> localhost | changed: "/var/lib/zuul/builds/8a661fb75e9742d59970ed217a4ef46f/work/logs/osd1" 2026-03-05 21:50:35.301710 | osd1 -> localhost | ok: "/var/lib/zuul/builds/8a661fb75e9742d59970ed217a4ef46f/work/artifacts" 2026-03-05 21:50:35.306321 | mon1 -> localhost | changed: "/var/lib/zuul/builds/8a661fb75e9742d59970ed217a4ef46f/work/artifacts" 2026-03-05 21:50:35.505921 | osd1 -> localhost | changed: "/var/lib/zuul/builds/8a661fb75e9742d59970ed217a4ef46f/work/docs" 2026-03-05 21:50:35.536566 | mon1 -> localhost | ok: "/var/lib/zuul/builds/8a661fb75e9742d59970ed217a4ef46f/work/docs" 2026-03-05 21:50:35.536749 | mon1 -> localhost | changed: All items complete 2026-03-05 21:50:35.536844 | 2026-03-05 21:50:35.555430 | 2026-03-05 21:50:35.555558 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-05 21:50:36.198180 | mon1 | changed: .d..t...... ./ 2026-03-05 21:50:36.204870 | osd1 | changed: .d..t...... ./ 2026-03-05 21:50:36.664145 | mon1 | changed: .d..t...... ./ 2026-03-05 21:50:36.678272 | osd1 | changed: .d..t...... ./ 2026-03-05 21:50:37.125490 | mon1 | changed: .d..t...... ./ 2026-03-05 21:50:37.130836 | osd1 | changed: .d..t...... ./ 2026-03-05 21:50:37.154307 | 2026-03-05 21:50:37.154424 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-05 21:50:37.560880 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008004 2026-03-05 21:50:37.561126 | mon1 -> localhost | changed: All items complete 2026-03-05 21:50:37.561155 | 2026-03-05 21:50:37.796843 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.008708 2026-03-05 21:50:37.824577 | 2026-03-05 21:50:37.824768 | PLAY [all] 2026-03-05 21:50:37.833157 | 2026-03-05 21:50:37.833361 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-05 21:50:38.311414 | mon1 | changed 2026-03-05 21:50:38.504894 | osd1 | changed 2026-03-05 21:50:38.515672 | 2026-03-05 21:50:38.515722 | PLAY RECAP 2026-03-05 21:50:38.515769 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 21:50:38.515815 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 21:50:38.515837 | 2026-03-05 21:50:38.636400 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:50:38.641529 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-05 21:50:39.233547 | 2026-03-05 21:50:39.233695 | PLAY [localhost] 2026-03-05 21:50:39.243900 | 2026-03-05 21:50:39.243972 | TASK [Generate Zuul manifest] 2026-03-05 21:50:39.266512 | localhost | ok 2026-03-05 21:50:39.284008 | 2026-03-05 21:50:39.284097 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-05 21:50:39.607263 | localhost | changed 2026-03-05 21:50:39.619536 | 2026-03-05 21:50:39.619610 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-05 21:50:39.650743 | localhost | ok 2026-03-05 21:50:39.659404 | 2026-03-05 21:50:39.659468 | TASK [Upload logs] 2026-03-05 21:50:39.694010 | localhost | ok 2026-03-05 21:50:39.751731 | 2026-03-05 21:50:39.751857 | TASK [Set zuul-log-path fact] 2026-03-05 21:50:39.773284 | localhost | ok 2026-03-05 21:50:39.788857 | 2026-03-05 21:50:39.788940 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 21:50:39.819457 | localhost | ok 2026-03-05 21:50:39.827511 | 2026-03-05 21:50:39.827575 | TASK [upload-logs : Create log directories] 2026-03-05 21:50:40.293961 | localhost | changed 2026-03-05 21:50:40.300342 | 2026-03-05 21:50:40.300436 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-05 21:50:40.717940 | localhost -> localhost | ok: Runtime: 0:00:00.005802 2026-03-05 21:50:40.722981 | 2026-03-05 21:50:40.723045 | TASK [upload-logs : Upload logs to log server] 2026-03-05 21:50:41.159500 | localhost | Output suppressed because no_log was given 2026-03-05 21:50:41.164439 | 2026-03-05 21:50:41.164535 | LOOP [upload-logs : Compress console log and json output] 2026-03-05 21:50:41.207834 | localhost | skipping: Conditional result was False 2026-03-05 21:50:41.214664 | localhost | skipping: Conditional result was False 2026-03-05 21:50:41.227925 | 2026-03-05 21:50:41.228083 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-05 21:50:41.270371 | localhost | skipping: Conditional result was False 2026-03-05 21:50:41.270777 | 2026-03-05 21:50:41.274389 | localhost | skipping: Conditional result was False 2026-03-05 21:50:41.292310 | 2026-03-05 21:50:41.292473 | LOOP [upload-logs : Upload console log and json output]