2026-03-05 21:38:25.324371 | Job console starting 2026-03-05 21:38:25.335124 | Updating git repos 2026-03-05 21:38:25.362055 | Cloning repos into workspace 2026-03-05 21:38:25.424220 | Restoring repo states 2026-03-05 21:38:25.429832 | Merging changes 2026-03-05 21:38:25.678905 | Checking out repos 2026-03-05 21:38:25.732833 | Preparing playbooks 2026-03-05 21:38:26.552566 | Running Ansible setup 2026-03-05 21:38:29.967582 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 21:38:30.582380 | 2026-03-05 21:38:30.582508 | PLAY [localhost] 2026-03-05 21:38:30.590637 | 2026-03-05 21:38:30.591190 | TASK [Gathering Facts] 2026-03-05 21:38:32.479382 | localhost | ok 2026-03-05 21:38:32.489981 | 2026-03-05 21:38:32.490079 | TASK [Setup log path fact] 2026-03-05 21:38:32.510052 | localhost | ok 2026-03-05 21:38:32.521578 | 2026-03-05 21:38:32.521642 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 21:38:32.550360 | localhost | ok 2026-03-05 21:38:32.557760 | 2026-03-05 21:38:32.557822 | TASK [emit-job-header : Print job information] 2026-03-05 21:38:32.597280 | # Job Information 2026-03-05 21:38:32.597484 | Ansible Version: 2.16.16 2026-03-05 21:38:32.597554 | Job: ansible-collection-ceph-molecule-aio-ubuntu-jammy 2026-03-05 21:38:32.597604 | Pipeline: check 2026-03-05 21:38:32.597650 | Executor: 0a8996d2b663 2026-03-05 21:38:32.597693 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/95 2026-03-05 21:38:32.597743 | Event ID: 753cf340-18d7-11f1-84a2-1dadd23b4000 2026-03-05 21:38:32.602557 | 2026-03-05 21:38:32.602616 | LOOP [emit-job-header : Print node information] 2026-03-05 21:38:32.690785 | localhost | ok: 2026-03-05 21:38:32.691285 | localhost | # Node Information 2026-03-05 21:38:32.691318 | localhost | Inventory Hostname: aio 2026-03-05 21:38:32.691340 | localhost | Hostname: np0000157956 2026-03-05 21:38:32.691360 | localhost | Username: zuul 2026-03-05 21:38:32.691382 | localhost | Distro: Ubuntu 22.04 2026-03-05 21:38:32.691403 | localhost | Provider: yul1 2026-03-05 21:38:32.691422 | localhost | Region: ca-ymq-1 2026-03-05 21:38:32.691441 | localhost | Label: ubuntu-jammy 2026-03-05 21:38:32.691459 | localhost | Product Name: OpenStack Nova 2026-03-05 21:38:32.691477 | localhost | Interface IP: 199.204.45.72 2026-03-05 21:38:32.706598 | 2026-03-05 21:38:32.706739 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-05 21:38:33.130396 | localhost -> localhost | changed 2026-03-05 21:38:33.135087 | 2026-03-05 21:38:33.135155 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-05 21:38:33.966188 | localhost -> localhost | changed 2026-03-05 21:38:33.973952 | 2026-03-05 21:38:33.974057 | PLAY [all] 2026-03-05 21:38:33.984850 | 2026-03-05 21:38:33.985031 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-05 21:38:34.192160 | aio -> localhost | ok 2026-03-05 21:38:34.203317 | 2026-03-05 21:38:34.203401 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-05 21:38:34.236314 | aio | ok 2026-03-05 21:38:34.251893 | aio | included: /var/lib/zuul/builds/8203a69885dd46c0913b9b574f86ec6a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 21:38:34.257378 | 2026-03-05 21:38:34.257436 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-05 21:38:34.849522 | aio -> localhost | Generating public/private rsa key pair. 2026-03-05 21:38:34.850246 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/8203a69885dd46c0913b9b574f86ec6a/work/8203a69885dd46c0913b9b574f86ec6a_id_rsa 2026-03-05 21:38:34.850293 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/8203a69885dd46c0913b9b574f86ec6a/work/8203a69885dd46c0913b9b574f86ec6a_id_rsa.pub 2026-03-05 21:38:34.850327 | aio -> localhost | The key fingerprint is: 2026-03-05 21:38:34.850359 | aio -> localhost | SHA256:97Xa7Z7OR/KPPwoxWvY8zWxYfgOUmIiEfseZDOEb2Oc zuul-build-sshkey 2026-03-05 21:38:34.850403 | aio -> localhost | The key's randomart image is: 2026-03-05 21:38:34.850434 | aio -> localhost | +---[RSA 3072]----+ 2026-03-05 21:38:34.850475 | aio -> localhost | | .o. | 2026-03-05 21:38:34.850506 | aio -> localhost | | .=.. . o . | 2026-03-05 21:38:34.850536 | aio -> localhost | | .. =+ooo o | 2026-03-05 21:38:34.850565 | aio -> localhost | | . .=* . | 2026-03-05 21:38:34.850594 | aio -> localhost | | ..SE.= ... | 2026-03-05 21:38:34.850623 | aio -> localhost | | .+.=.X..| 2026-03-05 21:38:34.850651 | aio -> localhost | | . ..=.@.| 2026-03-05 21:38:34.850679 | aio -> localhost | | .o++*| 2026-03-05 21:38:34.850711 | aio -> localhost | | ..=BX| 2026-03-05 21:38:34.850740 | aio -> localhost | +----[SHA256]-----+ 2026-03-05 21:38:34.850799 | aio -> localhost | ok: Runtime: 0:00:00.203117 2026-03-05 21:38:34.857883 | 2026-03-05 21:38:34.857969 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-05 21:38:34.891307 | aio | ok 2026-03-05 21:38:34.899413 | aio | included: /var/lib/zuul/builds/8203a69885dd46c0913b9b574f86ec6a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 21:38:34.906870 | 2026-03-05 21:38:34.906950 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-05 21:38:34.930472 | aio | skipping: Conditional result was False 2026-03-05 21:38:34.940106 | 2026-03-05 21:38:34.940181 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-05 21:38:35.358501 | aio | changed 2026-03-05 21:38:35.365429 | 2026-03-05 21:38:35.365516 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-05 21:38:35.548553 | aio | ok 2026-03-05 21:38:35.555399 | 2026-03-05 21:38:35.555504 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-05 21:38:36.027461 | aio | changed 2026-03-05 21:38:36.032619 | 2026-03-05 21:38:36.032699 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-05 21:38:36.475873 | aio | changed 2026-03-05 21:38:36.484118 | 2026-03-05 21:38:36.484185 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-05 21:38:36.508003 | aio | skipping: Conditional result was False 2026-03-05 21:38:36.519107 | 2026-03-05 21:38:36.519219 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-05 21:38:36.867453 | aio -> localhost | changed 2026-03-05 21:38:36.880793 | 2026-03-05 21:38:36.880857 | TASK [add-build-sshkey : Add back temp key] 2026-03-05 21:38:37.136807 | aio -> localhost | Identity added: /var/lib/zuul/builds/8203a69885dd46c0913b9b574f86ec6a/work/8203a69885dd46c0913b9b574f86ec6a_id_rsa (zuul-build-sshkey) 2026-03-05 21:38:37.137002 | aio -> localhost | ok: Runtime: 0:00:00.008637 2026-03-05 21:38:37.141714 | 2026-03-05 21:38:37.141776 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-05 21:38:37.435890 | aio | ok 2026-03-05 21:38:37.442996 | 2026-03-05 21:38:37.443057 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-05 21:38:37.466831 | aio | skipping: Conditional result was False 2026-03-05 21:38:37.481993 | 2026-03-05 21:38:37.482079 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-05 21:38:37.853110 | aio | ok 2026-03-05 21:38:37.858929 | 2026-03-05 21:38:37.858989 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-05 21:38:38.593027 | aio | Output suppressed because no_log was given 2026-03-05 21:38:38.601470 | 2026-03-05 21:38:38.601534 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-05 21:38:38.788093 | aio | ok: "logs" 2026-03-05 21:38:38.788369 | aio | ok: All items complete 2026-03-05 21:38:38.788465 | 2026-03-05 21:38:38.950079 | aio | ok: "artifacts" 2026-03-05 21:38:39.091260 | aio | ok: "docs" 2026-03-05 21:38:39.106233 | 2026-03-05 21:38:39.106373 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-05 21:38:39.320285 | aio | changed: "logs" 2026-03-05 21:38:39.477896 | aio | changed: "artifacts" 2026-03-05 21:38:39.635160 | aio | changed: "docs" 2026-03-05 21:38:39.647868 | 2026-03-05 21:38:39.647928 | PLAY RECAP 2026-03-05 21:38:39.647976 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 21:38:39.648010 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:38:39.648032 | 2026-03-05 21:38:39.744042 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 21:38:39.747045 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 21:38:40.279145 | 2026-03-05 21:38:40.279264 | PLAY [all] 2026-03-05 21:38:40.290065 | 2026-03-05 21:38:40.290141 | TASK [setup-uv : Extract archive] 2026-03-05 21:38:42.387445 | aio | changed 2026-03-05 21:38:42.395902 | 2026-03-05 21:38:42.396004 | TASK [setup-uv : Print version] 2026-03-05 21:38:42.351029 | aio | uv 0.8.13 2026-03-05 21:38:42.933053 | aio | ok: Runtime: 0:00:00.011981 2026-03-05 21:38:42.938768 | 2026-03-05 21:38:42.938814 | PLAY RECAP 2026-03-05 21:38:42.938858 | aio | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:38:42.938881 | 2026-03-05 21:38:43.041003 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 21:38:43.044133 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 21:38:43.583505 | 2026-03-05 21:38:43.584220 | PLAY [all] 2026-03-05 21:38:43.594622 | 2026-03-05 21:38:43.594694 | TASK [Copy inventory file for Zuul] 2026-03-05 21:38:44.412317 | aio | changed 2026-03-05 21:38:44.418250 | 2026-03-05 21:38:44.418325 | TASK [Switch "ansible_host" to private IP] 2026-03-05 21:38:44.679442 | aio | changed: 1 replacements made 2026-03-05 21:38:44.684454 | 2026-03-05 21:38:44.684516 | TASK [Run Molecule scenario] 2026-03-05 21:38:44.787930 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-03-05 21:38:45.495302 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-03-05 21:38:45.679481 | aio | Using CPython 3.13.7 2026-03-05 21:38:45.679564 | aio | Creating virtual environment at: .venv 2026-03-05 21:38:45.899164 | aio | Downloading ansible-core (2.1MiB) 2026-03-05 21:38:45.900975 | aio | Downloading pygments (1.2MiB) 2026-03-05 21:38:45.901488 | aio | Downloading cryptography (4.3MiB) 2026-03-05 21:38:45.902009 | aio | Downloading netaddr (2.2MiB) 2026-03-05 21:38:46.075941 | aio | Downloading netaddr 2026-03-05 21:38:46.084810 | aio | Downloading cryptography 2026-03-05 21:38:46.127247 | aio | Downloading pygments 2026-03-05 21:38:46.247956 | aio | Downloading ansible-core 2026-03-05 21:38:46.276276 | aio | Installed 36 packages in 27ms 2026-03-05 21:38:47.346689 | aio | INFO Collection 'vexxhost.ceph' detected. 2026-03-05 21:38:47.346783 | aio | INFO Scenarios will be used from 'extensions/molecule' 2026-03-05 21:38:47.941440 | aio | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-05 21:38:47.941537 | aio | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-05 21:39:00.584426 | aio | INFO [default > dependency] Executing 2026-03-05 21:39:00.584526 | aio | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-05 21:39:00.584734 | aio | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-05 21:39:00.584785 | aio | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-05 21:39:00.589911 | aio | INFO [default > cleanup] Executing 2026-03-05 21:39:00.590194 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:39:00.595316 | aio | INFO [default > destroy] Executing 2026-03-05 21:39:00.595351 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 21:39:00.595368 | aio | INFO [default > destroy] Executed: Successful 2026-03-05 21:39:00.600422 | aio | INFO [default > syntax] Executing 2026-03-05 21:39:01.677364 | aio | 2026-03-05 21:39:01.677554 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-05 21:39:01.728440 | aio | INFO [default > syntax] Executed: Successful 2026-03-05 21:39:01.737911 | aio | INFO [default > create] Executing 2026-03-05 21:39:01.741860 | aio | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:39:01.749439 | aio | INFO [default > prepare] Executing 2026-03-05 21:39:02.410943 | aio | 2026-03-05 21:39:02.411020 | aio | PLAY [Prepare] ***************************************************************** 2026-03-05 21:39:02.411028 | aio | 2026-03-05 21:39:02.411034 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:39:02.411227 | aio | Thursday 05 March 2026 21:39:02 +0000 (0:00:00.034) 0:00:00.034 ******** 2026-03-05 21:39:03.564780 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 21:39:03.565019 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:39:03.565276 | aio | interpreter could change the meaning of that path. See 2026-03-05 21:39:03.565530 | aio | https://docs.ansible.com/ansible- 2026-03-05 21:39:03.565793 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:39:03.573628 | aio | ok: [aio] 2026-03-05 21:39:03.573880 | aio | 2026-03-05 21:39:03.574130 | aio | TASK [Configure short hostname] ************************************************ 2026-03-05 21:39:03.574377 | aio | Thursday 05 March 2026 21:39:03 +0000 (0:00:01.170) 0:00:01.204 ******** 2026-03-05 21:39:04.294790 | aio | changed: [aio] 2026-03-05 21:39:04.295012 | aio | 2026-03-05 21:39:04.295275 | aio | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-05 21:39:04.295533 | aio | Thursday 05 March 2026 21:39:04 +0000 (0:00:00.720) 0:00:01.925 ******** 2026-03-05 21:39:04.562537 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-05 21:39:04.562712 | aio | with a mode of 0700, this may cause issues when running as another user. To 2026-03-05 21:39:04.562921 | aio | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-05 21:39:04.563213 | aio | changed: [aio] 2026-03-05 21:39:04.563403 | aio | 2026-03-05 21:39:04.563601 | aio | TASK [Update apt cache] ******************************************************** 2026-03-05 21:39:04.563815 | aio | Thursday 05 March 2026 21:39:04 +0000 (0:00:00.268) 0:00:02.194 ******** 2026-03-05 21:39:11.286189 | aio | changed: [aio] 2026-03-05 21:39:11.286310 | aio | 2026-03-05 21:39:11.286568 | aio | PLAY [Create devices for Ceph] ************************************************* 2026-03-05 21:39:11.286709 | aio | 2026-03-05 21:39:11.286903 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:39:11.287149 | aio | Thursday 05 March 2026 21:39:11 +0000 (0:00:06.722) 0:00:08.917 ******** 2026-03-05 21:39:11.974399 | aio | ok: [aio] 2026-03-05 21:39:11.974516 | aio | 2026-03-05 21:39:11.974719 | aio | TASK [Install depedencies] ***************************************************** 2026-03-05 21:39:11.974922 | aio | Thursday 05 March 2026 21:39:11 +0000 (0:00:00.687) 0:00:09.605 ******** 2026-03-05 21:39:33.643519 | aio | changed: [aio] 2026-03-05 21:39:33.643676 | aio | 2026-03-05 21:39:33.643933 | aio | TASK [Start up service] ******************************************************** 2026-03-05 21:39:33.644202 | aio | Thursday 05 March 2026 21:39:33 +0000 (0:00:21.668) 0:00:31.274 ******** 2026-03-05 21:39:34.188925 | aio | ok: [aio] 2026-03-05 21:39:34.189079 | aio | 2026-03-05 21:39:34.189402 | aio | TASK [Generate lvm.conf] ******************************************************* 2026-03-05 21:39:34.189554 | aio | Thursday 05 March 2026 21:39:34 +0000 (0:00:00.545) 0:00:31.820 ******** 2026-03-05 21:39:34.508707 | aio | ok: [aio] 2026-03-05 21:39:34.508849 | aio | 2026-03-05 21:39:34.509120 | aio | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-05 21:39:34.509328 | aio | Thursday 05 March 2026 21:39:34 +0000 (0:00:00.319) 0:00:32.139 ******** 2026-03-05 21:39:35.163286 | aio | changed: [aio] 2026-03-05 21:39:35.163538 | aio | 2026-03-05 21:39:35.163844 | aio | TASK [Get list of all loopback devices] **************************************** 2026-03-05 21:39:35.164159 | aio | Thursday 05 March 2026 21:39:35 +0000 (0:00:00.654) 0:00:32.794 ******** 2026-03-05 21:39:35.348744 | aio | ok: [aio] 2026-03-05 21:39:35.349011 | aio | 2026-03-05 21:39:35.349344 | aio | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-05 21:39:35.349644 | aio | Thursday 05 March 2026 21:39:35 +0000 (0:00:00.185) 0:00:32.980 ******** 2026-03-05 21:39:35.370171 | aio | skipping: [aio] 2026-03-05 21:39:35.370433 | aio | 2026-03-05 21:39:35.370703 | aio | TASK [Create devices for Ceph] ************************************************* 2026-03-05 21:39:35.370962 | aio | Thursday 05 March 2026 21:39:35 +0000 (0:00:00.021) 0:00:33.001 ******** 2026-03-05 21:39:35.915502 | aio | changed: [aio] => (item=osd0) 2026-03-05 21:39:35.915724 | aio | changed: [aio] => (item=osd1) 2026-03-05 21:39:35.915926 | aio | changed: [aio] => (item=osd2) 2026-03-05 21:39:35.916169 | aio | 2026-03-05 21:39:35.916372 | aio | TASK [Set permissions on loopback devices] ************************************* 2026-03-05 21:39:35.916572 | aio | Thursday 05 March 2026 21:39:35 +0000 (0:00:00.545) 0:00:33.546 ******** 2026-03-05 21:39:36.590342 | aio | changed: [aio] => (item=osd0) 2026-03-05 21:39:36.590537 | aio | changed: [aio] => (item=osd1) 2026-03-05 21:39:36.590747 | aio | changed: [aio] => (item=osd2) 2026-03-05 21:39:36.590950 | aio | 2026-03-05 21:39:36.591154 | aio | TASK [Start loop devices] ****************************************************** 2026-03-05 21:39:36.591367 | aio | Thursday 05 March 2026 21:39:36 +0000 (0:00:00.675) 0:00:34.221 ******** 2026-03-05 21:39:37.292615 | aio | changed: [aio] => (item=osd0) 2026-03-05 21:39:37.292804 | aio | changed: [aio] => (item=osd1) 2026-03-05 21:39:37.293007 | aio | changed: [aio] => (item=osd2) 2026-03-05 21:39:37.293186 | aio | 2026-03-05 21:39:37.293392 | aio | TASK [Create a volume group for each loop device] ****************************** 2026-03-05 21:39:37.293592 | aio | Thursday 05 March 2026 21:39:37 +0000 (0:00:00.702) 0:00:34.923 ******** 2026-03-05 21:39:40.293340 | aio | changed: [aio] => (item=osd0) 2026-03-05 21:39:40.293492 | aio | changed: [aio] => (item=osd1) 2026-03-05 21:39:40.293735 | aio | changed: [aio] => (item=osd2) 2026-03-05 21:39:40.293874 | aio | 2026-03-05 21:39:40.294092 | aio | TASK [Create a logical volume for each loop device] **************************** 2026-03-05 21:39:40.294322 | aio | Thursday 05 March 2026 21:39:40 +0000 (0:00:03.000) 0:00:37.924 ******** 2026-03-05 21:39:42.068377 | aio | changed: [aio] => (item=ceph-aio-osd0) 2026-03-05 21:39:42.068593 | aio | changed: [aio] => (item=ceph-aio-osd1) 2026-03-05 21:39:42.068804 | aio | changed: [aio] => (item=ceph-aio-osd2) 2026-03-05 21:39:42.068981 | aio | 2026-03-05 21:39:42.069165 | aio | PLAY RECAP ********************************************************************* 2026-03-05 21:39:42.069393 | aio | aio : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-05 21:39:42.069561 | aio | 2026-03-05 21:39:42.069733 | aio | 2026-03-05 21:39:42.069922 | aio | TASKS RECAP ******************************************************************** 2026-03-05 21:39:42.070120 | aio | Thursday 05 March 2026 21:39:42 +0000 (0:00:01.775) 0:00:39.700 ******** 2026-03-05 21:39:42.070300 | aio | =============================================================================== 2026-03-05 21:39:42.070492 | aio | Install depedencies ---------------------------------------------------- 21.67s 2026-03-05 21:39:42.070682 | aio | Update apt cache -------------------------------------------------------- 6.72s 2026-03-05 21:39:42.070877 | aio | Create a volume group for each loop device ------------------------------ 3.00s 2026-03-05 21:39:42.071192 | aio | Create a logical volume for each loop device ---------------------------- 1.78s 2026-03-05 21:39:42.071401 | aio | Gathering Facts --------------------------------------------------------- 1.17s 2026-03-05 21:39:42.071600 | aio | Configure short hostname ------------------------------------------------ 0.72s 2026-03-05 21:39:42.071801 | aio | Start loop devices ------------------------------------------------------ 0.70s 2026-03-05 21:39:42.071940 | aio | Gathering Facts --------------------------------------------------------- 0.69s 2026-03-05 21:39:42.072152 | aio | Set permissions on loopback devices ------------------------------------- 0.68s 2026-03-05 21:39:42.072222 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.65s 2026-03-05 21:39:42.072343 | aio | Start up service -------------------------------------------------------- 0.55s 2026-03-05 21:39:42.072464 | aio | Create devices for Ceph ------------------------------------------------- 0.55s 2026-03-05 21:39:42.072585 | aio | Generate lvm.conf ------------------------------------------------------- 0.32s 2026-03-05 21:39:42.072705 | aio | Ensure hostname inside hosts file --------------------------------------- 0.27s 2026-03-05 21:39:42.072828 | aio | Get list of all loopback devices ---------------------------------------- 0.19s 2026-03-05 21:39:42.072951 | aio | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-03-05 21:39:42.129641 | aio | INFO [default > prepare] Executed: Successful 2026-03-05 21:39:42.138823 | aio | INFO [default > converge] Executing 2026-03-05 21:39:42.918505 | aio | 2026-03-05 21:39:42.918674 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 21:39:42.918858 | aio | 2026-03-05 21:39:42.919084 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:39:42.919287 | aio | Thursday 05 March 2026 21:39:42 +0000 (0:00:00.046) 0:00:00.046 ******** 2026-03-05 21:39:44.032514 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 21:39:44.032705 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:39:44.032909 | aio | interpreter could change the meaning of that path. See 2026-03-05 21:39:44.033114 | aio | https://docs.ansible.com/ansible- 2026-03-05 21:39:44.033314 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:39:44.047038 | aio | ok: [aio] 2026-03-05 21:39:44.047241 | aio | 2026-03-05 21:39:44.047517 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:39:44.047720 | aio | Thursday 05 March 2026 21:39:44 +0000 (0:00:01.128) 0:00:01.175 ******** 2026-03-05 21:39:44.320588 | aio | ok: [aio] 2026-03-05 21:39:44.320729 | aio | 2026-03-05 21:39:44.320943 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:39:44.321150 | aio | Thursday 05 March 2026 21:39:44 +0000 (0:00:00.273) 0:00:01.448 ******** 2026-03-05 21:39:44.352591 | aio | skipping: [aio] 2026-03-05 21:39:44.352786 | aio | 2026-03-05 21:39:44.353009 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:39:44.353231 | aio | Thursday 05 March 2026 21:39:44 +0000 (0:00:00.031) 0:00:01.480 ******** 2026-03-05 21:39:44.648409 | aio | changed: [aio] 2026-03-05 21:39:44.648519 | aio | 2026-03-05 21:39:44.648532 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:39:44.648628 | aio | Thursday 05 March 2026 21:39:44 +0000 (0:00:00.295) 0:00:01.776 ******** 2026-03-05 21:39:44.739649 | aio | ok: [aio] => { 2026-03-05 21:39:44.739814 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:39:44.740030 | aio | } 2026-03-05 21:39:44.740212 | aio | 2026-03-05 21:39:44.740409 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:39:44.740607 | aio | Thursday 05 March 2026 21:39:44 +0000 (0:00:00.091) 0:00:01.867 ******** 2026-03-05 21:39:45.326926 | aio | changed: [aio] 2026-03-05 21:39:45.327096 | aio | 2026-03-05 21:39:45.327307 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:39:45.327506 | aio | Thursday 05 March 2026 21:39:45 +0000 (0:00:00.587) 0:00:02.454 ******** 2026-03-05 21:39:45.365694 | aio | skipping: [aio] 2026-03-05 21:39:45.365879 | aio | 2026-03-05 21:39:45.366094 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:39:45.366300 | aio | Thursday 05 March 2026 21:39:45 +0000 (0:00:00.039) 0:00:02.493 ******** 2026-03-05 21:39:45.414059 | aio | skipping: [aio] 2026-03-05 21:39:45.414140 | aio | 2026-03-05 21:39:45.414279 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:39:45.414410 | aio | Thursday 05 March 2026 21:39:45 +0000 (0:00:00.048) 0:00:02.542 ******** 2026-03-05 21:39:45.608439 | aio | ok: [aio] 2026-03-05 21:39:45.608671 | aio | 2026-03-05 21:39:45.608924 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:39:45.609181 | aio | Thursday 05 March 2026 21:39:45 +0000 (0:00:00.194) 0:00:02.736 ******** 2026-03-05 21:39:46.687461 | aio | ok: [aio] 2026-03-05 21:39:46.687703 | aio | 2026-03-05 21:39:46.687923 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:39:46.688166 | aio | Thursday 05 March 2026 21:39:46 +0000 (0:00:01.079) 0:00:03.815 ******** 2026-03-05 21:39:46.759492 | aio | ok: [aio] => { 2026-03-05 21:39:46.759768 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:39:46.760041 | aio | } 2026-03-05 21:39:46.760271 | aio | 2026-03-05 21:39:46.760532 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:39:46.760789 | aio | Thursday 05 March 2026 21:39:46 +0000 (0:00:00.072) 0:00:03.887 ******** 2026-03-05 21:39:47.407596 | aio | changed: [aio] 2026-03-05 21:39:47.407756 | aio | 2026-03-05 21:39:47.407994 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:39:47.408240 | aio | Thursday 05 March 2026 21:39:47 +0000 (0:00:00.647) 0:00:04.535 ******** 2026-03-05 21:39:50.311746 | aio | changed: [aio] 2026-03-05 21:39:50.312165 | aio | 2026-03-05 21:39:50.312477 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:39:50.312758 | aio | Thursday 05 March 2026 21:39:50 +0000 (0:00:02.904) 0:00:07.439 ******** 2026-03-05 21:39:50.340796 | aio | skipping: [aio] 2026-03-05 21:39:50.341112 | aio | 2026-03-05 21:39:50.341391 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:39:50.341755 | aio | Thursday 05 March 2026 21:39:50 +0000 (0:00:00.027) 0:00:07.466 ******** 2026-03-05 21:39:50.368461 | aio | skipping: [aio] 2026-03-05 21:39:50.368501 | aio | 2026-03-05 21:39:50.368612 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:39:50.368887 | aio | Thursday 05 March 2026 21:39:50 +0000 (0:00:00.027) 0:00:07.494 ******** 2026-03-05 21:39:50.396433 | aio | skipping: [aio] 2026-03-05 21:39:50.396563 | aio | 2026-03-05 21:39:50.396692 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:39:50.396814 | aio | Thursday 05 March 2026 21:39:50 +0000 (0:00:00.028) 0:00:07.522 ******** 2026-03-05 21:39:55.276665 | aio | changed: [aio] 2026-03-05 21:39:55.276735 | aio | 2026-03-05 21:39:55.276934 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:39:55.276971 | aio | Thursday 05 March 2026 21:39:55 +0000 (0:00:04.881) 0:00:12.404 ******** 2026-03-05 21:39:55.788233 | aio | changed: [aio] 2026-03-05 21:39:55.788321 | aio | 2026-03-05 21:39:55.788337 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:39:55.788489 | aio | Thursday 05 March 2026 21:39:55 +0000 (0:00:00.511) 0:00:12.916 ******** 2026-03-05 21:39:56.648658 | aio | changed: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 21:39:56.648730 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:39:56.648809 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:39:56.649275 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:39:56.649447 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:39:56.649454 | aio | 2026-03-05 21:39:56.649460 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:39:56.649464 | aio | Thursday 05 March 2026 21:39:56 +0000 (0:00:00.860) 0:00:13.776 ******** 2026-03-05 21:39:57.176791 | aio | changed: [aio] 2026-03-05 21:39:57.176840 | aio | 2026-03-05 21:39:57.176848 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:39:57.176855 | aio | Thursday 05 March 2026 21:39:57 +0000 (0:00:00.518) 0:00:14.295 ******** 2026-03-05 21:39:57.176861 | aio | 2026-03-05 21:39:57.176866 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:39:57.176872 | aio | Thursday 05 March 2026 21:39:57 +0000 (0:00:00.008) 0:00:14.304 ******** 2026-03-05 21:39:58.067606 | aio | ok: [aio] 2026-03-05 21:39:58.067658 | aio | 2026-03-05 21:39:58.067767 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 21:39:58.067899 | aio | Thursday 05 March 2026 21:39:58 +0000 (0:00:00.891) 0:00:15.195 ******** 2026-03-05 21:39:58.494594 | aio | changed: [aio] 2026-03-05 21:39:58.494674 | aio | 2026-03-05 21:39:58.494733 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:39:58.494856 | aio | Thursday 05 March 2026 21:39:58 +0000 (0:00:00.426) 0:00:15.622 ******** 2026-03-05 21:39:59.020314 | aio | changed: [aio] 2026-03-05 21:39:59.020380 | aio | 2026-03-05 21:39:59.020580 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:39:59.020627 | aio | Thursday 05 March 2026 21:39:59 +0000 (0:00:00.525) 0:00:16.148 ******** 2026-03-05 21:39:59.215504 | aio | ok: [aio] 2026-03-05 21:39:59.215547 | aio | 2026-03-05 21:39:59.215553 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:39:59.215566 | aio | Thursday 05 March 2026 21:39:59 +0000 (0:00:00.195) 0:00:16.343 ******** 2026-03-05 21:39:59.284013 | aio | ok: [aio] => { 2026-03-05 21:39:59.284039 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:39:59.284045 | aio | } 2026-03-05 21:39:59.284049 | aio | 2026-03-05 21:39:59.284053 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:39:59.284057 | aio | Thursday 05 March 2026 21:39:59 +0000 (0:00:00.068) 0:00:16.412 ******** 2026-03-05 21:40:00.107971 | aio | changed: [aio] 2026-03-05 21:40:00.108069 | aio | 2026-03-05 21:40:00.108108 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:40:00.108241 | aio | Thursday 05 March 2026 21:40:00 +0000 (0:00:00.824) 0:00:17.236 ******** 2026-03-05 21:40:04.426898 | aio | changed: [aio] 2026-03-05 21:40:04.426959 | aio | 2026-03-05 21:40:04.427056 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:40:04.427158 | aio | Thursday 05 March 2026 21:40:04 +0000 (0:00:04.318) 0:00:21.555 ******** 2026-03-05 21:40:05.320285 | aio | ok: [aio] 2026-03-05 21:40:05.320386 | aio | 2026-03-05 21:40:05.320398 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:40:05.320513 | aio | Thursday 05 March 2026 21:40:05 +0000 (0:00:00.893) 0:00:22.448 ******** 2026-03-05 21:40:05.678713 | aio | changed: [aio] 2026-03-05 21:40:05.678774 | aio | 2026-03-05 21:40:05.678984 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:40:05.679023 | aio | Thursday 05 March 2026 21:40:05 +0000 (0:00:00.358) 0:00:22.806 ******** 2026-03-05 21:40:06.112464 | aio | changed: [aio] 2026-03-05 21:40:06.112532 | aio | 2026-03-05 21:40:06.112617 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:40:06.112745 | aio | Thursday 05 March 2026 21:40:06 +0000 (0:00:00.433) 0:00:23.240 ******** 2026-03-05 21:40:06.653148 | aio | changed: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 21:40:06.653218 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:40:06.653277 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:40:06.653597 | aio | 2026-03-05 21:40:06.653645 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:40:06.653651 | aio | Thursday 05 March 2026 21:40:06 +0000 (0:00:00.540) 0:00:23.781 ******** 2026-03-05 21:40:07.087952 | aio | changed: [aio] 2026-03-05 21:40:07.088064 | aio | 2026-03-05 21:40:07.088380 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:40:07.088424 | aio | Thursday 05 March 2026 21:40:07 +0000 (0:00:00.434) 0:00:24.216 ******** 2026-03-05 21:40:07.540161 | aio | changed: [aio] 2026-03-05 21:40:07.540228 | aio | 2026-03-05 21:40:07.540723 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:40:07.540768 | aio | Thursday 05 March 2026 21:40:07 +0000 (0:00:00.445) 0:00:24.661 ******** 2026-03-05 21:40:07.540774 | aio | 2026-03-05 21:40:07.540779 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:40:07.540783 | aio | Thursday 05 March 2026 21:40:07 +0000 (0:00:00.006) 0:00:24.668 ******** 2026-03-05 21:40:08.215491 | aio | ok: [aio] 2026-03-05 21:40:08.215532 | aio | 2026-03-05 21:40:08.215538 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 21:40:08.215543 | aio | Thursday 05 March 2026 21:40:08 +0000 (0:00:00.675) 0:00:25.343 ******** 2026-03-05 21:40:11.268130 | aio | changed: [aio] 2026-03-05 21:40:11.268533 | aio | 2026-03-05 21:40:11.268553 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:40:11.268559 | aio | Thursday 05 March 2026 21:40:11 +0000 (0:00:03.052) 0:00:28.396 ******** 2026-03-05 21:40:11.791703 | aio | changed: [aio] 2026-03-05 21:40:11.791761 | aio | 2026-03-05 21:40:11.791854 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:40:11.791995 | aio | Thursday 05 March 2026 21:40:11 +0000 (0:00:00.523) 0:00:28.920 ******** 2026-03-05 21:40:11.837135 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:40:11.837412 | aio | 2026-03-05 21:40:11.837437 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:40:11.837443 | aio | Thursday 05 March 2026 21:40:11 +0000 (0:00:00.045) 0:00:28.965 ******** 2026-03-05 21:40:16.631911 | aio | changed: [aio] 2026-03-05 21:40:16.631957 | aio | 2026-03-05 21:40:16.631962 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:40:16.631967 | aio | Thursday 05 March 2026 21:40:16 +0000 (0:00:04.794) 0:00:33.759 ******** 2026-03-05 21:40:17.246620 | aio | ok: [aio] => (item=chronyd) 2026-03-05 21:40:17.246690 | aio | ok: [aio] => (item=sshd) 2026-03-05 21:40:17.246755 | aio | 2026-03-05 21:40:17.246973 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:40:17.247124 | aio | Thursday 05 March 2026 21:40:17 +0000 (0:00:00.614) 0:00:34.374 ******** 2026-03-05 21:40:17.525997 | aio | changed: [aio] 2026-03-05 21:40:17.526066 | aio | 2026-03-05 21:40:17.526147 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:40:17.526277 | aio | Thursday 05 March 2026 21:40:17 +0000 (0:00:00.279) 0:00:34.654 ******** 2026-03-05 21:40:17.713226 | aio | ok: [aio] 2026-03-05 21:40:17.713278 | aio | 2026-03-05 21:40:17.713381 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:40:17.713496 | aio | Thursday 05 March 2026 21:40:17 +0000 (0:00:00.187) 0:00:34.841 ******** 2026-03-05 21:40:18.142434 | aio | changed: [aio] 2026-03-05 21:40:18.142497 | aio | 2026-03-05 21:40:18.142551 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:40:18.142649 | aio | Thursday 05 March 2026 21:40:18 +0000 (0:00:00.429) 0:00:35.270 ******** 2026-03-05 21:40:18.456500 | aio | changed: [aio] 2026-03-05 21:40:18.456562 | aio | 2026-03-05 21:40:18.456624 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:40:18.456758 | aio | Thursday 05 March 2026 21:40:18 +0000 (0:00:00.313) 0:00:35.584 ******** 2026-03-05 21:40:18.593853 | aio | ok: [aio] 2026-03-05 21:40:18.593924 | aio | 2026-03-05 21:40:18.593939 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:40:18.594080 | aio | Thursday 05 March 2026 21:40:18 +0000 (0:00:00.137) 0:00:35.722 ******** 2026-03-05 21:40:18.808797 | aio | ok: [aio] => (item=aio) 2026-03-05 21:40:18.808866 | aio | 2026-03-05 21:40:18.809113 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:40:18.809190 | aio | Thursday 05 March 2026 21:40:18 +0000 (0:00:00.214) 0:00:35.936 ******** 2026-03-05 21:40:18.855985 | aio | ok: [aio] 2026-03-05 21:40:18.856135 | aio | 2026-03-05 21:40:18.856151 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:40:18.856265 | aio | Thursday 05 March 2026 21:40:18 +0000 (0:00:00.047) 0:00:35.983 ******** 2026-03-05 21:40:18.958857 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for aio 2026-03-05 21:40:18.958903 | aio | 2026-03-05 21:40:18.959142 | aio | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-05 21:40:18.959201 | aio | Thursday 05 March 2026 21:40:18 +0000 (0:00:00.103) 0:00:36.087 ******** 2026-03-05 21:40:19.242386 | aio | changed: [aio] 2026-03-05 21:40:19.242445 | aio | 2026-03-05 21:40:19.242724 | aio | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-05 21:40:19.242745 | aio | Thursday 05 March 2026 21:40:19 +0000 (0:00:00.283) 0:00:36.370 ******** 2026-03-05 21:40:19.865338 | aio | changed: [aio] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-05 21:40:19.865411 | aio | changed: [aio] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-05 21:40:19.865485 | aio | changed: [aio] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-05 21:40:19.865763 | aio | 2026-03-05 21:40:19.865807 | aio | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-05 21:40:19.865812 | aio | Thursday 05 March 2026 21:40:19 +0000 (0:00:00.623) 0:00:36.993 ******** 2026-03-05 21:42:36.855538 | aio | ok: [aio] 2026-03-05 21:42:36.855608 | aio | 2026-03-05 21:42:36.855822 | aio | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-05 21:42:36.855865 | aio | Thursday 05 March 2026 21:42:36 +0000 (0:02:16.990) 0:02:53.983 ******** 2026-03-05 21:42:37.050133 | aio | changed: [aio] 2026-03-05 21:42:37.050208 | aio | 2026-03-05 21:42:37.050462 | aio | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-05 21:42:37.050502 | aio | Thursday 05 March 2026 21:42:37 +0000 (0:00:00.194) 0:02:54.178 ******** 2026-03-05 21:42:37.083034 | aio | ok: [aio] 2026-03-05 21:42:37.083113 | aio | 2026-03-05 21:42:37.083343 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:42:37.083390 | aio | Thursday 05 March 2026 21:42:37 +0000 (0:00:00.033) 0:02:54.211 ******** 2026-03-05 21:42:37.148308 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 21:42:37.148382 | aio | 2026-03-05 21:42:37.148487 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:42:37.148587 | aio | Thursday 05 March 2026 21:42:37 +0000 (0:00:00.065) 0:02:54.276 ******** 2026-03-05 21:42:42.633149 | aio | ok: [aio] 2026-03-05 21:42:42.633211 | aio | 2026-03-05 21:42:42.633436 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:42:42.633661 | aio | Thursday 05 March 2026 21:42:42 +0000 (0:00:05.484) 0:02:59.761 ******** 2026-03-05 21:42:42.677862 | aio | ok: [aio] => (item=aio) 2026-03-05 21:42:42.677978 | aio | 2026-03-05 21:42:42.678081 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:42:42.678173 | aio | Thursday 05 March 2026 21:42:42 +0000 (0:00:00.044) 0:02:59.806 ******** 2026-03-05 21:42:43.011114 | aio | ok: [aio] 2026-03-05 21:42:43.011233 | aio | 2026-03-05 21:42:43.011378 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:42:43.011514 | aio | Thursday 05 March 2026 21:42:43 +0000 (0:00:00.333) 0:03:00.139 ******** 2026-03-05 21:42:49.502270 | aio | ok: [aio] 2026-03-05 21:42:49.502439 | aio | 2026-03-05 21:42:49.502656 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:42:49.502861 | aio | Thursday 05 March 2026 21:42:49 +0000 (0:00:06.491) 0:03:06.630 ******** 2026-03-05 21:43:01.507681 | aio | changed: [aio] 2026-03-05 21:43:01.507785 | aio | 2026-03-05 21:43:01.507798 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:43:01.507819 | aio | Thursday 05 March 2026 21:43:01 +0000 (0:00:12.004) 0:03:18.635 ******** 2026-03-05 21:43:15.799744 | aio | ok: [aio] 2026-03-05 21:43:15.799822 | aio | 2026-03-05 21:43:15.799876 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:43:15.800026 | aio | Thursday 05 March 2026 21:43:15 +0000 (0:00:14.292) 0:03:32.927 ******** 2026-03-05 21:43:15.863629 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 21:43:15.863670 | aio | 2026-03-05 21:43:15.863957 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:43:15.864054 | aio | Thursday 05 March 2026 21:43:15 +0000 (0:00:00.063) 0:03:32.991 ******** 2026-03-05 21:43:15.899611 | aio | skipping: [aio] 2026-03-05 21:43:15.899967 | aio | 2026-03-05 21:43:15.900042 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:43:15.900049 | aio | Thursday 05 March 2026 21:43:15 +0000 (0:00:00.036) 0:03:33.027 ******** 2026-03-05 21:43:15.946813 | aio | skipping: [aio] => (item=aio) 2026-03-05 21:43:15.946873 | aio | skipping: [aio] 2026-03-05 21:43:15.947203 | aio | 2026-03-05 21:43:15.947264 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:43:15.947271 | aio | Thursday 05 March 2026 21:43:15 +0000 (0:00:00.047) 0:03:33.074 ******** 2026-03-05 21:43:16.192016 | aio | ok: [aio] 2026-03-05 21:43:16.192142 | aio | 2026-03-05 21:43:16.192154 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:43:16.192246 | aio | Thursday 05 March 2026 21:43:16 +0000 (0:00:00.245) 0:03:33.319 ******** 2026-03-05 21:43:22.661763 | aio | ok: [aio] 2026-03-05 21:43:22.661892 | aio | 2026-03-05 21:43:22.662143 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:43:22.662410 | aio | Thursday 05 March 2026 21:43:22 +0000 (0:00:06.469) 0:03:39.789 ******** 2026-03-05 21:43:34.679026 | aio | changed: [aio] 2026-03-05 21:43:34.679448 | aio | 2026-03-05 21:43:34.679466 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:43:34.679477 | aio | Thursday 05 March 2026 21:43:34 +0000 (0:00:12.017) 0:03:51.806 ******** 2026-03-05 21:43:40.804486 | aio | ok: [aio] 2026-03-05 21:43:40.804560 | aio | 2026-03-05 21:43:40.804768 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:43:40.804813 | aio | Thursday 05 March 2026 21:43:40 +0000 (0:00:06.125) 0:03:57.932 ******** 2026-03-05 21:43:48.647075 | aio | changed: [aio] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:43:48.647153 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-03-05 21:43:48.647231 | aio | changed: [aio] => (item={'name': 'prometheus'}) 2026-03-05 21:43:48.647323 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-03-05 21:43:48.647410 | aio | 2026-03-05 21:43:48.647506 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:43:48.647586 | aio | 2026-03-05 21:43:48.647679 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:43:48.647773 | aio | Thursday 05 March 2026 21:43:48 +0000 (0:00:07.842) 0:04:05.775 ******** 2026-03-05 21:43:49.511723 | aio | ok: [aio] 2026-03-05 21:43:49.511797 | aio | 2026-03-05 21:43:49.511879 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:43:49.512008 | aio | Thursday 05 March 2026 21:43:49 +0000 (0:00:00.862) 0:04:06.637 ******** 2026-03-05 21:43:49.709728 | aio | ok: [aio] 2026-03-05 21:43:49.709802 | aio | 2026-03-05 21:43:49.709883 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:43:49.709979 | aio | Thursday 05 March 2026 21:43:49 +0000 (0:00:00.200) 0:04:06.838 ******** 2026-03-05 21:43:49.742546 | aio | skipping: [aio] 2026-03-05 21:43:49.742597 | aio | 2026-03-05 21:43:49.742708 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:43:49.742804 | aio | Thursday 05 March 2026 21:43:49 +0000 (0:00:00.032) 0:04:06.870 ******** 2026-03-05 21:43:49.952640 | aio | ok: [aio] 2026-03-05 21:43:49.952711 | aio | 2026-03-05 21:43:49.952794 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:43:49.952889 | aio | Thursday 05 March 2026 21:43:49 +0000 (0:00:00.209) 0:04:07.080 ******** 2026-03-05 21:43:50.007396 | aio | ok: [aio] => { 2026-03-05 21:43:50.007533 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:43:50.007665 | aio | } 2026-03-05 21:43:50.007787 | aio | 2026-03-05 21:43:50.007927 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:43:50.008097 | aio | Thursday 05 March 2026 21:43:50 +0000 (0:00:00.054) 0:04:07.135 ******** 2026-03-05 21:43:50.322691 | aio | ok: [aio] 2026-03-05 21:43:50.322761 | aio | 2026-03-05 21:43:50.322848 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:43:50.322949 | aio | Thursday 05 March 2026 21:43:50 +0000 (0:00:00.315) 0:04:07.450 ******** 2026-03-05 21:43:50.361892 | aio | skipping: [aio] 2026-03-05 21:43:50.361955 | aio | 2026-03-05 21:43:50.362051 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:43:50.362145 | aio | Thursday 05 March 2026 21:43:50 +0000 (0:00:00.039) 0:04:07.490 ******** 2026-03-05 21:43:50.400675 | aio | skipping: [aio] 2026-03-05 21:43:50.400723 | aio | 2026-03-05 21:43:50.400822 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:43:50.400918 | aio | Thursday 05 March 2026 21:43:50 +0000 (0:00:00.038) 0:04:07.529 ******** 2026-03-05 21:43:50.605693 | aio | ok: [aio] 2026-03-05 21:43:50.605773 | aio | 2026-03-05 21:43:50.605821 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:43:50.605924 | aio | Thursday 05 March 2026 21:43:50 +0000 (0:00:00.204) 0:04:07.733 ******** 2026-03-05 21:43:51.841144 | aio | ok: [aio] 2026-03-05 21:43:51.841210 | aio | 2026-03-05 21:43:51.841258 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:43:51.841360 | aio | Thursday 05 March 2026 21:43:51 +0000 (0:00:01.235) 0:04:08.969 ******** 2026-03-05 21:43:51.909090 | aio | ok: [aio] => { 2026-03-05 21:43:51.909172 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:43:51.909271 | aio | } 2026-03-05 21:43:51.909356 | aio | 2026-03-05 21:43:51.909460 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:43:51.909555 | aio | Thursday 05 March 2026 21:43:51 +0000 (0:00:00.067) 0:04:09.036 ******** 2026-03-05 21:43:52.284708 | aio | ok: [aio] 2026-03-05 21:43:52.284768 | aio | 2026-03-05 21:43:52.284891 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:43:52.285029 | aio | Thursday 05 March 2026 21:43:52 +0000 (0:00:00.375) 0:04:09.412 ******** 2026-03-05 21:43:54.222000 | aio | ok: [aio] 2026-03-05 21:43:54.222078 | aio | 2026-03-05 21:43:54.222145 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:43:54.222237 | aio | Thursday 05 March 2026 21:43:54 +0000 (0:00:01.937) 0:04:11.349 ******** 2026-03-05 21:43:54.252083 | aio | skipping: [aio] 2026-03-05 21:43:54.252222 | aio | 2026-03-05 21:43:54.252364 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:43:54.252494 | aio | Thursday 05 March 2026 21:43:54 +0000 (0:00:00.030) 0:04:11.380 ******** 2026-03-05 21:43:54.284330 | aio | skipping: [aio] 2026-03-05 21:43:54.284409 | aio | 2026-03-05 21:43:54.284428 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:43:54.284462 | aio | Thursday 05 March 2026 21:43:54 +0000 (0:00:00.032) 0:04:11.412 ******** 2026-03-05 21:43:54.315515 | aio | skipping: [aio] 2026-03-05 21:43:54.315555 | aio | 2026-03-05 21:43:54.315717 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:43:54.315838 | aio | Thursday 05 March 2026 21:43:54 +0000 (0:00:00.031) 0:04:11.443 ******** 2026-03-05 21:43:55.514623 | aio | ok: [aio] 2026-03-05 21:43:55.514699 | aio | 2026-03-05 21:43:55.514816 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:43:55.514958 | aio | Thursday 05 March 2026 21:43:55 +0000 (0:00:01.198) 0:04:12.642 ******** 2026-03-05 21:43:55.924975 | aio | ok: [aio] 2026-03-05 21:43:55.925032 | aio | 2026-03-05 21:43:55.925093 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:43:55.925182 | aio | Thursday 05 March 2026 21:43:55 +0000 (0:00:00.410) 0:04:13.053 ******** 2026-03-05 21:43:56.783325 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 21:43:56.783389 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:43:56.783488 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:43:56.783589 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:43:56.783687 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:43:56.783773 | aio | 2026-03-05 21:43:56.783863 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:43:56.783990 | aio | Thursday 05 March 2026 21:43:56 +0000 (0:00:00.858) 0:04:13.911 ******** 2026-03-05 21:43:57.280348 | aio | ok: [aio] 2026-03-05 21:43:57.280440 | aio | 2026-03-05 21:43:57.280590 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:43:57.280729 | aio | Thursday 05 March 2026 21:43:57 +0000 (0:00:00.488) 0:04:14.400 ******** 2026-03-05 21:43:57.280852 | aio | 2026-03-05 21:43:57.280992 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:43:57.281126 | aio | Thursday 05 March 2026 21:43:57 +0000 (0:00:00.008) 0:04:14.408 ******** 2026-03-05 21:43:57.626950 | aio | ok: [aio] 2026-03-05 21:43:57.627017 | aio | 2026-03-05 21:43:57.627078 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:43:57.627163 | aio | Thursday 05 March 2026 21:43:57 +0000 (0:00:00.347) 0:04:14.755 ******** 2026-03-05 21:43:57.823116 | aio | ok: [aio] 2026-03-05 21:43:57.823189 | aio | 2026-03-05 21:43:57.823204 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:43:57.823308 | aio | Thursday 05 March 2026 21:43:57 +0000 (0:00:00.195) 0:04:14.951 ******** 2026-03-05 21:43:57.871645 | aio | ok: [aio] => { 2026-03-05 21:43:57.871768 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:43:57.871893 | aio | } 2026-03-05 21:43:57.872032 | aio | 2026-03-05 21:43:57.872168 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:43:57.872299 | aio | Thursday 05 March 2026 21:43:57 +0000 (0:00:00.048) 0:04:15.000 ******** 2026-03-05 21:43:58.221128 | aio | ok: [aio] 2026-03-05 21:43:58.221341 | aio | 2026-03-05 21:43:58.221573 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:43:58.221781 | aio | Thursday 05 March 2026 21:43:58 +0000 (0:00:00.348) 0:04:15.348 ******** 2026-03-05 21:44:01.295252 | aio | ok: [aio] 2026-03-05 21:44:01.295328 | aio | 2026-03-05 21:44:01.295464 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:44:01.295597 | aio | Thursday 05 March 2026 21:44:01 +0000 (0:00:03.074) 0:04:18.423 ******** 2026-03-05 21:44:02.240470 | aio | ok: [aio] 2026-03-05 21:44:02.240741 | aio | 2026-03-05 21:44:02.240754 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:44:02.240816 | aio | Thursday 05 March 2026 21:44:02 +0000 (0:00:00.945) 0:04:19.368 ******** 2026-03-05 21:44:02.424127 | aio | ok: [aio] 2026-03-05 21:44:02.424228 | aio | 2026-03-05 21:44:02.424361 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:44:02.424493 | aio | Thursday 05 March 2026 21:44:02 +0000 (0:00:00.183) 0:04:19.552 ******** 2026-03-05 21:44:02.834932 | aio | ok: [aio] 2026-03-05 21:44:02.834997 | aio | 2026-03-05 21:44:02.835114 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:44:02.835240 | aio | Thursday 05 March 2026 21:44:02 +0000 (0:00:00.410) 0:04:19.963 ******** 2026-03-05 21:44:03.369451 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 21:44:03.369515 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:44:03.369574 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:44:03.369651 | aio | 2026-03-05 21:44:03.369764 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:44:03.369861 | aio | Thursday 05 March 2026 21:44:03 +0000 (0:00:00.534) 0:04:20.497 ******** 2026-03-05 21:44:03.775706 | aio | ok: [aio] 2026-03-05 21:44:03.775799 | aio | 2026-03-05 21:44:03.775936 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:44:03.776132 | aio | Thursday 05 March 2026 21:44:03 +0000 (0:00:00.405) 0:04:20.903 ******** 2026-03-05 21:44:04.197496 | aio | ok: [aio] 2026-03-05 21:44:04.197563 | aio | 2026-03-05 21:44:04.197643 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:44:04.197741 | aio | Thursday 05 March 2026 21:44:04 +0000 (0:00:00.416) 0:04:21.319 ******** 2026-03-05 21:44:04.197823 | aio | 2026-03-05 21:44:04.197925 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:44:04.198003 | aio | Thursday 05 March 2026 21:44:04 +0000 (0:00:00.006) 0:04:21.325 ******** 2026-03-05 21:44:04.560805 | aio | ok: [aio] 2026-03-05 21:44:04.560870 | aio | 2026-03-05 21:44:04.560933 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:44:04.561022 | aio | Thursday 05 March 2026 21:44:04 +0000 (0:00:00.363) 0:04:21.689 ******** 2026-03-05 21:44:04.610128 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:44:04.610179 | aio | 2026-03-05 21:44:04.610316 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:44:04.610433 | aio | Thursday 05 March 2026 21:44:04 +0000 (0:00:00.049) 0:04:21.738 ******** 2026-03-05 21:44:05.531432 | aio | ok: [aio] 2026-03-05 21:44:05.531501 | aio | 2026-03-05 21:44:05.531679 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:44:05.531822 | aio | Thursday 05 March 2026 21:44:05 +0000 (0:00:00.921) 0:04:22.659 ******** 2026-03-05 21:44:06.157575 | aio | ok: [aio] => (item=chronyd) 2026-03-05 21:44:06.157677 | aio | ok: [aio] => (item=sshd) 2026-03-05 21:44:06.157793 | aio | 2026-03-05 21:44:06.157928 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:44:06.158055 | aio | Thursday 05 March 2026 21:44:06 +0000 (0:00:00.626) 0:04:23.285 ******** 2026-03-05 21:44:06.467410 | aio | ok: [aio] 2026-03-05 21:44:06.467511 | aio | 2026-03-05 21:44:06.467638 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:44:06.467803 | aio | Thursday 05 March 2026 21:44:06 +0000 (0:00:00.309) 0:04:23.595 ******** 2026-03-05 21:44:06.661927 | aio | ok: [aio] 2026-03-05 21:44:06.662008 | aio | 2026-03-05 21:44:06.662186 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:44:06.662261 | aio | Thursday 05 March 2026 21:44:06 +0000 (0:00:00.194) 0:04:23.790 ******** 2026-03-05 21:44:06.904448 | aio | ok: [aio] 2026-03-05 21:44:06.904507 | aio | 2026-03-05 21:44:06.904701 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:44:06.904791 | aio | Thursday 05 March 2026 21:44:06 +0000 (0:00:00.242) 0:04:24.032 ******** 2026-03-05 21:44:07.102699 | aio | ok: [aio] 2026-03-05 21:44:07.102742 | aio | 2026-03-05 21:44:07.102845 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:44:07.102935 | aio | Thursday 05 March 2026 21:44:07 +0000 (0:00:00.198) 0:04:24.230 ******** 2026-03-05 21:44:07.312728 | aio | ok: [aio] => (item=aio) 2026-03-05 21:44:07.312791 | aio | 2026-03-05 21:44:07.312932 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:44:07.313065 | aio | Thursday 05 March 2026 21:44:07 +0000 (0:00:00.209) 0:04:24.440 ******** 2026-03-05 21:44:07.348259 | aio | ok: [aio] 2026-03-05 21:44:07.348347 | aio | 2026-03-05 21:44:07.348477 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:44:07.348606 | aio | Thursday 05 March 2026 21:44:07 +0000 (0:00:00.035) 0:04:24.476 ******** 2026-03-05 21:44:07.402708 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 21:44:07.402771 | aio | 2026-03-05 21:44:07.402877 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:44:07.402969 | aio | Thursday 05 March 2026 21:44:07 +0000 (0:00:00.054) 0:04:24.531 ******** 2026-03-05 21:44:07.452445 | aio | skipping: [aio] 2026-03-05 21:44:07.452527 | aio | 2026-03-05 21:44:07.452680 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:44:07.452799 | aio | Thursday 05 March 2026 21:44:07 +0000 (0:00:00.049) 0:04:24.580 ******** 2026-03-05 21:44:07.494161 | aio | skipping: [aio] => (item=aio) 2026-03-05 21:44:07.494267 | aio | skipping: [aio] 2026-03-05 21:44:07.494387 | aio | 2026-03-05 21:44:07.494505 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:44:07.494631 | aio | Thursday 05 March 2026 21:44:07 +0000 (0:00:00.041) 0:04:24.622 ******** 2026-03-05 21:44:07.740119 | aio | ok: [aio] 2026-03-05 21:44:07.740157 | aio | 2026-03-05 21:44:07.740587 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:44:07.740693 | aio | Thursday 05 March 2026 21:44:07 +0000 (0:00:00.245) 0:04:24.868 ******** 2026-03-05 21:44:20.108468 | aio | ok: [aio] 2026-03-05 21:44:20.108667 | aio | 2026-03-05 21:44:20.108895 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:44:20.109123 | aio | Thursday 05 March 2026 21:44:20 +0000 (0:00:12.367) 0:04:37.236 ******** 2026-03-05 21:44:24.419544 | aio | ok: [aio] 2026-03-05 21:44:24.419584 | aio | 2026-03-05 21:44:24.419590 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:44:24.419595 | aio | Thursday 05 March 2026 21:44:24 +0000 (0:00:04.311) 0:04:41.547 ******** 2026-03-05 21:44:38.732095 | aio | ok: [aio] 2026-03-05 21:44:38.732153 | aio | 2026-03-05 21:44:38.732268 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:44:38.732409 | aio | Thursday 05 March 2026 21:44:38 +0000 (0:00:14.312) 0:04:55.860 ******** 2026-03-05 21:46:28.327054 | aio | ok: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-03-05 21:46:28.327110 | aio | ok: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-03-05 21:46:28.327117 | aio | ok: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-03-05 21:46:28.327123 | aio | 2026-03-05 21:46:28.327130 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:46:28.327136 | aio | Thursday 05 March 2026 21:46:28 +0000 (0:01:49.593) 0:06:45.454 ******** 2026-03-05 21:46:34.175366 | aio | ok: [aio] 2026-03-05 21:46:34.175487 | aio | 2026-03-05 21:46:34.175504 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:46:34.175656 | aio | Thursday 05 March 2026 21:46:34 +0000 (0:00:05.849) 0:06:51.303 ******** 2026-03-05 21:46:40.348910 | aio | ok: [aio] 2026-03-05 21:46:40.348976 | aio | 2026-03-05 21:46:40.349188 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:46:40.349242 | aio | Thursday 05 March 2026 21:46:40 +0000 (0:00:06.173) 0:06:57.477 ******** 2026-03-05 21:46:40.396691 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-03-05 21:46:40.396733 | aio | 2026-03-05 21:46:40.396979 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:46:40.397029 | aio | Thursday 05 March 2026 21:46:40 +0000 (0:00:00.047) 0:06:57.524 ******** 2026-03-05 21:46:40.432970 | aio | ok: [aio] 2026-03-05 21:46:40.433037 | aio | 2026-03-05 21:46:40.433281 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:46:40.433331 | aio | Thursday 05 March 2026 21:46:40 +0000 (0:00:00.036) 0:06:57.561 ******** 2026-03-05 21:46:46.602512 | aio | ok: [aio] 2026-03-05 21:46:46.602581 | aio | 2026-03-05 21:46:46.602756 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:46:46.602772 | aio | Thursday 05 March 2026 21:46:46 +0000 (0:00:06.169) 0:07:03.730 ******** 2026-03-05 21:46:46.643184 | aio | ok: [aio] 2026-03-05 21:46:46.643271 | aio | 2026-03-05 21:46:46.643510 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:46:46.643550 | aio | Thursday 05 March 2026 21:46:46 +0000 (0:00:00.040) 0:07:03.771 ******** 2026-03-05 21:46:46.688152 | aio | skipping: [aio] => (item=1) 2026-03-05 21:46:46.688246 | aio | skipping: [aio] => (item=1) 2026-03-05 21:46:46.688339 | aio | skipping: [aio] => (item=1) 2026-03-05 21:46:46.688702 | aio | skipping: [aio] 2026-03-05 21:46:46.688722 | aio | 2026-03-05 21:46:46.688727 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:46:46.688732 | aio | Thursday 05 March 2026 21:46:46 +0000 (0:00:00.045) 0:07:03.816 ******** 2026-03-05 21:46:46.721130 | aio | skipping: [aio] 2026-03-05 21:46:46.721183 | aio | 2026-03-05 21:46:46.722518 | aio | PLAY RECAP ********************************************************************* 2026-03-05 21:46:46.722551 | aio | aio : ok=106 changed=29 unreachable=0 failed=0 skipped=18 rescued=0 ignored=0 2026-03-05 21:46:46.722563 | aio | 2026-03-05 21:46:46.722572 | aio | 2026-03-05 21:46:46.722581 | aio | TASKS RECAP ******************************************************************** 2026-03-05 21:46:46.722590 | aio | Thursday 05 March 2026 21:46:46 +0000 (0:00:00.033) 0:07:03.849 ******** 2026-03-05 21:46:46.722599 | aio | =============================================================================== 2026-03-05 21:46:46.722608 | aio | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 136.99s 2026-03-05 21:46:46.722617 | aio | vexxhost.ceph.osd : Install OSDs -------------------------------------- 109.59s 2026-03-05 21:46:46.722626 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.31s 2026-03-05 21:46:46.722635 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.29s 2026-03-05 21:46:46.722644 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 12.37s 2026-03-05 21:46:46.722652 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.02s 2026-03-05 21:46:46.722661 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 12.00s 2026-03-05 21:46:46.722670 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.84s 2026-03-05 21:46:46.722684 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.49s 2026-03-05 21:46:46.722693 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.47s 2026-03-05 21:46:46.723578 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.17s 2026-03-05 21:46:46.723627 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.17s 2026-03-05 21:46:46.723632 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.13s 2026-03-05 21:46:46.723636 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 5.85s 2026-03-05 21:46:46.723640 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.48s 2026-03-05 21:46:46.723644 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 4.88s 2026-03-05 21:46:46.723649 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 4.79s 2026-03-05 21:46:46.723653 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.32s 2026-03-05 21:46:46.723657 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 4.31s 2026-03-05 21:46:46.723661 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.07s 2026-03-05 21:46:46.837206 | aio | INFO [default > converge] Executed: Successful 2026-03-05 21:46:46.845955 | aio | INFO [default > idempotence] Executing 2026-03-05 21:46:47.650220 | aio | 2026-03-05 21:46:47.650585 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 21:46:47.650835 | aio | 2026-03-05 21:46:47.651106 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:46:47.651372 | aio | Thursday 05 March 2026 21:46:47 +0000 (0:00:00.046) 0:00:00.046 ******** 2026-03-05 21:46:48.797888 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 21:46:48.798219 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:46:48.798225 | aio | interpreter could change the meaning of that path. See 2026-03-05 21:46:48.798230 | aio | https://docs.ansible.com/ansible- 2026-03-05 21:46:48.798245 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:46:48.810656 | aio | ok: [aio] 2026-03-05 21:46:48.810714 | aio | 2026-03-05 21:46:48.810726 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:46:48.810736 | aio | Thursday 05 March 2026 21:46:48 +0000 (0:00:01.159) 0:00:01.206 ******** 2026-03-05 21:46:49.085134 | aio | ok: [aio] 2026-03-05 21:46:49.085204 | aio | 2026-03-05 21:46:49.085263 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:46:49.085371 | aio | Thursday 05 March 2026 21:46:49 +0000 (0:00:00.275) 0:00:01.481 ******** 2026-03-05 21:46:49.117415 | aio | skipping: [aio] 2026-03-05 21:46:49.117603 | aio | 2026-03-05 21:46:49.117814 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:46:49.118015 | aio | Thursday 05 March 2026 21:46:49 +0000 (0:00:00.032) 0:00:01.514 ******** 2026-03-05 21:46:49.434053 | aio | ok: [aio] 2026-03-05 21:46:49.434204 | aio | 2026-03-05 21:46:49.434428 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:46:49.434646 | aio | Thursday 05 March 2026 21:46:49 +0000 (0:00:00.316) 0:00:01.830 ******** 2026-03-05 21:46:49.505192 | aio | ok: [aio] => { 2026-03-05 21:46:49.505422 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:46:49.505623 | aio | } 2026-03-05 21:46:49.505839 | aio | 2026-03-05 21:46:49.506035 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:46:49.506240 | aio | Thursday 05 March 2026 21:46:49 +0000 (0:00:00.071) 0:00:01.901 ******** 2026-03-05 21:46:49.932976 | aio | ok: [aio] 2026-03-05 21:46:49.933172 | aio | 2026-03-05 21:46:49.933433 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:46:49.933700 | aio | Thursday 05 March 2026 21:46:49 +0000 (0:00:00.427) 0:00:02.329 ******** 2026-03-05 21:46:49.976417 | aio | skipping: [aio] 2026-03-05 21:46:49.976588 | aio | 2026-03-05 21:46:49.976808 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:46:49.977014 | aio | Thursday 05 March 2026 21:46:49 +0000 (0:00:00.043) 0:00:02.372 ******** 2026-03-05 21:46:50.017005 | aio | skipping: [aio] 2026-03-05 21:46:50.017189 | aio | 2026-03-05 21:46:50.017396 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:46:50.017595 | aio | Thursday 05 March 2026 21:46:50 +0000 (0:00:00.040) 0:00:02.413 ******** 2026-03-05 21:46:50.228512 | aio | ok: [aio] 2026-03-05 21:46:50.228684 | aio | 2026-03-05 21:46:50.228907 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:46:50.229177 | aio | Thursday 05 March 2026 21:46:50 +0000 (0:00:00.210) 0:00:02.624 ******** 2026-03-05 21:46:51.395700 | aio | ok: [aio] 2026-03-05 21:46:51.395878 | aio | 2026-03-05 21:46:51.396150 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:46:51.396366 | aio | Thursday 05 March 2026 21:46:51 +0000 (0:00:01.167) 0:00:03.791 ******** 2026-03-05 21:46:51.471154 | aio | ok: [aio] => { 2026-03-05 21:46:51.471335 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:46:51.471524 | aio | } 2026-03-05 21:46:51.471707 | aio | 2026-03-05 21:46:51.471916 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:46:51.472159 | aio | Thursday 05 March 2026 21:46:51 +0000 (0:00:00.075) 0:00:03.867 ******** 2026-03-05 21:46:51.837344 | aio | ok: [aio] 2026-03-05 21:46:51.837456 | aio | 2026-03-05 21:46:51.837683 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:46:51.837984 | aio | Thursday 05 March 2026 21:46:51 +0000 (0:00:00.366) 0:00:04.233 ******** 2026-03-05 21:46:54.066081 | aio | ok: [aio] 2026-03-05 21:46:54.066148 | aio | 2026-03-05 21:46:54.066160 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:46:54.066186 | aio | Thursday 05 March 2026 21:46:54 +0000 (0:00:02.227) 0:00:06.461 ******** 2026-03-05 21:46:54.095281 | aio | skipping: [aio] 2026-03-05 21:46:54.095641 | aio | 2026-03-05 21:46:54.095721 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:46:54.095728 | aio | Thursday 05 March 2026 21:46:54 +0000 (0:00:00.030) 0:00:06.491 ******** 2026-03-05 21:46:54.123523 | aio | skipping: [aio] 2026-03-05 21:46:54.123859 | aio | 2026-03-05 21:46:54.123917 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:46:54.123924 | aio | Thursday 05 March 2026 21:46:54 +0000 (0:00:00.028) 0:00:06.519 ******** 2026-03-05 21:46:54.154360 | aio | skipping: [aio] 2026-03-05 21:46:54.154697 | aio | 2026-03-05 21:46:54.154721 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:46:54.154727 | aio | Thursday 05 March 2026 21:46:54 +0000 (0:00:00.030) 0:00:06.550 ******** 2026-03-05 21:46:55.453878 | aio | ok: [aio] 2026-03-05 21:46:55.453961 | aio | 2026-03-05 21:46:55.454018 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:46:55.454156 | aio | Thursday 05 March 2026 21:46:55 +0000 (0:00:01.299) 0:00:07.850 ******** 2026-03-05 21:46:55.875708 | aio | ok: [aio] 2026-03-05 21:46:55.875775 | aio | 2026-03-05 21:46:55.875883 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:46:55.876097 | aio | Thursday 05 March 2026 21:46:55 +0000 (0:00:00.421) 0:00:08.272 ******** 2026-03-05 21:46:56.757598 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 21:46:56.757666 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:46:56.758348 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:46:56.758423 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:46:56.758431 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:46:56.758437 | aio | 2026-03-05 21:46:56.758442 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:46:56.758447 | aio | Thursday 05 March 2026 21:46:56 +0000 (0:00:00.880) 0:00:09.153 ******** 2026-03-05 21:46:57.247431 | aio | ok: [aio] 2026-03-05 21:46:57.247544 | aio | 2026-03-05 21:46:57.247557 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:46:57.247940 | aio | Thursday 05 March 2026 21:46:57 +0000 (0:00:00.482) 0:00:09.636 ******** 2026-03-05 21:46:57.248044 | aio | 2026-03-05 21:46:57.248051 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:46:57.248055 | aio | Thursday 05 March 2026 21:46:57 +0000 (0:00:00.007) 0:00:09.644 ******** 2026-03-05 21:46:57.837513 | aio | ok: [aio] 2026-03-05 21:46:57.837585 | aio | 2026-03-05 21:46:57.837648 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:46:57.837777 | aio | Thursday 05 March 2026 21:46:57 +0000 (0:00:00.590) 0:00:10.234 ******** 2026-03-05 21:46:58.034071 | aio | ok: [aio] 2026-03-05 21:46:58.034145 | aio | 2026-03-05 21:46:58.034364 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:46:58.034413 | aio | Thursday 05 March 2026 21:46:58 +0000 (0:00:00.196) 0:00:10.430 ******** 2026-03-05 21:46:58.100088 | aio | ok: [aio] => { 2026-03-05 21:46:58.100163 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:46:58.100554 | aio | } 2026-03-05 21:46:58.100598 | aio | 2026-03-05 21:46:58.100604 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:46:58.100609 | aio | Thursday 05 March 2026 21:46:58 +0000 (0:00:00.065) 0:00:10.496 ******** 2026-03-05 21:46:58.457937 | aio | ok: [aio] 2026-03-05 21:46:58.457999 | aio | 2026-03-05 21:46:58.458287 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:46:58.458309 | aio | Thursday 05 March 2026 21:46:58 +0000 (0:00:00.357) 0:00:10.854 ******** 2026-03-05 21:47:01.518675 | aio | ok: [aio] 2026-03-05 21:47:01.518748 | aio | 2026-03-05 21:47:01.518762 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:47:01.518931 | aio | Thursday 05 March 2026 21:47:01 +0000 (0:00:03.060) 0:00:13.915 ******** 2026-03-05 21:47:02.465491 | aio | ok: [aio] 2026-03-05 21:47:02.465559 | aio | 2026-03-05 21:47:02.465899 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:47:02.466143 | aio | Thursday 05 March 2026 21:47:02 +0000 (0:00:00.946) 0:00:14.861 ******** 2026-03-05 21:47:02.736704 | aio | ok: [aio] 2026-03-05 21:47:02.736761 | aio | 2026-03-05 21:47:02.736958 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:47:02.736977 | aio | Thursday 05 March 2026 21:47:02 +0000 (0:00:00.271) 0:00:15.133 ******** 2026-03-05 21:47:03.149229 | aio | ok: [aio] 2026-03-05 21:47:03.149298 | aio | 2026-03-05 21:47:03.149497 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:47:03.149542 | aio | Thursday 05 March 2026 21:47:03 +0000 (0:00:00.412) 0:00:15.545 ******** 2026-03-05 21:47:03.688400 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 21:47:03.688459 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:47:03.688568 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:47:03.688894 | aio | 2026-03-05 21:47:03.688936 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:47:03.688941 | aio | Thursday 05 March 2026 21:47:03 +0000 (0:00:00.538) 0:00:16.084 ******** 2026-03-05 21:47:04.084438 | aio | ok: [aio] 2026-03-05 21:47:04.084512 | aio | 2026-03-05 21:47:04.084748 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:47:04.084822 | aio | Thursday 05 March 2026 21:47:04 +0000 (0:00:00.395) 0:00:16.480 ******** 2026-03-05 21:47:04.507400 | aio | ok: [aio] 2026-03-05 21:47:04.507502 | aio | 2026-03-05 21:47:04.507515 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:47:04.507938 | aio | Thursday 05 March 2026 21:47:04 +0000 (0:00:00.416) 0:00:16.897 ******** 2026-03-05 21:47:04.508014 | aio | 2026-03-05 21:47:04.508021 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:47:04.508025 | aio | Thursday 05 March 2026 21:47:04 +0000 (0:00:00.006) 0:00:16.903 ******** 2026-03-05 21:47:04.867337 | aio | ok: [aio] 2026-03-05 21:47:04.867401 | aio | 2026-03-05 21:47:04.867610 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:47:04.867656 | aio | Thursday 05 March 2026 21:47:04 +0000 (0:00:00.359) 0:00:17.263 ******** 2026-03-05 21:47:04.909408 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:47:04.909456 | aio | 2026-03-05 21:47:04.909686 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:47:04.909739 | aio | Thursday 05 March 2026 21:47:04 +0000 (0:00:00.042) 0:00:17.306 ******** 2026-03-05 21:47:05.827782 | aio | ok: [aio] 2026-03-05 21:47:05.827854 | aio | 2026-03-05 21:47:05.827862 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:47:05.828035 | aio | Thursday 05 March 2026 21:47:05 +0000 (0:00:00.918) 0:00:18.224 ******** 2026-03-05 21:47:06.489367 | aio | ok: [aio] => (item=chronyd) 2026-03-05 21:47:06.489430 | aio | ok: [aio] => (item=sshd) 2026-03-05 21:47:06.489763 | aio | 2026-03-05 21:47:06.489807 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:47:06.489813 | aio | Thursday 05 March 2026 21:47:06 +0000 (0:00:00.661) 0:00:18.885 ******** 2026-03-05 21:47:07.898353 | aio | ok: [aio] 2026-03-05 21:47:07.898434 | aio | 2026-03-05 21:47:07.898513 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:47:07.898681 | aio | Thursday 05 March 2026 21:47:07 +0000 (0:00:01.408) 0:00:20.294 ******** 2026-03-05 21:47:08.093379 | aio | ok: [aio] 2026-03-05 21:47:08.093451 | aio | 2026-03-05 21:47:08.093465 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:47:08.093615 | aio | Thursday 05 March 2026 21:47:08 +0000 (0:00:00.195) 0:00:20.489 ******** 2026-03-05 21:47:08.493089 | aio | ok: [aio] 2026-03-05 21:47:08.493181 | aio | 2026-03-05 21:47:08.493198 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:47:08.493348 | aio | Thursday 05 March 2026 21:47:08 +0000 (0:00:00.399) 0:00:20.889 ******** 2026-03-05 21:47:08.809796 | aio | ok: [aio] 2026-03-05 21:47:08.809860 | aio | 2026-03-05 21:47:08.809896 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:47:08.810040 | aio | Thursday 05 March 2026 21:47:08 +0000 (0:00:00.316) 0:00:21.206 ******** 2026-03-05 21:47:08.878475 | aio | ok: [aio] 2026-03-05 21:47:08.878551 | aio | 2026-03-05 21:47:08.878756 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:47:08.878779 | aio | Thursday 05 March 2026 21:47:08 +0000 (0:00:00.068) 0:00:21.275 ******** 2026-03-05 21:47:09.111105 | aio | ok: [aio] => (item=aio) 2026-03-05 21:47:09.111184 | aio | 2026-03-05 21:47:09.111393 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:47:09.111696 | aio | Thursday 05 March 2026 21:47:09 +0000 (0:00:00.232) 0:00:21.507 ******** 2026-03-05 21:47:09.151475 | aio | ok: [aio] 2026-03-05 21:47:09.151957 | aio | 2026-03-05 21:47:09.152039 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:47:09.152047 | aio | Thursday 05 March 2026 21:47:09 +0000 (0:00:00.040) 0:00:21.547 ******** 2026-03-05 21:47:09.192232 | aio | skipping: [aio] 2026-03-05 21:47:09.192597 | aio | 2026-03-05 21:47:09.192655 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:47:09.192661 | aio | Thursday 05 March 2026 21:47:09 +0000 (0:00:00.040) 0:00:21.588 ******** 2026-03-05 21:47:09.252521 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 21:47:09.252571 | aio | 2026-03-05 21:47:09.252577 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:47:09.252582 | aio | Thursday 05 March 2026 21:47:09 +0000 (0:00:00.060) 0:00:21.648 ******** 2026-03-05 21:47:15.614008 | aio | ok: [aio] 2026-03-05 21:47:15.614107 | aio | 2026-03-05 21:47:15.614378 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:47:15.614427 | aio | Thursday 05 March 2026 21:47:15 +0000 (0:00:06.361) 0:00:28.010 ******** 2026-03-05 21:47:15.665732 | aio | ok: [aio] => (item=aio) 2026-03-05 21:47:15.666237 | aio | 2026-03-05 21:47:15.666291 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:47:15.666301 | aio | Thursday 05 March 2026 21:47:15 +0000 (0:00:00.051) 0:00:28.062 ******** 2026-03-05 21:47:16.043395 | aio | ok: [aio] 2026-03-05 21:47:16.043518 | aio | 2026-03-05 21:47:16.043531 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:47:16.043660 | aio | Thursday 05 March 2026 21:47:16 +0000 (0:00:00.377) 0:00:28.440 ******** 2026-03-05 21:47:22.726513 | aio | ok: [aio] 2026-03-05 21:47:22.726592 | aio | 2026-03-05 21:47:22.726607 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:47:22.726709 | aio | Thursday 05 March 2026 21:47:22 +0000 (0:00:06.682) 0:00:35.122 ******** 2026-03-05 21:47:29.250550 | aio | ok: [aio] 2026-03-05 21:47:29.250688 | aio | 2026-03-05 21:47:29.250707 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:47:29.250785 | aio | Thursday 05 March 2026 21:47:29 +0000 (0:00:06.524) 0:00:41.647 ******** 2026-03-05 21:47:43.630697 | aio | ok: [aio] 2026-03-05 21:47:43.630780 | aio | 2026-03-05 21:47:43.630931 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:47:43.630958 | aio | Thursday 05 March 2026 21:47:43 +0000 (0:00:14.380) 0:00:56.027 ******** 2026-03-05 21:47:43.695622 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 21:47:43.695683 | aio | 2026-03-05 21:47:43.695699 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:47:43.695802 | aio | Thursday 05 March 2026 21:47:43 +0000 (0:00:00.064) 0:00:56.092 ******** 2026-03-05 21:47:43.737572 | aio | skipping: [aio] 2026-03-05 21:47:43.737774 | aio | 2026-03-05 21:47:43.738011 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:47:43.738223 | aio | Thursday 05 March 2026 21:47:43 +0000 (0:00:00.041) 0:00:56.134 ******** 2026-03-05 21:47:43.778848 | aio | skipping: [aio] => (item=aio) 2026-03-05 21:47:43.779102 | aio | skipping: [aio] 2026-03-05 21:47:43.779299 | aio | 2026-03-05 21:47:43.779527 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:47:43.779727 | aio | Thursday 05 March 2026 21:47:43 +0000 (0:00:00.041) 0:00:56.175 ******** 2026-03-05 21:47:44.020463 | aio | ok: [aio] 2026-03-05 21:47:44.020543 | aio | 2026-03-05 21:47:44.020690 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:47:44.020826 | aio | Thursday 05 March 2026 21:47:44 +0000 (0:00:00.241) 0:00:56.417 ******** 2026-03-05 21:47:50.595855 | aio | ok: [aio] 2026-03-05 21:47:50.596063 | aio | 2026-03-05 21:47:50.596283 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:47:50.596492 | aio | Thursday 05 March 2026 21:47:50 +0000 (0:00:06.574) 0:01:02.991 ******** 2026-03-05 21:47:56.732586 | aio | ok: [aio] 2026-03-05 21:47:56.732827 | aio | 2026-03-05 21:47:56.733071 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:47:56.733352 | aio | Thursday 05 March 2026 21:47:56 +0000 (0:00:06.136) 0:01:09.128 ******** 2026-03-05 21:48:02.961883 | aio | ok: [aio] 2026-03-05 21:48:02.962039 | aio | 2026-03-05 21:48:02.962239 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:48:02.962443 | aio | Thursday 05 March 2026 21:48:02 +0000 (0:00:06.229) 0:01:15.358 ******** 2026-03-05 21:48:11.093093 | aio | ok: [aio] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:48:11.093172 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-03-05 21:48:11.093229 | aio | ok: [aio] => (item={'name': 'prometheus'}) 2026-03-05 21:48:11.093788 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-03-05 21:48:11.093837 | aio | 2026-03-05 21:48:11.093843 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:48:11.093847 | aio | 2026-03-05 21:48:11.093851 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:48:11.093856 | aio | Thursday 05 March 2026 21:48:11 +0000 (0:00:08.131) 0:01:23.489 ******** 2026-03-05 21:48:11.959472 | aio | ok: [aio] 2026-03-05 21:48:11.959545 | aio | 2026-03-05 21:48:11.959773 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:48:11.959823 | aio | Thursday 05 March 2026 21:48:11 +0000 (0:00:00.866) 0:01:24.356 ******** 2026-03-05 21:48:12.153864 | aio | ok: [aio] 2026-03-05 21:48:12.153913 | aio | 2026-03-05 21:48:12.154163 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:48:12.154211 | aio | Thursday 05 March 2026 21:48:12 +0000 (0:00:00.194) 0:01:24.550 ******** 2026-03-05 21:48:12.189542 | aio | skipping: [aio] 2026-03-05 21:48:12.189625 | aio | 2026-03-05 21:48:12.189727 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:48:12.189846 | aio | Thursday 05 March 2026 21:48:12 +0000 (0:00:00.035) 0:01:24.586 ******** 2026-03-05 21:48:12.390252 | aio | ok: [aio] 2026-03-05 21:48:12.390322 | aio | 2026-03-05 21:48:12.390589 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:48:12.390665 | aio | Thursday 05 March 2026 21:48:12 +0000 (0:00:00.200) 0:01:24.786 ******** 2026-03-05 21:48:12.464641 | aio | ok: [aio] => { 2026-03-05 21:48:12.465115 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:48:12.465145 | aio | } 2026-03-05 21:48:12.465151 | aio | 2026-03-05 21:48:12.465156 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:48:12.465162 | aio | Thursday 05 March 2026 21:48:12 +0000 (0:00:00.074) 0:01:24.860 ******** 2026-03-05 21:48:12.774292 | aio | ok: [aio] 2026-03-05 21:48:12.774357 | aio | 2026-03-05 21:48:12.774365 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:48:12.774372 | aio | Thursday 05 March 2026 21:48:12 +0000 (0:00:00.309) 0:01:25.170 ******** 2026-03-05 21:48:12.813656 | aio | skipping: [aio] 2026-03-05 21:48:12.813700 | aio | 2026-03-05 21:48:12.813706 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:48:12.813710 | aio | Thursday 05 March 2026 21:48:12 +0000 (0:00:00.039) 0:01:25.210 ******** 2026-03-05 21:48:12.851951 | aio | skipping: [aio] 2026-03-05 21:48:12.851987 | aio | 2026-03-05 21:48:12.851994 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:48:12.851998 | aio | Thursday 05 March 2026 21:48:12 +0000 (0:00:00.038) 0:01:25.248 ******** 2026-03-05 21:48:13.048189 | aio | ok: [aio] 2026-03-05 21:48:13.048240 | aio | 2026-03-05 21:48:13.048247 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:48:13.048253 | aio | Thursday 05 March 2026 21:48:13 +0000 (0:00:00.195) 0:01:25.444 ******** 2026-03-05 21:48:13.990811 | aio | ok: [aio] 2026-03-05 21:48:13.990864 | aio | 2026-03-05 21:48:13.990870 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:48:13.990874 | aio | Thursday 05 March 2026 21:48:13 +0000 (0:00:00.942) 0:01:26.387 ******** 2026-03-05 21:48:14.059400 | aio | ok: [aio] => { 2026-03-05 21:48:14.059430 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:48:14.059438 | aio | } 2026-03-05 21:48:14.059443 | aio | 2026-03-05 21:48:14.059449 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:48:14.059455 | aio | Thursday 05 March 2026 21:48:14 +0000 (0:00:00.068) 0:01:26.455 ******** 2026-03-05 21:48:14.392454 | aio | ok: [aio] 2026-03-05 21:48:14.392531 | aio | 2026-03-05 21:48:14.392590 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:48:14.392730 | aio | Thursday 05 March 2026 21:48:14 +0000 (0:00:00.333) 0:01:26.789 ******** 2026-03-05 21:48:16.316954 | aio | ok: [aio] 2026-03-05 21:48:16.317022 | aio | 2026-03-05 21:48:16.317216 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:48:16.317266 | aio | Thursday 05 March 2026 21:48:16 +0000 (0:00:01.924) 0:01:28.713 ******** 2026-03-05 21:48:16.346185 | aio | skipping: [aio] 2026-03-05 21:48:16.346268 | aio | 2026-03-05 21:48:16.346471 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:48:16.346494 | aio | Thursday 05 March 2026 21:48:16 +0000 (0:00:00.029) 0:01:28.742 ******** 2026-03-05 21:48:16.375038 | aio | skipping: [aio] 2026-03-05 21:48:16.375110 | aio | 2026-03-05 21:48:16.375343 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:48:16.375392 | aio | Thursday 05 March 2026 21:48:16 +0000 (0:00:00.028) 0:01:28.771 ******** 2026-03-05 21:48:16.402356 | aio | skipping: [aio] 2026-03-05 21:48:16.402438 | aio | 2026-03-05 21:48:16.402533 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:48:16.402629 | aio | Thursday 05 March 2026 21:48:16 +0000 (0:00:00.027) 0:01:28.799 ******** 2026-03-05 21:48:17.322410 | aio | ok: [aio] 2026-03-05 21:48:17.322489 | aio | 2026-03-05 21:48:17.322763 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:48:17.322815 | aio | Thursday 05 March 2026 21:48:17 +0000 (0:00:00.919) 0:01:29.718 ******** 2026-03-05 21:48:17.726165 | aio | ok: [aio] 2026-03-05 21:48:17.726230 | aio | 2026-03-05 21:48:17.726313 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:48:17.726450 | aio | Thursday 05 March 2026 21:48:17 +0000 (0:00:00.403) 0:01:30.122 ******** 2026-03-05 21:48:18.628149 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 21:48:18.628257 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:48:18.629051 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:48:18.629104 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:48:18.629112 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:48:18.629120 | aio | 2026-03-05 21:48:18.629126 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:48:18.629132 | aio | Thursday 05 March 2026 21:48:18 +0000 (0:00:00.901) 0:01:31.024 ******** 2026-03-05 21:48:19.109457 | aio | ok: [aio] 2026-03-05 21:48:19.109531 | aio | 2026-03-05 21:48:19.110002 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:48:19.110049 | aio | Thursday 05 March 2026 21:48:19 +0000 (0:00:00.475) 0:01:31.499 ******** 2026-03-05 21:48:19.110055 | aio | 2026-03-05 21:48:19.110067 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:48:19.110072 | aio | Thursday 05 March 2026 21:48:19 +0000 (0:00:00.006) 0:01:31.506 ******** 2026-03-05 21:48:19.463640 | aio | ok: [aio] 2026-03-05 21:48:19.463720 | aio | 2026-03-05 21:48:19.463957 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:48:19.464014 | aio | Thursday 05 March 2026 21:48:19 +0000 (0:00:00.354) 0:01:31.860 ******** 2026-03-05 21:48:19.651946 | aio | ok: [aio] 2026-03-05 21:48:19.652038 | aio | 2026-03-05 21:48:19.652146 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:48:19.652231 | aio | Thursday 05 March 2026 21:48:19 +0000 (0:00:00.188) 0:01:32.048 ******** 2026-03-05 21:48:19.720033 | aio | ok: [aio] => { 2026-03-05 21:48:19.720277 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:48:19.720469 | aio | } 2026-03-05 21:48:19.720698 | aio | 2026-03-05 21:48:19.721010 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:48:19.721308 | aio | Thursday 05 March 2026 21:48:19 +0000 (0:00:00.067) 0:01:32.116 ******** 2026-03-05 21:48:20.103045 | aio | ok: [aio] 2026-03-05 21:48:20.103245 | aio | 2026-03-05 21:48:20.103494 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:48:20.103748 | aio | Thursday 05 March 2026 21:48:20 +0000 (0:00:00.382) 0:01:32.498 ******** 2026-03-05 21:48:23.135130 | aio | ok: [aio] 2026-03-05 21:48:23.135309 | aio | 2026-03-05 21:48:23.135526 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:48:23.135733 | aio | Thursday 05 March 2026 21:48:23 +0000 (0:00:03.032) 0:01:35.531 ******** 2026-03-05 21:48:24.350722 | aio | ok: [aio] 2026-03-05 21:48:24.351119 | aio | 2026-03-05 21:48:24.351133 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:48:24.351143 | aio | Thursday 05 March 2026 21:48:24 +0000 (0:00:01.215) 0:01:36.746 ******** 2026-03-05 21:48:24.546699 | aio | ok: [aio] 2026-03-05 21:48:24.546774 | aio | 2026-03-05 21:48:24.546970 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:48:24.547017 | aio | Thursday 05 March 2026 21:48:24 +0000 (0:00:00.196) 0:01:36.943 ******** 2026-03-05 21:48:24.963776 | aio | ok: [aio] 2026-03-05 21:48:24.963845 | aio | 2026-03-05 21:48:24.964085 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:48:24.964148 | aio | Thursday 05 March 2026 21:48:24 +0000 (0:00:00.417) 0:01:37.360 ******** 2026-03-05 21:48:25.492623 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 21:48:25.492696 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:48:25.493090 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:48:25.493132 | aio | 2026-03-05 21:48:25.493138 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:48:25.493143 | aio | Thursday 05 March 2026 21:48:25 +0000 (0:00:00.528) 0:01:37.889 ******** 2026-03-05 21:48:25.891518 | aio | ok: [aio] 2026-03-05 21:48:25.891590 | aio | 2026-03-05 21:48:25.891896 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:48:25.891951 | aio | Thursday 05 March 2026 21:48:25 +0000 (0:00:00.398) 0:01:38.287 ******** 2026-03-05 21:48:26.305338 | aio | ok: [aio] 2026-03-05 21:48:26.305411 | aio | 2026-03-05 21:48:26.305873 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:48:26.305923 | aio | Thursday 05 March 2026 21:48:26 +0000 (0:00:00.407) 0:01:38.695 ******** 2026-03-05 21:48:26.305928 | aio | 2026-03-05 21:48:26.305933 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:48:26.305937 | aio | Thursday 05 March 2026 21:48:26 +0000 (0:00:00.006) 0:01:38.701 ******** 2026-03-05 21:48:26.638544 | aio | ok: [aio] 2026-03-05 21:48:26.638621 | aio | 2026-03-05 21:48:26.638819 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:48:26.638867 | aio | Thursday 05 March 2026 21:48:26 +0000 (0:00:00.333) 0:01:39.035 ******** 2026-03-05 21:48:26.685609 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:48:26.686005 | aio | 2026-03-05 21:48:26.686030 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:48:26.686037 | aio | Thursday 05 March 2026 21:48:26 +0000 (0:00:00.046) 0:01:39.082 ******** 2026-03-05 21:48:27.644703 | aio | ok: [aio] 2026-03-05 21:48:27.644759 | aio | 2026-03-05 21:48:27.644766 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:48:27.644773 | aio | Thursday 05 March 2026 21:48:27 +0000 (0:00:00.958) 0:01:40.040 ******** 2026-03-05 21:48:28.262098 | aio | ok: [aio] => (item=chronyd) 2026-03-05 21:48:28.262185 | aio | ok: [aio] => (item=sshd) 2026-03-05 21:48:28.262197 | aio | 2026-03-05 21:48:28.262207 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:48:28.262216 | aio | Thursday 05 March 2026 21:48:28 +0000 (0:00:00.616) 0:01:40.657 ******** 2026-03-05 21:48:28.565579 | aio | ok: [aio] 2026-03-05 21:48:28.565643 | aio | 2026-03-05 21:48:28.565655 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:48:28.565666 | aio | Thursday 05 March 2026 21:48:28 +0000 (0:00:00.303) 0:01:40.961 ******** 2026-03-05 21:48:28.763216 | aio | ok: [aio] 2026-03-05 21:48:28.763275 | aio | 2026-03-05 21:48:28.763287 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:48:28.763297 | aio | Thursday 05 March 2026 21:48:28 +0000 (0:00:00.197) 0:01:41.158 ******** 2026-03-05 21:48:29.005718 | aio | ok: [aio] 2026-03-05 21:48:29.005756 | aio | 2026-03-05 21:48:29.005767 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:48:29.005777 | aio | Thursday 05 March 2026 21:48:29 +0000 (0:00:00.242) 0:01:41.401 ******** 2026-03-05 21:48:29.214666 | aio | ok: [aio] 2026-03-05 21:48:29.214709 | aio | 2026-03-05 21:48:29.214720 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:48:29.214730 | aio | Thursday 05 March 2026 21:48:29 +0000 (0:00:00.208) 0:01:41.610 ******** 2026-03-05 21:48:29.427953 | aio | ok: [aio] => (item=aio) 2026-03-05 21:48:29.428051 | aio | 2026-03-05 21:48:29.428059 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:48:29.428065 | aio | Thursday 05 March 2026 21:48:29 +0000 (0:00:00.213) 0:01:41.823 ******** 2026-03-05 21:48:29.467357 | aio | ok: [aio] 2026-03-05 21:48:29.467486 | aio | 2026-03-05 21:48:29.467682 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:48:29.467881 | aio | Thursday 05 March 2026 21:48:29 +0000 (0:00:00.039) 0:01:41.863 ******** 2026-03-05 21:48:29.527811 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 21:48:29.528097 | aio | 2026-03-05 21:48:29.528376 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:48:29.528629 | aio | Thursday 05 March 2026 21:48:29 +0000 (0:00:00.060) 0:01:41.924 ******** 2026-03-05 21:48:29.570136 | aio | skipping: [aio] 2026-03-05 21:48:29.570359 | aio | 2026-03-05 21:48:29.570627 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:48:29.570878 | aio | Thursday 05 March 2026 21:48:29 +0000 (0:00:00.042) 0:01:41.966 ******** 2026-03-05 21:48:29.607461 | aio | skipping: [aio] => (item=aio) 2026-03-05 21:48:29.607758 | aio | skipping: [aio] 2026-03-05 21:48:29.608005 | aio | 2026-03-05 21:48:29.608341 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:48:29.608604 | aio | Thursday 05 March 2026 21:48:29 +0000 (0:00:00.037) 0:01:42.004 ******** 2026-03-05 21:48:29.846660 | aio | ok: [aio] 2026-03-05 21:48:29.846832 | aio | 2026-03-05 21:48:29.847039 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:48:29.847240 | aio | Thursday 05 March 2026 21:48:29 +0000 (0:00:00.238) 0:01:42.242 ******** 2026-03-05 21:48:36.463635 | aio | ok: [aio] 2026-03-05 21:48:36.463755 | aio | 2026-03-05 21:48:36.463768 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:48:36.463778 | aio | Thursday 05 March 2026 21:48:36 +0000 (0:00:06.615) 0:01:48.858 ******** 2026-03-05 21:48:41.903720 | aio | ok: [aio] 2026-03-05 21:48:41.903851 | aio | 2026-03-05 21:48:41.903865 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:48:41.903878 | aio | Thursday 05 March 2026 21:48:41 +0000 (0:00:05.441) 0:01:54.300 ******** 2026-03-05 21:48:56.388765 | aio | ok: [aio] 2026-03-05 21:48:56.388908 | aio | 2026-03-05 21:48:56.389183 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:48:56.389241 | aio | Thursday 05 March 2026 21:48:56 +0000 (0:00:14.484) 0:02:08.785 ******** 2026-03-05 21:48:56.446917 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-03-05 21:48:56.446979 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-03-05 21:48:56.447224 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-03-05 21:48:56.447272 | aio | skipping: [aio] 2026-03-05 21:48:56.447289 | aio | 2026-03-05 21:48:56.447380 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:48:56.447470 | aio | Thursday 05 March 2026 21:48:56 +0000 (0:00:00.058) 0:02:08.843 ******** 2026-03-05 21:49:02.776906 | aio | ok: [aio] 2026-03-05 21:49:02.777049 | aio | 2026-03-05 21:49:02.777273 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:49:02.777484 | aio | Thursday 05 March 2026 21:49:02 +0000 (0:00:06.329) 0:02:15.172 ******** 2026-03-05 21:49:09.015497 | aio | ok: [aio] 2026-03-05 21:49:09.015664 | aio | 2026-03-05 21:49:09.015885 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:49:09.016145 | aio | Thursday 05 March 2026 21:49:09 +0000 (0:00:06.238) 0:02:21.411 ******** 2026-03-05 21:49:09.067507 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-03-05 21:49:09.067696 | aio | 2026-03-05 21:49:09.067937 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:49:09.068220 | aio | Thursday 05 March 2026 21:49:09 +0000 (0:00:00.052) 0:02:21.463 ******** 2026-03-05 21:49:09.111220 | aio | ok: [aio] 2026-03-05 21:49:09.111410 | aio | 2026-03-05 21:49:09.111613 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:49:09.111803 | aio | Thursday 05 March 2026 21:49:09 +0000 (0:00:00.043) 0:02:21.507 ******** 2026-03-05 21:49:15.364022 | aio | ok: [aio] 2026-03-05 21:49:15.364227 | aio | 2026-03-05 21:49:15.364454 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:49:15.364663 | aio | Thursday 05 March 2026 21:49:15 +0000 (0:00:06.252) 0:02:27.760 ******** 2026-03-05 21:49:15.402990 | aio | ok: [aio] 2026-03-05 21:49:15.403188 | aio | 2026-03-05 21:49:15.403422 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:49:15.403677 | aio | Thursday 05 March 2026 21:49:15 +0000 (0:00:00.039) 0:02:27.799 ******** 2026-03-05 21:49:15.439665 | aio | skipping: [aio] => (item=1) 2026-03-05 21:49:15.439847 | aio | skipping: [aio] => (item=1) 2026-03-05 21:49:15.440101 | aio | skipping: [aio] => (item=1) 2026-03-05 21:49:15.440306 | aio | skipping: [aio] 2026-03-05 21:49:15.440485 | aio | 2026-03-05 21:49:15.440690 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:49:15.440890 | aio | Thursday 05 March 2026 21:49:15 +0000 (0:00:00.036) 0:02:27.836 ******** 2026-03-05 21:49:15.470170 | aio | skipping: [aio] 2026-03-05 21:49:15.470384 | aio | 2026-03-05 21:49:15.470675 | aio | PLAY RECAP ********************************************************************* 2026-03-05 21:49:15.470862 | aio | aio : ok=95 changed=0 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 2026-03-05 21:49:15.471080 | aio | 2026-03-05 21:49:15.471195 | aio | 2026-03-05 21:49:15.471445 | aio | TASKS RECAP ******************************************************************** 2026-03-05 21:49:15.471586 | aio | Thursday 05 March 2026 21:49:15 +0000 (0:00:00.030) 0:02:27.867 ******** 2026-03-05 21:49:15.471765 | aio | =============================================================================== 2026-03-05 21:49:15.471998 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.48s 2026-03-05 21:49:15.472214 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.38s 2026-03-05 21:49:15.472436 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.13s 2026-03-05 21:49:15.472638 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.68s 2026-03-05 21:49:15.472864 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.62s 2026-03-05 21:49:15.473064 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.57s 2026-03-05 21:49:15.473268 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.52s 2026-03-05 21:49:15.473682 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.36s 2026-03-05 21:49:15.473953 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.33s 2026-03-05 21:49:15.474159 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.25s 2026-03-05 21:49:15.474387 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.24s 2026-03-05 21:49:15.474521 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.23s 2026-03-05 21:49:15.474647 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.14s 2026-03-05 21:49:15.474762 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.44s 2026-03-05 21:49:15.474896 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.06s 2026-03-05 21:49:15.475008 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.03s 2026-03-05 21:49:15.475129 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.23s 2026-03-05 21:49:15.475252 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 1.92s 2026-03-05 21:49:15.475375 | aio | vexxhost.ceph.cephadm : Download "cephadm" ------------------------------ 1.41s 2026-03-05 21:49:15.475496 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 1.30s 2026-03-05 21:49:15.569080 | aio | INFO [default > idempotence] Executed: Successful 2026-03-05 21:49:15.577657 | aio | INFO [default > side_effect] Executing 2026-03-05 21:49:15.578073 | aio | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:49:15.584367 | aio | INFO [default > verify] Executing 2026-03-05 21:49:16.207320 | aio | 2026-03-05 21:49:16.207526 | aio | PLAY [Verify] ****************************************************************** 2026-03-05 21:49:16.207733 | aio | 2026-03-05 21:49:16.207935 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:49:16.208170 | aio | Thursday 05 March 2026 21:49:16 +0000 (0:00:00.006) 0:00:00.006 ******** 2026-03-05 21:49:17.351889 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 21:49:17.351962 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:49:17.352064 | aio | interpreter could change the meaning of that path. See 2026-03-05 21:49:17.352156 | aio | https://docs.ansible.com/ansible- 2026-03-05 21:49:17.352248 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:49:17.362986 | aio | ok: [aio] 2026-03-05 21:49:17.363100 | aio | 2026-03-05 21:49:17.363228 | aio | TASK [Get cluster health status] *********************************************** 2026-03-05 21:49:17.363354 | aio | Thursday 05 March 2026 21:49:17 +0000 (0:00:01.155) 0:00:01.162 ******** 2026-03-05 21:49:27.684987 | aio | ok: [aio] 2026-03-05 21:49:27.685070 | aio | 2026-03-05 21:49:27.685131 | aio | TASK [Print cluster health status] ********************************************* 2026-03-05 21:49:27.685216 | aio | Thursday 05 March 2026 21:49:27 +0000 (0:00:10.321) 0:00:11.484 ******** 2026-03-05 21:49:27.716057 | aio | ok: [aio] => { 2026-03-05 21:49:27.716263 | aio | "_ceph_health": { 2026-03-05 21:49:27.716456 | aio | "changed": false, 2026-03-05 21:49:27.716645 | aio | "cmd": [ 2026-03-05 21:49:27.716834 | aio | "cephadm", 2026-03-05 21:49:27.717015 | aio | "shell", 2026-03-05 21:49:27.717198 | aio | "--", 2026-03-05 21:49:27.717379 | aio | "ceph", 2026-03-05 21:49:27.717562 | aio | "health" 2026-03-05 21:49:27.717744 | aio | ], 2026-03-05 21:49:27.717930 | aio | "delta": "0:00:10.038863", 2026-03-05 21:49:27.718123 | aio | "end": "2026-03-05 21:49:27.647607", 2026-03-05 21:49:27.718307 | aio | "failed": false, 2026-03-05 21:49:27.718493 | aio | "msg": "", 2026-03-05 21:49:27.718679 | aio | "rc": 0, 2026-03-05 21:49:27.718873 | aio | "start": "2026-03-05 21:49:17.608744", 2026-03-05 21:49:27.719094 | aio | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config", 2026-03-05 21:49:27.719280 | aio | "stderr_lines": [ 2026-03-05 21:49:27.719473 | aio | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-05 21:49:27.719685 | aio | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config" 2026-03-05 21:49:27.719920 | aio | ], 2026-03-05 21:49:27.720162 | aio | "stdout": "HEALTH_OK", 2026-03-05 21:49:27.720348 | aio | "stdout_lines": [ 2026-03-05 21:49:27.720534 | aio | "HEALTH_OK" 2026-03-05 21:49:27.720740 | aio | ] 2026-03-05 21:49:27.720969 | aio | } 2026-03-05 21:49:27.721162 | aio | } 2026-03-05 21:49:27.721335 | aio | 2026-03-05 21:49:27.721530 | aio | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-05 21:49:27.721728 | aio | Thursday 05 March 2026 21:49:27 +0000 (0:00:00.031) 0:00:11.515 ******** 2026-03-05 21:49:27.744620 | aio | ok: [aio] => { 2026-03-05 21:49:27.744813 | aio | "changed": false, 2026-03-05 21:49:27.745003 | aio | "msg": "All assertions passed" 2026-03-05 21:49:27.745186 | aio | } 2026-03-05 21:49:27.745360 | aio | 2026-03-05 21:49:27.745552 | aio | TASK [Create a test Ceph pool] ************************************************* 2026-03-05 21:49:27.745747 | aio | Thursday 05 March 2026 21:49:27 +0000 (0:00:00.028) 0:00:11.544 ******** 2026-03-05 21:49:34.014484 | aio | changed: [aio] 2026-03-05 21:49:34.014652 | aio | 2026-03-05 21:49:34.014863 | aio | TASK [Create a test Ceph key] ************************************************** 2026-03-05 21:49:34.015097 | aio | Thursday 05 March 2026 21:49:34 +0000 (0:00:06.269) 0:00:17.813 ******** 2026-03-05 21:49:36.346625 | aio | changed: [aio] 2026-03-05 21:49:36.346902 | aio | 2026-03-05 21:49:36.346914 | aio | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-05 21:49:36.346924 | aio | Thursday 05 March 2026 21:49:36 +0000 (0:00:02.331) 0:00:20.145 ******** 2026-03-05 21:49:37.486434 | aio | ok: [aio] 2026-03-05 21:49:37.486501 | aio | 2026-03-05 21:49:37.486722 | aio | TASK [Assert that key_info returns the correct key] **************************** 2026-03-05 21:49:37.486784 | aio | Thursday 05 March 2026 21:49:37 +0000 (0:00:01.140) 0:00:21.285 ******** 2026-03-05 21:49:37.518186 | aio | ok: [aio] => { 2026-03-05 21:49:37.520085 | aio | "changed": false, 2026-03-05 21:49:37.520146 | aio | "msg": "All assertions passed" 2026-03-05 21:49:37.520159 | aio | } 2026-03-05 21:49:37.520168 | aio | 2026-03-05 21:49:37.520178 | aio | PLAY RECAP ********************************************************************* 2026-03-05 21:49:37.520188 | aio | aio : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 21:49:37.520197 | aio | 2026-03-05 21:49:37.520205 | aio | 2026-03-05 21:49:37.520214 | aio | TASKS RECAP ******************************************************************** 2026-03-05 21:49:37.520230 | aio | Thursday 05 March 2026 21:49:37 +0000 (0:00:00.031) 0:00:21.317 ******** 2026-03-05 21:49:37.521929 | aio | =============================================================================== 2026-03-05 21:49:37.521965 | aio | Get cluster health status ---------------------------------------------- 10.32s 2026-03-05 21:49:37.521976 | aio | Create a test Ceph pool ------------------------------------------------- 6.27s 2026-03-05 21:49:37.521985 | aio | Create a test Ceph key -------------------------------------------------- 2.33s 2026-03-05 21:49:37.521994 | aio | Gathering Facts --------------------------------------------------------- 1.16s 2026-03-05 21:49:37.522003 | aio | Retrieve info for the test Ceph key ------------------------------------- 1.14s 2026-03-05 21:49:37.522012 | aio | Assert that key_info returns the correct key ---------------------------- 0.03s 2026-03-05 21:49:37.522020 | aio | Print cluster health status --------------------------------------------- 0.03s 2026-03-05 21:49:37.522029 | aio | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-03-05 21:49:37.583747 | aio | INFO [default > verify] Executed: Successful 2026-03-05 21:49:37.589422 | aio | INFO [default > cleanup] Executing 2026-03-05 21:49:37.589762 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:49:37.594700 | aio | INFO [default > destroy] Executing 2026-03-05 21:49:37.594795 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 21:49:37.594893 | aio | INFO [default > destroy] Executed: Successful 2026-03-05 21:49:37.595173 | aio | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-05 21:49:38.053461 | aio | ok: Runtime: 0:10:53.028063 2026-03-05 21:49:38.066109 | 2026-03-05 21:49:38.066155 | PLAY RECAP 2026-03-05 21:49:38.066200 | aio | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:49:38.066221 | 2026-03-05 21:49:38.165641 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 21:49:38.168934 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:49:38.775598 | 2026-03-05 21:49:38.775751 | PLAY [all] 2026-03-05 21:49:38.787509 | 2026-03-05 21:49:38.787585 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-05 21:49:38.833494 | aio | skipping: Conditional result was False 2026-03-05 21:49:38.844433 | 2026-03-05 21:49:38.844510 | TASK [fetch-output : Set log path for single node] 2026-03-05 21:49:38.886602 | aio | ok 2026-03-05 21:49:38.892440 | 2026-03-05 21:49:38.892507 | LOOP [fetch-output : Ensure local output dirs] 2026-03-05 21:49:39.247335 | aio -> localhost | ok: "/var/lib/zuul/builds/8203a69885dd46c0913b9b574f86ec6a/work/logs" 2026-03-05 21:49:39.452057 | aio -> localhost | changed: "/var/lib/zuul/builds/8203a69885dd46c0913b9b574f86ec6a/work/artifacts" 2026-03-05 21:49:39.674884 | aio -> localhost | changed: "/var/lib/zuul/builds/8203a69885dd46c0913b9b574f86ec6a/work/docs" 2026-03-05 21:49:39.695571 | 2026-03-05 21:49:39.695643 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-05 21:49:40.308519 | aio | changed: .d..t...... ./ 2026-03-05 21:49:40.308788 | aio | changed: All items complete 2026-03-05 21:49:40.308863 | 2026-03-05 21:49:40.723264 | aio | changed: .d..t...... ./ 2026-03-05 21:49:41.164656 | aio | changed: .d..t...... ./ 2026-03-05 21:49:41.187891 | 2026-03-05 21:49:41.188015 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-05 21:49:41.578307 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.007684 2026-03-05 21:49:41.809701 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.007998 2026-03-05 21:49:41.829329 | 2026-03-05 21:49:41.829411 | PLAY [all] 2026-03-05 21:49:41.835439 | 2026-03-05 21:49:41.835503 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-05 21:49:42.232657 | aio | changed 2026-03-05 21:49:42.239636 | 2026-03-05 21:49:42.239727 | PLAY RECAP 2026-03-05 21:49:42.239774 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 21:49:42.239797 | 2026-03-05 21:49:42.349299 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:49:42.353210 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-05 21:49:42.981014 | 2026-03-05 21:49:42.982014 | PLAY [localhost] 2026-03-05 21:49:42.993803 | 2026-03-05 21:49:42.993898 | TASK [Generate Zuul manifest] 2026-03-05 21:49:43.018965 | localhost | ok 2026-03-05 21:49:43.035837 | 2026-03-05 21:49:43.035923 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-05 21:49:43.337114 | localhost | changed 2026-03-05 21:49:43.349769 | 2026-03-05 21:49:43.349848 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-05 21:49:43.469522 | localhost | ok 2026-03-05 21:49:43.475957 | 2026-03-05 21:49:43.476023 | TASK [Upload logs] 2026-03-05 21:49:43.499487 | localhost | ok 2026-03-05 21:49:43.560508 | 2026-03-05 21:49:43.560608 | TASK [Set zuul-log-path fact] 2026-03-05 21:49:43.585181 | localhost | ok 2026-03-05 21:49:43.598352 | 2026-03-05 21:49:43.598456 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 21:49:43.635416 | localhost | ok 2026-03-05 21:49:43.643613 | 2026-03-05 21:49:43.643680 | TASK [upload-logs : Create log directories] 2026-03-05 21:49:44.041674 | localhost | changed 2026-03-05 21:49:44.047984 | 2026-03-05 21:49:44.048053 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-05 21:49:44.428413 | localhost -> localhost | ok: Runtime: 0:00:00.004927 2026-03-05 21:49:44.434797 | 2026-03-05 21:49:44.434877 | TASK [upload-logs : Upload logs to log server] 2026-03-05 21:49:44.884852 | localhost | Output suppressed because no_log was given 2026-03-05 21:49:44.889621 | 2026-03-05 21:49:44.889692 | LOOP [upload-logs : Compress console log and json output] 2026-03-05 21:49:44.936679 | localhost | skipping: Conditional result was False 2026-03-05 21:49:44.943659 | localhost | skipping: Conditional result was False 2026-03-05 21:49:44.959023 | 2026-03-05 21:49:44.959209 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-05 21:49:45.003424 | localhost | skipping: Conditional result was False 2026-03-05 21:49:45.003827 | 2026-03-05 21:49:45.007597 | localhost | skipping: Conditional result was False 2026-03-05 21:49:45.024625 | 2026-03-05 21:49:45.024807 | LOOP [upload-logs : Upload console log and json output]