2026-03-05 16:31:27.962395 | Job console starting 2026-03-05 16:31:28.079232 | Updating git repos 2026-03-05 16:31:28.106125 | Cloning repos into workspace 2026-03-05 16:31:28.462581 | Restoring repo states 2026-03-05 16:31:28.470841 | Merging changes 2026-03-05 16:31:28.733623 | Checking out repos 2026-03-05 16:31:28.768215 | Preparing playbooks 2026-03-05 16:31:32.270351 | Running Ansible setup 2026-03-05 16:31:36.202763 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 16:31:36.820792 | 2026-03-05 16:31:36.821519 | PLAY [localhost] 2026-03-05 16:31:36.829150 | 2026-03-05 16:31:36.829225 | TASK [Gathering Facts] 2026-03-05 16:31:37.666232 | localhost | ok 2026-03-05 16:31:37.678014 | 2026-03-05 16:31:37.678134 | TASK [Setup log path fact] 2026-03-05 16:31:37.697612 | localhost | ok 2026-03-05 16:31:37.712199 | 2026-03-05 16:31:37.712314 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 16:31:37.742214 | localhost | ok 2026-03-05 16:31:37.749911 | 2026-03-05 16:31:37.750006 | TASK [emit-job-header : Print job information] 2026-03-05 16:31:37.791164 | # Job Information 2026-03-05 16:31:37.791384 | Ansible Version: 2.16.16 2026-03-05 16:31:37.791464 | Job: ansible-collection-ceph-molecule-aio-ubuntu-noble 2026-03-05 16:31:37.791534 | Pipeline: check 2026-03-05 16:31:37.791591 | Executor: 0a8996d2b663 2026-03-05 16:31:37.791644 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/93 2026-03-05 16:31:37.791702 | Event ID: 6c11fb90-18ae-11f1-8dd1-418c053b88bb 2026-03-05 16:31:37.796035 | 2026-03-05 16:31:37.796121 | LOOP [emit-job-header : Print node information] 2026-03-05 16:31:37.892094 | localhost | ok: 2026-03-05 16:31:37.892309 | localhost | # Node Information 2026-03-05 16:31:37.892356 | localhost | Inventory Hostname: aio 2026-03-05 16:31:37.892429 | localhost | Hostname: np0000157925 2026-03-05 16:31:37.892466 | localhost | Username: zuul 2026-03-05 16:31:37.892499 | localhost | Distro: Ubuntu 24.04 2026-03-05 16:31:37.892533 | localhost | Provider: yul1 2026-03-05 16:31:37.892564 | localhost | Region: ca-ymq-1 2026-03-05 16:31:37.892594 | localhost | Label: ubuntu-noble 2026-03-05 16:31:37.892623 | localhost | Product Name: OpenStack Nova 2026-03-05 16:31:37.892652 | localhost | Interface IP: 162.253.55.209 2026-03-05 16:31:37.903769 | 2026-03-05 16:31:37.903931 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-05 16:31:39.197869 | localhost -> localhost | changed 2026-03-05 16:31:39.207272 | 2026-03-05 16:31:39.207410 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-05 16:31:40.141963 | localhost -> localhost | changed 2026-03-05 16:31:40.152307 | 2026-03-05 16:31:40.152367 | PLAY [all] 2026-03-05 16:31:40.161776 | 2026-03-05 16:31:40.161841 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-05 16:31:40.419156 | aio -> localhost | ok 2026-03-05 16:31:40.430354 | 2026-03-05 16:31:40.430419 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-05 16:31:40.458765 | aio | ok 2026-03-05 16:31:40.472123 | aio | included: /var/lib/zuul/builds/eab25b2bf6de46359348732387283c61/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 16:31:40.478027 | 2026-03-05 16:31:40.478084 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-05 16:31:42.477028 | aio -> localhost | Generating public/private rsa key pair. 2026-03-05 16:31:42.477217 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/eab25b2bf6de46359348732387283c61/work/eab25b2bf6de46359348732387283c61_id_rsa 2026-03-05 16:31:42.477257 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/eab25b2bf6de46359348732387283c61/work/eab25b2bf6de46359348732387283c61_id_rsa.pub 2026-03-05 16:31:42.477288 | aio -> localhost | The key fingerprint is: 2026-03-05 16:31:42.477317 | aio -> localhost | SHA256:3zMovKr/yp/XTabJrWZFdrVwUfa8MndurQbjBEL/2MA zuul-build-sshkey 2026-03-05 16:31:42.477355 | aio -> localhost | The key's randomart image is: 2026-03-05 16:31:42.477384 | aio -> localhost | +---[RSA 3072]----+ 2026-03-05 16:31:42.477436 | aio -> localhost | | .=| 2026-03-05 16:31:42.477537 | aio -> localhost | | . . +o| 2026-03-05 16:31:42.477607 | aio -> localhost | | . o o =| 2026-03-05 16:31:42.477637 | aio -> localhost | | . E o.o| 2026-03-05 16:31:42.477665 | aio -> localhost | | S. * = +.| 2026-03-05 16:31:42.477693 | aio -> localhost | | . ..o* B.o| 2026-03-05 16:31:42.477719 | aio -> localhost | | o o=+@ +| 2026-03-05 16:31:42.477746 | aio -> localhost | | . +. Oo+o | 2026-03-05 16:31:42.477777 | aio -> localhost | | .o===. o.o. | 2026-03-05 16:31:42.477805 | aio -> localhost | +----[SHA256]-----+ 2026-03-05 16:31:42.477865 | aio -> localhost | ok: Runtime: 0:00:01.613995 2026-03-05 16:31:42.486730 | 2026-03-05 16:31:42.486794 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-05 16:31:42.521192 | aio | ok 2026-03-05 16:31:42.532946 | aio | included: /var/lib/zuul/builds/eab25b2bf6de46359348732387283c61/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 16:31:42.540833 | 2026-03-05 16:31:42.540892 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-05 16:31:42.554635 | aio | skipping: Conditional result was False 2026-03-05 16:31:42.566184 | 2026-03-05 16:31:42.566248 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-05 16:31:43.063051 | aio | changed 2026-03-05 16:31:43.096313 | 2026-03-05 16:31:43.096441 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-05 16:31:43.306602 | aio | ok 2026-03-05 16:31:43.312076 | 2026-03-05 16:31:43.312143 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-05 16:31:43.864271 | aio | changed 2026-03-05 16:31:44.230778 | 2026-03-05 16:31:44.230910 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-05 16:31:44.804439 | aio | changed 2026-03-05 16:31:44.809859 | 2026-03-05 16:31:44.809923 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-05 16:31:44.833452 | aio | skipping: Conditional result was False 2026-03-05 16:31:44.843765 | 2026-03-05 16:31:44.843858 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-05 16:31:45.213592 | aio -> localhost | changed 2026-03-05 16:31:45.232363 | 2026-03-05 16:31:45.232434 | TASK [add-build-sshkey : Add back temp key] 2026-03-05 16:31:45.493502 | aio -> localhost | Identity added: /var/lib/zuul/builds/eab25b2bf6de46359348732387283c61/work/eab25b2bf6de46359348732387283c61_id_rsa (zuul-build-sshkey) 2026-03-05 16:31:45.493854 | aio -> localhost | ok: Runtime: 0:00:00.013666 2026-03-05 16:31:45.502121 | 2026-03-05 16:31:45.502210 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-05 16:31:45.853485 | aio | ok 2026-03-05 16:31:45.860733 | 2026-03-05 16:31:45.860823 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-05 16:31:45.885751 | aio | skipping: Conditional result was False 2026-03-05 16:31:45.901961 | 2026-03-05 16:31:45.902034 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-05 16:31:46.267396 | aio | ok 2026-03-05 16:31:46.283511 | 2026-03-05 16:31:46.283606 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-05 16:31:47.105647 | aio | Output suppressed because no_log was given 2026-03-05 16:31:47.147321 | 2026-03-05 16:31:47.973714 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-05 16:31:48.206356 | aio | ok: "logs" 2026-03-05 16:31:48.206610 | aio | ok: All items complete 2026-03-05 16:31:48.206649 | 2026-03-05 16:31:48.395523 | aio | ok: "artifacts" 2026-03-05 16:31:48.585126 | aio | ok: "docs" 2026-03-05 16:31:48.598615 | 2026-03-05 16:31:48.598817 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-05 16:31:48.818918 | aio | changed: "logs" 2026-03-05 16:31:49.001455 | aio | changed: "artifacts" 2026-03-05 16:31:49.238072 | aio | changed: "docs" 2026-03-05 16:31:49.258590 | 2026-03-05 16:31:49.679038 | PLAY RECAP 2026-03-05 16:31:49.679302 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 16:31:49.679380 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 16:31:49.679437 | 2026-03-05 16:31:49.843895 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 16:31:50.056605 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 16:31:50.649610 | 2026-03-05 16:31:51.060340 | PLAY [all] 2026-03-05 16:31:51.079100 | 2026-03-05 16:31:51.079215 | TASK [setup-uv : Extract archive] 2026-03-05 16:31:53.500572 | aio | changed 2026-03-05 16:31:54.433094 | 2026-03-05 16:31:54.433211 | TASK [setup-uv : Print version] 2026-03-05 16:31:54.113474 | aio | uv 0.8.13 2026-03-05 16:31:54.971557 | aio | ok: Runtime: 0:00:00.019672 2026-03-05 16:31:54.977876 | 2026-03-05 16:31:54.977923 | PLAY RECAP 2026-03-05 16:31:54.977968 | aio | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 16:31:54.977991 | 2026-03-05 16:31:55.101879 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 16:31:55.103480 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 16:31:55.691924 | 2026-03-05 16:31:55.692047 | PLAY [all] 2026-03-05 16:31:55.704184 | 2026-03-05 16:31:55.704256 | TASK [Copy inventory file for Zuul] 2026-03-05 16:31:56.660903 | aio | changed 2026-03-05 16:31:56.668310 | 2026-03-05 16:31:56.668410 | TASK [Switch "ansible_host" to private IP] 2026-03-05 16:31:57.027560 | aio | changed: 1 replacements made 2026-03-05 16:31:57.035958 | 2026-03-05 16:31:57.036045 | TASK [Run Molecule scenario] 2026-03-05 16:31:57.504973 | aio | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-03-05 16:31:57.505165 | aio | Creating virtual environment at: .venv 2026-03-05 16:31:57.824191 | aio | Downloading pygments (1.2MiB) 2026-03-05 16:31:57.824983 | aio | Downloading cryptography (4.3MiB) 2026-03-05 16:31:57.825604 | aio | Downloading netaddr (2.2MiB) 2026-03-05 16:31:57.845506 | aio | Downloading ansible-core (2.1MiB) 2026-03-05 16:31:58.016164 | aio | Downloading netaddr 2026-03-05 16:31:58.025662 | aio | Downloading cryptography 2026-03-05 16:31:58.098019 | aio | Downloading pygments 2026-03-05 16:31:58.280523 | aio | Downloading ansible-core 2026-03-05 16:31:58.330443 | aio | Installed 37 packages in 48ms 2026-03-05 16:31:59.073222 | aio | INFO Collection 'vexxhost.ceph' detected. 2026-03-05 16:31:59.073325 | aio | INFO Scenarios will be used from 'extensions/molecule' 2026-03-05 16:31:59.795140 | aio | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-05 16:31:59.795233 | aio | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-05 16:32:12.437317 | aio | INFO [default > dependency] Executing 2026-03-05 16:32:12.437447 | aio | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-05 16:32:12.437655 | aio | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-05 16:32:12.437804 | aio | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-05 16:32:12.443602 | aio | INFO [default > cleanup] Executing 2026-03-05 16:32:12.443926 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:32:12.449632 | aio | INFO [default > destroy] Executing 2026-03-05 16:32:12.449716 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 16:32:12.449782 | aio | INFO [default > destroy] Executed: Successful 2026-03-05 16:32:12.455419 | aio | INFO [default > syntax] Executing 2026-03-05 16:32:13.602689 | aio | 2026-03-05 16:32:13.602951 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-05 16:32:13.693355 | aio | INFO [default > syntax] Executed: Successful 2026-03-05 16:32:13.703520 | aio | INFO [default > create] Executing 2026-03-05 16:32:13.705779 | aio | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:32:13.713462 | aio | INFO [default > prepare] Executing 2026-03-05 16:32:14.524828 | aio | 2026-03-05 16:32:14.525065 | aio | PLAY [Prepare] ***************************************************************** 2026-03-05 16:32:14.525311 | aio | 2026-03-05 16:32:14.525549 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:32:14.525795 | aio | Thursday 05 March 2026 16:32:14 +0000 (0:00:00.034) 0:00:00.034 ******** 2026-03-05 16:32:15.829162 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 16:32:15.829407 | aio | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 16:32:15.829686 | aio | interpreter could change the meaning of that path. See 2026-03-05 16:32:15.829972 | aio | https://docs.ansible.com/ansible- 2026-03-05 16:32:15.830360 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:32:15.838827 | aio | ok: [aio] 2026-03-05 16:32:15.839060 | aio | 2026-03-05 16:32:15.839400 | aio | TASK [Configure short hostname] ************************************************ 2026-03-05 16:32:15.839636 | aio | Thursday 05 March 2026 16:32:15 +0000 (0:00:01.315) 0:00:01.349 ******** 2026-03-05 16:32:16.601631 | aio | changed: [aio] 2026-03-05 16:32:16.601728 | aio | 2026-03-05 16:32:16.602003 | aio | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-05 16:32:16.602289 | aio | Thursday 05 March 2026 16:32:16 +0000 (0:00:00.762) 0:00:02.111 ******** 2026-03-05 16:32:16.937282 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-05 16:32:16.937481 | aio | with a mode of 0700, this may cause issues when running as another user. To 2026-03-05 16:32:16.937742 | aio | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-05 16:32:16.945944 | aio | changed: [aio] 2026-03-05 16:32:16.946230 | aio | 2026-03-05 16:32:16.946490 | aio | TASK [Update apt cache] ******************************************************** 2026-03-05 16:32:16.946752 | aio | Thursday 05 March 2026 16:32:16 +0000 (0:00:00.344) 0:00:02.456 ******** 2026-03-05 16:32:23.259999 | aio | changed: [aio] 2026-03-05 16:32:23.260243 | aio | 2026-03-05 16:32:23.260461 | aio | PLAY [Create devices for Ceph] ************************************************* 2026-03-05 16:32:23.260629 | aio | 2026-03-05 16:32:23.260806 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:32:23.261010 | aio | Thursday 05 March 2026 16:32:23 +0000 (0:00:06.313) 0:00:08.769 ******** 2026-03-05 16:32:25.084072 | aio | ok: [aio] 2026-03-05 16:32:25.084108 | aio | 2026-03-05 16:32:25.084215 | aio | TASK [Install depedencies] ***************************************************** 2026-03-05 16:32:25.084456 | aio | Thursday 05 March 2026 16:32:25 +0000 (0:00:01.824) 0:00:10.594 ******** 2026-03-05 16:32:44.278241 | aio | changed: [aio] 2026-03-05 16:32:44.278382 | aio | 2026-03-05 16:32:44.278636 | aio | TASK [Start up service] ******************************************************** 2026-03-05 16:32:44.278920 | aio | Thursday 05 March 2026 16:32:44 +0000 (0:00:19.194) 0:00:29.788 ******** 2026-03-05 16:32:44.895963 | aio | ok: [aio] 2026-03-05 16:32:44.896081 | aio | 2026-03-05 16:32:44.896102 | aio | TASK [Generate lvm.conf] ******************************************************* 2026-03-05 16:32:44.896118 | aio | Thursday 05 March 2026 16:32:44 +0000 (0:00:00.617) 0:00:30.405 ******** 2026-03-05 16:32:45.231999 | aio | ok: [aio] 2026-03-05 16:32:45.232089 | aio | 2026-03-05 16:32:45.232103 | aio | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-05 16:32:45.232116 | aio | Thursday 05 March 2026 16:32:45 +0000 (0:00:00.335) 0:00:30.741 ******** 2026-03-05 16:32:45.989198 | aio | changed: [aio] 2026-03-05 16:32:45.989251 | aio | 2026-03-05 16:32:45.989266 | aio | TASK [Get list of all loopback devices] **************************************** 2026-03-05 16:32:45.989539 | aio | Thursday 05 March 2026 16:32:45 +0000 (0:00:00.757) 0:00:31.499 ******** 2026-03-05 16:32:46.238815 | aio | ok: [aio] 2026-03-05 16:32:46.238999 | aio | 2026-03-05 16:32:46.239306 | aio | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-05 16:32:46.239592 | aio | Thursday 05 March 2026 16:32:46 +0000 (0:00:00.249) 0:00:31.748 ******** 2026-03-05 16:32:46.265264 | aio | skipping: [aio] 2026-03-05 16:32:46.265456 | aio | 2026-03-05 16:32:46.265704 | aio | TASK [Create devices for Ceph] ************************************************* 2026-03-05 16:32:46.265960 | aio | Thursday 05 March 2026 16:32:46 +0000 (0:00:00.027) 0:00:31.776 ******** 2026-03-05 16:32:46.956019 | aio | changed: [aio] => (item=osd0) 2026-03-05 16:32:46.956287 | aio | changed: [aio] => (item=osd1) 2026-03-05 16:32:46.956540 | aio | changed: [aio] => (item=osd2) 2026-03-05 16:32:46.956767 | aio | 2026-03-05 16:32:46.957015 | aio | TASK [Set permissions on loopback devices] ************************************* 2026-03-05 16:32:46.957300 | aio | Thursday 05 March 2026 16:32:46 +0000 (0:00:00.688) 0:00:32.465 ******** 2026-03-05 16:32:47.729453 | aio | changed: [aio] => (item=osd0) 2026-03-05 16:32:47.729716 | aio | changed: [aio] => (item=osd1) 2026-03-05 16:32:47.729929 | aio | changed: [aio] => (item=osd2) 2026-03-05 16:32:47.730191 | aio | 2026-03-05 16:32:47.730450 | aio | TASK [Start loop devices] ****************************************************** 2026-03-05 16:32:47.730679 | aio | Thursday 05 March 2026 16:32:47 +0000 (0:00:00.774) 0:00:33.239 ******** 2026-03-05 16:32:48.535759 | aio | changed: [aio] => (item=osd0) 2026-03-05 16:32:48.536001 | aio | changed: [aio] => (item=osd1) 2026-03-05 16:32:48.536333 | aio | changed: [aio] => (item=osd2) 2026-03-05 16:32:48.536572 | aio | 2026-03-05 16:32:48.536838 | aio | TASK [Create a volume group for each loop device] ****************************** 2026-03-05 16:32:48.537145 | aio | Thursday 05 March 2026 16:32:48 +0000 (0:00:00.806) 0:00:34.045 ******** 2026-03-05 16:32:50.036200 | aio | changed: [aio] => (item=osd0) 2026-03-05 16:32:50.036267 | aio | changed: [aio] => (item=osd1) 2026-03-05 16:32:50.036284 | aio | changed: [aio] => (item=osd2) 2026-03-05 16:32:50.036298 | aio | 2026-03-05 16:32:50.036313 | aio | TASK [Create a logical volume for each loop device] **************************** 2026-03-05 16:32:50.036488 | aio | Thursday 05 March 2026 16:32:50 +0000 (0:00:01.499) 0:00:35.545 ******** 2026-03-05 16:32:51.326124 | aio | changed: [aio] => (item=ceph-aio-osd0) 2026-03-05 16:32:51.326184 | aio | changed: [aio] => (item=ceph-aio-osd1) 2026-03-05 16:32:51.327201 | aio | changed: [aio] => (item=ceph-aio-osd2) 2026-03-05 16:32:51.327285 | aio | 2026-03-05 16:32:51.327296 | aio | PLAY RECAP ********************************************************************* 2026-03-05 16:32:51.327307 | aio | aio : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-05 16:32:51.327318 | aio | 2026-03-05 16:32:51.327328 | aio | 2026-03-05 16:32:51.327336 | aio | TASKS RECAP ******************************************************************** 2026-03-05 16:32:51.327354 | aio | Thursday 05 March 2026 16:32:51 +0000 (0:00:01.291) 0:00:36.836 ******** 2026-03-05 16:32:51.328094 | aio | =============================================================================== 2026-03-05 16:32:51.328110 | aio | Install depedencies ---------------------------------------------------- 19.19s 2026-03-05 16:32:51.328119 | aio | Update apt cache -------------------------------------------------------- 6.31s 2026-03-05 16:32:51.328129 | aio | Gathering Facts --------------------------------------------------------- 1.82s 2026-03-05 16:32:51.328137 | aio | Create a volume group for each loop device ------------------------------ 1.50s 2026-03-05 16:32:51.328150 | aio | Gathering Facts --------------------------------------------------------- 1.32s 2026-03-05 16:32:51.328330 | aio | Create a logical volume for each loop device ---------------------------- 1.29s 2026-03-05 16:32:51.329141 | aio | Start loop devices ------------------------------------------------------ 0.81s 2026-03-05 16:32:51.329206 | aio | Set permissions on loopback devices ------------------------------------- 0.77s 2026-03-05 16:32:51.329215 | aio | Configure short hostname ------------------------------------------------ 0.76s 2026-03-05 16:32:51.329224 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.76s 2026-03-05 16:32:51.329240 | aio | Create devices for Ceph ------------------------------------------------- 0.69s 2026-03-05 16:32:51.329951 | aio | Start up service -------------------------------------------------------- 0.62s 2026-03-05 16:32:51.329969 | aio | Ensure hostname inside hosts file --------------------------------------- 0.34s 2026-03-05 16:32:51.329975 | aio | Generate lvm.conf ------------------------------------------------------- 0.34s 2026-03-05 16:32:51.329981 | aio | Get list of all loopback devices ---------------------------------------- 0.25s 2026-03-05 16:32:51.329986 | aio | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-03-05 16:32:51.407418 | aio | INFO [default > prepare] Executed: Successful 2026-03-05 16:32:51.417410 | aio | INFO [default > converge] Executing 2026-03-05 16:32:52.347740 | aio | 2026-03-05 16:32:52.347922 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 16:32:52.348209 | aio | 2026-03-05 16:32:52.348453 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:32:52.348713 | aio | Thursday 05 March 2026 16:32:52 +0000 (0:00:00.052) 0:00:00.052 ******** 2026-03-05 16:32:54.585068 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 16:32:54.585498 | aio | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 16:32:54.585596 | aio | interpreter could change the meaning of that path. See 2026-03-05 16:32:54.585865 | aio | https://docs.ansible.com/ansible- 2026-03-05 16:32:54.586150 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:32:54.599466 | aio | ok: [aio] 2026-03-05 16:32:54.599694 | aio | 2026-03-05 16:32:54.599956 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:32:54.600233 | aio | Thursday 05 March 2026 16:32:54 +0000 (0:00:02.252) 0:00:02.304 ******** 2026-03-05 16:32:54.931758 | aio | ok: [aio] 2026-03-05 16:32:54.931849 | aio | 2026-03-05 16:32:54.931922 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:32:54.932022 | aio | Thursday 05 March 2026 16:32:54 +0000 (0:00:00.332) 0:00:02.636 ******** 2026-03-05 16:32:54.974613 | aio | skipping: [aio] 2026-03-05 16:32:54.974803 | aio | 2026-03-05 16:32:54.975052 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:32:54.975347 | aio | Thursday 05 March 2026 16:32:54 +0000 (0:00:00.043) 0:00:02.679 ******** 2026-03-05 16:32:55.321157 | aio | changed: [aio] 2026-03-05 16:32:55.321259 | aio | 2026-03-05 16:32:55.321579 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:32:55.321825 | aio | Thursday 05 March 2026 16:32:55 +0000 (0:00:00.346) 0:00:03.026 ******** 2026-03-05 16:32:55.421394 | aio | ok: [aio] => { 2026-03-05 16:32:55.421661 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:32:55.421899 | aio | } 2026-03-05 16:32:55.422184 | aio | 2026-03-05 16:32:55.422457 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:32:55.422657 | aio | Thursday 05 March 2026 16:32:55 +0000 (0:00:00.100) 0:00:03.126 ******** 2026-03-05 16:32:56.197962 | aio | changed: [aio] 2026-03-05 16:32:56.198257 | aio | 2026-03-05 16:32:56.198577 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:32:56.198871 | aio | Thursday 05 March 2026 16:32:56 +0000 (0:00:00.776) 0:00:03.902 ******** 2026-03-05 16:32:56.248017 | aio | skipping: [aio] 2026-03-05 16:32:56.248338 | aio | 2026-03-05 16:32:56.248667 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:32:56.248970 | aio | Thursday 05 March 2026 16:32:56 +0000 (0:00:00.050) 0:00:03.953 ******** 2026-03-05 16:32:56.293137 | aio | skipping: [aio] 2026-03-05 16:32:56.293756 | aio | 2026-03-05 16:32:56.293773 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:32:56.293827 | aio | Thursday 05 March 2026 16:32:56 +0000 (0:00:00.045) 0:00:03.998 ******** 2026-03-05 16:32:56.536071 | aio | ok: [aio] 2026-03-05 16:32:56.536240 | aio | 2026-03-05 16:32:56.536851 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:32:56.536903 | aio | Thursday 05 March 2026 16:32:56 +0000 (0:00:00.242) 0:00:04.240 ******** 2026-03-05 16:32:57.581876 | aio | ok: [aio] 2026-03-05 16:32:57.581933 | aio | 2026-03-05 16:32:57.581943 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:32:57.581953 | aio | Thursday 05 March 2026 16:32:57 +0000 (0:00:01.045) 0:00:05.286 ******** 2026-03-05 16:32:57.777205 | aio | ok: [aio] => { 2026-03-05 16:32:57.777432 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:32:57.777695 | aio | } 2026-03-05 16:32:57.777922 | aio | 2026-03-05 16:32:57.778234 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:32:57.778479 | aio | Thursday 05 March 2026 16:32:57 +0000 (0:00:00.195) 0:00:05.482 ******** 2026-03-05 16:32:58.772469 | aio | changed: [aio] 2026-03-05 16:32:58.772548 | aio | 2026-03-05 16:32:58.772724 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:32:58.772876 | aio | Thursday 05 March 2026 16:32:58 +0000 (0:00:00.985) 0:00:06.467 ******** 2026-03-05 16:33:01.886988 | aio | changed: [aio] 2026-03-05 16:33:01.887075 | aio | 2026-03-05 16:33:01.887090 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:33:01.887122 | aio | Thursday 05 March 2026 16:33:01 +0000 (0:00:03.123) 0:00:09.591 ******** 2026-03-05 16:33:01.922114 | aio | skipping: [aio] 2026-03-05 16:33:01.922143 | aio | 2026-03-05 16:33:01.922662 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:33:01.922689 | aio | Thursday 05 March 2026 16:33:01 +0000 (0:00:00.034) 0:00:09.626 ******** 2026-03-05 16:33:01.952389 | aio | skipping: [aio] 2026-03-05 16:33:01.952451 | aio | 2026-03-05 16:33:01.952462 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:33:01.952472 | aio | Thursday 05 March 2026 16:33:01 +0000 (0:00:00.029) 0:00:09.656 ******** 2026-03-05 16:33:01.988498 | aio | skipping: [aio] 2026-03-05 16:33:01.990132 | aio | 2026-03-05 16:33:01.990166 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:33:01.990177 | aio | Thursday 05 March 2026 16:33:01 +0000 (0:00:00.036) 0:00:09.693 ******** 2026-03-05 16:33:09.088456 | aio | changed: [aio] 2026-03-05 16:33:09.088495 | aio | 2026-03-05 16:33:09.088504 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:33:09.088516 | aio | Thursday 05 March 2026 16:33:09 +0000 (0:00:07.098) 0:00:16.792 ******** 2026-03-05 16:33:09.739156 | aio | changed: [aio] 2026-03-05 16:33:09.739605 | aio | 2026-03-05 16:33:09.740064 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:33:09.740194 | aio | Thursday 05 March 2026 16:33:09 +0000 (0:00:00.651) 0:00:17.443 ******** 2026-03-05 16:33:10.820877 | aio | changed: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 16:33:10.820911 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:33:10.820918 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:33:10.820924 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:33:10.820929 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:33:10.821654 | aio | 2026-03-05 16:33:10.821741 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:33:10.821756 | aio | Thursday 05 March 2026 16:33:10 +0000 (0:00:01.081) 0:00:18.524 ******** 2026-03-05 16:33:11.517145 | aio | changed: [aio] 2026-03-05 16:33:11.517199 | aio | 2026-03-05 16:33:11.518125 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:33:11.518145 | aio | Thursday 05 March 2026 16:33:11 +0000 (0:00:00.688) 0:00:19.212 ******** 2026-03-05 16:33:11.518157 | aio | 2026-03-05 16:33:11.518169 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 16:33:11.518377 | aio | Thursday 05 March 2026 16:33:11 +0000 (0:00:00.008) 0:00:19.221 ******** 2026-03-05 16:33:12.635814 | aio | ok: [aio] 2026-03-05 16:33:12.636062 | aio | 2026-03-05 16:33:12.636333 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 16:33:12.636588 | aio | Thursday 05 March 2026 16:33:12 +0000 (0:00:01.118) 0:00:20.339 ******** 2026-03-05 16:33:13.197934 | aio | changed: [aio] 2026-03-05 16:33:13.198170 | aio | 2026-03-05 16:33:13.198425 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:33:13.198671 | aio | Thursday 05 March 2026 16:33:13 +0000 (0:00:00.563) 0:00:20.902 ******** 2026-03-05 16:33:13.898195 | aio | changed: [aio] 2026-03-05 16:33:13.898245 | aio | 2026-03-05 16:33:13.898265 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:33:13.898500 | aio | Thursday 05 March 2026 16:33:13 +0000 (0:00:00.699) 0:00:21.602 ******** 2026-03-05 16:33:14.146131 | aio | ok: [aio] 2026-03-05 16:33:14.146198 | aio | 2026-03-05 16:33:14.146683 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:33:14.146743 | aio | Thursday 05 March 2026 16:33:14 +0000 (0:00:00.248) 0:00:21.850 ******** 2026-03-05 16:33:14.224520 | aio | ok: [aio] => { 2026-03-05 16:33:14.225207 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:33:14.225262 | aio | } 2026-03-05 16:33:14.225273 | aio | 2026-03-05 16:33:14.225284 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:33:14.225300 | aio | Thursday 05 March 2026 16:33:14 +0000 (0:00:00.076) 0:00:21.927 ******** 2026-03-05 16:33:15.383140 | aio | changed: [aio] 2026-03-05 16:33:15.383193 | aio | 2026-03-05 16:33:15.383202 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:33:15.383210 | aio | Thursday 05 March 2026 16:33:15 +0000 (0:00:01.159) 0:00:23.086 ******** 2026-03-05 16:33:19.920686 | aio | changed: [aio] 2026-03-05 16:33:19.920744 | aio | 2026-03-05 16:33:19.920758 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:33:19.920771 | aio | Thursday 05 March 2026 16:33:19 +0000 (0:00:04.537) 0:00:27.624 ******** 2026-03-05 16:33:20.839161 | aio | ok: [aio] 2026-03-05 16:33:20.839228 | aio | 2026-03-05 16:33:20.839622 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:33:20.839684 | aio | Thursday 05 March 2026 16:33:20 +0000 (0:00:00.917) 0:00:28.542 ******** 2026-03-05 16:33:21.224550 | aio | changed: [aio] 2026-03-05 16:33:21.224600 | aio | 2026-03-05 16:33:21.224614 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:33:21.224627 | aio | Thursday 05 March 2026 16:33:21 +0000 (0:00:00.385) 0:00:28.927 ******** 2026-03-05 16:33:21.773617 | aio | changed: [aio] 2026-03-05 16:33:21.773677 | aio | 2026-03-05 16:33:21.773691 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:33:21.773703 | aio | Thursday 05 March 2026 16:33:21 +0000 (0:00:00.549) 0:00:29.476 ******** 2026-03-05 16:33:22.457163 | aio | changed: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 16:33:22.457212 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:33:22.458077 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:33:22.458138 | aio | 2026-03-05 16:33:22.458152 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:33:22.458165 | aio | Thursday 05 March 2026 16:33:22 +0000 (0:00:00.684) 0:00:30.161 ******** 2026-03-05 16:33:23.009147 | aio | changed: [aio] 2026-03-05 16:33:23.009214 | aio | 2026-03-05 16:33:23.009788 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:33:23.009839 | aio | Thursday 05 March 2026 16:33:23 +0000 (0:00:00.552) 0:00:30.713 ******** 2026-03-05 16:33:23.581380 | aio | changed: [aio] 2026-03-05 16:33:23.581430 | aio | 2026-03-05 16:33:23.581444 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:33:23.581457 | aio | Thursday 05 March 2026 16:33:23 +0000 (0:00:00.563) 0:00:31.277 ******** 2026-03-05 16:33:23.581498 | aio | 2026-03-05 16:33:23.581511 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 16:33:23.581523 | aio | Thursday 05 March 2026 16:33:23 +0000 (0:00:00.007) 0:00:31.284 ******** 2026-03-05 16:33:24.495118 | aio | ok: [aio] 2026-03-05 16:33:24.495169 | aio | 2026-03-05 16:33:24.495536 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 16:33:24.495606 | aio | Thursday 05 March 2026 16:33:24 +0000 (0:00:00.915) 0:00:32.199 ******** 2026-03-05 16:33:26.014448 | aio | changed: [aio] 2026-03-05 16:33:26.014514 | aio | 2026-03-05 16:33:26.014699 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:33:26.014804 | aio | Thursday 05 March 2026 16:33:26 +0000 (0:00:01.519) 0:00:33.719 ******** 2026-03-05 16:33:27.722152 | aio | changed: [aio] 2026-03-05 16:33:27.722217 | aio | 2026-03-05 16:33:27.722662 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:33:27.722720 | aio | Thursday 05 March 2026 16:33:27 +0000 (0:00:01.707) 0:00:35.426 ******** 2026-03-05 16:33:27.781519 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 16:33:27.781563 | aio | 2026-03-05 16:33:27.781574 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:33:27.781583 | aio | Thursday 05 March 2026 16:33:27 +0000 (0:00:00.058) 0:00:35.485 ******** 2026-03-05 16:33:28.743525 | aio | ok: [aio] 2026-03-05 16:33:28.743584 | aio | 2026-03-05 16:33:28.743624 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:33:28.743636 | aio | Thursday 05 March 2026 16:33:28 +0000 (0:00:00.961) 0:00:36.447 ******** 2026-03-05 16:33:29.539187 | aio | ok: [aio] => (item=systemd-timesyncd) 2026-03-05 16:33:29.539256 | aio | ok: [aio] => (item=ssh) 2026-03-05 16:33:29.539985 | aio | 2026-03-05 16:33:29.540008 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:33:29.540019 | aio | Thursday 05 March 2026 16:33:29 +0000 (0:00:00.795) 0:00:37.242 ******** 2026-03-05 16:33:29.947191 | aio | changed: [aio] 2026-03-05 16:33:29.947247 | aio | 2026-03-05 16:33:29.947339 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:33:29.947589 | aio | Thursday 05 March 2026 16:33:29 +0000 (0:00:00.409) 0:00:37.651 ******** 2026-03-05 16:33:30.188082 | aio | ok: [aio] 2026-03-05 16:33:30.188287 | aio | 2026-03-05 16:33:30.188598 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:33:30.188858 | aio | Thursday 05 March 2026 16:33:30 +0000 (0:00:00.240) 0:00:37.892 ******** 2026-03-05 16:33:30.757570 | aio | changed: [aio] 2026-03-05 16:33:30.757743 | aio | 2026-03-05 16:33:30.758086 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:33:30.758315 | aio | Thursday 05 March 2026 16:33:30 +0000 (0:00:00.569) 0:00:38.462 ******** 2026-03-05 16:33:31.172898 | aio | changed: [aio] 2026-03-05 16:33:31.173016 | aio | 2026-03-05 16:33:31.173325 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 16:33:31.173568 | aio | Thursday 05 March 2026 16:33:31 +0000 (0:00:00.415) 0:00:38.877 ******** 2026-03-05 16:33:31.303392 | aio | ok: [aio] 2026-03-05 16:33:31.303594 | aio | 2026-03-05 16:33:31.303886 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 16:33:31.304220 | aio | Thursday 05 March 2026 16:33:31 +0000 (0:00:00.130) 0:00:39.008 ******** 2026-03-05 16:33:31.568883 | aio | ok: [aio] => (item=aio) 2026-03-05 16:33:31.569099 | aio | 2026-03-05 16:33:31.569361 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 16:33:31.569610 | aio | Thursday 05 March 2026 16:33:31 +0000 (0:00:00.265) 0:00:39.273 ******** 2026-03-05 16:33:31.630249 | aio | ok: [aio] 2026-03-05 16:33:31.630540 | aio | 2026-03-05 16:33:31.630802 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 16:33:31.631051 | aio | Thursday 05 March 2026 16:33:31 +0000 (0:00:00.061) 0:00:39.335 ******** 2026-03-05 16:33:31.777021 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for aio 2026-03-05 16:33:31.777235 | aio | 2026-03-05 16:33:31.777490 | aio | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-05 16:33:31.777741 | aio | Thursday 05 March 2026 16:33:31 +0000 (0:00:00.146) 0:00:39.481 ******** 2026-03-05 16:33:32.090788 | aio | changed: [aio] 2026-03-05 16:33:32.090964 | aio | 2026-03-05 16:33:32.091268 | aio | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-05 16:33:32.091512 | aio | Thursday 05 March 2026 16:33:32 +0000 (0:00:00.313) 0:00:39.795 ******** 2026-03-05 16:33:32.865794 | aio | changed: [aio] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-05 16:33:32.866245 | aio | changed: [aio] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-05 16:33:32.866542 | aio | changed: [aio] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-05 16:33:32.866778 | aio | 2026-03-05 16:33:32.867187 | aio | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-05 16:33:32.867566 | aio | Thursday 05 March 2026 16:33:32 +0000 (0:00:00.774) 0:00:40.570 ******** 2026-03-05 16:35:46.243740 | aio | ok: [aio] 2026-03-05 16:35:46.243955 | aio | 2026-03-05 16:35:46.244308 | aio | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-05 16:35:46.244615 | aio | Thursday 05 March 2026 16:35:46 +0000 (0:02:13.378) 0:02:53.948 ******** 2026-03-05 16:35:46.505588 | aio | changed: [aio] 2026-03-05 16:35:46.505758 | aio | 2026-03-05 16:35:46.506053 | aio | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-05 16:35:46.506313 | aio | Thursday 05 March 2026 16:35:46 +0000 (0:00:00.261) 0:02:54.210 ******** 2026-03-05 16:35:46.548653 | aio | ok: [aio] 2026-03-05 16:35:46.548869 | aio | 2026-03-05 16:35:46.549166 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:35:46.549419 | aio | Thursday 05 March 2026 16:35:46 +0000 (0:00:00.043) 0:02:54.253 ******** 2026-03-05 16:35:46.629339 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 16:35:46.629383 | aio | 2026-03-05 16:35:46.629518 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:35:46.632120 | aio | Thursday 05 March 2026 16:35:46 +0000 (0:00:00.080) 0:02:54.334 ******** 2026-03-05 16:35:52.233901 | aio | ok: [aio] 2026-03-05 16:35:52.233968 | aio | 2026-03-05 16:35:52.233982 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:35:52.233995 | aio | Thursday 05 March 2026 16:35:52 +0000 (0:00:05.603) 0:02:59.937 ******** 2026-03-05 16:35:52.286440 | aio | ok: [aio] => (item=aio) 2026-03-05 16:35:52.286504 | aio | 2026-03-05 16:35:52.286624 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:35:52.286734 | aio | Thursday 05 March 2026 16:35:52 +0000 (0:00:00.051) 0:02:59.989 ******** 2026-03-05 16:35:52.713450 | aio | ok: [aio] 2026-03-05 16:35:52.713489 | aio | 2026-03-05 16:35:52.713498 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:35:52.713506 | aio | Thursday 05 March 2026 16:35:52 +0000 (0:00:00.428) 0:03:00.418 ******** 2026-03-05 16:36:00.774607 | aio | ok: [aio] 2026-03-05 16:36:00.774677 | aio | 2026-03-05 16:36:00.774688 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 16:36:00.774698 | aio | Thursday 05 March 2026 16:36:00 +0000 (0:00:08.060) 0:03:08.478 ******** 2026-03-05 16:36:13.965616 | aio | changed: [aio] 2026-03-05 16:36:13.965694 | aio | 2026-03-05 16:36:13.965712 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 16:36:13.965728 | aio | Thursday 05 March 2026 16:36:13 +0000 (0:00:13.191) 0:03:21.669 ******** 2026-03-05 16:36:28.563755 | aio | ok: [aio] 2026-03-05 16:36:28.563826 | aio | 2026-03-05 16:36:28.563841 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:36:28.563856 | aio | Thursday 05 March 2026 16:36:28 +0000 (0:00:14.597) 0:03:36.267 ******** 2026-03-05 16:36:28.634265 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 16:36:28.634467 | aio | 2026-03-05 16:36:28.634731 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:36:28.635004 | aio | Thursday 05 March 2026 16:36:28 +0000 (0:00:00.071) 0:03:36.339 ******** 2026-03-05 16:36:28.684801 | aio | skipping: [aio] 2026-03-05 16:36:28.684994 | aio | 2026-03-05 16:36:28.685336 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:36:28.685584 | aio | Thursday 05 March 2026 16:36:28 +0000 (0:00:00.050) 0:03:36.389 ******** 2026-03-05 16:36:28.736248 | aio | skipping: [aio] => (item=aio) 2026-03-05 16:36:28.736478 | aio | skipping: [aio] 2026-03-05 16:36:28.736700 | aio | 2026-03-05 16:36:28.736954 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:36:28.737233 | aio | Thursday 05 March 2026 16:36:28 +0000 (0:00:00.051) 0:03:36.441 ******** 2026-03-05 16:36:29.048979 | aio | ok: [aio] 2026-03-05 16:36:29.049069 | aio | 2026-03-05 16:36:29.049085 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:36:29.049095 | aio | Thursday 05 March 2026 16:36:29 +0000 (0:00:00.311) 0:03:36.753 ******** 2026-03-05 16:36:36.158223 | aio | ok: [aio] 2026-03-05 16:36:36.158300 | aio | 2026-03-05 16:36:36.158544 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 16:36:36.158786 | aio | Thursday 05 March 2026 16:36:36 +0000 (0:00:07.109) 0:03:43.863 ******** 2026-03-05 16:36:48.994887 | aio | changed: [aio] 2026-03-05 16:36:48.995079 | aio | 2026-03-05 16:36:48.995386 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 16:36:48.995630 | aio | Thursday 05 March 2026 16:36:48 +0000 (0:00:12.836) 0:03:56.699 ******** 2026-03-05 16:36:55.633524 | aio | ok: [aio] 2026-03-05 16:36:55.633599 | aio | 2026-03-05 16:36:55.633614 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 16:36:55.633628 | aio | Thursday 05 March 2026 16:36:55 +0000 (0:00:06.638) 0:04:03.337 ******** 2026-03-05 16:37:03.973595 | aio | changed: [aio] => (item={'name': 'diskprediction_local'}) 2026-03-05 16:37:03.973673 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-03-05 16:37:03.973797 | aio | changed: [aio] => (item={'name': 'prometheus'}) 2026-03-05 16:37:03.973914 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-03-05 16:37:03.974023 | aio | 2026-03-05 16:37:03.974174 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 16:37:03.974270 | aio | 2026-03-05 16:37:03.974382 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:37:03.974496 | aio | Thursday 05 March 2026 16:37:03 +0000 (0:00:08.339) 0:04:11.676 ******** 2026-03-05 16:37:04.995608 | aio | ok: [aio] 2026-03-05 16:37:04.995821 | aio | 2026-03-05 16:37:04.996119 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:37:04.996368 | aio | Thursday 05 March 2026 16:37:04 +0000 (0:00:01.023) 0:04:12.700 ******** 2026-03-05 16:37:05.275115 | aio | ok: [aio] 2026-03-05 16:37:05.275336 | aio | 2026-03-05 16:37:05.275615 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:37:05.275864 | aio | Thursday 05 March 2026 16:37:05 +0000 (0:00:00.279) 0:04:12.980 ******** 2026-03-05 16:37:05.317152 | aio | skipping: [aio] 2026-03-05 16:37:05.317364 | aio | 2026-03-05 16:37:05.317621 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:37:05.317867 | aio | Thursday 05 March 2026 16:37:05 +0000 (0:00:00.042) 0:04:13.022 ******** 2026-03-05 16:37:05.579293 | aio | ok: [aio] 2026-03-05 16:37:05.579525 | aio | 2026-03-05 16:37:05.579831 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:37:05.580106 | aio | Thursday 05 March 2026 16:37:05 +0000 (0:00:00.261) 0:04:13.284 ******** 2026-03-05 16:37:05.640377 | aio | ok: [aio] => { 2026-03-05 16:37:05.640607 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:37:05.640828 | aio | } 2026-03-05 16:37:05.641076 | aio | 2026-03-05 16:37:05.641356 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:37:05.641639 | aio | Thursday 05 March 2026 16:37:05 +0000 (0:00:00.061) 0:04:13.345 ******** 2026-03-05 16:37:06.024636 | aio | ok: [aio] 2026-03-05 16:37:06.024698 | aio | 2026-03-05 16:37:06.024712 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:37:06.024725 | aio | Thursday 05 March 2026 16:37:06 +0000 (0:00:00.383) 0:04:13.728 ******** 2026-03-05 16:37:06.075494 | aio | skipping: [aio] 2026-03-05 16:37:06.075566 | aio | 2026-03-05 16:37:06.075688 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:37:06.075798 | aio | Thursday 05 March 2026 16:37:06 +0000 (0:00:00.050) 0:04:13.778 ******** 2026-03-05 16:37:06.122062 | aio | skipping: [aio] 2026-03-05 16:37:06.122107 | aio | 2026-03-05 16:37:06.122231 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:37:06.122337 | aio | Thursday 05 March 2026 16:37:06 +0000 (0:00:00.048) 0:04:13.827 ******** 2026-03-05 16:37:06.362693 | aio | ok: [aio] 2026-03-05 16:37:06.362729 | aio | 2026-03-05 16:37:06.362734 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:37:06.362739 | aio | Thursday 05 March 2026 16:37:06 +0000 (0:00:00.237) 0:04:14.065 ******** 2026-03-05 16:37:07.317523 | aio | ok: [aio] 2026-03-05 16:37:07.317553 | aio | 2026-03-05 16:37:07.317558 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:37:07.317563 | aio | Thursday 05 March 2026 16:37:07 +0000 (0:00:00.957) 0:04:15.022 ******** 2026-03-05 16:37:07.399250 | aio | ok: [aio] => { 2026-03-05 16:37:07.399288 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:37:07.399304 | aio | } 2026-03-05 16:37:07.399310 | aio | 2026-03-05 16:37:07.399316 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:37:07.399322 | aio | Thursday 05 March 2026 16:37:07 +0000 (0:00:00.079) 0:04:15.102 ******** 2026-03-05 16:37:07.813463 | aio | ok: [aio] 2026-03-05 16:37:07.813546 | aio | 2026-03-05 16:37:07.813664 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:37:07.813776 | aio | Thursday 05 March 2026 16:37:07 +0000 (0:00:00.415) 0:04:15.518 ******** 2026-03-05 16:37:09.930524 | aio | ok: [aio] 2026-03-05 16:37:09.930614 | aio | 2026-03-05 16:37:09.930641 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:37:09.930806 | aio | Thursday 05 March 2026 16:37:09 +0000 (0:00:02.117) 0:04:17.635 ******** 2026-03-05 16:37:09.967302 | aio | skipping: [aio] 2026-03-05 16:37:09.967357 | aio | 2026-03-05 16:37:09.967471 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:37:09.967584 | aio | Thursday 05 March 2026 16:37:09 +0000 (0:00:00.036) 0:04:17.671 ******** 2026-03-05 16:37:10.000918 | aio | skipping: [aio] 2026-03-05 16:37:10.000961 | aio | 2026-03-05 16:37:10.002142 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:37:10.002250 | aio | Thursday 05 March 2026 16:37:09 +0000 (0:00:00.035) 0:04:17.706 ******** 2026-03-05 16:37:10.034323 | aio | skipping: [aio] 2026-03-05 16:37:10.034407 | aio | 2026-03-05 16:37:10.034510 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:37:10.034673 | aio | Thursday 05 March 2026 16:37:10 +0000 (0:00:00.032) 0:04:17.739 ******** 2026-03-05 16:37:10.987438 | aio | ok: [aio] 2026-03-05 16:37:10.987500 | aio | 2026-03-05 16:37:10.987618 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:37:10.987730 | aio | Thursday 05 March 2026 16:37:10 +0000 (0:00:00.952) 0:04:18.691 ******** 2026-03-05 16:37:11.505714 | aio | ok: [aio] 2026-03-05 16:37:11.505826 | aio | 2026-03-05 16:37:11.505987 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:37:11.506178 | aio | Thursday 05 March 2026 16:37:11 +0000 (0:00:00.518) 0:04:19.210 ******** 2026-03-05 16:37:12.613449 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 16:37:12.613539 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:37:12.613667 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:37:12.613788 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:37:12.613907 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:37:12.614013 | aio | 2026-03-05 16:37:12.614147 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:37:12.614258 | aio | Thursday 05 March 2026 16:37:12 +0000 (0:00:01.104) 0:04:20.315 ******** 2026-03-05 16:37:13.223062 | aio | ok: [aio] 2026-03-05 16:37:13.223126 | aio | 2026-03-05 16:37:13.223275 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:37:13.223408 | aio | Thursday 05 March 2026 16:37:13 +0000 (0:00:00.606) 0:04:20.921 ******** 2026-03-05 16:37:13.223511 | aio | 2026-03-05 16:37:13.223652 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:37:13.223756 | aio | Thursday 05 March 2026 16:37:13 +0000 (0:00:00.006) 0:04:20.928 ******** 2026-03-05 16:37:13.694285 | aio | ok: [aio] 2026-03-05 16:37:13.694345 | aio | 2026-03-05 16:37:13.694449 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:37:13.694561 | aio | Thursday 05 March 2026 16:37:13 +0000 (0:00:00.469) 0:04:21.397 ******** 2026-03-05 16:37:13.947143 | aio | ok: [aio] 2026-03-05 16:37:13.947191 | aio | 2026-03-05 16:37:13.947323 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:37:13.947436 | aio | Thursday 05 March 2026 16:37:13 +0000 (0:00:00.255) 0:04:21.652 ******** 2026-03-05 16:37:14.008088 | aio | ok: [aio] => { 2026-03-05 16:37:14.008213 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:37:14.008379 | aio | } 2026-03-05 16:37:14.008518 | aio | 2026-03-05 16:37:14.008675 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:37:14.008832 | aio | Thursday 05 March 2026 16:37:14 +0000 (0:00:00.060) 0:04:21.713 ******** 2026-03-05 16:37:14.421362 | aio | ok: [aio] 2026-03-05 16:37:14.421448 | aio | 2026-03-05 16:37:14.421578 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:37:14.421703 | aio | Thursday 05 March 2026 16:37:14 +0000 (0:00:00.410) 0:04:22.124 ******** 2026-03-05 16:37:17.667477 | aio | ok: [aio] 2026-03-05 16:37:17.667543 | aio | 2026-03-05 16:37:17.667650 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:37:17.667762 | aio | Thursday 05 March 2026 16:37:17 +0000 (0:00:03.248) 0:04:25.372 ******** 2026-03-05 16:37:18.865118 | aio | ok: [aio] 2026-03-05 16:37:18.865187 | aio | 2026-03-05 16:37:18.865309 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:37:18.865421 | aio | Thursday 05 March 2026 16:37:18 +0000 (0:00:01.197) 0:04:26.570 ******** 2026-03-05 16:37:19.115517 | aio | ok: [aio] 2026-03-05 16:37:19.115580 | aio | 2026-03-05 16:37:19.115698 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:37:19.115820 | aio | Thursday 05 March 2026 16:37:19 +0000 (0:00:00.247) 0:04:26.817 ******** 2026-03-05 16:37:19.623869 | aio | ok: [aio] 2026-03-05 16:37:19.623940 | aio | 2026-03-05 16:37:19.624080 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:37:19.624192 | aio | Thursday 05 March 2026 16:37:19 +0000 (0:00:00.511) 0:04:27.329 ******** 2026-03-05 16:37:20.330870 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 16:37:20.330962 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:37:20.331191 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:37:20.331392 | aio | 2026-03-05 16:37:20.331520 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:37:20.331692 | aio | Thursday 05 March 2026 16:37:20 +0000 (0:00:00.706) 0:04:28.035 ******** 2026-03-05 16:37:20.849717 | aio | ok: [aio] 2026-03-05 16:37:20.849772 | aio | 2026-03-05 16:37:20.849854 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:37:20.849970 | aio | Thursday 05 March 2026 16:37:20 +0000 (0:00:00.519) 0:04:28.555 ******** 2026-03-05 16:37:21.385466 | aio | ok: [aio] 2026-03-05 16:37:21.385543 | aio | 2026-03-05 16:37:21.385626 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:37:21.385741 | aio | Thursday 05 March 2026 16:37:21 +0000 (0:00:00.526) 0:04:29.081 ******** 2026-03-05 16:37:21.385843 | aio | 2026-03-05 16:37:21.385967 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:37:21.386141 | aio | Thursday 05 March 2026 16:37:21 +0000 (0:00:00.006) 0:04:29.087 ******** 2026-03-05 16:37:21.826206 | aio | ok: [aio] 2026-03-05 16:37:21.826264 | aio | 2026-03-05 16:37:21.826392 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:37:21.826496 | aio | Thursday 05 March 2026 16:37:21 +0000 (0:00:00.443) 0:04:29.531 ******** 2026-03-05 16:37:21.885653 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 16:37:21.885702 | aio | 2026-03-05 16:37:21.885866 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:37:21.885977 | aio | Thursday 05 March 2026 16:37:21 +0000 (0:00:00.059) 0:04:29.590 ******** 2026-03-05 16:37:22.817517 | aio | ok: [aio] 2026-03-05 16:37:22.817634 | aio | 2026-03-05 16:37:22.817804 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:37:22.817963 | aio | Thursday 05 March 2026 16:37:22 +0000 (0:00:00.931) 0:04:30.522 ******** 2026-03-05 16:37:23.645171 | aio | ok: [aio] => (item=systemd-timesyncd) 2026-03-05 16:37:23.645305 | aio | ok: [aio] => (item=ssh) 2026-03-05 16:37:23.645425 | aio | 2026-03-05 16:37:23.645570 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:37:23.645716 | aio | Thursday 05 March 2026 16:37:23 +0000 (0:00:00.826) 0:04:31.348 ******** 2026-03-05 16:37:24.027456 | aio | ok: [aio] 2026-03-05 16:37:24.027524 | aio | 2026-03-05 16:37:24.027627 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:37:24.027742 | aio | Thursday 05 March 2026 16:37:24 +0000 (0:00:00.383) 0:04:31.732 ******** 2026-03-05 16:37:24.275478 | aio | ok: [aio] 2026-03-05 16:37:24.275606 | aio | 2026-03-05 16:37:24.275768 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:37:24.275929 | aio | Thursday 05 March 2026 16:37:24 +0000 (0:00:00.247) 0:04:31.980 ******** 2026-03-05 16:37:24.608510 | aio | ok: [aio] 2026-03-05 16:37:24.608659 | aio | 2026-03-05 16:37:24.608829 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:37:24.608989 | aio | Thursday 05 March 2026 16:37:24 +0000 (0:00:00.332) 0:04:32.313 ******** 2026-03-05 16:37:24.873096 | aio | ok: [aio] 2026-03-05 16:37:24.873155 | aio | 2026-03-05 16:37:24.873264 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 16:37:24.873381 | aio | Thursday 05 March 2026 16:37:24 +0000 (0:00:00.262) 0:04:32.575 ******** 2026-03-05 16:37:25.146475 | aio | ok: [aio] => (item=aio) 2026-03-05 16:37:25.146521 | aio | 2026-03-05 16:37:25.146662 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 16:37:25.146870 | aio | Thursday 05 March 2026 16:37:25 +0000 (0:00:00.274) 0:04:32.850 ******** 2026-03-05 16:37:25.194927 | aio | ok: [aio] 2026-03-05 16:37:25.194970 | aio | 2026-03-05 16:37:25.195175 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:37:25.195232 | aio | Thursday 05 March 2026 16:37:25 +0000 (0:00:00.049) 0:04:32.900 ******** 2026-03-05 16:37:25.260494 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 16:37:25.260604 | aio | 2026-03-05 16:37:25.260743 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:37:25.260861 | aio | Thursday 05 March 2026 16:37:25 +0000 (0:00:00.064) 0:04:32.964 ******** 2026-03-05 16:37:25.308309 | aio | skipping: [aio] 2026-03-05 16:37:25.308379 | aio | 2026-03-05 16:37:25.308575 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:37:25.308738 | aio | Thursday 05 March 2026 16:37:25 +0000 (0:00:00.048) 0:04:33.013 ******** 2026-03-05 16:37:25.359537 | aio | skipping: [aio] => (item=aio) 2026-03-05 16:37:25.359648 | aio | skipping: [aio] 2026-03-05 16:37:25.359751 | aio | 2026-03-05 16:37:25.359907 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:37:25.360172 | aio | Thursday 05 March 2026 16:37:25 +0000 (0:00:00.048) 0:04:33.062 ******** 2026-03-05 16:37:25.678633 | aio | ok: [aio] 2026-03-05 16:37:25.678735 | aio | 2026-03-05 16:37:25.678881 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:37:25.679044 | aio | Thursday 05 March 2026 16:37:25 +0000 (0:00:00.321) 0:04:33.384 ******** 2026-03-05 16:37:37.752817 | aio | ok: [aio] 2026-03-05 16:37:37.752891 | aio | 2026-03-05 16:37:37.752949 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 16:37:37.753131 | aio | Thursday 05 March 2026 16:37:37 +0000 (0:00:12.072) 0:04:45.456 ******** 2026-03-05 16:37:43.002801 | aio | ok: [aio] 2026-03-05 16:37:43.002844 | aio | 2026-03-05 16:37:43.003127 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 16:37:43.003369 | aio | Thursday 05 March 2026 16:37:42 +0000 (0:00:05.249) 0:04:50.706 ******** 2026-03-05 16:37:58.048798 | aio | ok: [aio] 2026-03-05 16:37:58.049003 | aio | 2026-03-05 16:37:58.049302 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 16:37:58.049735 | aio | Thursday 05 March 2026 16:37:58 +0000 (0:00:15.046) 0:05:05.753 ******** 2026-03-05 16:39:50.114673 | aio | ok: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-03-05 16:39:50.114920 | aio | ok: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-03-05 16:39:50.115207 | aio | ok: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-03-05 16:39:50.115448 | aio | 2026-03-05 16:39:50.115772 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 16:39:50.116019 | aio | Thursday 05 March 2026 16:39:50 +0000 (0:01:52.065) 0:06:57.819 ******** 2026-03-05 16:39:56.614560 | aio | ok: [aio] 2026-03-05 16:39:56.614769 | aio | 2026-03-05 16:39:56.615119 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 16:39:56.615342 | aio | Thursday 05 March 2026 16:39:56 +0000 (0:00:06.499) 0:07:04.318 ******** 2026-03-05 16:40:03.364633 | aio | ok: [aio] 2026-03-05 16:40:03.364678 | aio | 2026-03-05 16:40:03.364685 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 16:40:03.364692 | aio | Thursday 05 March 2026 16:40:03 +0000 (0:00:06.750) 0:07:11.069 ******** 2026-03-05 16:40:03.429196 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-03-05 16:40:03.429271 | aio | 2026-03-05 16:40:03.429881 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 16:40:03.429911 | aio | Thursday 05 March 2026 16:40:03 +0000 (0:00:00.063) 0:07:11.133 ******** 2026-03-05 16:40:03.480244 | aio | ok: [aio] 2026-03-05 16:40:03.480323 | aio | 2026-03-05 16:40:03.480813 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 16:40:03.480885 | aio | Thursday 05 March 2026 16:40:03 +0000 (0:00:00.050) 0:07:11.184 ******** 2026-03-05 16:40:10.198156 | aio | ok: [aio] 2026-03-05 16:40:10.198232 | aio | 2026-03-05 16:40:10.198794 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 16:40:10.198868 | aio | Thursday 05 March 2026 16:40:10 +0000 (0:00:06.718) 0:07:17.902 ******** 2026-03-05 16:40:10.254134 | aio | ok: [aio] 2026-03-05 16:40:10.254199 | aio | 2026-03-05 16:40:10.254553 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 16:40:10.254601 | aio | Thursday 05 March 2026 16:40:10 +0000 (0:00:00.055) 0:07:17.957 ******** 2026-03-05 16:40:10.305842 | aio | skipping: [aio] => (item=1) 2026-03-05 16:40:10.305940 | aio | skipping: [aio] => (item=1) 2026-03-05 16:40:10.305953 | aio | skipping: [aio] => (item=1) 2026-03-05 16:40:10.305965 | aio | skipping: [aio] 2026-03-05 16:40:10.305985 | aio | 2026-03-05 16:40:10.305997 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 16:40:10.306141 | aio | Thursday 05 March 2026 16:40:10 +0000 (0:00:00.052) 0:07:18.009 ******** 2026-03-05 16:40:10.401144 | aio | skipping: [aio] 2026-03-05 16:40:10.401209 | aio | 2026-03-05 16:40:10.401228 | aio | PLAY RECAP ********************************************************************* 2026-03-05 16:40:10.402126 | aio | aio : ok=106 changed=28 unreachable=0 failed=0 skipped=18 rescued=0 ignored=0 2026-03-05 16:40:10.402145 | aio | 2026-03-05 16:40:10.402155 | aio | 2026-03-05 16:40:10.402169 | aio | TASKS RECAP ******************************************************************** 2026-03-05 16:40:10.402439 | aio | Thursday 05 March 2026 16:40:10 +0000 (0:00:00.095) 0:07:18.105 ******** 2026-03-05 16:40:10.402664 | aio | =============================================================================== 2026-03-05 16:40:10.402902 | aio | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 133.38s 2026-03-05 16:40:10.403176 | aio | vexxhost.ceph.osd : Install OSDs -------------------------------------- 112.07s 2026-03-05 16:40:10.403414 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 15.05s 2026-03-05 16:40:10.403653 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.60s 2026-03-05 16:40:10.403917 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 13.19s 2026-03-05 16:40:10.404165 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.84s 2026-03-05 16:40:10.404401 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 12.07s 2026-03-05 16:40:10.404725 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.34s 2026-03-05 16:40:10.404970 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 8.06s 2026-03-05 16:40:10.405238 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.11s 2026-03-05 16:40:10.405408 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.10s 2026-03-05 16:40:10.405567 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.75s 2026-03-05 16:40:10.405722 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.72s 2026-03-05 16:40:10.405880 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.64s 2026-03-05 16:40:10.406083 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.50s 2026-03-05 16:40:10.406244 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.60s 2026-03-05 16:40:10.406401 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.25s 2026-03-05 16:40:10.406559 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.54s 2026-03-05 16:40:10.406717 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.25s 2026-03-05 16:40:10.406876 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.12s 2026-03-05 16:40:10.505788 | aio | INFO [default > converge] Executed: Successful 2026-03-05 16:40:10.515923 | aio | INFO [default > idempotence] Executing 2026-03-05 16:40:11.832931 | aio | 2026-03-05 16:40:11.833186 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 16:40:11.833415 | aio | 2026-03-05 16:40:11.833665 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:40:11.833939 | aio | Thursday 05 March 2026 16:40:11 +0000 (0:00:00.053) 0:00:00.053 ******** 2026-03-05 16:40:13.091561 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 16:40:13.091642 | aio | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 16:40:13.091868 | aio | interpreter could change the meaning of that path. See 2026-03-05 16:40:13.092021 | aio | https://docs.ansible.com/ansible- 2026-03-05 16:40:13.092301 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:40:13.108541 | aio | ok: [aio] 2026-03-05 16:40:13.108732 | aio | 2026-03-05 16:40:13.108978 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:40:13.109276 | aio | Thursday 05 March 2026 16:40:13 +0000 (0:00:01.275) 0:00:01.328 ******** 2026-03-05 16:40:13.450166 | aio | ok: [aio] 2026-03-05 16:40:13.450220 | aio | 2026-03-05 16:40:13.450235 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:40:13.450252 | aio | Thursday 05 March 2026 16:40:13 +0000 (0:00:00.340) 0:00:01.669 ******** 2026-03-05 16:40:13.492885 | aio | skipping: [aio] 2026-03-05 16:40:13.493137 | aio | 2026-03-05 16:40:13.493419 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:40:13.493792 | aio | Thursday 05 March 2026 16:40:13 +0000 (0:00:00.043) 0:00:01.713 ******** 2026-03-05 16:40:13.857452 | aio | ok: [aio] 2026-03-05 16:40:13.857700 | aio | 2026-03-05 16:40:13.858011 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:40:13.858358 | aio | Thursday 05 March 2026 16:40:13 +0000 (0:00:00.364) 0:00:02.077 ******** 2026-03-05 16:40:13.933329 | aio | ok: [aio] => { 2026-03-05 16:40:13.933586 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:40:13.933821 | aio | } 2026-03-05 16:40:13.934047 | aio | 2026-03-05 16:40:13.934328 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:40:13.934672 | aio | Thursday 05 March 2026 16:40:13 +0000 (0:00:00.076) 0:00:02.153 ******** 2026-03-05 16:40:14.417781 | aio | ok: [aio] 2026-03-05 16:40:14.417865 | aio | 2026-03-05 16:40:14.418106 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:40:14.418233 | aio | Thursday 05 March 2026 16:40:14 +0000 (0:00:00.484) 0:00:02.638 ******** 2026-03-05 16:40:14.468943 | aio | skipping: [aio] 2026-03-05 16:40:14.469150 | aio | 2026-03-05 16:40:14.469404 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:40:14.469644 | aio | Thursday 05 March 2026 16:40:14 +0000 (0:00:00.051) 0:00:02.689 ******** 2026-03-05 16:40:14.521521 | aio | skipping: [aio] 2026-03-05 16:40:14.521770 | aio | 2026-03-05 16:40:14.522075 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:40:14.522322 | aio | Thursday 05 March 2026 16:40:14 +0000 (0:00:00.052) 0:00:02.742 ******** 2026-03-05 16:40:14.774696 | aio | ok: [aio] 2026-03-05 16:40:14.774907 | aio | 2026-03-05 16:40:14.775199 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:40:14.775449 | aio | Thursday 05 March 2026 16:40:14 +0000 (0:00:00.252) 0:00:02.994 ******** 2026-03-05 16:40:16.138132 | aio | ok: [aio] 2026-03-05 16:40:16.138342 | aio | 2026-03-05 16:40:16.138596 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:40:16.138842 | aio | Thursday 05 March 2026 16:40:16 +0000 (0:00:01.363) 0:00:04.358 ******** 2026-03-05 16:40:16.348668 | aio | ok: [aio] => { 2026-03-05 16:40:16.348919 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:40:16.349193 | aio | } 2026-03-05 16:40:16.349409 | aio | 2026-03-05 16:40:16.349659 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:40:16.349923 | aio | Thursday 05 March 2026 16:40:16 +0000 (0:00:00.210) 0:00:04.568 ******** 2026-03-05 16:40:16.875710 | aio | ok: [aio] 2026-03-05 16:40:16.875913 | aio | 2026-03-05 16:40:16.876206 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:40:16.876449 | aio | Thursday 05 March 2026 16:40:16 +0000 (0:00:00.526) 0:00:05.095 ******** 2026-03-05 16:40:19.374239 | aio | ok: [aio] 2026-03-05 16:40:19.374453 | aio | 2026-03-05 16:40:19.374727 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:40:19.375002 | aio | Thursday 05 March 2026 16:40:19 +0000 (0:00:02.498) 0:00:07.594 ******** 2026-03-05 16:40:19.409609 | aio | skipping: [aio] 2026-03-05 16:40:19.409716 | aio | 2026-03-05 16:40:19.409892 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:40:19.410053 | aio | Thursday 05 March 2026 16:40:19 +0000 (0:00:00.035) 0:00:07.629 ******** 2026-03-05 16:40:19.450305 | aio | skipping: [aio] 2026-03-05 16:40:19.450426 | aio | 2026-03-05 16:40:19.450684 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:40:19.450936 | aio | Thursday 05 March 2026 16:40:19 +0000 (0:00:00.040) 0:00:07.670 ******** 2026-03-05 16:40:19.486318 | aio | skipping: [aio] 2026-03-05 16:40:19.486577 | aio | 2026-03-05 16:40:19.486967 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:40:19.487394 | aio | Thursday 05 March 2026 16:40:19 +0000 (0:00:00.036) 0:00:07.706 ******** 2026-03-05 16:40:20.748687 | aio | ok: [aio] 2026-03-05 16:40:20.748903 | aio | 2026-03-05 16:40:20.749216 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:40:20.749465 | aio | Thursday 05 March 2026 16:40:20 +0000 (0:00:01.261) 0:00:08.968 ******** 2026-03-05 16:40:21.324731 | aio | ok: [aio] 2026-03-05 16:40:21.324944 | aio | 2026-03-05 16:40:21.325245 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:40:21.325495 | aio | Thursday 05 March 2026 16:40:21 +0000 (0:00:00.576) 0:00:09.544 ******** 2026-03-05 16:40:22.475658 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 16:40:22.475769 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:40:22.475907 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:40:22.476070 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:40:22.476228 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:40:22.476350 | aio | 2026-03-05 16:40:22.476485 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:40:22.476618 | aio | Thursday 05 March 2026 16:40:22 +0000 (0:00:01.151) 0:00:10.696 ******** 2026-03-05 16:40:23.146160 | aio | ok: [aio] 2026-03-05 16:40:23.146214 | aio | 2026-03-05 16:40:23.146373 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:40:23.146498 | aio | Thursday 05 March 2026 16:40:23 +0000 (0:00:00.660) 0:00:11.356 ******** 2026-03-05 16:40:23.146610 | aio | 2026-03-05 16:40:23.146741 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:40:23.146874 | aio | Thursday 05 March 2026 16:40:23 +0000 (0:00:00.010) 0:00:11.366 ******** 2026-03-05 16:40:23.878927 | aio | ok: [aio] 2026-03-05 16:40:23.878981 | aio | 2026-03-05 16:40:23.878995 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:40:23.879005 | aio | Thursday 05 March 2026 16:40:23 +0000 (0:00:00.731) 0:00:12.098 ******** 2026-03-05 16:40:24.150962 | aio | ok: [aio] 2026-03-05 16:40:24.151075 | aio | 2026-03-05 16:40:24.151091 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:40:24.151102 | aio | Thursday 05 March 2026 16:40:24 +0000 (0:00:00.271) 0:00:12.370 ******** 2026-03-05 16:40:24.228268 | aio | ok: [aio] => { 2026-03-05 16:40:24.228636 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:40:24.228888 | aio | } 2026-03-05 16:40:24.229118 | aio | 2026-03-05 16:40:24.229404 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:40:24.229660 | aio | Thursday 05 March 2026 16:40:24 +0000 (0:00:00.077) 0:00:12.447 ******** 2026-03-05 16:40:24.672128 | aio | ok: [aio] 2026-03-05 16:40:24.672261 | aio | 2026-03-05 16:40:24.672507 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:40:24.672749 | aio | Thursday 05 March 2026 16:40:24 +0000 (0:00:00.444) 0:00:12.892 ******** 2026-03-05 16:40:28.005893 | aio | ok: [aio] 2026-03-05 16:40:28.006069 | aio | 2026-03-05 16:40:28.006403 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:40:28.006725 | aio | Thursday 05 March 2026 16:40:28 +0000 (0:00:03.334) 0:00:16.226 ******** 2026-03-05 16:40:29.061482 | aio | ok: [aio] 2026-03-05 16:40:29.061537 | aio | 2026-03-05 16:40:29.061548 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:40:29.061558 | aio | Thursday 05 March 2026 16:40:29 +0000 (0:00:01.054) 0:00:17.280 ******** 2026-03-05 16:40:29.408237 | aio | ok: [aio] 2026-03-05 16:40:29.408327 | aio | 2026-03-05 16:40:29.408338 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:40:29.408357 | aio | Thursday 05 March 2026 16:40:29 +0000 (0:00:00.346) 0:00:17.627 ******** 2026-03-05 16:40:29.961489 | aio | ok: [aio] 2026-03-05 16:40:29.961587 | aio | 2026-03-05 16:40:29.962224 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:40:29.962288 | aio | Thursday 05 March 2026 16:40:29 +0000 (0:00:00.553) 0:00:18.181 ******** 2026-03-05 16:40:30.672216 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 16:40:30.672285 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:40:30.672299 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:40:30.672310 | aio | 2026-03-05 16:40:30.672319 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:40:30.672328 | aio | Thursday 05 March 2026 16:40:30 +0000 (0:00:00.708) 0:00:18.890 ******** 2026-03-05 16:40:31.234186 | aio | ok: [aio] 2026-03-05 16:40:31.234244 | aio | 2026-03-05 16:40:31.234473 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:40:31.234746 | aio | Thursday 05 March 2026 16:40:31 +0000 (0:00:00.563) 0:00:19.453 ******** 2026-03-05 16:40:31.784863 | aio | ok: [aio] 2026-03-05 16:40:31.785125 | aio | 2026-03-05 16:40:31.785391 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:40:31.785650 | aio | Thursday 05 March 2026 16:40:31 +0000 (0:00:00.543) 0:00:19.996 ******** 2026-03-05 16:40:31.786798 | aio | 2026-03-05 16:40:31.787132 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:40:31.787577 | aio | Thursday 05 March 2026 16:40:31 +0000 (0:00:00.008) 0:00:20.005 ******** 2026-03-05 16:40:32.258640 | aio | ok: [aio] 2026-03-05 16:40:32.258836 | aio | 2026-03-05 16:40:32.259125 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:40:32.259374 | aio | Thursday 05 March 2026 16:40:32 +0000 (0:00:00.473) 0:00:20.478 ******** 2026-03-05 16:40:32.311302 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 16:40:32.311499 | aio | 2026-03-05 16:40:32.311742 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:40:32.311987 | aio | Thursday 05 March 2026 16:40:32 +0000 (0:00:00.052) 0:00:20.531 ******** 2026-03-05 16:40:33.464729 | aio | ok: [aio] 2026-03-05 16:40:33.464893 | aio | 2026-03-05 16:40:33.465189 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:40:33.465439 | aio | Thursday 05 March 2026 16:40:33 +0000 (0:00:01.152) 0:00:21.684 ******** 2026-03-05 16:40:34.308468 | aio | ok: [aio] => (item=systemd-timesyncd) 2026-03-05 16:40:34.308704 | aio | ok: [aio] => (item=ssh) 2026-03-05 16:40:34.308932 | aio | 2026-03-05 16:40:34.309245 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:40:34.309479 | aio | Thursday 05 March 2026 16:40:34 +0000 (0:00:00.843) 0:00:22.528 ******** 2026-03-05 16:40:34.691675 | aio | ok: [aio] 2026-03-05 16:40:34.691743 | aio | 2026-03-05 16:40:34.692168 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:40:34.692385 | aio | Thursday 05 March 2026 16:40:34 +0000 (0:00:00.382) 0:00:22.911 ******** 2026-03-05 16:40:34.939646 | aio | ok: [aio] 2026-03-05 16:40:34.939730 | aio | 2026-03-05 16:40:34.939742 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:40:34.939752 | aio | Thursday 05 March 2026 16:40:34 +0000 (0:00:00.246) 0:00:23.157 ******** 2026-03-05 16:40:35.390741 | aio | ok: [aio] 2026-03-05 16:40:35.390788 | aio | 2026-03-05 16:40:35.390799 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:40:35.390810 | aio | Thursday 05 March 2026 16:40:35 +0000 (0:00:00.451) 0:00:23.609 ******** 2026-03-05 16:40:35.743209 | aio | ok: [aio] 2026-03-05 16:40:35.743338 | aio | 2026-03-05 16:40:35.743349 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 16:40:35.743359 | aio | Thursday 05 March 2026 16:40:35 +0000 (0:00:00.351) 0:00:23.961 ******** 2026-03-05 16:40:35.825874 | aio | ok: [aio] 2026-03-05 16:40:35.825986 | aio | 2026-03-05 16:40:35.826007 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 16:40:35.826018 | aio | Thursday 05 March 2026 16:40:35 +0000 (0:00:00.083) 0:00:24.044 ******** 2026-03-05 16:40:36.120167 | aio | ok: [aio] => (item=aio) 2026-03-05 16:40:36.120228 | aio | 2026-03-05 16:40:36.120239 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 16:40:36.120305 | aio | Thursday 05 March 2026 16:40:36 +0000 (0:00:00.294) 0:00:24.339 ******** 2026-03-05 16:40:36.171254 | aio | ok: [aio] 2026-03-05 16:40:36.171335 | aio | 2026-03-05 16:40:36.171347 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 16:40:36.171358 | aio | Thursday 05 March 2026 16:40:36 +0000 (0:00:00.051) 0:00:24.390 ******** 2026-03-05 16:40:36.215353 | aio | skipping: [aio] 2026-03-05 16:40:36.215586 | aio | 2026-03-05 16:40:36.215842 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:40:36.216132 | aio | Thursday 05 March 2026 16:40:36 +0000 (0:00:00.045) 0:00:24.435 ******** 2026-03-05 16:40:36.290800 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 16:40:36.291062 | aio | 2026-03-05 16:40:36.291414 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:40:36.291665 | aio | Thursday 05 March 2026 16:40:36 +0000 (0:00:00.075) 0:00:24.510 ******** 2026-03-05 16:40:43.070683 | aio | ok: [aio] 2026-03-05 16:40:43.070805 | aio | 2026-03-05 16:40:43.070960 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:40:43.071148 | aio | Thursday 05 March 2026 16:40:43 +0000 (0:00:06.779) 0:00:31.290 ******** 2026-03-05 16:40:43.128914 | aio | ok: [aio] => (item=aio) 2026-03-05 16:40:43.129160 | aio | 2026-03-05 16:40:43.129428 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:40:43.129666 | aio | Thursday 05 March 2026 16:40:43 +0000 (0:00:00.058) 0:00:31.349 ******** 2026-03-05 16:40:43.585923 | aio | ok: [aio] 2026-03-05 16:40:43.586125 | aio | 2026-03-05 16:40:43.586435 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:40:43.586685 | aio | Thursday 05 March 2026 16:40:43 +0000 (0:00:00.456) 0:00:31.805 ******** 2026-03-05 16:40:50.757515 | aio | ok: [aio] 2026-03-05 16:40:50.757698 | aio | 2026-03-05 16:40:50.757958 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 16:40:50.758240 | aio | Thursday 05 March 2026 16:40:50 +0000 (0:00:07.171) 0:00:38.977 ******** 2026-03-05 16:40:57.462054 | aio | ok: [aio] 2026-03-05 16:40:57.462123 | aio | 2026-03-05 16:40:57.462136 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 16:40:57.462149 | aio | Thursday 05 March 2026 16:40:57 +0000 (0:00:06.703) 0:00:45.681 ******** 2026-03-05 16:41:12.124153 | aio | ok: [aio] 2026-03-05 16:41:12.124224 | aio | 2026-03-05 16:41:12.124687 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:41:12.124747 | aio | Thursday 05 March 2026 16:41:12 +0000 (0:00:14.662) 0:01:00.343 ******** 2026-03-05 16:41:12.199130 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 16:41:12.199226 | aio | 2026-03-05 16:41:12.199850 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:41:12.199893 | aio | Thursday 05 March 2026 16:41:12 +0000 (0:00:00.074) 0:01:00.418 ******** 2026-03-05 16:41:12.252132 | aio | skipping: [aio] 2026-03-05 16:41:12.252195 | aio | 2026-03-05 16:41:12.252730 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:41:12.252773 | aio | Thursday 05 March 2026 16:41:12 +0000 (0:00:00.052) 0:01:00.471 ******** 2026-03-05 16:41:12.305162 | aio | skipping: [aio] => (item=aio) 2026-03-05 16:41:12.305218 | aio | skipping: [aio] 2026-03-05 16:41:12.305852 | aio | 2026-03-05 16:41:12.305877 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:41:12.305888 | aio | Thursday 05 March 2026 16:41:12 +0000 (0:00:00.053) 0:01:00.524 ******** 2026-03-05 16:41:12.623146 | aio | ok: [aio] 2026-03-05 16:41:12.623207 | aio | 2026-03-05 16:41:12.623601 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:41:12.623640 | aio | Thursday 05 March 2026 16:41:12 +0000 (0:00:00.317) 0:01:00.842 ******** 2026-03-05 16:41:19.684966 | aio | ok: [aio] 2026-03-05 16:41:19.685007 | aio | 2026-03-05 16:41:19.685014 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 16:41:19.685020 | aio | Thursday 05 March 2026 16:41:19 +0000 (0:00:07.060) 0:01:07.903 ******** 2026-03-05 16:41:26.182693 | aio | ok: [aio] 2026-03-05 16:41:26.182788 | aio | 2026-03-05 16:41:26.182812 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 16:41:26.182959 | aio | Thursday 05 March 2026 16:41:26 +0000 (0:00:06.499) 0:01:14.402 ******** 2026-03-05 16:41:32.761654 | aio | ok: [aio] 2026-03-05 16:41:32.761718 | aio | 2026-03-05 16:41:32.761732 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 16:41:32.761745 | aio | Thursday 05 March 2026 16:41:32 +0000 (0:00:06.577) 0:01:20.980 ******** 2026-03-05 16:41:40.358801 | aio | ok: [aio] => (item={'name': 'diskprediction_local'}) 2026-03-05 16:41:40.358852 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-03-05 16:41:40.358860 | aio | ok: [aio] => (item={'name': 'prometheus'}) 2026-03-05 16:41:40.358866 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-03-05 16:41:40.358873 | aio | 2026-03-05 16:41:40.358880 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 16:41:40.358887 | aio | 2026-03-05 16:41:40.358894 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:41:40.358905 | aio | Thursday 05 March 2026 16:41:40 +0000 (0:00:07.596) 0:01:28.576 ******** 2026-03-05 16:41:41.313694 | aio | ok: [aio] 2026-03-05 16:41:41.313751 | aio | 2026-03-05 16:41:41.313765 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:41:41.313777 | aio | Thursday 05 March 2026 16:41:41 +0000 (0:00:00.955) 0:01:29.532 ******** 2026-03-05 16:41:41.555810 | aio | ok: [aio] 2026-03-05 16:41:41.556144 | aio | 2026-03-05 16:41:41.556635 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:41:41.556691 | aio | Thursday 05 March 2026 16:41:41 +0000 (0:00:00.242) 0:01:29.775 ******** 2026-03-05 16:41:41.596144 | aio | skipping: [aio] 2026-03-05 16:41:41.596204 | aio | 2026-03-05 16:41:41.596253 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:41:41.596550 | aio | Thursday 05 March 2026 16:41:41 +0000 (0:00:00.040) 0:01:29.815 ******** 2026-03-05 16:41:41.846160 | aio | ok: [aio] 2026-03-05 16:41:41.846229 | aio | 2026-03-05 16:41:41.846714 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:41:41.846761 | aio | Thursday 05 March 2026 16:41:41 +0000 (0:00:00.249) 0:01:30.065 ******** 2026-03-05 16:41:41.919764 | aio | ok: [aio] => { 2026-03-05 16:41:41.920170 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:41:41.920428 | aio | } 2026-03-05 16:41:41.920708 | aio | 2026-03-05 16:41:41.921056 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:41:41.921334 | aio | Thursday 05 March 2026 16:41:41 +0000 (0:00:00.073) 0:01:30.139 ******** 2026-03-05 16:41:42.309671 | aio | ok: [aio] 2026-03-05 16:41:42.309727 | aio | 2026-03-05 16:41:42.309738 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:41:42.309748 | aio | Thursday 05 March 2026 16:41:42 +0000 (0:00:00.389) 0:01:30.528 ******** 2026-03-05 16:41:42.357208 | aio | skipping: [aio] 2026-03-05 16:41:42.357266 | aio | 2026-03-05 16:41:42.357284 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:41:42.357490 | aio | Thursday 05 March 2026 16:41:42 +0000 (0:00:00.048) 0:01:30.577 ******** 2026-03-05 16:41:42.401095 | aio | skipping: [aio] 2026-03-05 16:41:42.401310 | aio | 2026-03-05 16:41:42.401639 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:41:42.401814 | aio | Thursday 05 March 2026 16:41:42 +0000 (0:00:00.044) 0:01:30.621 ******** 2026-03-05 16:41:42.652426 | aio | ok: [aio] 2026-03-05 16:41:42.652504 | aio | 2026-03-05 16:41:42.652657 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:41:42.654197 | aio | Thursday 05 March 2026 16:41:42 +0000 (0:00:00.250) 0:01:30.872 ******** 2026-03-05 16:41:43.855192 | aio | ok: [aio] 2026-03-05 16:41:43.855250 | aio | 2026-03-05 16:41:43.855261 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:41:43.855271 | aio | Thursday 05 March 2026 16:41:43 +0000 (0:00:01.202) 0:01:32.074 ******** 2026-03-05 16:41:44.027225 | aio | ok: [aio] => { 2026-03-05 16:41:44.027251 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:41:44.027256 | aio | } 2026-03-05 16:41:44.027260 | aio | 2026-03-05 16:41:44.027265 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:41:44.027516 | aio | Thursday 05 March 2026 16:41:44 +0000 (0:00:00.170) 0:01:32.245 ******** 2026-03-05 16:41:44.560476 | aio | ok: [aio] 2026-03-05 16:41:44.560580 | aio | 2026-03-05 16:41:44.560592 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:41:44.560612 | aio | Thursday 05 March 2026 16:41:44 +0000 (0:00:00.534) 0:01:32.779 ******** 2026-03-05 16:41:46.787614 | aio | ok: [aio] 2026-03-05 16:41:46.787683 | aio | 2026-03-05 16:41:46.787697 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:41:46.787709 | aio | Thursday 05 March 2026 16:41:46 +0000 (0:00:02.226) 0:01:35.006 ******** 2026-03-05 16:41:46.820767 | aio | skipping: [aio] 2026-03-05 16:41:46.820825 | aio | 2026-03-05 16:41:46.820852 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:41:46.820866 | aio | Thursday 05 March 2026 16:41:46 +0000 (0:00:00.033) 0:01:35.039 ******** 2026-03-05 16:41:46.857154 | aio | skipping: [aio] 2026-03-05 16:41:46.857228 | aio | 2026-03-05 16:41:46.857248 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:41:46.857507 | aio | Thursday 05 March 2026 16:41:46 +0000 (0:00:00.036) 0:01:35.076 ******** 2026-03-05 16:41:46.891478 | aio | skipping: [aio] 2026-03-05 16:41:46.891529 | aio | 2026-03-05 16:41:46.891773 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:41:46.891804 | aio | Thursday 05 March 2026 16:41:46 +0000 (0:00:00.035) 0:01:35.111 ******** 2026-03-05 16:41:48.830452 | aio | ok: [aio] 2026-03-05 16:41:48.830517 | aio | 2026-03-05 16:41:48.830747 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:41:48.830784 | aio | Thursday 05 March 2026 16:41:48 +0000 (0:00:01.937) 0:01:37.049 ******** 2026-03-05 16:41:49.356421 | aio | ok: [aio] 2026-03-05 16:41:49.356477 | aio | 2026-03-05 16:41:49.356610 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:41:49.356720 | aio | Thursday 05 March 2026 16:41:49 +0000 (0:00:00.526) 0:01:37.576 ******** 2026-03-05 16:41:50.451185 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 16:41:50.452130 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:41:50.452147 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:41:50.452152 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:41:50.452157 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:41:50.452162 | aio | 2026-03-05 16:41:50.452168 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:41:50.452173 | aio | Thursday 05 March 2026 16:41:50 +0000 (0:00:01.095) 0:01:38.671 ******** 2026-03-05 16:41:51.059182 | aio | ok: [aio] 2026-03-05 16:41:51.059232 | aio | 2026-03-05 16:41:51.060044 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:41:51.060079 | aio | Thursday 05 March 2026 16:41:51 +0000 (0:00:00.600) 0:01:39.272 ******** 2026-03-05 16:41:51.060084 | aio | 2026-03-05 16:41:51.060718 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:41:51.060746 | aio | Thursday 05 March 2026 16:41:51 +0000 (0:00:00.006) 0:01:39.278 ******** 2026-03-05 16:41:51.501724 | aio | ok: [aio] 2026-03-05 16:41:51.501811 | aio | 2026-03-05 16:41:51.501822 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:41:51.501833 | aio | Thursday 05 March 2026 16:41:51 +0000 (0:00:00.442) 0:01:39.720 ******** 2026-03-05 16:41:51.753224 | aio | ok: [aio] 2026-03-05 16:41:51.753277 | aio | 2026-03-05 16:41:51.753296 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:41:51.753605 | aio | Thursday 05 March 2026 16:41:51 +0000 (0:00:00.251) 0:01:39.972 ******** 2026-03-05 16:41:51.824214 | aio | ok: [aio] => { 2026-03-05 16:41:51.824262 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:41:51.824272 | aio | } 2026-03-05 16:41:51.824287 | aio | 2026-03-05 16:41:51.824784 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:41:51.824808 | aio | Thursday 05 March 2026 16:41:51 +0000 (0:00:00.070) 0:01:40.043 ******** 2026-03-05 16:41:52.248662 | aio | ok: [aio] 2026-03-05 16:41:52.248779 | aio | 2026-03-05 16:41:52.248791 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:41:52.248800 | aio | Thursday 05 March 2026 16:41:52 +0000 (0:00:00.424) 0:01:40.467 ******** 2026-03-05 16:41:55.498590 | aio | ok: [aio] 2026-03-05 16:41:55.498660 | aio | 2026-03-05 16:41:55.498675 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:41:55.498862 | aio | Thursday 05 March 2026 16:41:55 +0000 (0:00:03.250) 0:01:43.717 ******** 2026-03-05 16:41:56.417826 | aio | ok: [aio] 2026-03-05 16:41:56.417863 | aio | 2026-03-05 16:41:56.417869 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:41:56.417875 | aio | Thursday 05 March 2026 16:41:56 +0000 (0:00:00.919) 0:01:44.637 ******** 2026-03-05 16:41:56.645759 | aio | ok: [aio] 2026-03-05 16:41:56.645791 | aio | 2026-03-05 16:41:56.645800 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:41:56.645998 | aio | Thursday 05 March 2026 16:41:56 +0000 (0:00:00.226) 0:01:44.864 ******** 2026-03-05 16:41:57.156061 | aio | ok: [aio] 2026-03-05 16:41:57.156098 | aio | 2026-03-05 16:41:57.156107 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:41:57.156115 | aio | Thursday 05 March 2026 16:41:57 +0000 (0:00:00.511) 0:01:45.375 ******** 2026-03-05 16:41:57.820124 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 16:41:57.820158 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:41:57.820175 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:41:57.820180 | aio | 2026-03-05 16:41:57.820184 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:41:57.820188 | aio | Thursday 05 March 2026 16:41:57 +0000 (0:00:00.664) 0:01:46.039 ******** 2026-03-05 16:41:58.332989 | aio | ok: [aio] 2026-03-05 16:41:58.333056 | aio | 2026-03-05 16:41:58.333068 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:41:58.333076 | aio | Thursday 05 March 2026 16:41:58 +0000 (0:00:00.511) 0:01:46.551 ******** 2026-03-05 16:41:58.860128 | aio | ok: [aio] 2026-03-05 16:41:58.860186 | aio | 2026-03-05 16:41:58.860238 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:41:58.861119 | aio | Thursday 05 March 2026 16:41:58 +0000 (0:00:00.516) 0:01:47.068 ******** 2026-03-05 16:41:58.861172 | aio | 2026-03-05 16:41:58.861186 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:41:58.861204 | aio | Thursday 05 March 2026 16:41:58 +0000 (0:00:00.011) 0:01:47.079 ******** 2026-03-05 16:41:59.292212 | aio | ok: [aio] 2026-03-05 16:41:59.292280 | aio | 2026-03-05 16:41:59.292302 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:41:59.292497 | aio | Thursday 05 March 2026 16:41:59 +0000 (0:00:00.432) 0:01:47.511 ******** 2026-03-05 16:41:59.346835 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 16:41:59.346874 | aio | 2026-03-05 16:41:59.346880 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:41:59.346886 | aio | Thursday 05 March 2026 16:41:59 +0000 (0:00:00.055) 0:01:47.567 ******** 2026-03-05 16:42:00.262250 | aio | ok: [aio] 2026-03-05 16:42:00.262315 | aio | 2026-03-05 16:42:00.262353 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:42:00.262558 | aio | Thursday 05 March 2026 16:42:00 +0000 (0:00:00.914) 0:01:48.481 ******** 2026-03-05 16:42:01.062126 | aio | ok: [aio] => (item=systemd-timesyncd) 2026-03-05 16:42:01.062195 | aio | ok: [aio] => (item=ssh) 2026-03-05 16:42:01.062210 | aio | 2026-03-05 16:42:01.062223 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:42:01.062242 | aio | Thursday 05 March 2026 16:42:01 +0000 (0:00:00.799) 0:01:49.280 ******** 2026-03-05 16:42:01.428695 | aio | ok: [aio] 2026-03-05 16:42:01.428756 | aio | 2026-03-05 16:42:01.428802 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:42:01.428815 | aio | Thursday 05 March 2026 16:42:01 +0000 (0:00:00.366) 0:01:49.647 ******** 2026-03-05 16:42:01.666579 | aio | ok: [aio] 2026-03-05 16:42:01.666634 | aio | 2026-03-05 16:42:01.666648 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:42:01.666660 | aio | Thursday 05 March 2026 16:42:01 +0000 (0:00:00.238) 0:01:49.885 ******** 2026-03-05 16:42:01.981879 | aio | ok: [aio] 2026-03-05 16:42:01.981929 | aio | 2026-03-05 16:42:01.981942 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:42:01.981955 | aio | Thursday 05 March 2026 16:42:01 +0000 (0:00:00.314) 0:01:50.200 ******** 2026-03-05 16:42:02.235178 | aio | ok: [aio] 2026-03-05 16:42:02.235218 | aio | 2026-03-05 16:42:02.235225 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 16:42:02.235232 | aio | Thursday 05 March 2026 16:42:02 +0000 (0:00:00.254) 0:01:50.454 ******** 2026-03-05 16:42:02.520181 | aio | ok: [aio] => (item=aio) 2026-03-05 16:42:02.520239 | aio | 2026-03-05 16:42:02.520261 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 16:42:02.520476 | aio | Thursday 05 March 2026 16:42:02 +0000 (0:00:00.285) 0:01:50.739 ******** 2026-03-05 16:42:02.572992 | aio | ok: [aio] 2026-03-05 16:42:02.573219 | aio | 2026-03-05 16:42:02.573473 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:42:02.573722 | aio | Thursday 05 March 2026 16:42:02 +0000 (0:00:00.053) 0:01:50.793 ******** 2026-03-05 16:42:02.636931 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 16:42:02.637185 | aio | 2026-03-05 16:42:02.637462 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:42:02.637725 | aio | Thursday 05 March 2026 16:42:02 +0000 (0:00:00.063) 0:01:50.857 ******** 2026-03-05 16:42:02.684070 | aio | skipping: [aio] 2026-03-05 16:42:02.684278 | aio | 2026-03-05 16:42:02.684574 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:42:02.684825 | aio | Thursday 05 March 2026 16:42:02 +0000 (0:00:00.047) 0:01:50.904 ******** 2026-03-05 16:42:02.733459 | aio | skipping: [aio] => (item=aio) 2026-03-05 16:42:02.733699 | aio | skipping: [aio] 2026-03-05 16:42:02.733954 | aio | 2026-03-05 16:42:02.734274 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:42:02.734524 | aio | Thursday 05 March 2026 16:42:02 +0000 (0:00:00.049) 0:01:50.953 ******** 2026-03-05 16:42:03.062488 | aio | ok: [aio] 2026-03-05 16:42:03.062715 | aio | 2026-03-05 16:42:03.062982 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:42:03.063270 | aio | Thursday 05 March 2026 16:42:03 +0000 (0:00:00.328) 0:01:51.282 ******** 2026-03-05 16:42:10.109933 | aio | ok: [aio] 2026-03-05 16:42:10.109972 | aio | 2026-03-05 16:42:10.109978 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 16:42:10.109984 | aio | Thursday 05 March 2026 16:42:10 +0000 (0:00:07.045) 0:01:58.328 ******** 2026-03-05 16:42:15.843616 | aio | ok: [aio] 2026-03-05 16:42:15.843685 | aio | 2026-03-05 16:42:15.843698 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 16:42:15.843711 | aio | Thursday 05 March 2026 16:42:15 +0000 (0:00:05.734) 0:02:04.062 ******** 2026-03-05 16:42:30.777176 | aio | ok: [aio] 2026-03-05 16:42:30.777241 | aio | 2026-03-05 16:42:30.777255 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 16:42:30.777378 | aio | Thursday 05 March 2026 16:42:30 +0000 (0:00:14.933) 0:02:18.996 ******** 2026-03-05 16:42:30.846271 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-03-05 16:42:30.846313 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-03-05 16:42:30.846325 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-03-05 16:42:30.846337 | aio | skipping: [aio] 2026-03-05 16:42:30.846349 | aio | 2026-03-05 16:42:30.846362 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 16:42:30.846373 | aio | Thursday 05 March 2026 16:42:30 +0000 (0:00:00.068) 0:02:19.064 ******** 2026-03-05 16:42:37.395939 | aio | ok: [aio] 2026-03-05 16:42:37.395984 | aio | 2026-03-05 16:42:37.395991 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 16:42:37.395998 | aio | Thursday 05 March 2026 16:42:37 +0000 (0:00:06.550) 0:02:25.615 ******** 2026-03-05 16:42:43.880453 | aio | ok: [aio] 2026-03-05 16:42:43.880530 | aio | 2026-03-05 16:42:43.880774 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 16:42:43.880828 | aio | Thursday 05 March 2026 16:42:43 +0000 (0:00:06.485) 0:02:32.100 ******** 2026-03-05 16:42:43.944194 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-03-05 16:42:43.944268 | aio | 2026-03-05 16:42:43.944649 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 16:42:43.944687 | aio | Thursday 05 March 2026 16:42:43 +0000 (0:00:00.062) 0:02:32.163 ******** 2026-03-05 16:42:43.988197 | aio | ok: [aio] 2026-03-05 16:42:43.988236 | aio | 2026-03-05 16:42:43.988255 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 16:42:43.988588 | aio | Thursday 05 March 2026 16:42:43 +0000 (0:00:00.044) 0:02:32.208 ******** 2026-03-05 16:42:50.547358 | aio | ok: [aio] 2026-03-05 16:42:50.547469 | aio | 2026-03-05 16:42:50.547477 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 16:42:50.547484 | aio | Thursday 05 March 2026 16:42:50 +0000 (0:00:06.558) 0:02:38.766 ******** 2026-03-05 16:42:50.591129 | aio | ok: [aio] 2026-03-05 16:42:50.591894 | aio | 2026-03-05 16:42:50.591942 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 16:42:50.591953 | aio | Thursday 05 March 2026 16:42:50 +0000 (0:00:00.044) 0:02:38.810 ******** 2026-03-05 16:42:50.631234 | aio | skipping: [aio] => (item=1) 2026-03-05 16:42:50.631297 | aio | skipping: [aio] => (item=1) 2026-03-05 16:42:50.632695 | aio | skipping: [aio] => (item=1) 2026-03-05 16:42:50.632713 | aio | skipping: [aio] 2026-03-05 16:42:50.632717 | aio | 2026-03-05 16:42:50.632722 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 16:42:50.632969 | aio | Thursday 05 March 2026 16:42:50 +0000 (0:00:00.040) 0:02:38.851 ******** 2026-03-05 16:42:50.673126 | aio | skipping: [aio] 2026-03-05 16:42:50.673199 | aio | 2026-03-05 16:42:50.673209 | aio | PLAY RECAP ********************************************************************* 2026-03-05 16:42:50.673220 | aio | aio : ok=95 changed=0 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 2026-03-05 16:42:50.673229 | aio | 2026-03-05 16:42:50.673238 | aio | 2026-03-05 16:42:50.673246 | aio | TASKS RECAP ******************************************************************** 2026-03-05 16:42:50.673255 | aio | Thursday 05 March 2026 16:42:50 +0000 (0:00:00.039) 0:02:38.890 ******** 2026-03-05 16:42:50.673543 | aio | =============================================================================== 2026-03-05 16:42:50.673864 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.93s 2026-03-05 16:42:50.674217 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.66s 2026-03-05 16:42:50.674614 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.60s 2026-03-05 16:42:50.674940 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.17s 2026-03-05 16:42:50.675291 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.06s 2026-03-05 16:42:50.675611 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.05s 2026-03-05 16:42:50.675926 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.78s 2026-03-05 16:42:50.676323 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.70s 2026-03-05 16:42:50.676653 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.58s 2026-03-05 16:42:50.676963 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.56s 2026-03-05 16:42:50.677333 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.55s 2026-03-05 16:42:50.677683 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.50s 2026-03-05 16:42:50.678167 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.49s 2026-03-05 16:42:50.678615 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.73s 2026-03-05 16:42:50.679087 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.33s 2026-03-05 16:42:50.679517 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.25s 2026-03-05 16:42:50.679994 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.50s 2026-03-05 16:42:50.680568 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.23s 2026-03-05 16:42:50.680901 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 1.94s 2026-03-05 16:42:50.681125 | aio | vexxhost.containers.package : Update state for tar ---------------------- 1.36s 2026-03-05 16:42:50.759701 | aio | INFO [default > idempotence] Executed: Successful 2026-03-05 16:42:50.772119 | aio | INFO [default > side_effect] Executing 2026-03-05 16:42:50.772478 | aio | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:42:50.778464 | aio | INFO [default > verify] Executing 2026-03-05 16:42:51.507819 | aio | 2026-03-05 16:42:51.508342 | aio | PLAY [Verify] ****************************************************************** 2026-03-05 16:42:51.508697 | aio | 2026-03-05 16:42:51.509121 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:42:51.509492 | aio | Thursday 05 March 2026 16:42:51 +0000 (0:00:00.007) 0:00:00.007 ******** 2026-03-05 16:42:52.740616 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 16:42:52.742087 | aio | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 16:42:52.742117 | aio | interpreter could change the meaning of that path. See 2026-03-05 16:42:52.742127 | aio | https://docs.ansible.com/ansible- 2026-03-05 16:42:52.742136 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:42:52.751117 | aio | ok: [aio] 2026-03-05 16:42:52.751159 | aio | 2026-03-05 16:42:52.751244 | aio | TASK [Get cluster health status] *********************************************** 2026-03-05 16:42:52.751479 | aio | Thursday 05 March 2026 16:42:52 +0000 (0:00:01.242) 0:00:01.250 ******** 2026-03-05 16:43:03.382077 | aio | ok: [aio] 2026-03-05 16:43:03.382134 | aio | 2026-03-05 16:43:03.382173 | aio | TASK [Print cluster health status] ********************************************* 2026-03-05 16:43:03.382186 | aio | Thursday 05 March 2026 16:43:03 +0000 (0:00:10.630) 0:00:11.881 ******** 2026-03-05 16:43:03.415225 | aio | ok: [aio] => { 2026-03-05 16:43:03.415294 | aio | "_ceph_health": { 2026-03-05 16:43:03.415663 | aio | "changed": false, 2026-03-05 16:43:03.415909 | aio | "cmd": [ 2026-03-05 16:43:03.416170 | aio | "cephadm", 2026-03-05 16:43:03.416402 | aio | "shell", 2026-03-05 16:43:03.416627 | aio | "--", 2026-03-05 16:43:03.416856 | aio | "ceph", 2026-03-05 16:43:03.417110 | aio | "health" 2026-03-05 16:43:03.417339 | aio | ], 2026-03-05 16:43:03.417706 | aio | "delta": "0:00:10.304504", 2026-03-05 16:43:03.417975 | aio | "end": "2026-03-05 16:43:03.335292", 2026-03-05 16:43:03.418274 | aio | "failed": false, 2026-03-05 16:43:03.418520 | aio | "msg": "", 2026-03-05 16:43:03.418752 | aio | "rc": 0, 2026-03-05 16:43:03.418981 | aio | "start": "2026-03-05 16:42:53.030788", 2026-03-05 16:43:03.419274 | aio | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config", 2026-03-05 16:43:03.419521 | aio | "stderr_lines": [ 2026-03-05 16:43:03.419767 | aio | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-05 16:43:03.420021 | aio | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config" 2026-03-05 16:43:03.420277 | aio | ], 2026-03-05 16:43:03.420560 | aio | "stdout": "HEALTH_OK", 2026-03-05 16:43:03.420741 | aio | "stdout_lines": [ 2026-03-05 16:43:03.420967 | aio | "HEALTH_OK" 2026-03-05 16:43:03.421231 | aio | ] 2026-03-05 16:43:03.421473 | aio | } 2026-03-05 16:43:03.421715 | aio | } 2026-03-05 16:43:03.421932 | aio | 2026-03-05 16:43:03.422229 | aio | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-05 16:43:03.422497 | aio | Thursday 05 March 2026 16:43:03 +0000 (0:00:00.033) 0:00:11.915 ******** 2026-03-05 16:43:03.449486 | aio | ok: [aio] => { 2026-03-05 16:43:03.449675 | aio | "changed": false, 2026-03-05 16:43:03.449974 | aio | "msg": "All assertions passed" 2026-03-05 16:43:03.450176 | aio | } 2026-03-05 16:43:03.450553 | aio | 2026-03-05 16:43:03.450811 | aio | TASK [Create a test Ceph pool] ************************************************* 2026-03-05 16:43:03.451087 | aio | Thursday 05 March 2026 16:43:03 +0000 (0:00:00.034) 0:00:11.949 ******** 2026-03-05 16:43:10.057671 | aio | changed: [aio] 2026-03-05 16:43:10.057741 | aio | 2026-03-05 16:43:10.058263 | aio | TASK [Create a test Ceph key] ************************************************** 2026-03-05 16:43:10.058289 | aio | Thursday 05 March 2026 16:43:10 +0000 (0:00:06.604) 0:00:18.554 ******** 2026-03-05 16:43:12.727970 | aio | changed: [aio] 2026-03-05 16:43:12.728124 | aio | 2026-03-05 16:43:12.728286 | aio | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-05 16:43:12.728518 | aio | Thursday 05 March 2026 16:43:12 +0000 (0:00:02.673) 0:00:21.227 ******** 2026-03-05 16:43:14.087273 | aio | ok: [aio] 2026-03-05 16:43:14.087370 | aio | 2026-03-05 16:43:14.087388 | aio | TASK [Assert that key_info returns the correct key] **************************** 2026-03-05 16:43:14.087404 | aio | Thursday 05 March 2026 16:43:14 +0000 (0:00:01.358) 0:00:22.586 ******** 2026-03-05 16:43:14.126259 | aio | ok: [aio] => { 2026-03-05 16:43:14.126344 | aio | "changed": false, 2026-03-05 16:43:14.126360 | aio | "msg": "All assertions passed" 2026-03-05 16:43:14.126374 | aio | } 2026-03-05 16:43:14.126395 | aio | 2026-03-05 16:43:14.126824 | aio | PLAY RECAP ********************************************************************* 2026-03-05 16:43:14.126893 | aio | aio : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 16:43:14.126908 | aio | 2026-03-05 16:43:14.126927 | aio | 2026-03-05 16:43:14.127129 | aio | TASKS RECAP ******************************************************************** 2026-03-05 16:43:14.128086 | aio | Thursday 05 March 2026 16:43:14 +0000 (0:00:00.040) 0:00:22.626 ******** 2026-03-05 16:43:14.128134 | aio | =============================================================================== 2026-03-05 16:43:14.128143 | aio | Get cluster health status ---------------------------------------------- 10.63s 2026-03-05 16:43:14.128151 | aio | Create a test Ceph pool ------------------------------------------------- 6.60s 2026-03-05 16:43:14.128160 | aio | Create a test Ceph key -------------------------------------------------- 2.67s 2026-03-05 16:43:14.128167 | aio | Retrieve info for the test Ceph key ------------------------------------- 1.36s 2026-03-05 16:43:14.128305 | aio | Gathering Facts --------------------------------------------------------- 1.24s 2026-03-05 16:43:14.128525 | aio | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-03-05 16:43:14.128719 | aio | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-03-05 16:43:14.128909 | aio | Print cluster health status --------------------------------------------- 0.03s 2026-03-05 16:43:14.213548 | aio | INFO [default > verify] Executed: Successful 2026-03-05 16:43:14.221258 | aio | INFO [default > cleanup] Executing 2026-03-05 16:43:14.221740 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:43:14.229754 | aio | INFO [default > destroy] Executing 2026-03-05 16:43:14.229902 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 16:43:14.230117 | aio | INFO [default > destroy] Executed: Successful 2026-03-05 16:43:14.230560 | aio | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-05 16:43:14.536480 | aio | ok: Runtime: 0:11:16.877450 2026-03-05 16:43:14.550658 | 2026-03-05 16:43:14.550717 | PLAY RECAP 2026-03-05 16:43:14.550764 | aio | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 16:43:14.550785 | 2026-03-05 16:43:14.651734 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 16:43:14.654982 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 16:43:15.209967 | 2026-03-05 16:43:15.210091 | PLAY [all] 2026-03-05 16:43:15.222020 | 2026-03-05 16:43:15.222134 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-05 16:43:15.266676 | aio | skipping: Conditional result was False 2026-03-05 16:43:15.279001 | 2026-03-05 16:43:15.279121 | TASK [fetch-output : Set log path for single node] 2026-03-05 16:43:15.324479 | aio | ok 2026-03-05 16:43:15.330320 | 2026-03-05 16:43:15.330390 | LOOP [fetch-output : Ensure local output dirs] 2026-03-05 16:43:15.702161 | aio -> localhost | ok: "/var/lib/zuul/builds/eab25b2bf6de46359348732387283c61/work/logs" 2026-03-05 16:43:15.901676 | aio -> localhost | changed: "/var/lib/zuul/builds/eab25b2bf6de46359348732387283c61/work/artifacts" 2026-03-05 16:43:16.127473 | aio -> localhost | changed: "/var/lib/zuul/builds/eab25b2bf6de46359348732387283c61/work/docs" 2026-03-05 16:43:16.146593 | 2026-03-05 16:43:16.146706 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-05 16:43:16.822709 | aio | changed: .d..t...... ./ 2026-03-05 16:43:16.822957 | aio | changed: All items complete 2026-03-05 16:43:16.822997 | 2026-03-05 16:43:17.289551 | aio | changed: .d..t...... ./ 2026-03-05 16:43:17.765061 | aio | changed: .d..t...... ./ 2026-03-05 16:43:17.786687 | 2026-03-05 16:43:17.786818 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-05 16:43:18.242307 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.007375 2026-03-05 16:43:18.460943 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.007316 2026-03-05 16:43:18.482378 | 2026-03-05 16:43:18.482482 | PLAY [all] 2026-03-05 16:43:18.488996 | 2026-03-05 16:43:18.489071 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-05 16:43:18.957040 | aio | changed 2026-03-05 16:43:18.966381 | 2026-03-05 16:43:18.966446 | PLAY RECAP 2026-03-05 16:43:18.966513 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 16:43:18.966553 | 2026-03-05 16:43:19.089929 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 16:43:19.093402 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-05 16:43:19.672669 | 2026-03-05 16:43:19.672797 | PLAY [localhost] 2026-03-05 16:43:19.682523 | 2026-03-05 16:43:19.682594 | TASK [Generate Zuul manifest] 2026-03-05 16:43:19.711530 | localhost | ok 2026-03-05 16:43:19.732114 | 2026-03-05 16:43:19.732258 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-05 16:43:20.100065 | localhost | changed 2026-03-05 16:43:20.113695 | 2026-03-05 16:43:20.113780 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-05 16:43:20.145064 | localhost | ok 2026-03-05 16:43:20.153233 | 2026-03-05 16:43:20.153305 | TASK [Upload logs] 2026-03-05 16:43:20.176546 | localhost | ok 2026-03-05 16:43:20.242106 | 2026-03-05 16:43:20.242281 | TASK [Set zuul-log-path fact] 2026-03-05 16:43:20.265335 | localhost | ok 2026-03-05 16:43:20.282779 | 2026-03-05 16:43:20.282884 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 16:43:20.316883 | localhost | ok 2026-03-05 16:43:20.325939 | 2026-03-05 16:43:20.326033 | TASK [upload-logs : Create log directories] 2026-03-05 16:43:20.742246 | localhost | changed 2026-03-05 16:43:20.749085 | 2026-03-05 16:43:20.749189 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-05 16:43:21.188211 | localhost -> localhost | ok: Runtime: 0:00:00.006440 2026-03-05 16:43:21.195199 | 2026-03-05 16:43:21.195301 | TASK [upload-logs : Upload logs to log server] 2026-03-05 16:43:21.655633 | localhost | Output suppressed because no_log was given 2026-03-05 16:43:21.661848 | 2026-03-05 16:43:21.661972 | LOOP [upload-logs : Compress console log and json output] 2026-03-05 16:43:21.709266 | localhost | skipping: Conditional result was False 2026-03-05 16:43:21.715799 | localhost | skipping: Conditional result was False 2026-03-05 16:43:21.726322 | 2026-03-05 16:43:21.726428 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-05 16:43:21.772067 | localhost | skipping: Conditional result was False 2026-03-05 16:43:21.772542 | 2026-03-05 16:43:21.776491 | localhost | skipping: Conditional result was False 2026-03-05 16:43:21.793830 | 2026-03-05 16:43:21.793967 | LOOP [upload-logs : Upload console log and json output]