2026-03-31 18:17:10.040852 | Job console starting 2026-03-31 18:17:10.191979 | Updating git repos 2026-03-31 18:17:10.583794 | Cloning repos into workspace 2026-03-31 18:17:12.207922 | Restoring repo states 2026-03-31 18:17:12.213813 | Merging changes 2026-03-31 18:17:12.908465 | Checking out repos 2026-03-31 18:17:13.664712 | Preparing playbooks 2026-03-31 18:17:24.414945 | Running Ansible setup 2026-03-31 18:17:28.955246 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-31 18:17:29.711394 | 2026-03-31 18:17:29.711530 | PLAY [localhost] 2026-03-31 18:17:29.718954 | 2026-03-31 18:17:29.719025 | TASK [Gathering Facts] 2026-03-31 18:17:30.864618 | localhost | ok 2026-03-31 18:17:30.885957 | 2026-03-31 18:17:30.886098 | TASK [Setup log path fact] 2026-03-31 18:17:30.914206 | localhost | ok 2026-03-31 18:17:30.994220 | 2026-03-31 18:17:30.994323 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-31 18:17:31.033019 | localhost | ok 2026-03-31 18:17:31.110514 | 2026-03-31 18:17:31.110675 | TASK [emit-job-header : Print job information] 2026-03-31 18:17:31.142123 | # Job Information 2026-03-31 18:17:31.142326 | Ansible Version: 2.16.16 2026-03-31 18:17:31.142374 | Job: ansible-collection-ceph-molecule-aio-ubuntu-jammy 2026-03-31 18:17:31.142408 | Pipeline: check 2026-03-31 18:17:31.142438 | Executor: 0a8996d2b663 2026-03-31 18:17:31.142468 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/96 2026-03-31 18:17:31.142502 | Event ID: 55a9a070-2d11-11f1-9233-a3bfad3c5a11 2026-03-31 18:17:31.146986 | 2026-03-31 18:17:31.147084 | LOOP [emit-job-header : Print node information] 2026-03-31 18:17:31.310762 | localhost | ok: 2026-03-31 18:17:31.311175 | localhost | # Node Information 2026-03-31 18:17:31.311207 | localhost | Inventory Hostname: aio 2026-03-31 18:17:31.311230 | localhost | Hostname: np0000161920 2026-03-31 18:17:31.311251 | localhost | Username: zuul 2026-03-31 18:17:31.311279 | localhost | Distro: Ubuntu 22.04 2026-03-31 18:17:31.311302 | localhost | Provider: yul1 2026-03-31 18:17:31.311322 | localhost | Region: ca-ymq-1 2026-03-31 18:17:31.311341 | localhost | Label: ubuntu-jammy 2026-03-31 18:17:31.311361 | localhost | Product Name: OpenStack Nova 2026-03-31 18:17:31.311380 | localhost | Interface IP: 199.19.213.174 2026-03-31 18:17:31.331251 | 2026-03-31 18:17:31.331372 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-31 18:17:32.027339 | localhost -> localhost | changed 2026-03-31 18:17:32.035830 | 2026-03-31 18:17:32.035950 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-31 18:17:33.215284 | localhost -> localhost | changed 2026-03-31 18:17:33.221380 | 2026-03-31 18:17:33.221444 | PLAY [all] 2026-03-31 18:17:33.234807 | 2026-03-31 18:17:33.234986 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-31 18:17:33.544256 | aio -> localhost | ok 2026-03-31 18:17:33.554952 | 2026-03-31 18:17:33.555029 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-31 18:17:33.586399 | aio | ok 2026-03-31 18:17:33.612293 | aio | included: /var/lib/zuul/builds/6a54a21a75124543a74e92e8d3a2221e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-31 18:17:33.618136 | 2026-03-31 18:17:33.618207 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-31 18:17:34.566300 | aio -> localhost | Generating public/private rsa key pair. 2026-03-31 18:17:34.566753 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/6a54a21a75124543a74e92e8d3a2221e/work/6a54a21a75124543a74e92e8d3a2221e_id_rsa 2026-03-31 18:17:34.566802 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/6a54a21a75124543a74e92e8d3a2221e/work/6a54a21a75124543a74e92e8d3a2221e_id_rsa.pub 2026-03-31 18:17:34.566837 | aio -> localhost | The key fingerprint is: 2026-03-31 18:17:34.566870 | aio -> localhost | SHA256:lleNePTaMTCxHbHTyadBgDOJb5eTIj4bcECqQkFrTxE zuul-build-sshkey 2026-03-31 18:17:34.566948 | aio -> localhost | The key's randomart image is: 2026-03-31 18:17:34.566984 | aio -> localhost | +---[RSA 3072]----+ 2026-03-31 18:17:34.567028 | aio -> localhost | |.o E... . o*o+. | 2026-03-31 18:17:34.567061 | aio -> localhost | | o ... . =o X.+.| 2026-03-31 18:17:34.567090 | aio -> localhost | | + .. . ..o=oXoo| 2026-03-31 18:17:34.567119 | aio -> localhost | |o o. . o.+o=o *.| 2026-03-31 18:17:34.567147 | aio -> localhost | |. .. +So.o..o | 2026-03-31 18:17:34.567175 | aio -> localhost | | . .+. | 2026-03-31 18:17:34.567204 | aio -> localhost | | + | 2026-03-31 18:17:34.567233 | aio -> localhost | | . | 2026-03-31 18:17:34.567265 | aio -> localhost | | | 2026-03-31 18:17:34.567299 | aio -> localhost | +----[SHA256]-----+ 2026-03-31 18:17:34.567380 | aio -> localhost | ok: Runtime: 0:00:00.402527 2026-03-31 18:17:34.573708 | 2026-03-31 18:17:34.573780 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-31 18:17:34.608943 | aio | ok 2026-03-31 18:17:34.617345 | aio | included: /var/lib/zuul/builds/6a54a21a75124543a74e92e8d3a2221e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-31 18:17:34.625942 | 2026-03-31 18:17:34.626052 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-31 18:17:34.655945 | aio | skipping: Conditional result was False 2026-03-31 18:17:34.665670 | 2026-03-31 18:17:34.665792 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-31 18:17:35.144719 | aio | changed 2026-03-31 18:17:35.229616 | 2026-03-31 18:17:35.229758 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-31 18:17:35.427491 | aio | ok 2026-03-31 18:17:35.437684 | 2026-03-31 18:17:35.437871 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-31 18:17:35.874019 | aio | changed 2026-03-31 18:17:35.882196 | 2026-03-31 18:17:35.882307 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-31 18:17:36.363057 | aio | changed 2026-03-31 18:17:36.368993 | 2026-03-31 18:17:36.369139 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-31 18:17:36.385986 | aio | skipping: Conditional result was False 2026-03-31 18:17:36.393280 | 2026-03-31 18:17:36.393379 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-31 18:17:36.905569 | aio -> localhost | changed 2026-03-31 18:17:36.919595 | 2026-03-31 18:17:36.919783 | TASK [add-build-sshkey : Add back temp key] 2026-03-31 18:17:37.320386 | aio -> localhost | Identity added: /var/lib/zuul/builds/6a54a21a75124543a74e92e8d3a2221e/work/6a54a21a75124543a74e92e8d3a2221e_id_rsa (zuul-build-sshkey) 2026-03-31 18:17:37.320564 | aio -> localhost | ok: Runtime: 0:00:00.016109 2026-03-31 18:17:37.325862 | 2026-03-31 18:17:37.325929 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-31 18:17:37.629353 | aio | ok 2026-03-31 18:17:37.635575 | 2026-03-31 18:17:37.635639 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-31 18:17:37.680079 | aio | skipping: Conditional result was False 2026-03-31 18:17:37.690377 | 2026-03-31 18:17:37.690464 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-31 18:17:38.032028 | aio | ok 2026-03-31 18:17:38.037552 | 2026-03-31 18:17:38.037625 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-31 18:17:39.332292 | aio | Output suppressed because no_log was given 2026-03-31 18:17:39.347750 | 2026-03-31 18:17:39.347863 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-31 18:17:39.558208 | aio | ok: "logs" 2026-03-31 18:17:39.558425 | aio | ok: All items complete 2026-03-31 18:17:39.558455 | 2026-03-31 18:17:39.691564 | aio | ok: "artifacts" 2026-03-31 18:17:39.840398 | aio | ok: "docs" 2026-03-31 18:17:39.851070 | 2026-03-31 18:17:39.851210 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-31 18:17:40.107207 | aio | changed: "logs" 2026-03-31 18:17:40.436288 | aio | changed: "artifacts" 2026-03-31 18:17:40.443730 | aio | changed: "docs" 2026-03-31 18:17:40.463153 | 2026-03-31 18:17:40.463257 | PLAY RECAP 2026-03-31 18:17:40.463417 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-31 18:17:40.463466 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-31 18:17:40.463511 | 2026-03-31 18:17:40.591370 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-31 18:17:40.616164 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-31 18:17:41.221563 | 2026-03-31 18:17:41.308795 | PLAY [all] 2026-03-31 18:17:41.328006 | 2026-03-31 18:17:41.328212 | TASK [setup-uv : Extract archive] 2026-03-31 18:17:43.517600 | aio | changed 2026-03-31 18:17:43.525385 | 2026-03-31 18:17:43.525507 | TASK [setup-uv : Print version] 2026-03-31 18:17:43.907038 | aio | uv 0.8.13 2026-03-31 18:17:44.062332 | aio | ok: Runtime: 0:00:00.010753 2026-03-31 18:17:44.069004 | 2026-03-31 18:17:44.069065 | PLAY RECAP 2026-03-31 18:17:44.069145 | aio | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-31 18:17:44.069172 | 2026-03-31 18:17:44.186003 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-31 18:17:44.300270 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-31 18:17:44.948321 | 2026-03-31 18:17:44.948492 | PLAY [all] 2026-03-31 18:17:44.968583 | 2026-03-31 18:17:44.968718 | TASK [Copy inventory file for Zuul] 2026-03-31 18:17:45.856218 | aio | changed 2026-03-31 18:17:45.873919 | 2026-03-31 18:17:45.874108 | TASK [Switch "ansible_host" to private IP] 2026-03-31 18:17:46.147586 | aio | changed: 1 replacements made 2026-03-31 18:17:46.170070 | 2026-03-31 18:17:46.170207 | TASK [Run Molecule scenario] 2026-03-31 18:17:46.841640 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-03-31 18:17:47.564383 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-03-31 18:17:47.732752 | aio | Using CPython 3.13.7 2026-03-31 18:17:47.732820 | aio | Creating virtual environment at: .venv 2026-03-31 18:17:47.976112 | aio | Downloading ansible-core (2.1MiB) 2026-03-31 18:17:47.976503 | aio | Downloading cryptography (4.3MiB) 2026-03-31 18:17:47.976715 | aio | Downloading pygments (1.2MiB) 2026-03-31 18:17:47.976943 | aio | Downloading netaddr (2.2MiB) 2026-03-31 18:17:48.141612 | aio | Downloading netaddr 2026-03-31 18:17:48.205245 | aio | Downloading pygments 2026-03-31 18:17:48.242310 | aio | Downloading cryptography 2026-03-31 18:17:48.331439 | aio | Downloading ansible-core 2026-03-31 18:17:48.358820 | aio | Installed 36 packages in 26ms 2026-03-31 18:17:49.488681 | aio | INFO Collection 'vexxhost.ceph' detected. 2026-03-31 18:17:49.488766 | aio | INFO Scenarios will be used from 'extensions/molecule' 2026-03-31 18:17:50.090385 | aio | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-31 18:17:50.090470 | aio | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-31 18:18:03.449161 | aio | INFO [default > dependency] Executing 2026-03-31 18:18:03.449214 | aio | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-31 18:18:03.449224 | aio | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-31 18:18:03.449309 | aio | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-31 18:18:03.456879 | aio | INFO [default > cleanup] Executing 2026-03-31 18:18:03.457213 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-31 18:18:03.462289 | aio | INFO [default > destroy] Executing 2026-03-31 18:18:03.462393 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-31 18:18:03.462483 | aio | INFO [default > destroy] Executed: Successful 2026-03-31 18:18:03.467608 | aio | INFO [default > syntax] Executing 2026-03-31 18:18:04.394019 | aio | 2026-03-31 18:18:04.394181 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-31 18:18:04.444120 | aio | INFO [default > syntax] Executed: Successful 2026-03-31 18:18:04.449745 | aio | INFO [default > create] Executing 2026-03-31 18:18:04.451109 | aio | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-31 18:18:04.456146 | aio | INFO [default > prepare] Executing 2026-03-31 18:18:05.103776 | aio | 2026-03-31 18:18:05.103897 | aio | PLAY [Prepare] ***************************************************************** 2026-03-31 18:18:05.104024 | aio | 2026-03-31 18:18:05.104163 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:18:05.104295 | aio | Tuesday 31 March 2026 18:18:05 +0000 (0:00:00.030) 0:00:00.030 ********* 2026-03-31 18:18:06.223901 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-31 18:18:06.224064 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-31 18:18:06.224292 | aio | interpreter could change the meaning of that path. See 2026-03-31 18:18:06.224497 | aio | https://docs.ansible.com/ansible- 2026-03-31 18:18:06.224723 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:18:06.229889 | aio | ok: [aio] 2026-03-31 18:18:06.230083 | aio | 2026-03-31 18:18:06.230289 | aio | TASK [Configure short hostname] ************************************************ 2026-03-31 18:18:06.230493 | aio | Tuesday 31 March 2026 18:18:06 +0000 (0:00:01.126) 0:00:01.156 ********* 2026-03-31 18:18:06.911651 | aio | changed: [aio] 2026-03-31 18:18:06.911881 | aio | 2026-03-31 18:18:06.912107 | aio | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-31 18:18:06.912324 | aio | Tuesday 31 March 2026 18:18:06 +0000 (0:00:00.681) 0:00:01.838 ********* 2026-03-31 18:18:07.166529 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-31 18:18:07.166739 | aio | with a mode of 0700, this may cause issues when running as another user. To 2026-03-31 18:18:07.166969 | aio | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-31 18:18:07.173755 | aio | changed: [aio] 2026-03-31 18:18:07.173951 | aio | 2026-03-31 18:18:07.174167 | aio | TASK [Update apt cache] ******************************************************** 2026-03-31 18:18:07.174394 | aio | Tuesday 31 March 2026 18:18:07 +0000 (0:00:00.262) 0:00:02.100 ********* 2026-03-31 18:18:34.599262 | aio | changed: [aio] 2026-03-31 18:18:34.599436 | aio | 2026-03-31 18:18:34.599655 | aio | PLAY [Create devices for Ceph] ************************************************* 2026-03-31 18:18:34.599910 | aio | 2026-03-31 18:18:34.600198 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:18:34.600483 | aio | Tuesday 31 March 2026 18:18:34 +0000 (0:00:27.425) 0:00:29.525 ********* 2026-03-31 18:18:35.286014 | aio | ok: [aio] 2026-03-31 18:18:35.286144 | aio | 2026-03-31 18:18:35.286351 | aio | TASK [Install depedencies] ***************************************************** 2026-03-31 18:18:35.286600 | aio | Tuesday 31 March 2026 18:18:35 +0000 (0:00:00.686) 0:00:30.212 ********* 2026-03-31 18:19:00.582170 | aio | changed: [aio] 2026-03-31 18:19:00.582419 | aio | 2026-03-31 18:19:00.582433 | aio | TASK [Start up service] ******************************************************** 2026-03-31 18:19:00.582506 | aio | Tuesday 31 March 2026 18:19:00 +0000 (0:00:25.289) 0:00:55.502 ********* 2026-03-31 18:19:01.109693 | aio | ok: [aio] 2026-03-31 18:19:01.109869 | aio | 2026-03-31 18:19:01.110081 | aio | TASK [Generate lvm.conf] ******************************************************* 2026-03-31 18:19:01.110314 | aio | Tuesday 31 March 2026 18:19:01 +0000 (0:00:00.534) 0:00:56.036 ********* 2026-03-31 18:19:01.394273 | aio | ok: [aio] 2026-03-31 18:19:01.394621 | aio | 2026-03-31 18:19:01.394925 | aio | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-31 18:19:01.395223 | aio | Tuesday 31 March 2026 18:19:01 +0000 (0:00:00.284) 0:00:56.320 ********* 2026-03-31 18:19:02.015898 | aio | changed: [aio] 2026-03-31 18:19:02.015967 | aio | 2026-03-31 18:19:02.016041 | aio | TASK [Get list of all loopback devices] **************************************** 2026-03-31 18:19:02.016140 | aio | Tuesday 31 March 2026 18:19:02 +0000 (0:00:00.621) 0:00:56.942 ********* 2026-03-31 18:19:02.205545 | aio | ok: [aio] 2026-03-31 18:19:02.205582 | aio | 2026-03-31 18:19:02.205588 | aio | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-31 18:19:02.205634 | aio | Tuesday 31 March 2026 18:19:02 +0000 (0:00:00.189) 0:00:57.131 ********* 2026-03-31 18:19:02.231468 | aio | skipping: [aio] 2026-03-31 18:19:02.231677 | aio | 2026-03-31 18:19:02.231842 | aio | TASK [Create devices for Ceph] ************************************************* 2026-03-31 18:19:02.231976 | aio | Tuesday 31 March 2026 18:19:02 +0000 (0:00:00.026) 0:00:57.158 ********* 2026-03-31 18:19:02.760510 | aio | changed: [aio] => (item=osd0) 2026-03-31 18:19:02.760622 | aio | changed: [aio] => (item=osd1) 2026-03-31 18:19:02.760768 | aio | changed: [aio] => (item=osd2) 2026-03-31 18:19:02.760890 | aio | 2026-03-31 18:19:02.761032 | aio | TASK [Set permissions on loopback devices] ************************************* 2026-03-31 18:19:02.761170 | aio | Tuesday 31 March 2026 18:19:02 +0000 (0:00:00.529) 0:00:57.687 ********* 2026-03-31 18:19:03.377931 | aio | changed: [aio] => (item=osd0) 2026-03-31 18:19:03.378141 | aio | changed: [aio] => (item=osd1) 2026-03-31 18:19:03.378353 | aio | changed: [aio] => (item=osd2) 2026-03-31 18:19:03.378544 | aio | 2026-03-31 18:19:03.378754 | aio | TASK [Start loop devices] ****************************************************** 2026-03-31 18:19:03.378960 | aio | Tuesday 31 March 2026 18:19:03 +0000 (0:00:00.617) 0:00:58.304 ********* 2026-03-31 18:19:04.067353 | aio | changed: [aio] => (item=osd0) 2026-03-31 18:19:04.067560 | aio | changed: [aio] => (item=osd1) 2026-03-31 18:19:04.067776 | aio | changed: [aio] => (item=osd2) 2026-03-31 18:19:04.067962 | aio | 2026-03-31 18:19:04.068177 | aio | TASK [Create a volume group for each loop device] ****************************** 2026-03-31 18:19:04.068393 | aio | Tuesday 31 March 2026 18:19:04 +0000 (0:00:00.688) 0:00:58.993 ********* 2026-03-31 18:19:07.248869 | aio | changed: [aio] => (item=osd0) 2026-03-31 18:19:07.248986 | aio | changed: [aio] => (item=osd1) 2026-03-31 18:19:07.249000 | aio | changed: [aio] => (item=osd2) 2026-03-31 18:19:07.249073 | aio | 2026-03-31 18:19:07.249168 | aio | TASK [Create a logical volume for each loop device] **************************** 2026-03-31 18:19:07.249264 | aio | Tuesday 31 March 2026 18:19:07 +0000 (0:00:03.182) 0:01:02.175 ********* 2026-03-31 18:19:09.143159 | aio | changed: [aio] => (item=ceph-aio-osd0) 2026-03-31 18:19:09.143222 | aio | changed: [aio] => (item=ceph-aio-osd1) 2026-03-31 18:19:09.143235 | aio | changed: [aio] => (item=ceph-aio-osd2) 2026-03-31 18:19:09.143353 | aio | 2026-03-31 18:19:09.143543 | aio | PLAY RECAP ********************************************************************* 2026-03-31 18:19:09.144022 | aio | aio : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-31 18:19:09.144030 | aio | 2026-03-31 18:19:09.144128 | aio | 2026-03-31 18:19:09.144320 | aio | TASKS RECAP ******************************************************************** 2026-03-31 18:19:09.144554 | aio | Tuesday 31 March 2026 18:19:09 +0000 (0:00:01.893) 0:01:04.069 ********* 2026-03-31 18:19:09.144707 | aio | =============================================================================== 2026-03-31 18:19:09.144892 | aio | Update apt cache ------------------------------------------------------- 27.43s 2026-03-31 18:19:09.145081 | aio | Install depedencies ---------------------------------------------------- 25.29s 2026-03-31 18:19:09.145276 | aio | Create a volume group for each loop device ------------------------------ 3.18s 2026-03-31 18:19:09.145479 | aio | Create a logical volume for each loop device ---------------------------- 1.89s 2026-03-31 18:19:09.145694 | aio | Gathering Facts --------------------------------------------------------- 1.13s 2026-03-31 18:19:09.145878 | aio | Start loop devices ------------------------------------------------------ 0.69s 2026-03-31 18:19:09.146066 | aio | Gathering Facts --------------------------------------------------------- 0.69s 2026-03-31 18:19:09.146254 | aio | Configure short hostname ------------------------------------------------ 0.68s 2026-03-31 18:19:09.146444 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.62s 2026-03-31 18:19:09.146636 | aio | Set permissions on loopback devices ------------------------------------- 0.62s 2026-03-31 18:19:09.146824 | aio | Start up service -------------------------------------------------------- 0.53s 2026-03-31 18:19:09.147012 | aio | Create devices for Ceph ------------------------------------------------- 0.53s 2026-03-31 18:19:09.147201 | aio | Generate lvm.conf ------------------------------------------------------- 0.28s 2026-03-31 18:19:09.147391 | aio | Ensure hostname inside hosts file --------------------------------------- 0.26s 2026-03-31 18:19:09.147581 | aio | Get list of all loopback devices ---------------------------------------- 0.19s 2026-03-31 18:19:09.147775 | aio | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-03-31 18:19:09.208851 | aio | INFO [default > prepare] Executed: Successful 2026-03-31 18:19:09.218575 | aio | INFO [default > converge] Executing 2026-03-31 18:19:10.000202 | aio | 2026-03-31 18:19:10.000378 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-31 18:19:10.000588 | aio | 2026-03-31 18:19:10.000803 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:19:10.001046 | aio | Tuesday 31 March 2026 18:19:09 +0000 (0:00:00.046) 0:00:00.046 ********* 2026-03-31 18:19:11.194074 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-31 18:19:11.194790 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-31 18:19:11.194805 | aio | interpreter could change the meaning of that path. See 2026-03-31 18:19:11.194839 | aio | https://docs.ansible.com/ansible- 2026-03-31 18:19:11.194849 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:19:11.202289 | aio | ok: [aio] 2026-03-31 18:19:11.202421 | aio | 2026-03-31 18:19:11.202560 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:19:11.202695 | aio | Tuesday 31 March 2026 18:19:11 +0000 (0:00:01.202) 0:00:01.248 ********* 2026-03-31 18:19:11.481742 | aio | ok: [aio] 2026-03-31 18:19:11.481897 | aio | 2026-03-31 18:19:11.482111 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:19:11.482321 | aio | Tuesday 31 March 2026 18:19:11 +0000 (0:00:00.279) 0:00:01.528 ********* 2026-03-31 18:19:11.520041 | aio | skipping: [aio] 2026-03-31 18:19:11.520208 | aio | 2026-03-31 18:19:11.520423 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-31 18:19:11.520645 | aio | Tuesday 31 March 2026 18:19:11 +0000 (0:00:00.038) 0:00:01.566 ********* 2026-03-31 18:19:11.821651 | aio | changed: [aio] 2026-03-31 18:19:11.821812 | aio | 2026-03-31 18:19:11.822027 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:19:11.822295 | aio | Tuesday 31 March 2026 18:19:11 +0000 (0:00:00.301) 0:00:01.868 ********* 2026-03-31 18:19:11.912041 | aio | ok: [aio] => { 2026-03-31 18:19:11.912220 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-31 18:19:11.912419 | aio | } 2026-03-31 18:19:11.912607 | aio | 2026-03-31 18:19:11.912817 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:19:11.913016 | aio | Tuesday 31 March 2026 18:19:11 +0000 (0:00:00.090) 0:00:01.958 ********* 2026-03-31 18:19:12.594413 | aio | changed: [aio] 2026-03-31 18:19:12.594571 | aio | 2026-03-31 18:19:12.594782 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:19:12.594983 | aio | Tuesday 31 March 2026 18:19:12 +0000 (0:00:00.682) 0:00:02.640 ********* 2026-03-31 18:19:12.636162 | aio | skipping: [aio] 2026-03-31 18:19:12.636343 | aio | 2026-03-31 18:19:12.636562 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:19:12.636770 | aio | Tuesday 31 March 2026 18:19:12 +0000 (0:00:00.041) 0:00:02.682 ********* 2026-03-31 18:19:12.668855 | aio | skipping: [aio] 2026-03-31 18:19:12.669060 | aio | 2026-03-31 18:19:12.669270 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:19:12.669482 | aio | Tuesday 31 March 2026 18:19:12 +0000 (0:00:00.032) 0:00:02.715 ********* 2026-03-31 18:19:12.866867 | aio | ok: [aio] 2026-03-31 18:19:12.867040 | aio | 2026-03-31 18:19:12.867259 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:19:12.867465 | aio | Tuesday 31 March 2026 18:19:12 +0000 (0:00:00.198) 0:00:02.913 ********* 2026-03-31 18:19:13.979753 | aio | ok: [aio] 2026-03-31 18:19:13.979905 | aio | 2026-03-31 18:19:13.980122 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:19:13.980330 | aio | Tuesday 31 March 2026 18:19:13 +0000 (0:00:01.112) 0:00:04.026 ********* 2026-03-31 18:19:14.058732 | aio | ok: [aio] => { 2026-03-31 18:19:14.058939 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-31 18:19:14.059139 | aio | } 2026-03-31 18:19:14.059365 | aio | 2026-03-31 18:19:14.059579 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:19:14.059800 | aio | Tuesday 31 March 2026 18:19:14 +0000 (0:00:00.078) 0:00:04.105 ********* 2026-03-31 18:19:15.008422 | aio | changed: [aio] 2026-03-31 18:19:15.008746 | aio | 2026-03-31 18:19:15.009026 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:19:15.009329 | aio | Tuesday 31 March 2026 18:19:15 +0000 (0:00:00.949) 0:00:05.054 ********* 2026-03-31 18:19:17.861908 | aio | changed: [aio] 2026-03-31 18:19:17.861988 | aio | 2026-03-31 18:19:17.862071 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-31 18:19:17.862246 | aio | Tuesday 31 March 2026 18:19:17 +0000 (0:00:02.851) 0:00:07.906 ********* 2026-03-31 18:19:17.893563 | aio | skipping: [aio] 2026-03-31 18:19:17.893653 | aio | 2026-03-31 18:19:17.893725 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-31 18:19:17.893819 | aio | Tuesday 31 March 2026 18:19:17 +0000 (0:00:00.030) 0:00:07.937 ********* 2026-03-31 18:19:17.920867 | aio | skipping: [aio] 2026-03-31 18:19:17.920926 | aio | 2026-03-31 18:19:17.921045 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-31 18:19:17.921140 | aio | Tuesday 31 March 2026 18:19:17 +0000 (0:00:00.030) 0:00:07.967 ********* 2026-03-31 18:19:17.947031 | aio | skipping: [aio] 2026-03-31 18:19:17.947134 | aio | 2026-03-31 18:19:17.947327 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-31 18:19:17.947466 | aio | Tuesday 31 March 2026 18:19:17 +0000 (0:00:00.025) 0:00:07.993 ********* 2026-03-31 18:19:22.973037 | aio | changed: [aio] 2026-03-31 18:19:22.973147 | aio | 2026-03-31 18:19:22.973286 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-31 18:19:22.973432 | aio | Tuesday 31 March 2026 18:19:22 +0000 (0:00:05.025) 0:00:13.019 ********* 2026-03-31 18:19:23.482286 | aio | changed: [aio] 2026-03-31 18:19:23.482367 | aio | 2026-03-31 18:19:23.482505 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-31 18:19:23.482651 | aio | Tuesday 31 March 2026 18:19:23 +0000 (0:00:00.509) 0:00:13.528 ********* 2026-03-31 18:19:24.398013 | aio | changed: [aio] => (item={'path': '/etc/containerd'}) 2026-03-31 18:19:24.398079 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-31 18:19:24.398136 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-31 18:19:24.398632 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-31 18:19:24.398692 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-31 18:19:24.398699 | aio | 2026-03-31 18:19:24.398704 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-31 18:19:24.398709 | aio | Tuesday 31 March 2026 18:19:24 +0000 (0:00:00.915) 0:00:14.444 ********* 2026-03-31 18:19:24.918381 | aio | changed: [aio] 2026-03-31 18:19:24.918455 | aio | 2026-03-31 18:19:24.919132 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-31 18:19:24.919191 | aio | Tuesday 31 March 2026 18:19:24 +0000 (0:00:00.511) 0:00:14.956 ********* 2026-03-31 18:19:24.919198 | aio | 2026-03-31 18:19:24.919204 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-31 18:19:24.919209 | aio | Tuesday 31 March 2026 18:19:24 +0000 (0:00:00.008) 0:00:14.964 ********* 2026-03-31 18:19:25.912208 | aio | ok: [aio] 2026-03-31 18:19:25.912272 | aio | 2026-03-31 18:19:25.912494 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-31 18:19:25.912539 | aio | Tuesday 31 March 2026 18:19:25 +0000 (0:00:00.993) 0:00:15.958 ********* 2026-03-31 18:19:26.373823 | aio | changed: [aio] 2026-03-31 18:19:26.373901 | aio | 2026-03-31 18:19:26.374229 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-31 18:19:26.374307 | aio | Tuesday 31 March 2026 18:19:26 +0000 (0:00:00.461) 0:00:16.420 ********* 2026-03-31 18:19:26.942818 | aio | changed: [aio] 2026-03-31 18:19:26.942902 | aio | 2026-03-31 18:19:26.942910 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:19:26.943083 | aio | Tuesday 31 March 2026 18:19:26 +0000 (0:00:00.569) 0:00:16.989 ********* 2026-03-31 18:19:27.147427 | aio | ok: [aio] 2026-03-31 18:19:27.147526 | aio | 2026-03-31 18:19:27.147578 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:19:27.147662 | aio | Tuesday 31 March 2026 18:19:27 +0000 (0:00:00.204) 0:00:17.194 ********* 2026-03-31 18:19:27.215995 | aio | ok: [aio] => { 2026-03-31 18:19:27.216084 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-31 18:19:27.216097 | aio | } 2026-03-31 18:19:27.216398 | aio | 2026-03-31 18:19:27.216453 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:19:27.216459 | aio | Tuesday 31 March 2026 18:19:27 +0000 (0:00:00.068) 0:00:17.262 ********* 2026-03-31 18:19:28.417936 | aio | changed: [aio] 2026-03-31 18:19:28.418013 | aio | 2026-03-31 18:19:28.418076 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:19:28.418199 | aio | Tuesday 31 March 2026 18:19:28 +0000 (0:00:01.201) 0:00:18.464 ********* 2026-03-31 18:19:32.823514 | aio | changed: [aio] 2026-03-31 18:19:32.823593 | aio | 2026-03-31 18:19:32.823653 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-31 18:19:32.823784 | aio | Tuesday 31 March 2026 18:19:32 +0000 (0:00:04.405) 0:00:22.870 ********* 2026-03-31 18:19:33.749716 | aio | ok: [aio] 2026-03-31 18:19:33.750140 | aio | 2026-03-31 18:19:33.750197 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-31 18:19:33.750205 | aio | Tuesday 31 March 2026 18:19:33 +0000 (0:00:00.925) 0:00:23.796 ********* 2026-03-31 18:19:34.157757 | aio | changed: [aio] 2026-03-31 18:19:34.157845 | aio | 2026-03-31 18:19:34.157904 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-31 18:19:34.158024 | aio | Tuesday 31 March 2026 18:19:34 +0000 (0:00:00.408) 0:00:24.204 ********* 2026-03-31 18:19:34.648708 | aio | changed: [aio] 2026-03-31 18:19:34.648780 | aio | 2026-03-31 18:19:34.648795 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-31 18:19:34.648946 | aio | Tuesday 31 March 2026 18:19:34 +0000 (0:00:00.491) 0:00:24.695 ********* 2026-03-31 18:19:35.198756 | aio | changed: [aio] => (item={'path': '/etc/docker'}) 2026-03-31 18:19:35.198819 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-31 18:19:35.199201 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-31 18:19:35.199217 | aio | 2026-03-31 18:19:35.199223 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-31 18:19:35.199227 | aio | Tuesday 31 March 2026 18:19:35 +0000 (0:00:00.550) 0:00:25.245 ********* 2026-03-31 18:19:35.663069 | aio | changed: [aio] 2026-03-31 18:19:35.663135 | aio | 2026-03-31 18:19:35.663146 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-31 18:19:35.663155 | aio | Tuesday 31 March 2026 18:19:35 +0000 (0:00:00.463) 0:00:25.708 ********* 2026-03-31 18:19:36.124276 | aio | changed: [aio] 2026-03-31 18:19:36.124351 | aio | 2026-03-31 18:19:36.124879 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-31 18:19:36.124935 | aio | Tuesday 31 March 2026 18:19:36 +0000 (0:00:00.453) 0:00:26.162 ********* 2026-03-31 18:19:36.124941 | aio | 2026-03-31 18:19:36.124946 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-31 18:19:36.124950 | aio | Tuesday 31 March 2026 18:19:36 +0000 (0:00:00.008) 0:00:26.170 ********* 2026-03-31 18:19:36.835237 | aio | ok: [aio] 2026-03-31 18:19:36.835335 | aio | 2026-03-31 18:19:36.835347 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-31 18:19:36.835487 | aio | Tuesday 31 March 2026 18:19:36 +0000 (0:00:00.710) 0:00:26.881 ********* 2026-03-31 18:19:37.697000 | aio | changed: [aio] 2026-03-31 18:19:37.697063 | aio | 2026-03-31 18:19:37.697141 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-31 18:19:37.697281 | aio | Tuesday 31 March 2026 18:19:37 +0000 (0:00:00.861) 0:00:27.743 ********* 2026-03-31 18:19:38.236114 | aio | changed: [aio] 2026-03-31 18:19:38.236200 | aio | 2026-03-31 18:19:38.236256 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-31 18:19:38.236386 | aio | Tuesday 31 March 2026 18:19:38 +0000 (0:00:00.539) 0:00:28.282 ********* 2026-03-31 18:19:38.284946 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-31 18:19:38.285384 | aio | 2026-03-31 18:19:38.285453 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-31 18:19:38.285462 | aio | Tuesday 31 March 2026 18:19:38 +0000 (0:00:00.048) 0:00:28.331 ********* 2026-03-31 18:19:44.536258 | aio | changed: [aio] 2026-03-31 18:19:44.536351 | aio | 2026-03-31 18:19:44.536616 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-31 18:19:44.536637 | aio | Tuesday 31 March 2026 18:19:44 +0000 (0:00:06.251) 0:00:34.582 ********* 2026-03-31 18:19:45.185677 | aio | ok: [aio] => (item=chronyd) 2026-03-31 18:19:45.185757 | aio | ok: [aio] => (item=sshd) 2026-03-31 18:19:45.186076 | aio | 2026-03-31 18:19:45.186158 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-31 18:19:45.186164 | aio | Tuesday 31 March 2026 18:19:45 +0000 (0:00:00.649) 0:00:35.232 ********* 2026-03-31 18:19:45.506291 | aio | changed: [aio] 2026-03-31 18:19:45.506400 | aio | 2026-03-31 18:19:45.506413 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-31 18:19:45.506559 | aio | Tuesday 31 March 2026 18:19:45 +0000 (0:00:00.320) 0:00:35.552 ********* 2026-03-31 18:19:45.721624 | aio | ok: [aio] 2026-03-31 18:19:45.721702 | aio | 2026-03-31 18:19:45.721762 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-31 18:19:45.721905 | aio | Tuesday 31 March 2026 18:19:45 +0000 (0:00:00.215) 0:00:35.768 ********* 2026-03-31 18:19:46.174856 | aio | changed: [aio] 2026-03-31 18:19:46.174994 | aio | 2026-03-31 18:19:46.175008 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-31 18:19:46.175093 | aio | Tuesday 31 March 2026 18:19:46 +0000 (0:00:00.453) 0:00:36.221 ********* 2026-03-31 18:19:46.514723 | aio | changed: [aio] 2026-03-31 18:19:46.514794 | aio | 2026-03-31 18:19:46.514941 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-31 18:19:46.514957 | aio | Tuesday 31 March 2026 18:19:46 +0000 (0:00:00.339) 0:00:36.561 ********* 2026-03-31 18:19:46.666860 | aio | ok: [aio] 2026-03-31 18:19:46.666926 | aio | 2026-03-31 18:19:46.667111 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-31 18:19:46.667131 | aio | Tuesday 31 March 2026 18:19:46 +0000 (0:00:00.152) 0:00:36.713 ********* 2026-03-31 18:19:46.876789 | aio | ok: [aio] => (item=aio) 2026-03-31 18:19:46.876881 | aio | 2026-03-31 18:19:46.876943 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-31 18:19:46.877110 | aio | Tuesday 31 March 2026 18:19:46 +0000 (0:00:00.209) 0:00:36.922 ********* 2026-03-31 18:19:46.917928 | aio | ok: [aio] 2026-03-31 18:19:46.917985 | aio | 2026-03-31 18:19:46.918255 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-31 18:19:46.918321 | aio | Tuesday 31 March 2026 18:19:46 +0000 (0:00:00.041) 0:00:36.964 ********* 2026-03-31 18:19:47.053000 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for aio 2026-03-31 18:19:47.053091 | aio | 2026-03-31 18:19:47.053104 | aio | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-31 18:19:47.053163 | aio | Tuesday 31 March 2026 18:19:47 +0000 (0:00:00.134) 0:00:37.098 ********* 2026-03-31 18:19:47.328739 | aio | changed: [aio] 2026-03-31 18:19:47.328807 | aio | 2026-03-31 18:19:47.329001 | aio | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-31 18:19:47.329017 | aio | Tuesday 31 March 2026 18:19:47 +0000 (0:00:00.276) 0:00:37.375 ********* 2026-03-31 18:19:47.999945 | aio | changed: [aio] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-31 18:19:48.000032 | aio | changed: [aio] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-31 18:19:48.000065 | aio | changed: [aio] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-31 18:19:48.000332 | aio | 2026-03-31 18:19:48.000349 | aio | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-31 18:19:48.000354 | aio | Tuesday 31 March 2026 18:19:47 +0000 (0:00:00.671) 0:00:38.046 ********* 2026-03-31 18:21:09.705027 | aio | ok: [aio] 2026-03-31 18:21:09.705090 | aio | 2026-03-31 18:21:09.705441 | aio | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-31 18:21:09.705517 | aio | Tuesday 31 March 2026 18:21:09 +0000 (0:01:21.704) 0:01:59.751 ********* 2026-03-31 18:21:09.919409 | aio | changed: [aio] 2026-03-31 18:21:09.919544 | aio | 2026-03-31 18:21:09.919557 | aio | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-31 18:21:09.919605 | aio | Tuesday 31 March 2026 18:21:09 +0000 (0:00:00.214) 0:01:59.965 ********* 2026-03-31 18:21:09.952480 | aio | ok: [aio] 2026-03-31 18:21:09.952540 | aio | 2026-03-31 18:21:09.952546 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:21:09.952551 | aio | Tuesday 31 March 2026 18:21:09 +0000 (0:00:00.032) 0:01:59.998 ********* 2026-03-31 18:21:10.026502 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-31 18:21:10.026560 | aio | 2026-03-31 18:21:10.026790 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:21:10.026998 | aio | Tuesday 31 March 2026 18:21:10 +0000 (0:00:00.074) 0:02:00.073 ********* 2026-03-31 18:21:15.476465 | aio | ok: [aio] 2026-03-31 18:21:15.476573 | aio | 2026-03-31 18:21:15.476886 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:21:15.476905 | aio | Tuesday 31 March 2026 18:21:15 +0000 (0:00:05.449) 0:02:05.522 ********* 2026-03-31 18:21:15.519083 | aio | ok: [aio] => (item=aio) 2026-03-31 18:21:15.519142 | aio | 2026-03-31 18:21:15.519367 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:21:15.519411 | aio | Tuesday 31 March 2026 18:21:15 +0000 (0:00:00.042) 0:02:05.565 ********* 2026-03-31 18:21:15.901434 | aio | ok: [aio] 2026-03-31 18:21:15.901536 | aio | 2026-03-31 18:21:15.901544 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:21:15.901550 | aio | Tuesday 31 March 2026 18:21:15 +0000 (0:00:00.381) 0:02:05.947 ********* 2026-03-31 18:21:22.176892 | aio | ok: [aio] 2026-03-31 18:21:22.176972 | aio | 2026-03-31 18:21:22.177028 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-31 18:21:22.177157 | aio | Tuesday 31 March 2026 18:21:22 +0000 (0:00:06.275) 0:02:12.223 ********* 2026-03-31 18:22:06.646726 | aio | changed: [aio] 2026-03-31 18:22:06.646806 | aio | 2026-03-31 18:22:06.646822 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-31 18:22:06.646969 | aio | Tuesday 31 March 2026 18:22:06 +0000 (0:00:44.469) 0:02:56.693 ********* 2026-03-31 18:22:20.703952 | aio | ok: [aio] 2026-03-31 18:22:20.704052 | aio | 2026-03-31 18:22:20.704066 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:22:20.704228 | aio | Tuesday 31 March 2026 18:22:20 +0000 (0:00:14.056) 0:03:10.750 ********* 2026-03-31 18:22:20.771292 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-31 18:22:20.771364 | aio | 2026-03-31 18:22:20.771425 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:22:20.771580 | aio | Tuesday 31 March 2026 18:22:20 +0000 (0:00:00.067) 0:03:10.817 ********* 2026-03-31 18:22:20.843535 | aio | skipping: [aio] 2026-03-31 18:22:20.843611 | aio | 2026-03-31 18:22:20.843849 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:22:20.843936 | aio | Tuesday 31 March 2026 18:22:20 +0000 (0:00:00.072) 0:03:10.889 ********* 2026-03-31 18:22:20.886939 | aio | skipping: [aio] => (item=aio) 2026-03-31 18:22:20.887041 | aio | skipping: [aio] 2026-03-31 18:22:20.887588 | aio | 2026-03-31 18:22:20.887653 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:22:20.887660 | aio | Tuesday 31 March 2026 18:22:20 +0000 (0:00:00.043) 0:03:10.933 ********* 2026-03-31 18:22:21.138515 | aio | ok: [aio] 2026-03-31 18:22:21.138593 | aio | 2026-03-31 18:22:21.138659 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:22:21.138789 | aio | Tuesday 31 March 2026 18:22:21 +0000 (0:00:00.251) 0:03:11.185 ********* 2026-03-31 18:22:27.603936 | aio | ok: [aio] 2026-03-31 18:22:27.604006 | aio | 2026-03-31 18:22:27.604087 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-31 18:22:27.604179 | aio | Tuesday 31 March 2026 18:22:27 +0000 (0:00:06.465) 0:03:17.650 ********* 2026-03-31 18:22:39.744441 | aio | changed: [aio] 2026-03-31 18:22:39.744521 | aio | 2026-03-31 18:22:39.744712 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-31 18:22:39.744756 | aio | Tuesday 31 March 2026 18:22:39 +0000 (0:00:12.140) 0:03:29.791 ********* 2026-03-31 18:22:45.727597 | aio | ok: [aio] 2026-03-31 18:22:45.727713 | aio | 2026-03-31 18:22:45.727726 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-31 18:22:45.727804 | aio | Tuesday 31 March 2026 18:22:45 +0000 (0:00:05.981) 0:03:35.773 ********* 2026-03-31 18:22:53.600928 | aio | changed: [aio] => (item={'name': 'diskprediction_local'}) 2026-03-31 18:22:53.601008 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-03-31 18:22:53.601090 | aio | changed: [aio] => (item={'name': 'prometheus'}) 2026-03-31 18:22:53.601182 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-03-31 18:22:53.601269 | aio | 2026-03-31 18:22:53.601365 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-31 18:22:53.601442 | aio | 2026-03-31 18:22:53.601557 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:22:53.601651 | aio | Tuesday 31 March 2026 18:22:53 +0000 (0:00:07.874) 0:03:43.647 ********* 2026-03-31 18:22:54.535582 | aio | ok: [aio] 2026-03-31 18:22:54.535661 | aio | 2026-03-31 18:22:54.535750 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:22:54.535850 | aio | Tuesday 31 March 2026 18:22:54 +0000 (0:00:00.934) 0:03:44.581 ********* 2026-03-31 18:22:54.735130 | aio | ok: [aio] 2026-03-31 18:22:54.735200 | aio | 2026-03-31 18:22:54.735271 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:22:54.735369 | aio | Tuesday 31 March 2026 18:22:54 +0000 (0:00:00.199) 0:03:44.781 ********* 2026-03-31 18:22:54.769266 | aio | skipping: [aio] 2026-03-31 18:22:54.769345 | aio | 2026-03-31 18:22:54.769393 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-31 18:22:54.769513 | aio | Tuesday 31 March 2026 18:22:54 +0000 (0:00:00.034) 0:03:44.815 ********* 2026-03-31 18:22:54.976204 | aio | ok: [aio] 2026-03-31 18:22:54.976269 | aio | 2026-03-31 18:22:54.976352 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:22:54.976448 | aio | Tuesday 31 March 2026 18:22:54 +0000 (0:00:00.206) 0:03:45.022 ********* 2026-03-31 18:22:55.038422 | aio | ok: [aio] => { 2026-03-31 18:22:55.038519 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-31 18:22:55.038676 | aio | } 2026-03-31 18:22:55.038754 | aio | 2026-03-31 18:22:55.038849 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:22:55.038942 | aio | Tuesday 31 March 2026 18:22:55 +0000 (0:00:00.062) 0:03:45.084 ********* 2026-03-31 18:22:55.345601 | aio | ok: [aio] 2026-03-31 18:22:55.345677 | aio | 2026-03-31 18:22:55.345690 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:22:55.345700 | aio | Tuesday 31 March 2026 18:22:55 +0000 (0:00:00.306) 0:03:45.391 ********* 2026-03-31 18:22:55.386546 | aio | skipping: [aio] 2026-03-31 18:22:55.386651 | aio | 2026-03-31 18:22:55.386663 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:22:55.386787 | aio | Tuesday 31 March 2026 18:22:55 +0000 (0:00:00.041) 0:03:45.433 ********* 2026-03-31 18:22:55.430727 | aio | skipping: [aio] 2026-03-31 18:22:55.430874 | aio | 2026-03-31 18:22:55.431073 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:22:55.431230 | aio | Tuesday 31 March 2026 18:22:55 +0000 (0:00:00.043) 0:03:45.477 ********* 2026-03-31 18:22:55.635372 | aio | ok: [aio] 2026-03-31 18:22:55.635539 | aio | 2026-03-31 18:22:55.635758 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:22:55.635965 | aio | Tuesday 31 March 2026 18:22:55 +0000 (0:00:00.204) 0:03:45.681 ********* 2026-03-31 18:22:56.874170 | aio | ok: [aio] 2026-03-31 18:22:56.874494 | aio | 2026-03-31 18:22:56.874686 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:22:56.874930 | aio | Tuesday 31 March 2026 18:22:56 +0000 (0:00:01.238) 0:03:46.919 ********* 2026-03-31 18:22:56.945412 | aio | ok: [aio] => { 2026-03-31 18:22:56.945665 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-31 18:22:56.945874 | aio | } 2026-03-31 18:22:56.946108 | aio | 2026-03-31 18:22:56.946308 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:22:56.946531 | aio | Tuesday 31 March 2026 18:22:56 +0000 (0:00:00.070) 0:03:46.990 ********* 2026-03-31 18:22:57.307551 | aio | ok: [aio] 2026-03-31 18:22:57.307738 | aio | 2026-03-31 18:22:57.307968 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:22:57.308182 | aio | Tuesday 31 March 2026 18:22:57 +0000 (0:00:00.363) 0:03:47.354 ********* 2026-03-31 18:22:59.373367 | aio | ok: [aio] 2026-03-31 18:22:59.373457 | aio | 2026-03-31 18:22:59.373498 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-31 18:22:59.373518 | aio | Tuesday 31 March 2026 18:22:59 +0000 (0:00:02.064) 0:03:49.418 ********* 2026-03-31 18:22:59.403571 | aio | skipping: [aio] 2026-03-31 18:22:59.403645 | aio | 2026-03-31 18:22:59.403806 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-31 18:22:59.403922 | aio | Tuesday 31 March 2026 18:22:59 +0000 (0:00:00.031) 0:03:49.449 ********* 2026-03-31 18:22:59.444433 | aio | skipping: [aio] 2026-03-31 18:22:59.444709 | aio | 2026-03-31 18:22:59.445764 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-31 18:22:59.445784 | aio | Tuesday 31 March 2026 18:22:59 +0000 (0:00:00.040) 0:03:49.490 ********* 2026-03-31 18:22:59.473036 | aio | skipping: [aio] 2026-03-31 18:22:59.473151 | aio | 2026-03-31 18:22:59.473303 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-31 18:22:59.473446 | aio | Tuesday 31 March 2026 18:22:59 +0000 (0:00:00.028) 0:03:49.519 ********* 2026-03-31 18:23:00.748782 | aio | ok: [aio] 2026-03-31 18:23:00.748890 | aio | 2026-03-31 18:23:00.748902 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-31 18:23:00.748914 | aio | Tuesday 31 March 2026 18:23:00 +0000 (0:00:01.274) 0:03:50.794 ********* 2026-03-31 18:23:01.173391 | aio | ok: [aio] 2026-03-31 18:23:01.173598 | aio | 2026-03-31 18:23:01.173669 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-31 18:23:01.173809 | aio | Tuesday 31 March 2026 18:23:01 +0000 (0:00:00.425) 0:03:51.219 ********* 2026-03-31 18:23:02.134351 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-31 18:23:02.134567 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-31 18:23:02.134599 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-31 18:23:02.134610 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-31 18:23:02.134620 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-31 18:23:02.134813 | aio | 2026-03-31 18:23:02.134865 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-31 18:23:02.135002 | aio | Tuesday 31 March 2026 18:23:02 +0000 (0:00:00.960) 0:03:52.180 ********* 2026-03-31 18:23:02.650761 | aio | ok: [aio] 2026-03-31 18:23:02.651192 | aio | 2026-03-31 18:23:02.651307 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-31 18:23:02.651802 | aio | Tuesday 31 March 2026 18:23:02 +0000 (0:00:00.509) 0:03:52.689 ********* 2026-03-31 18:23:02.651819 | aio | 2026-03-31 18:23:02.651824 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-31 18:23:02.651829 | aio | Tuesday 31 March 2026 18:23:02 +0000 (0:00:00.006) 0:03:52.696 ********* 2026-03-31 18:23:03.012064 | aio | ok: [aio] 2026-03-31 18:23:03.012136 | aio | 2026-03-31 18:23:03.012199 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:23:03.012361 | aio | Tuesday 31 March 2026 18:23:03 +0000 (0:00:00.361) 0:03:53.058 ********* 2026-03-31 18:23:03.230472 | aio | ok: [aio] 2026-03-31 18:23:03.230561 | aio | 2026-03-31 18:23:03.230626 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:23:03.230782 | aio | Tuesday 31 March 2026 18:23:03 +0000 (0:00:00.218) 0:03:53.276 ********* 2026-03-31 18:23:03.283615 | aio | ok: [aio] => { 2026-03-31 18:23:03.283704 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-31 18:23:03.284131 | aio | } 2026-03-31 18:23:03.284180 | aio | 2026-03-31 18:23:03.284186 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:23:03.284192 | aio | Tuesday 31 March 2026 18:23:03 +0000 (0:00:00.053) 0:03:53.329 ********* 2026-03-31 18:23:03.677545 | aio | ok: [aio] 2026-03-31 18:23:03.677842 | aio | 2026-03-31 18:23:03.678195 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:23:03.678289 | aio | Tuesday 31 March 2026 18:23:03 +0000 (0:00:00.393) 0:03:53.723 ********* 2026-03-31 18:23:07.842072 | aio | ok: [aio] 2026-03-31 18:23:07.842202 | aio | 2026-03-31 18:23:07.842214 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-31 18:23:07.842363 | aio | Tuesday 31 March 2026 18:23:07 +0000 (0:00:04.164) 0:03:57.888 ********* 2026-03-31 18:23:09.149718 | aio | ok: [aio] 2026-03-31 18:23:09.149817 | aio | 2026-03-31 18:23:09.149833 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-31 18:23:09.150004 | aio | Tuesday 31 March 2026 18:23:09 +0000 (0:00:01.307) 0:03:59.196 ********* 2026-03-31 18:23:09.366479 | aio | ok: [aio] 2026-03-31 18:23:09.366551 | aio | 2026-03-31 18:23:09.366804 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-31 18:23:09.366885 | aio | Tuesday 31 March 2026 18:23:09 +0000 (0:00:00.216) 0:03:59.412 ********* 2026-03-31 18:23:09.815689 | aio | ok: [aio] 2026-03-31 18:23:09.815797 | aio | 2026-03-31 18:23:09.815810 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-31 18:23:09.815913 | aio | Tuesday 31 March 2026 18:23:09 +0000 (0:00:00.449) 0:03:59.861 ********* 2026-03-31 18:23:10.435838 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-31 18:23:10.435910 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-31 18:23:10.436555 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-31 18:23:10.436649 | aio | 2026-03-31 18:23:10.436659 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-31 18:23:10.436666 | aio | Tuesday 31 March 2026 18:23:10 +0000 (0:00:00.620) 0:04:00.481 ********* 2026-03-31 18:23:10.885949 | aio | ok: [aio] 2026-03-31 18:23:10.886065 | aio | 2026-03-31 18:23:10.886077 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-31 18:23:10.886226 | aio | Tuesday 31 March 2026 18:23:10 +0000 (0:00:00.450) 0:04:00.932 ********* 2026-03-31 18:23:11.298287 | aio | ok: [aio] 2026-03-31 18:23:11.298429 | aio | 2026-03-31 18:23:11.298444 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-31 18:23:11.298510 | aio | Tuesday 31 March 2026 18:23:11 +0000 (0:00:00.406) 0:04:01.338 ********* 2026-03-31 18:23:11.298579 | aio | 2026-03-31 18:23:11.298679 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-31 18:23:11.298774 | aio | Tuesday 31 March 2026 18:23:11 +0000 (0:00:00.005) 0:04:01.344 ********* 2026-03-31 18:23:11.662109 | aio | ok: [aio] 2026-03-31 18:23:11.662252 | aio | 2026-03-31 18:23:11.662607 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-31 18:23:11.662743 | aio | Tuesday 31 March 2026 18:23:11 +0000 (0:00:00.363) 0:04:01.707 ********* 2026-03-31 18:23:11.712548 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-31 18:23:11.712714 | aio | 2026-03-31 18:23:11.712928 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-31 18:23:11.713137 | aio | Tuesday 31 March 2026 18:23:11 +0000 (0:00:00.051) 0:04:01.759 ********* 2026-03-31 18:23:13.014997 | aio | ok: [aio] 2026-03-31 18:23:13.015096 | aio | 2026-03-31 18:23:13.015108 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-31 18:23:13.015117 | aio | Tuesday 31 March 2026 18:23:13 +0000 (0:00:01.300) 0:04:03.059 ********* 2026-03-31 18:23:13.654974 | aio | ok: [aio] => (item=chronyd) 2026-03-31 18:23:13.655135 | aio | ok: [aio] => (item=sshd) 2026-03-31 18:23:13.655150 | aio | 2026-03-31 18:23:13.655163 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-31 18:23:13.655323 | aio | Tuesday 31 March 2026 18:23:13 +0000 (0:00:00.641) 0:04:03.701 ********* 2026-03-31 18:23:13.946967 | aio | ok: [aio] 2026-03-31 18:23:13.947038 | aio | 2026-03-31 18:23:13.947272 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-31 18:23:13.947350 | aio | Tuesday 31 March 2026 18:23:13 +0000 (0:00:00.291) 0:04:03.993 ********* 2026-03-31 18:23:14.160682 | aio | ok: [aio] 2026-03-31 18:23:14.160803 | aio | 2026-03-31 18:23:14.160815 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-31 18:23:14.160948 | aio | Tuesday 31 March 2026 18:23:14 +0000 (0:00:00.213) 0:04:04.207 ********* 2026-03-31 18:23:14.409831 | aio | ok: [aio] 2026-03-31 18:23:14.409910 | aio | 2026-03-31 18:23:14.410138 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-31 18:23:14.410219 | aio | Tuesday 31 March 2026 18:23:14 +0000 (0:00:00.248) 0:04:04.456 ********* 2026-03-31 18:23:14.634328 | aio | ok: [aio] 2026-03-31 18:23:14.634429 | aio | 2026-03-31 18:23:14.634444 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-31 18:23:14.634554 | aio | Tuesday 31 March 2026 18:23:14 +0000 (0:00:00.224) 0:04:04.680 ********* 2026-03-31 18:23:14.865317 | aio | ok: [aio] => (item=aio) 2026-03-31 18:23:14.865434 | aio | 2026-03-31 18:23:14.865500 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-31 18:23:14.865724 | aio | Tuesday 31 March 2026 18:23:14 +0000 (0:00:00.230) 0:04:04.911 ********* 2026-03-31 18:23:14.914492 | aio | ok: [aio] 2026-03-31 18:23:14.914537 | aio | 2026-03-31 18:23:14.914782 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:23:14.914843 | aio | Tuesday 31 March 2026 18:23:14 +0000 (0:00:00.049) 0:04:04.960 ********* 2026-03-31 18:23:14.970462 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-31 18:23:14.970541 | aio | 2026-03-31 18:23:14.970752 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:23:14.970783 | aio | Tuesday 31 March 2026 18:23:14 +0000 (0:00:00.056) 0:04:05.016 ********* 2026-03-31 18:23:15.023199 | aio | skipping: [aio] 2026-03-31 18:23:15.023257 | aio | 2026-03-31 18:23:15.023514 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:23:15.023624 | aio | Tuesday 31 March 2026 18:23:15 +0000 (0:00:00.052) 0:04:05.069 ********* 2026-03-31 18:23:15.068235 | aio | skipping: [aio] => (item=aio) 2026-03-31 18:23:15.068356 | aio | skipping: [aio] 2026-03-31 18:23:15.068368 | aio | 2026-03-31 18:23:15.068562 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:23:15.068608 | aio | Tuesday 31 March 2026 18:23:15 +0000 (0:00:00.044) 0:04:05.114 ********* 2026-03-31 18:23:15.328368 | aio | ok: [aio] 2026-03-31 18:23:15.329250 | aio | 2026-03-31 18:23:15.329335 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:23:15.329342 | aio | Tuesday 31 March 2026 18:23:15 +0000 (0:00:00.260) 0:04:05.374 ********* 2026-03-31 18:23:21.745079 | aio | ok: [aio] 2026-03-31 18:23:21.745215 | aio | 2026-03-31 18:23:21.745229 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-31 18:23:21.745382 | aio | Tuesday 31 March 2026 18:23:21 +0000 (0:00:06.416) 0:04:11.791 ********* 2026-03-31 18:23:27.060216 | aio | ok: [aio] 2026-03-31 18:23:27.060305 | aio | 2026-03-31 18:23:27.060322 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-31 18:23:27.060493 | aio | Tuesday 31 March 2026 18:23:27 +0000 (0:00:05.314) 0:04:17.106 ********* 2026-03-31 18:23:41.039575 | aio | ok: [aio] 2026-03-31 18:23:41.039665 | aio | 2026-03-31 18:23:41.039678 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-31 18:23:41.039689 | aio | Tuesday 31 March 2026 18:23:41 +0000 (0:00:13.968) 0:04:31.074 ********* 2026-03-31 18:25:12.800389 | aio | ok: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-03-31 18:25:12.800498 | aio | ok: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-03-31 18:25:12.800748 | aio | ok: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-03-31 18:25:12.801059 | aio | 2026-03-31 18:25:12.801313 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-31 18:25:12.801595 | aio | Tuesday 31 March 2026 18:25:12 +0000 (0:01:31.771) 0:06:02.845 ********* 2026-03-31 18:25:18.668134 | aio | ok: [aio] 2026-03-31 18:25:18.668235 | aio | 2026-03-31 18:25:18.668248 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-31 18:25:18.668260 | aio | Tuesday 31 March 2026 18:25:18 +0000 (0:00:05.867) 0:06:08.713 ********* 2026-03-31 18:25:24.765184 | aio | ok: [aio] 2026-03-31 18:25:24.765358 | aio | 2026-03-31 18:25:24.765383 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-31 18:25:24.765625 | aio | Tuesday 31 March 2026 18:25:24 +0000 (0:00:06.097) 0:06:14.811 ********* 2026-03-31 18:25:24.818720 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-03-31 18:25:24.818833 | aio | 2026-03-31 18:25:24.818845 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-31 18:25:24.818980 | aio | Tuesday 31 March 2026 18:25:24 +0000 (0:00:00.053) 0:06:14.865 ********* 2026-03-31 18:25:24.887311 | aio | ok: [aio] 2026-03-31 18:25:24.887418 | aio | 2026-03-31 18:25:24.887430 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-31 18:25:24.887600 | aio | Tuesday 31 March 2026 18:25:24 +0000 (0:00:00.068) 0:06:14.933 ********* 2026-03-31 18:25:31.033126 | aio | ok: [aio] 2026-03-31 18:25:31.033204 | aio | 2026-03-31 18:25:31.033642 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-31 18:25:31.033725 | aio | Tuesday 31 March 2026 18:25:31 +0000 (0:00:06.145) 0:06:21.079 ********* 2026-03-31 18:25:31.082618 | aio | ok: [aio] 2026-03-31 18:25:31.082679 | aio | 2026-03-31 18:25:31.083043 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-31 18:25:31.083116 | aio | Tuesday 31 March 2026 18:25:31 +0000 (0:00:00.049) 0:06:21.128 ********* 2026-03-31 18:25:31.125856 | aio | skipping: [aio] => (item=1) 2026-03-31 18:25:31.125915 | aio | skipping: [aio] => (item=1) 2026-03-31 18:25:31.126419 | aio | skipping: [aio] => (item=1) 2026-03-31 18:25:31.126460 | aio | skipping: [aio] 2026-03-31 18:25:31.126466 | aio | 2026-03-31 18:25:31.126471 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-31 18:25:31.126476 | aio | Tuesday 31 March 2026 18:25:31 +0000 (0:00:00.043) 0:06:21.172 ********* 2026-03-31 18:25:31.160748 | aio | skipping: [aio] 2026-03-31 18:25:31.161336 | aio | 2026-03-31 18:25:31.161423 | aio | PLAY RECAP ********************************************************************* 2026-03-31 18:25:31.161437 | aio | aio : ok=106 changed=29 unreachable=0 failed=0 skipped=18 rescued=0 ignored=0 2026-03-31 18:25:31.161447 | aio | 2026-03-31 18:25:31.161456 | aio | 2026-03-31 18:25:31.161504 | aio | TASKS RECAP ******************************************************************** 2026-03-31 18:25:31.161517 | aio | Tuesday 31 March 2026 18:25:31 +0000 (0:00:00.035) 0:06:21.207 ********* 2026-03-31 18:25:31.161529 | aio | =============================================================================== 2026-03-31 18:25:31.163590 | aio | vexxhost.ceph.osd : Install OSDs --------------------------------------- 91.77s 2026-03-31 18:25:31.163639 | aio | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 81.70s 2026-03-31 18:25:31.163646 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 44.47s 2026-03-31 18:25:31.163652 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.06s 2026-03-31 18:25:31.163657 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 13.97s 2026-03-31 18:25:31.163663 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.14s 2026-03-31 18:25:31.163668 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.87s 2026-03-31 18:25:31.163674 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.47s 2026-03-31 18:25:31.163679 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.42s 2026-03-31 18:25:31.163685 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.28s 2026-03-31 18:25:31.163690 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 6.25s 2026-03-31 18:25:31.163696 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.15s 2026-03-31 18:25:31.163701 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.10s 2026-03-31 18:25:31.163707 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 5.98s 2026-03-31 18:25:31.163712 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 5.87s 2026-03-31 18:25:31.163717 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.45s 2026-03-31 18:25:31.163723 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.32s 2026-03-31 18:25:31.163728 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.03s 2026-03-31 18:25:31.163734 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.41s 2026-03-31 18:25:31.163739 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.16s 2026-03-31 18:25:31.305169 | aio | INFO [default > converge] Executed: Successful 2026-03-31 18:25:31.317025 | aio | INFO [default > idempotence] Executing 2026-03-31 18:25:32.192118 | aio | 2026-03-31 18:25:32.192525 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-31 18:25:32.192792 | aio | 2026-03-31 18:25:32.193076 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:25:32.193353 | aio | Tuesday 31 March 2026 18:25:32 +0000 (0:00:00.050) 0:00:00.050 ********* 2026-03-31 18:25:33.416983 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-31 18:25:33.417091 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-31 18:25:33.417108 | aio | interpreter could change the meaning of that path. See 2026-03-31 18:25:33.417120 | aio | https://docs.ansible.com/ansible- 2026-03-31 18:25:33.417158 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:25:33.428931 | aio | ok: [aio] 2026-03-31 18:25:33.428966 | aio | 2026-03-31 18:25:33.428978 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:25:33.428988 | aio | Tuesday 31 March 2026 18:25:33 +0000 (0:00:01.236) 0:00:01.287 ********* 2026-03-31 18:25:33.715603 | aio | ok: [aio] 2026-03-31 18:25:33.715704 | aio | 2026-03-31 18:25:33.715717 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:25:33.715747 | aio | Tuesday 31 March 2026 18:25:33 +0000 (0:00:00.286) 0:00:01.573 ********* 2026-03-31 18:25:33.752473 | aio | skipping: [aio] 2026-03-31 18:25:33.752508 | aio | 2026-03-31 18:25:33.752519 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-31 18:25:33.752528 | aio | Tuesday 31 March 2026 18:25:33 +0000 (0:00:00.037) 0:00:01.610 ********* 2026-03-31 18:25:34.076946 | aio | ok: [aio] 2026-03-31 18:25:34.077034 | aio | 2026-03-31 18:25:34.077045 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:25:34.077056 | aio | Tuesday 31 March 2026 18:25:34 +0000 (0:00:00.323) 0:00:01.934 ********* 2026-03-31 18:25:34.147545 | aio | ok: [aio] => { 2026-03-31 18:25:34.147580 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-31 18:25:34.147592 | aio | } 2026-03-31 18:25:34.147601 | aio | 2026-03-31 18:25:34.147610 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:25:34.147620 | aio | Tuesday 31 March 2026 18:25:34 +0000 (0:00:00.071) 0:00:02.005 ********* 2026-03-31 18:25:34.599783 | aio | ok: [aio] 2026-03-31 18:25:34.599874 | aio | 2026-03-31 18:25:34.599886 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:25:34.599897 | aio | Tuesday 31 March 2026 18:25:34 +0000 (0:00:00.451) 0:00:02.457 ********* 2026-03-31 18:25:34.646871 | aio | skipping: [aio] 2026-03-31 18:25:34.646941 | aio | 2026-03-31 18:25:34.646955 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:25:34.646966 | aio | Tuesday 31 March 2026 18:25:34 +0000 (0:00:00.047) 0:00:02.504 ********* 2026-03-31 18:25:34.696530 | aio | skipping: [aio] 2026-03-31 18:25:34.696619 | aio | 2026-03-31 18:25:34.696630 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:25:34.696641 | aio | Tuesday 31 March 2026 18:25:34 +0000 (0:00:00.049) 0:00:02.554 ********* 2026-03-31 18:25:34.937040 | aio | ok: [aio] 2026-03-31 18:25:34.937110 | aio | 2026-03-31 18:25:34.937122 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:25:34.937141 | aio | Tuesday 31 March 2026 18:25:34 +0000 (0:00:00.240) 0:00:02.795 ********* 2026-03-31 18:25:36.341270 | aio | ok: [aio] 2026-03-31 18:25:36.341443 | aio | 2026-03-31 18:25:36.341688 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:25:36.341911 | aio | Tuesday 31 March 2026 18:25:36 +0000 (0:00:01.404) 0:00:04.199 ********* 2026-03-31 18:25:36.437033 | aio | ok: [aio] => { 2026-03-31 18:25:36.437201 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-31 18:25:36.437388 | aio | } 2026-03-31 18:25:36.437614 | aio | 2026-03-31 18:25:36.437824 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:25:36.438030 | aio | Tuesday 31 March 2026 18:25:36 +0000 (0:00:00.095) 0:00:04.295 ********* 2026-03-31 18:25:36.805350 | aio | ok: [aio] 2026-03-31 18:25:36.805437 | aio | 2026-03-31 18:25:36.805708 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:25:36.805818 | aio | Tuesday 31 March 2026 18:25:36 +0000 (0:00:00.368) 0:00:04.664 ********* 2026-03-31 18:25:39.144434 | aio | ok: [aio] 2026-03-31 18:25:39.144534 | aio | 2026-03-31 18:25:39.144545 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-31 18:25:39.144582 | aio | Tuesday 31 March 2026 18:25:39 +0000 (0:00:02.338) 0:00:07.002 ********* 2026-03-31 18:25:39.174572 | aio | skipping: [aio] 2026-03-31 18:25:39.174641 | aio | 2026-03-31 18:25:39.175003 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-31 18:25:39.175086 | aio | Tuesday 31 March 2026 18:25:39 +0000 (0:00:00.030) 0:00:07.033 ********* 2026-03-31 18:25:39.209366 | aio | skipping: [aio] 2026-03-31 18:25:39.209808 | aio | 2026-03-31 18:25:39.209849 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-31 18:25:39.209855 | aio | Tuesday 31 March 2026 18:25:39 +0000 (0:00:00.034) 0:00:07.068 ********* 2026-03-31 18:25:39.242294 | aio | skipping: [aio] 2026-03-31 18:25:39.242344 | aio | 2026-03-31 18:25:39.242585 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-31 18:25:39.242625 | aio | Tuesday 31 March 2026 18:25:39 +0000 (0:00:00.033) 0:00:07.101 ********* 2026-03-31 18:25:40.304254 | aio | ok: [aio] 2026-03-31 18:25:40.304327 | aio | 2026-03-31 18:25:40.304338 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-31 18:25:40.304348 | aio | Tuesday 31 March 2026 18:25:40 +0000 (0:00:01.061) 0:00:08.162 ********* 2026-03-31 18:25:40.750687 | aio | ok: [aio] 2026-03-31 18:25:40.750794 | aio | 2026-03-31 18:25:40.750807 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-31 18:25:40.750960 | aio | Tuesday 31 March 2026 18:25:40 +0000 (0:00:00.447) 0:00:08.609 ********* 2026-03-31 18:25:41.709330 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-31 18:25:41.709411 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-31 18:25:41.709596 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-31 18:25:41.709682 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-31 18:25:41.710117 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-31 18:25:41.710376 | aio | 2026-03-31 18:25:41.710384 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-31 18:25:41.710388 | aio | Tuesday 31 March 2026 18:25:41 +0000 (0:00:00.958) 0:00:09.568 ********* 2026-03-31 18:25:42.218287 | aio | ok: [aio] 2026-03-31 18:25:42.218382 | aio | 2026-03-31 18:25:42.218400 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-31 18:25:42.218845 | aio | Tuesday 31 March 2026 18:25:42 +0000 (0:00:00.500) 0:00:10.068 ********* 2026-03-31 18:25:42.218909 | aio | 2026-03-31 18:25:42.218915 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-31 18:25:42.218920 | aio | Tuesday 31 March 2026 18:25:42 +0000 (0:00:00.008) 0:00:10.077 ********* 2026-03-31 18:25:42.869131 | aio | ok: [aio] 2026-03-31 18:25:42.869232 | aio | 2026-03-31 18:25:42.869247 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:25:42.869437 | aio | Tuesday 31 March 2026 18:25:42 +0000 (0:00:00.650) 0:00:10.727 ********* 2026-03-31 18:25:43.086444 | aio | ok: [aio] 2026-03-31 18:25:43.086552 | aio | 2026-03-31 18:25:43.086565 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:25:43.086725 | aio | Tuesday 31 March 2026 18:25:43 +0000 (0:00:00.217) 0:00:10.945 ********* 2026-03-31 18:25:43.155470 | aio | ok: [aio] => { 2026-03-31 18:25:43.155546 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-31 18:25:43.155946 | aio | } 2026-03-31 18:25:43.156027 | aio | 2026-03-31 18:25:43.156033 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:25:43.156038 | aio | Tuesday 31 March 2026 18:25:43 +0000 (0:00:00.068) 0:00:11.014 ********* 2026-03-31 18:25:43.536189 | aio | ok: [aio] 2026-03-31 18:25:43.536281 | aio | 2026-03-31 18:25:43.536304 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:25:43.536385 | aio | Tuesday 31 March 2026 18:25:43 +0000 (0:00:00.380) 0:00:11.394 ********* 2026-03-31 18:25:46.696080 | aio | ok: [aio] 2026-03-31 18:25:46.696274 | aio | 2026-03-31 18:25:46.696553 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-31 18:25:46.696816 | aio | Tuesday 31 March 2026 18:25:46 +0000 (0:00:03.160) 0:00:14.554 ********* 2026-03-31 18:25:47.988621 | aio | ok: [aio] 2026-03-31 18:25:47.988725 | aio | 2026-03-31 18:25:47.988746 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-31 18:25:47.988887 | aio | Tuesday 31 March 2026 18:25:47 +0000 (0:00:01.292) 0:00:15.847 ********* 2026-03-31 18:25:48.268418 | aio | ok: [aio] 2026-03-31 18:25:48.268504 | aio | 2026-03-31 18:25:48.268855 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-31 18:25:48.268930 | aio | Tuesday 31 March 2026 18:25:48 +0000 (0:00:00.279) 0:00:16.127 ********* 2026-03-31 18:25:48.738096 | aio | ok: [aio] 2026-03-31 18:25:48.738167 | aio | 2026-03-31 18:25:48.738173 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-31 18:25:48.738178 | aio | Tuesday 31 March 2026 18:25:48 +0000 (0:00:00.469) 0:00:16.596 ********* 2026-03-31 18:25:49.348032 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-31 18:25:49.348138 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-31 18:25:49.348150 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-31 18:25:49.348479 | aio | 2026-03-31 18:25:49.348547 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-31 18:25:49.348553 | aio | Tuesday 31 March 2026 18:25:49 +0000 (0:00:00.610) 0:00:17.206 ********* 2026-03-31 18:25:49.796366 | aio | ok: [aio] 2026-03-31 18:25:49.796449 | aio | 2026-03-31 18:25:49.796513 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-31 18:25:49.796653 | aio | Tuesday 31 March 2026 18:25:49 +0000 (0:00:00.448) 0:00:17.655 ********* 2026-03-31 18:25:50.239903 | aio | ok: [aio] 2026-03-31 18:25:50.239995 | aio | 2026-03-31 18:25:50.240007 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-31 18:25:50.240422 | aio | Tuesday 31 March 2026 18:25:50 +0000 (0:00:00.436) 0:00:18.092 ********* 2026-03-31 18:25:50.240502 | aio | 2026-03-31 18:25:50.240509 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-31 18:25:50.240514 | aio | Tuesday 31 March 2026 18:25:50 +0000 (0:00:00.006) 0:00:18.098 ********* 2026-03-31 18:25:50.599462 | aio | ok: [aio] 2026-03-31 18:25:50.599542 | aio | 2026-03-31 18:25:50.599610 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-31 18:25:50.599768 | aio | Tuesday 31 March 2026 18:25:50 +0000 (0:00:00.359) 0:00:18.458 ********* 2026-03-31 18:25:50.651160 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-31 18:25:50.651201 | aio | 2026-03-31 18:25:50.651429 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-31 18:25:50.651462 | aio | Tuesday 31 March 2026 18:25:50 +0000 (0:00:00.051) 0:00:18.509 ********* 2026-03-31 18:25:51.898648 | aio | ok: [aio] 2026-03-31 18:25:51.898753 | aio | 2026-03-31 18:25:51.899257 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-31 18:25:51.899336 | aio | Tuesday 31 March 2026 18:25:51 +0000 (0:00:01.246) 0:00:19.756 ********* 2026-03-31 18:25:52.598732 | aio | ok: [aio] => (item=chronyd) 2026-03-31 18:25:52.598833 | aio | ok: [aio] => (item=sshd) 2026-03-31 18:25:52.598904 | aio | 2026-03-31 18:25:52.599128 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-31 18:25:52.599180 | aio | Tuesday 31 March 2026 18:25:52 +0000 (0:00:00.700) 0:00:20.457 ********* 2026-03-31 18:25:52.906971 | aio | ok: [aio] 2026-03-31 18:25:52.907055 | aio | 2026-03-31 18:25:52.907101 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-31 18:25:52.907242 | aio | Tuesday 31 March 2026 18:25:52 +0000 (0:00:00.308) 0:00:20.765 ********* 2026-03-31 18:25:53.114568 | aio | ok: [aio] 2026-03-31 18:25:53.114660 | aio | 2026-03-31 18:25:53.114900 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-31 18:25:53.114959 | aio | Tuesday 31 March 2026 18:25:53 +0000 (0:00:00.207) 0:00:20.973 ********* 2026-03-31 18:25:53.546904 | aio | ok: [aio] 2026-03-31 18:25:53.547010 | aio | 2026-03-31 18:25:53.547029 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-31 18:25:53.547167 | aio | Tuesday 31 March 2026 18:25:53 +0000 (0:00:00.432) 0:00:21.405 ********* 2026-03-31 18:25:53.902488 | aio | ok: [aio] 2026-03-31 18:25:53.902585 | aio | 2026-03-31 18:25:53.902910 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-31 18:25:53.903032 | aio | Tuesday 31 March 2026 18:25:53 +0000 (0:00:00.355) 0:00:21.760 ********* 2026-03-31 18:25:53.977109 | aio | ok: [aio] 2026-03-31 18:25:53.977198 | aio | 2026-03-31 18:25:53.977208 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-31 18:25:53.977335 | aio | Tuesday 31 March 2026 18:25:53 +0000 (0:00:00.074) 0:00:21.835 ********* 2026-03-31 18:25:54.226401 | aio | ok: [aio] => (item=aio) 2026-03-31 18:25:54.226480 | aio | 2026-03-31 18:25:54.226700 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-31 18:25:54.226770 | aio | Tuesday 31 March 2026 18:25:54 +0000 (0:00:00.249) 0:00:22.085 ********* 2026-03-31 18:25:54.270469 | aio | ok: [aio] 2026-03-31 18:25:54.270810 | aio | 2026-03-31 18:25:54.270886 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-31 18:25:54.270892 | aio | Tuesday 31 March 2026 18:25:54 +0000 (0:00:00.043) 0:00:22.129 ********* 2026-03-31 18:25:54.311265 | aio | skipping: [aio] 2026-03-31 18:25:54.311378 | aio | 2026-03-31 18:25:54.311390 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:25:54.311455 | aio | Tuesday 31 March 2026 18:25:54 +0000 (0:00:00.040) 0:00:22.169 ********* 2026-03-31 18:25:54.380035 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-31 18:25:54.380110 | aio | 2026-03-31 18:25:54.380117 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:25:54.380122 | aio | Tuesday 31 March 2026 18:25:54 +0000 (0:00:00.068) 0:00:22.238 ********* 2026-03-31 18:26:00.616562 | aio | ok: [aio] 2026-03-31 18:26:00.616775 | aio | 2026-03-31 18:26:00.616804 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:26:00.616913 | aio | Tuesday 31 March 2026 18:26:00 +0000 (0:00:06.236) 0:00:28.474 ********* 2026-03-31 18:26:00.681536 | aio | ok: [aio] => (item=aio) 2026-03-31 18:26:00.681658 | aio | 2026-03-31 18:26:00.681848 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:26:00.682050 | aio | Tuesday 31 March 2026 18:26:00 +0000 (0:00:00.065) 0:00:28.540 ********* 2026-03-31 18:26:01.099608 | aio | ok: [aio] 2026-03-31 18:26:01.099744 | aio | 2026-03-31 18:26:01.099957 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:26:01.100305 | aio | Tuesday 31 March 2026 18:26:01 +0000 (0:00:00.417) 0:00:28.958 ********* 2026-03-31 18:26:07.625167 | aio | ok: [aio] 2026-03-31 18:26:07.625351 | aio | 2026-03-31 18:26:07.625637 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-31 18:26:07.625860 | aio | Tuesday 31 March 2026 18:26:07 +0000 (0:00:06.525) 0:00:35.483 ********* 2026-03-31 18:26:14.029172 | aio | ok: [aio] 2026-03-31 18:26:14.029249 | aio | 2026-03-31 18:26:14.029262 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-31 18:26:14.029272 | aio | Tuesday 31 March 2026 18:26:14 +0000 (0:00:06.403) 0:00:41.887 ********* 2026-03-31 18:26:28.215066 | aio | ok: [aio] 2026-03-31 18:26:28.215168 | aio | 2026-03-31 18:26:28.215183 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:26:28.215330 | aio | Tuesday 31 March 2026 18:26:28 +0000 (0:00:14.186) 0:00:56.073 ********* 2026-03-31 18:26:28.280018 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-31 18:26:28.280068 | aio | 2026-03-31 18:26:28.280312 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:26:28.280370 | aio | Tuesday 31 March 2026 18:26:28 +0000 (0:00:00.064) 0:00:56.138 ********* 2026-03-31 18:26:28.328942 | aio | skipping: [aio] 2026-03-31 18:26:28.329011 | aio | 2026-03-31 18:26:28.329074 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:26:28.329209 | aio | Tuesday 31 March 2026 18:26:28 +0000 (0:00:00.048) 0:00:56.187 ********* 2026-03-31 18:26:28.377837 | aio | skipping: [aio] => (item=aio) 2026-03-31 18:26:28.377947 | aio | skipping: [aio] 2026-03-31 18:26:28.377970 | aio | 2026-03-31 18:26:28.377981 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:26:28.377995 | aio | Tuesday 31 March 2026 18:26:28 +0000 (0:00:00.048) 0:00:56.236 ********* 2026-03-31 18:26:28.630200 | aio | ok: [aio] 2026-03-31 18:26:28.630300 | aio | 2026-03-31 18:26:28.630314 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:26:28.630476 | aio | Tuesday 31 March 2026 18:26:28 +0000 (0:00:00.252) 0:00:56.489 ********* 2026-03-31 18:26:35.100370 | aio | ok: [aio] 2026-03-31 18:26:35.100438 | aio | 2026-03-31 18:26:35.100444 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-31 18:26:35.100449 | aio | Tuesday 31 March 2026 18:26:35 +0000 (0:00:06.469) 0:01:02.958 ********* 2026-03-31 18:26:41.343718 | aio | ok: [aio] 2026-03-31 18:26:41.343818 | aio | 2026-03-31 18:26:41.343830 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-31 18:26:41.343976 | aio | Tuesday 31 March 2026 18:26:41 +0000 (0:00:06.243) 0:01:09.202 ********* 2026-03-31 18:26:47.386859 | aio | ok: [aio] 2026-03-31 18:26:47.386960 | aio | 2026-03-31 18:26:47.386972 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-31 18:26:47.387124 | aio | Tuesday 31 March 2026 18:26:47 +0000 (0:00:06.042) 0:01:15.244 ********* 2026-03-31 18:26:54.831800 | aio | ok: [aio] => (item={'name': 'diskprediction_local'}) 2026-03-31 18:26:54.831891 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-03-31 18:26:54.831942 | aio | ok: [aio] => (item={'name': 'prometheus'}) 2026-03-31 18:26:54.832531 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-03-31 18:26:54.832604 | aio | 2026-03-31 18:26:54.832611 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-31 18:26:54.832616 | aio | 2026-03-31 18:26:54.832620 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:26:54.832625 | aio | Tuesday 31 March 2026 18:26:54 +0000 (0:00:07.445) 0:01:22.690 ********* 2026-03-31 18:26:55.769066 | aio | ok: [aio] 2026-03-31 18:26:55.769171 | aio | 2026-03-31 18:26:55.769477 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:26:55.769538 | aio | Tuesday 31 March 2026 18:26:55 +0000 (0:00:00.937) 0:01:23.627 ********* 2026-03-31 18:26:55.973796 | aio | ok: [aio] 2026-03-31 18:26:55.973871 | aio | 2026-03-31 18:26:55.974115 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:26:55.974183 | aio | Tuesday 31 March 2026 18:26:55 +0000 (0:00:00.204) 0:01:23.832 ********* 2026-03-31 18:26:56.014856 | aio | skipping: [aio] 2026-03-31 18:26:56.014939 | aio | 2026-03-31 18:26:56.015135 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-31 18:26:56.015168 | aio | Tuesday 31 March 2026 18:26:56 +0000 (0:00:00.040) 0:01:23.873 ********* 2026-03-31 18:26:56.231277 | aio | ok: [aio] 2026-03-31 18:26:56.231348 | aio | 2026-03-31 18:26:56.231566 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:26:56.231640 | aio | Tuesday 31 March 2026 18:26:56 +0000 (0:00:00.216) 0:01:24.090 ********* 2026-03-31 18:26:56.324918 | aio | ok: [aio] => { 2026-03-31 18:26:56.325022 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-31 18:26:56.325088 | aio | } 2026-03-31 18:26:56.325450 | aio | 2026-03-31 18:26:56.325491 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:26:56.325499 | aio | Tuesday 31 March 2026 18:26:56 +0000 (0:00:00.093) 0:01:24.183 ********* 2026-03-31 18:26:56.653877 | aio | ok: [aio] 2026-03-31 18:26:56.653973 | aio | 2026-03-31 18:26:56.654271 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:26:56.654328 | aio | Tuesday 31 March 2026 18:26:56 +0000 (0:00:00.329) 0:01:24.512 ********* 2026-03-31 18:26:56.694009 | aio | skipping: [aio] 2026-03-31 18:26:56.694107 | aio | 2026-03-31 18:26:56.694374 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:26:56.694442 | aio | Tuesday 31 March 2026 18:26:56 +0000 (0:00:00.040) 0:01:24.552 ********* 2026-03-31 18:26:56.736367 | aio | skipping: [aio] 2026-03-31 18:26:56.736461 | aio | 2026-03-31 18:26:56.736472 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:26:56.736584 | aio | Tuesday 31 March 2026 18:26:56 +0000 (0:00:00.042) 0:01:24.595 ********* 2026-03-31 18:26:56.953041 | aio | ok: [aio] 2026-03-31 18:26:56.953141 | aio | 2026-03-31 18:26:56.953154 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:26:56.953307 | aio | Tuesday 31 March 2026 18:26:56 +0000 (0:00:00.216) 0:01:24.812 ********* 2026-03-31 18:26:58.079305 | aio | ok: [aio] 2026-03-31 18:26:58.079401 | aio | 2026-03-31 18:26:58.079473 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:26:58.079598 | aio | Tuesday 31 March 2026 18:26:58 +0000 (0:00:01.126) 0:01:25.938 ********* 2026-03-31 18:26:58.157753 | aio | ok: [aio] => { 2026-03-31 18:26:58.157853 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-31 18:26:58.158500 | aio | } 2026-03-31 18:26:58.158570 | aio | 2026-03-31 18:26:58.158578 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:26:58.158586 | aio | Tuesday 31 March 2026 18:26:58 +0000 (0:00:00.077) 0:01:26.016 ********* 2026-03-31 18:26:58.515911 | aio | ok: [aio] 2026-03-31 18:26:58.516029 | aio | 2026-03-31 18:26:58.516434 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:26:58.516461 | aio | Tuesday 31 March 2026 18:26:58 +0000 (0:00:00.358) 0:01:26.374 ********* 2026-03-31 18:27:00.548076 | aio | ok: [aio] 2026-03-31 18:27:00.548187 | aio | 2026-03-31 18:27:00.548467 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-31 18:27:00.548543 | aio | Tuesday 31 March 2026 18:27:00 +0000 (0:00:02.032) 0:01:28.406 ********* 2026-03-31 18:27:00.576000 | aio | skipping: [aio] 2026-03-31 18:27:00.576090 | aio | 2026-03-31 18:27:00.576356 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-31 18:27:00.576428 | aio | Tuesday 31 March 2026 18:27:00 +0000 (0:00:00.027) 0:01:28.434 ********* 2026-03-31 18:27:00.608612 | aio | skipping: [aio] 2026-03-31 18:27:00.608705 | aio | 2026-03-31 18:27:00.608720 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-31 18:27:00.608852 | aio | Tuesday 31 March 2026 18:27:00 +0000 (0:00:00.032) 0:01:28.467 ********* 2026-03-31 18:27:00.639365 | aio | skipping: [aio] 2026-03-31 18:27:00.639459 | aio | 2026-03-31 18:27:00.639785 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-31 18:27:00.639854 | aio | Tuesday 31 March 2026 18:27:00 +0000 (0:00:00.030) 0:01:28.497 ********* 2026-03-31 18:27:01.898198 | aio | ok: [aio] 2026-03-31 18:27:01.898312 | aio | 2026-03-31 18:27:01.898325 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-31 18:27:01.898469 | aio | Tuesday 31 March 2026 18:27:01 +0000 (0:00:01.258) 0:01:29.756 ********* 2026-03-31 18:27:02.321128 | aio | ok: [aio] 2026-03-31 18:27:02.321219 | aio | 2026-03-31 18:27:02.321534 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-31 18:27:02.321602 | aio | Tuesday 31 March 2026 18:27:02 +0000 (0:00:00.423) 0:01:30.179 ********* 2026-03-31 18:27:03.261267 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-31 18:27:03.261337 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-31 18:27:03.261351 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-31 18:27:03.261361 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-31 18:27:03.261371 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-31 18:27:03.261381 | aio | 2026-03-31 18:27:03.261390 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-31 18:27:03.261400 | aio | Tuesday 31 March 2026 18:27:03 +0000 (0:00:00.938) 0:01:31.118 ********* 2026-03-31 18:27:03.782033 | aio | ok: [aio] 2026-03-31 18:27:03.782105 | aio | 2026-03-31 18:27:03.782584 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-31 18:27:03.782931 | aio | Tuesday 31 March 2026 18:27:03 +0000 (0:00:00.515) 0:01:31.634 ********* 2026-03-31 18:27:03.782938 | aio | 2026-03-31 18:27:03.782956 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-31 18:27:03.782961 | aio | Tuesday 31 March 2026 18:27:03 +0000 (0:00:00.006) 0:01:31.640 ********* 2026-03-31 18:27:04.152239 | aio | ok: [aio] 2026-03-31 18:27:04.152366 | aio | 2026-03-31 18:27:04.152383 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:27:04.152555 | aio | Tuesday 31 March 2026 18:27:04 +0000 (0:00:00.370) 0:01:32.011 ********* 2026-03-31 18:27:04.368619 | aio | ok: [aio] 2026-03-31 18:27:04.368737 | aio | 2026-03-31 18:27:04.368754 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:27:04.368837 | aio | Tuesday 31 March 2026 18:27:04 +0000 (0:00:00.216) 0:01:32.227 ********* 2026-03-31 18:27:04.443862 | aio | ok: [aio] => { 2026-03-31 18:27:04.443934 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-31 18:27:04.443941 | aio | } 2026-03-31 18:27:04.443946 | aio | 2026-03-31 18:27:04.443951 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:27:04.443956 | aio | Tuesday 31 March 2026 18:27:04 +0000 (0:00:00.074) 0:01:32.301 ********* 2026-03-31 18:27:04.838350 | aio | ok: [aio] 2026-03-31 18:27:04.838459 | aio | 2026-03-31 18:27:04.838755 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:27:04.838827 | aio | Tuesday 31 March 2026 18:27:04 +0000 (0:00:00.394) 0:01:32.696 ********* 2026-03-31 18:27:08.005865 | aio | ok: [aio] 2026-03-31 18:27:08.005959 | aio | 2026-03-31 18:27:08.005971 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-31 18:27:08.006056 | aio | Tuesday 31 March 2026 18:27:08 +0000 (0:00:03.167) 0:01:35.864 ********* 2026-03-31 18:27:09.064031 | aio | ok: [aio] 2026-03-31 18:27:09.064107 | aio | 2026-03-31 18:27:09.064119 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-31 18:27:09.064173 | aio | Tuesday 31 March 2026 18:27:09 +0000 (0:00:01.058) 0:01:36.922 ********* 2026-03-31 18:27:09.265873 | aio | ok: [aio] 2026-03-31 18:27:09.265941 | aio | 2026-03-31 18:27:09.265946 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-31 18:27:09.265951 | aio | Tuesday 31 March 2026 18:27:09 +0000 (0:00:00.201) 0:01:37.124 ********* 2026-03-31 18:27:09.725232 | aio | ok: [aio] 2026-03-31 18:27:09.725323 | aio | 2026-03-31 18:27:09.725331 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-31 18:27:09.725508 | aio | Tuesday 31 March 2026 18:27:09 +0000 (0:00:00.459) 0:01:37.584 ********* 2026-03-31 18:27:10.306840 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-31 18:27:10.306947 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-31 18:27:10.307527 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-31 18:27:10.307588 | aio | 2026-03-31 18:27:10.307597 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-31 18:27:10.307604 | aio | Tuesday 31 March 2026 18:27:10 +0000 (0:00:00.581) 0:01:38.165 ********* 2026-03-31 18:27:10.739068 | aio | ok: [aio] 2026-03-31 18:27:10.739166 | aio | 2026-03-31 18:27:10.739514 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-31 18:27:10.739588 | aio | Tuesday 31 March 2026 18:27:10 +0000 (0:00:00.432) 0:01:38.597 ********* 2026-03-31 18:27:11.174518 | aio | ok: [aio] 2026-03-31 18:27:11.174581 | aio | 2026-03-31 18:27:11.174587 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-31 18:27:11.174592 | aio | Tuesday 31 March 2026 18:27:11 +0000 (0:00:00.427) 0:01:39.025 ********* 2026-03-31 18:27:11.174596 | aio | 2026-03-31 18:27:11.174600 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-31 18:27:11.174604 | aio | Tuesday 31 March 2026 18:27:11 +0000 (0:00:00.007) 0:01:39.032 ********* 2026-03-31 18:27:11.542815 | aio | ok: [aio] 2026-03-31 18:27:11.542894 | aio | 2026-03-31 18:27:11.542951 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-31 18:27:11.543082 | aio | Tuesday 31 March 2026 18:27:11 +0000 (0:00:00.369) 0:01:39.401 ********* 2026-03-31 18:27:11.591737 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-31 18:27:11.591828 | aio | 2026-03-31 18:27:11.592165 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-31 18:27:11.592220 | aio | Tuesday 31 March 2026 18:27:11 +0000 (0:00:00.048) 0:01:39.450 ********* 2026-03-31 18:27:13.002413 | aio | ok: [aio] 2026-03-31 18:27:13.002501 | aio | 2026-03-31 18:27:13.002560 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-31 18:27:13.002712 | aio | Tuesday 31 March 2026 18:27:12 +0000 (0:00:01.410) 0:01:40.860 ********* 2026-03-31 18:27:13.680327 | aio | ok: [aio] => (item=chronyd) 2026-03-31 18:27:13.680425 | aio | ok: [aio] => (item=sshd) 2026-03-31 18:27:13.680821 | aio | 2026-03-31 18:27:13.680887 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-31 18:27:13.680907 | aio | Tuesday 31 March 2026 18:27:13 +0000 (0:00:00.678) 0:01:41.539 ********* 2026-03-31 18:27:13.973814 | aio | ok: [aio] 2026-03-31 18:27:13.973881 | aio | 2026-03-31 18:27:13.973969 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-31 18:27:13.974066 | aio | Tuesday 31 March 2026 18:27:13 +0000 (0:00:00.293) 0:01:41.832 ********* 2026-03-31 18:27:14.177985 | aio | ok: [aio] 2026-03-31 18:27:14.178150 | aio | 2026-03-31 18:27:14.178401 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-31 18:27:14.178622 | aio | Tuesday 31 March 2026 18:27:14 +0000 (0:00:00.203) 0:01:42.036 ********* 2026-03-31 18:27:14.433808 | aio | ok: [aio] 2026-03-31 18:27:14.433975 | aio | 2026-03-31 18:27:14.434210 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-31 18:27:14.434521 | aio | Tuesday 31 March 2026 18:27:14 +0000 (0:00:00.255) 0:01:42.292 ********* 2026-03-31 18:27:14.660437 | aio | ok: [aio] 2026-03-31 18:27:14.660563 | aio | 2026-03-31 18:27:14.660790 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-31 18:27:14.661010 | aio | Tuesday 31 March 2026 18:27:14 +0000 (0:00:00.226) 0:01:42.518 ********* 2026-03-31 18:27:14.908795 | aio | ok: [aio] => (item=aio) 2026-03-31 18:27:14.908964 | aio | 2026-03-31 18:27:14.909192 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-31 18:27:14.909522 | aio | Tuesday 31 March 2026 18:27:14 +0000 (0:00:00.248) 0:01:42.767 ********* 2026-03-31 18:27:14.948278 | aio | ok: [aio] 2026-03-31 18:27:14.948573 | aio | 2026-03-31 18:27:14.948871 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:27:14.949197 | aio | Tuesday 31 March 2026 18:27:14 +0000 (0:00:00.039) 0:01:42.806 ********* 2026-03-31 18:27:15.000782 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-31 18:27:15.000981 | aio | 2026-03-31 18:27:15.001315 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:27:15.001614 | aio | Tuesday 31 March 2026 18:27:14 +0000 (0:00:00.052) 0:01:42.859 ********* 2026-03-31 18:27:15.038926 | aio | skipping: [aio] 2026-03-31 18:27:15.039062 | aio | 2026-03-31 18:27:15.039276 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:27:15.039481 | aio | Tuesday 31 March 2026 18:27:15 +0000 (0:00:00.038) 0:01:42.897 ********* 2026-03-31 18:27:15.084822 | aio | skipping: [aio] => (item=aio) 2026-03-31 18:27:15.084925 | aio | skipping: [aio] 2026-03-31 18:27:15.085116 | aio | 2026-03-31 18:27:15.085361 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:27:15.085613 | aio | Tuesday 31 March 2026 18:27:15 +0000 (0:00:00.045) 0:01:42.943 ********* 2026-03-31 18:27:15.354364 | aio | ok: [aio] 2026-03-31 18:27:15.354511 | aio | 2026-03-31 18:27:15.354725 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:27:15.354933 | aio | Tuesday 31 March 2026 18:27:15 +0000 (0:00:00.269) 0:01:43.212 ********* 2026-03-31 18:27:21.859864 | aio | ok: [aio] 2026-03-31 18:27:21.860004 | aio | 2026-03-31 18:27:21.860243 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-31 18:27:21.860491 | aio | Tuesday 31 March 2026 18:27:21 +0000 (0:00:06.505) 0:01:49.718 ********* 2026-03-31 18:27:27.354426 | aio | ok: [aio] 2026-03-31 18:27:27.354517 | aio | 2026-03-31 18:27:27.354707 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-31 18:27:27.354781 | aio | Tuesday 31 March 2026 18:27:27 +0000 (0:00:05.494) 0:01:55.213 ********* 2026-03-31 18:27:41.503577 | aio | ok: [aio] 2026-03-31 18:27:41.503692 | aio | 2026-03-31 18:27:41.503714 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-31 18:27:41.503844 | aio | Tuesday 31 March 2026 18:27:41 +0000 (0:00:14.149) 0:02:09.362 ********* 2026-03-31 18:27:41.573348 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-03-31 18:27:41.573413 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-03-31 18:27:41.573419 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-03-31 18:27:41.573423 | aio | skipping: [aio] 2026-03-31 18:27:41.573428 | aio | 2026-03-31 18:27:41.573433 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-31 18:27:41.573437 | aio | Tuesday 31 March 2026 18:27:41 +0000 (0:00:00.069) 0:02:09.431 ********* 2026-03-31 18:27:47.733582 | aio | ok: [aio] 2026-03-31 18:27:47.733656 | aio | 2026-03-31 18:27:47.733873 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-31 18:27:47.733891 | aio | Tuesday 31 March 2026 18:27:47 +0000 (0:00:06.160) 0:02:15.592 ********* 2026-03-31 18:27:53.883568 | aio | ok: [aio] 2026-03-31 18:27:53.883669 | aio | 2026-03-31 18:27:53.883993 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-31 18:27:53.884049 | aio | Tuesday 31 March 2026 18:27:53 +0000 (0:00:06.149) 0:02:21.742 ********* 2026-03-31 18:27:53.933916 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-03-31 18:27:53.934003 | aio | 2026-03-31 18:27:53.934258 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-31 18:27:53.934330 | aio | Tuesday 31 March 2026 18:27:53 +0000 (0:00:00.050) 0:02:21.792 ********* 2026-03-31 18:27:53.977439 | aio | ok: [aio] 2026-03-31 18:27:53.977660 | aio | 2026-03-31 18:27:53.977773 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-31 18:27:53.977823 | aio | Tuesday 31 March 2026 18:27:53 +0000 (0:00:00.043) 0:02:21.836 ********* 2026-03-31 18:28:00.034187 | aio | ok: [aio] 2026-03-31 18:28:00.034285 | aio | 2026-03-31 18:28:00.034322 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-31 18:28:00.034469 | aio | Tuesday 31 March 2026 18:28:00 +0000 (0:00:06.056) 0:02:27.892 ********* 2026-03-31 18:28:00.073203 | aio | ok: [aio] 2026-03-31 18:28:00.073301 | aio | 2026-03-31 18:28:00.073588 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-31 18:28:00.073668 | aio | Tuesday 31 March 2026 18:28:00 +0000 (0:00:00.039) 0:02:27.931 ********* 2026-03-31 18:28:00.117700 | aio | skipping: [aio] => (item=1) 2026-03-31 18:28:00.117785 | aio | skipping: [aio] => (item=1) 2026-03-31 18:28:00.118439 | aio | skipping: [aio] => (item=1) 2026-03-31 18:28:00.118518 | aio | skipping: [aio] 2026-03-31 18:28:00.118526 | aio | 2026-03-31 18:28:00.118533 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-31 18:28:00.118540 | aio | Tuesday 31 March 2026 18:28:00 +0000 (0:00:00.044) 0:02:27.975 ********* 2026-03-31 18:28:00.155708 | aio | skipping: [aio] 2026-03-31 18:28:00.155792 | aio | 2026-03-31 18:28:00.157641 | aio | PLAY RECAP ********************************************************************* 2026-03-31 18:28:00.157728 | aio | aio : ok=95 changed=0 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 2026-03-31 18:28:00.157743 | aio | 2026-03-31 18:28:00.157753 | aio | 2026-03-31 18:28:00.157762 | aio | TASKS RECAP ******************************************************************** 2026-03-31 18:28:00.157772 | aio | Tuesday 31 March 2026 18:28:00 +0000 (0:00:00.038) 0:02:28.014 ********* 2026-03-31 18:28:00.157782 | aio | =============================================================================== 2026-03-31 18:28:00.157791 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.19s 2026-03-31 18:28:00.157800 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.15s 2026-03-31 18:28:00.157809 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.45s 2026-03-31 18:28:00.157819 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.53s 2026-03-31 18:28:00.157828 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.51s 2026-03-31 18:28:00.157837 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.47s 2026-03-31 18:28:00.157846 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.40s 2026-03-31 18:28:00.157864 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.24s 2026-03-31 18:28:00.157966 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.24s 2026-03-31 18:28:00.158222 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.16s 2026-03-31 18:28:00.158438 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.15s 2026-03-31 18:28:00.158611 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.06s 2026-03-31 18:28:00.158860 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.04s 2026-03-31 18:28:00.159021 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.49s 2026-03-31 18:28:00.159144 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.17s 2026-03-31 18:28:00.159266 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.16s 2026-03-31 18:28:00.159385 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.34s 2026-03-31 18:28:00.159505 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.03s 2026-03-31 18:28:00.159626 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 1.41s 2026-03-31 18:28:00.159767 | aio | vexxhost.containers.package : Update state for tar ---------------------- 1.40s 2026-03-31 18:28:00.318663 | aio | INFO [default > idempotence] Executed: Successful 2026-03-31 18:28:00.330983 | aio | INFO [default > side_effect] Executing 2026-03-31 18:28:00.332019 | aio | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-31 18:28:00.337235 | aio | INFO [default > verify] Executing 2026-03-31 18:28:00.957639 | aio | 2026-03-31 18:28:00.958005 | aio | PLAY [Verify] ****************************************************************** 2026-03-31 18:28:00.958256 | aio | 2026-03-31 18:28:00.958520 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:28:00.958784 | aio | Tuesday 31 March 2026 18:28:00 +0000 (0:00:00.006) 0:00:00.006 ********* 2026-03-31 18:28:02.200265 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-31 18:28:02.200359 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-31 18:28:02.200371 | aio | interpreter could change the meaning of that path. See 2026-03-31 18:28:02.200381 | aio | https://docs.ansible.com/ansible- 2026-03-31 18:28:02.200390 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:28:02.211056 | aio | ok: [aio] 2026-03-31 18:28:02.211080 | aio | 2026-03-31 18:28:02.211087 | aio | TASK [Get cluster health status] *********************************************** 2026-03-31 18:28:02.211093 | aio | Tuesday 31 March 2026 18:28:02 +0000 (0:00:01.253) 0:00:01.260 ********* 2026-03-31 18:28:12.552273 | aio | ok: [aio] 2026-03-31 18:28:12.552697 | aio | 2026-03-31 18:28:12.552711 | aio | TASK [Print cluster health status] ********************************************* 2026-03-31 18:28:12.552963 | aio | Tuesday 31 March 2026 18:28:12 +0000 (0:00:10.340) 0:00:11.601 ********* 2026-03-31 18:28:12.584866 | aio | ok: [aio] => { 2026-03-31 18:28:12.585078 | aio | "_ceph_health": { 2026-03-31 18:28:12.585300 | aio | "changed": false, 2026-03-31 18:28:12.585608 | aio | "cmd": [ 2026-03-31 18:28:12.585845 | aio | "cephadm", 2026-03-31 18:28:12.586037 | aio | "shell", 2026-03-31 18:28:12.586225 | aio | "--", 2026-03-31 18:28:12.586445 | aio | "ceph", 2026-03-31 18:28:12.586630 | aio | "health" 2026-03-31 18:28:12.586831 | aio | ], 2026-03-31 18:28:12.587037 | aio | "delta": "0:00:10.047641", 2026-03-31 18:28:12.587249 | aio | "end": "2026-03-31 18:28:12.509938", 2026-03-31 18:28:12.587453 | aio | "failed": false, 2026-03-31 18:28:12.587655 | aio | "msg": "", 2026-03-31 18:28:12.587856 | aio | "rc": 0, 2026-03-31 18:28:12.588069 | aio | "start": "2026-03-31 18:28:02.462297", 2026-03-31 18:28:12.588316 | aio | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config", 2026-03-31 18:28:12.588536 | aio | "stderr_lines": [ 2026-03-31 18:28:12.588746 | aio | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-31 18:28:12.588973 | aio | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config" 2026-03-31 18:28:12.589200 | aio | ], 2026-03-31 18:28:12.589425 | aio | "stdout": "HEALTH_OK", 2026-03-31 18:28:12.589686 | aio | "stdout_lines": [ 2026-03-31 18:28:12.589901 | aio | "HEALTH_OK" 2026-03-31 18:28:12.590131 | aio | ] 2026-03-31 18:28:12.590315 | aio | } 2026-03-31 18:28:12.590514 | aio | } 2026-03-31 18:28:12.590707 | aio | 2026-03-31 18:28:12.590919 | aio | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-31 18:28:12.591126 | aio | Tuesday 31 March 2026 18:28:12 +0000 (0:00:00.033) 0:00:11.634 ********* 2026-03-31 18:28:12.613720 | aio | ok: [aio] => { 2026-03-31 18:28:12.613905 | aio | "changed": false, 2026-03-31 18:28:12.614101 | aio | "msg": "All assertions passed" 2026-03-31 18:28:12.614288 | aio | } 2026-03-31 18:28:12.614463 | aio | 2026-03-31 18:28:12.614660 | aio | TASK [Create a test Ceph pool] ************************************************* 2026-03-31 18:28:12.614859 | aio | Tuesday 31 March 2026 18:28:12 +0000 (0:00:00.028) 0:00:11.663 ********* 2026-03-31 18:28:18.785772 | aio | changed: [aio] 2026-03-31 18:28:18.785945 | aio | 2026-03-31 18:28:18.786162 | aio | TASK [Create a test Ceph key] ************************************************** 2026-03-31 18:28:18.786366 | aio | Tuesday 31 March 2026 18:28:18 +0000 (0:00:06.171) 0:00:17.834 ********* 2026-03-31 18:28:21.280801 | aio | changed: [aio] 2026-03-31 18:28:21.280891 | aio | 2026-03-31 18:28:21.280899 | aio | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-31 18:28:21.280906 | aio | Tuesday 31 March 2026 18:28:21 +0000 (0:00:02.494) 0:00:20.329 ********* 2026-03-31 18:28:22.499536 | aio | ok: [aio] 2026-03-31 18:28:22.499623 | aio | 2026-03-31 18:28:22.499682 | aio | TASK [Assert that key_info returns the correct key] **************************** 2026-03-31 18:28:22.499826 | aio | Tuesday 31 March 2026 18:28:22 +0000 (0:00:01.219) 0:00:21.549 ********* 2026-03-31 18:28:22.538634 | aio | ok: [aio] => { 2026-03-31 18:28:22.539890 | aio | "changed": false, 2026-03-31 18:28:22.539936 | aio | "msg": "All assertions passed" 2026-03-31 18:28:22.539949 | aio | } 2026-03-31 18:28:22.539958 | aio | 2026-03-31 18:28:22.539968 | aio | PLAY RECAP ********************************************************************* 2026-03-31 18:28:22.539978 | aio | aio : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-31 18:28:22.540509 | aio | 2026-03-31 18:28:22.540536 | aio | 2026-03-31 18:28:22.540545 | aio | TASKS RECAP ******************************************************************** 2026-03-31 18:28:22.540706 | aio | Tuesday 31 March 2026 18:28:22 +0000 (0:00:00.039) 0:00:21.588 ********* 2026-03-31 18:28:22.540892 | aio | =============================================================================== 2026-03-31 18:28:22.541098 | aio | Get cluster health status ---------------------------------------------- 10.34s 2026-03-31 18:28:22.541279 | aio | Create a test Ceph pool ------------------------------------------------- 6.17s 2026-03-31 18:28:22.541486 | aio | Create a test Ceph key -------------------------------------------------- 2.49s 2026-03-31 18:28:22.541751 | aio | Gathering Facts --------------------------------------------------------- 1.25s 2026-03-31 18:28:22.541961 | aio | Retrieve info for the test Ceph key ------------------------------------- 1.22s 2026-03-31 18:28:22.542386 | aio | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-03-31 18:28:22.542688 | aio | Print cluster health status --------------------------------------------- 0.03s 2026-03-31 18:28:22.542888 | aio | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-03-31 18:28:22.630846 | aio | INFO [default > verify] Executed: Successful 2026-03-31 18:28:22.641337 | aio | INFO [default > cleanup] Executing 2026-03-31 18:28:22.641787 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-31 18:28:22.648758 | aio | INFO [default > destroy] Executing 2026-03-31 18:28:22.648841 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-31 18:28:22.648927 | aio | INFO [default > destroy] Executed: Successful 2026-03-31 18:28:22.649286 | aio | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-31 18:28:23.147427 | aio | ok: Runtime: 0:10:36.212315 2026-03-31 18:28:23.161387 | 2026-03-31 18:28:23.161468 | PLAY RECAP 2026-03-31 18:28:23.161510 | aio | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-31 18:28:23.161533 | 2026-03-31 18:28:23.264496 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-31 18:28:23.268154 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-31 18:28:23.835175 | 2026-03-31 18:28:23.835290 | PLAY [all] 2026-03-31 18:28:23.846014 | 2026-03-31 18:28:23.846096 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-31 18:28:23.890654 | aio | skipping: Conditional result was False 2026-03-31 18:28:23.900567 | 2026-03-31 18:28:23.900682 | TASK [fetch-output : Set log path for single node] 2026-03-31 18:28:23.944276 | aio | ok 2026-03-31 18:28:23.950975 | 2026-03-31 18:28:23.951072 | LOOP [fetch-output : Ensure local output dirs] 2026-03-31 18:28:24.327054 | aio -> localhost | ok: "/var/lib/zuul/builds/6a54a21a75124543a74e92e8d3a2221e/work/logs" 2026-03-31 18:28:24.544217 | aio -> localhost | changed: "/var/lib/zuul/builds/6a54a21a75124543a74e92e8d3a2221e/work/artifacts" 2026-03-31 18:28:24.757698 | aio -> localhost | changed: "/var/lib/zuul/builds/6a54a21a75124543a74e92e8d3a2221e/work/docs" 2026-03-31 18:28:24.771462 | 2026-03-31 18:28:24.771590 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-31 18:28:25.433720 | aio | ok 2026-03-31 18:28:25.434009 | aio | changed: All items complete 2026-03-31 18:28:25.434053 | 2026-03-31 18:28:25.898823 | aio | changed: .d..t...... ./ 2026-03-31 18:28:26.365550 | aio | changed: .d..t...... ./ 2026-03-31 18:28:26.386419 | 2026-03-31 18:28:26.386642 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-31 18:28:26.858353 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.008173 2026-03-31 18:28:27.126473 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.007701 2026-03-31 18:28:27.144340 | 2026-03-31 18:28:27.144458 | PLAY [all] 2026-03-31 18:28:27.150162 | 2026-03-31 18:28:27.150225 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-31 18:28:27.619820 | aio | changed 2026-03-31 18:28:27.625521 | 2026-03-31 18:28:27.625571 | PLAY RECAP 2026-03-31 18:28:27.625614 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-31 18:28:27.625636 | 2026-03-31 18:28:27.730369 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-31 18:28:27.733805 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-31 18:28:28.363688 | 2026-03-31 18:28:28.363813 | PLAY [localhost] 2026-03-31 18:28:28.375289 | 2026-03-31 18:28:28.375411 | TASK [Generate Zuul manifest] 2026-03-31 18:28:28.407627 | localhost | ok 2026-03-31 18:28:28.429894 | 2026-03-31 18:28:28.430081 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-31 18:28:28.789465 | localhost | changed 2026-03-31 18:28:28.800302 | 2026-03-31 18:28:28.800387 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-31 18:28:28.832165 | localhost | ok 2026-03-31 18:28:28.840855 | 2026-03-31 18:28:28.840947 | TASK [Upload logs] 2026-03-31 18:28:28.864615 | localhost | ok 2026-03-31 18:28:28.931371 | 2026-03-31 18:28:28.931514 | TASK [Set zuul-log-path fact] 2026-03-31 18:28:28.963301 | localhost | ok 2026-03-31 18:28:28.976079 | 2026-03-31 18:28:28.976216 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-31 18:28:29.009676 | localhost | ok 2026-03-31 18:28:29.019242 | 2026-03-31 18:28:29.019328 | TASK [upload-logs : Create log directories] 2026-03-31 18:28:29.427268 | localhost | changed 2026-03-31 18:28:29.434017 | 2026-03-31 18:28:29.434118 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-31 18:28:29.864299 | localhost -> localhost | ok: Runtime: 0:00:00.006316 2026-03-31 18:28:29.872362 | 2026-03-31 18:28:29.872505 | TASK [upload-logs : Upload logs to log server] 2026-03-31 18:28:30.369414 | localhost | Output suppressed because no_log was given 2026-03-31 18:28:30.374524 | 2026-03-31 18:28:30.374631 | LOOP [upload-logs : Compress console log and json output] 2026-03-31 18:28:30.423090 | localhost | skipping: Conditional result was False 2026-03-31 18:28:30.430701 | localhost | skipping: Conditional result was False 2026-03-31 18:28:30.439605 | 2026-03-31 18:28:30.439795 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-31 18:28:30.487818 | localhost | skipping: Conditional result was False 2026-03-31 18:28:30.488305 | 2026-03-31 18:28:30.492546 | localhost | skipping: Conditional result was False 2026-03-31 18:28:30.506092 | 2026-03-31 18:28:30.506234 | LOOP [upload-logs : Upload console log and json output]