2026-04-18 16:22:25.073963 | Job console starting 2026-04-18 16:22:25.111581 | Updating git repos 2026-04-18 16:22:25.142920 | Cloning repos into workspace 2026-04-18 16:22:25.178638 | Restoring repo states 2026-04-18 16:22:25.184618 | Merging changes 2026-04-18 16:22:25.448088 | Checking out repos 2026-04-18 16:22:25.486097 | Preparing playbooks 2026-04-18 16:22:27.191296 | Running Ansible setup 2026-04-18 16:22:32.128587 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-18 16:22:32.754399 | 2026-04-18 16:22:32.754547 | PLAY [localhost] 2026-04-18 16:22:32.763913 | 2026-04-18 16:22:32.763997 | TASK [Gathering Facts] 2026-04-18 16:22:33.641853 | localhost | ok 2026-04-18 16:22:33.650918 | 2026-04-18 16:22:33.651002 | TASK [Setup log path fact] 2026-04-18 16:22:33.669501 | localhost | ok 2026-04-18 16:22:33.679659 | 2026-04-18 16:22:33.679725 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-18 16:22:33.709741 | localhost | ok 2026-04-18 16:22:33.717836 | 2026-04-18 16:22:33.717925 | TASK [emit-job-header : Print job information] 2026-04-18 16:22:33.764257 | # Job Information 2026-04-18 16:22:33.764592 | Ansible Version: 2.16.16 2026-04-18 16:22:33.764669 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-04-18 16:22:33.764721 | Pipeline: check 2026-04-18 16:22:33.764767 | Executor: 0a8996d2b663 2026-04-18 16:22:33.764811 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/97 2026-04-18 16:22:33.764861 | Event ID: a870ef90-3b42-11f1-89d2-e70f18b94fca 2026-04-18 16:22:33.767808 | 2026-04-18 16:22:33.767879 | LOOP [emit-job-header : Print node information] 2026-04-18 16:22:33.867897 | localhost | ok: 2026-04-18 16:22:33.868257 | localhost | # Node Information 2026-04-18 16:22:33.868328 | localhost | Inventory Hostname: mon1 2026-04-18 16:22:33.868380 | localhost | Hostname: np0000167298 2026-04-18 16:22:33.868429 | localhost | Username: zuul 2026-04-18 16:22:33.868482 | localhost | Distro: Ubuntu 24.04 2026-04-18 16:22:33.868530 | localhost | Provider: yul1 2026-04-18 16:22:33.868576 | localhost | Region: ca-ymq-1 2026-04-18 16:22:33.868622 | localhost | Label: ubuntu-noble 2026-04-18 16:22:33.868667 | localhost | Product Name: OpenStack Nova 2026-04-18 16:22:33.868771 | localhost | Interface IP: 199.204.45.44 2026-04-18 16:22:33.915179 | localhost | ok: 2026-04-18 16:22:33.915296 | localhost | # Node Information 2026-04-18 16:22:33.915334 | localhost | Inventory Hostname: osd1 2026-04-18 16:22:33.915364 | localhost | Hostname: np0000167299 2026-04-18 16:22:33.915392 | localhost | Username: zuul 2026-04-18 16:22:33.915419 | localhost | Distro: Ubuntu 24.04 2026-04-18 16:22:33.915445 | localhost | Provider: yul1 2026-04-18 16:22:33.915470 | localhost | Region: ca-ymq-1 2026-04-18 16:22:33.915496 | localhost | Label: ubuntu-noble 2026-04-18 16:22:33.915521 | localhost | Product Name: OpenStack Nova 2026-04-18 16:22:33.915547 | localhost | Interface IP: 199.204.45.246 2026-04-18 16:22:33.924504 | 2026-04-18 16:22:33.924610 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-18 16:22:34.297047 | localhost -> localhost | changed 2026-04-18 16:22:34.304752 | 2026-04-18 16:22:34.304854 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-18 16:22:35.161989 | localhost -> localhost | changed 2026-04-18 16:22:35.170987 | 2026-04-18 16:22:35.171059 | PLAY [all] 2026-04-18 16:22:35.183231 | 2026-04-18 16:22:35.183325 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-18 16:22:35.423434 | mon1 -> localhost | ok 2026-04-18 16:22:35.433807 | 2026-04-18 16:22:35.433894 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-18 16:22:35.466075 | mon1 | ok 2026-04-18 16:22:35.472038 | osd1 | ok 2026-04-18 16:22:35.490624 | mon1 | included: /var/lib/zuul/builds/2c082c37bda94b58968c002c19ba70ce/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-18 16:22:35.490677 | osd1 | included: /var/lib/zuul/builds/2c082c37bda94b58968c002c19ba70ce/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-18 16:22:35.496990 | 2026-04-18 16:22:35.497051 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-18 16:22:36.665615 | mon1 -> localhost | Generating public/private rsa key pair. 2026-04-18 16:22:36.665933 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/2c082c37bda94b58968c002c19ba70ce/work/2c082c37bda94b58968c002c19ba70ce_id_rsa 2026-04-18 16:22:36.666007 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/2c082c37bda94b58968c002c19ba70ce/work/2c082c37bda94b58968c002c19ba70ce_id_rsa.pub 2026-04-18 16:22:36.666059 | mon1 -> localhost | The key fingerprint is: 2026-04-18 16:22:36.666111 | mon1 -> localhost | SHA256:4nflvGKjWRSMx5FpsnDd56GPzs9Gx3Jbzn2E03VzKt0 zuul-build-sshkey 2026-04-18 16:22:36.666161 | mon1 -> localhost | The key's randomart image is: 2026-04-18 16:22:36.666212 | mon1 -> localhost | +---[RSA 3072]----+ 2026-04-18 16:22:36.666255 | mon1 -> localhost | | ..+ | 2026-04-18 16:22:36.666298 | mon1 -> localhost | | . o+=.. o | 2026-04-18 16:22:36.666342 | mon1 -> localhost | | o.+= + . | 2026-04-18 16:22:36.666386 | mon1 -> localhost | | .. .. ..+| 2026-04-18 16:22:36.666427 | mon1 -> localhost | | . S . .+ *=| 2026-04-18 16:22:36.666467 | mon1 -> localhost | | . . . +o O E| 2026-04-18 16:22:36.666508 | mon1 -> localhost | | . . oooo O+| 2026-04-18 16:22:36.666550 | mon1 -> localhost | | . ++ oo..=| 2026-04-18 16:22:36.666591 | mon1 -> localhost | | oo o.oo .| 2026-04-18 16:22:36.666631 | mon1 -> localhost | +----[SHA256]-----+ 2026-04-18 16:22:36.666734 | mon1 -> localhost | ok: Runtime: 0:00:00.736693 2026-04-18 16:22:36.676746 | 2026-04-18 16:22:36.676855 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-18 16:22:36.710201 | mon1 | ok 2026-04-18 16:22:36.731088 | osd1 | ok 2026-04-18 16:22:36.746335 | mon1 | included: /var/lib/zuul/builds/2c082c37bda94b58968c002c19ba70ce/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-18 16:22:36.746408 | osd1 | included: /var/lib/zuul/builds/2c082c37bda94b58968c002c19ba70ce/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-18 16:22:36.757721 | 2026-04-18 16:22:36.757788 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-18 16:22:36.788190 | mon1 | skipping: Conditional result was False 2026-04-18 16:22:36.799331 | osd1 | skipping: Conditional result was False 2026-04-18 16:22:36.809826 | 2026-04-18 16:22:36.809924 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-18 16:22:37.330016 | mon1 | changed 2026-04-18 16:22:37.369240 | osd1 | changed 2026-04-18 16:22:37.377557 | 2026-04-18 16:22:37.377657 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-18 16:22:37.621832 | mon1 | ok 2026-04-18 16:22:37.628027 | osd1 | ok 2026-04-18 16:22:37.634310 | 2026-04-18 16:22:37.634392 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-18 16:22:38.204656 | mon1 | changed 2026-04-18 16:22:38.234548 | osd1 | changed 2026-04-18 16:22:38.240754 | 2026-04-18 16:22:38.240824 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-18 16:22:38.868379 | mon1 | changed 2026-04-18 16:22:38.879578 | osd1 | changed 2026-04-18 16:22:38.885343 | 2026-04-18 16:22:38.885415 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-18 16:22:38.912835 | mon1 | skipping: Conditional result was False 2026-04-18 16:22:38.924495 | osd1 | skipping: Conditional result was False 2026-04-18 16:22:38.935018 | 2026-04-18 16:22:38.935129 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-18 16:22:39.278574 | mon1 -> localhost | changed 2026-04-18 16:22:39.307411 | 2026-04-18 16:22:39.307596 | TASK [add-build-sshkey : Add back temp key] 2026-04-18 16:22:39.593039 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/2c082c37bda94b58968c002c19ba70ce/work/2c082c37bda94b58968c002c19ba70ce_id_rsa (zuul-build-sshkey) 2026-04-18 16:22:39.593288 | mon1 -> localhost | ok: Runtime: 0:00:00.014745 2026-04-18 16:22:39.598772 | 2026-04-18 16:22:39.598842 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-18 16:22:39.916892 | osd1 | ok 2026-04-18 16:22:39.921714 | mon1 | ok 2026-04-18 16:22:39.926851 | 2026-04-18 16:22:39.926918 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-18 16:22:39.953970 | mon1 | skipping: Conditional result was False 2026-04-18 16:22:39.965481 | osd1 | skipping: Conditional result was False 2026-04-18 16:22:39.986324 | 2026-04-18 16:22:39.986464 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-18 16:22:40.311950 | mon1 | ok 2026-04-18 16:22:40.332559 | osd1 | ok 2026-04-18 16:22:40.343655 | 2026-04-18 16:22:40.343723 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-18 16:22:41.152728 | mon1 | Output suppressed because no_log was given 2026-04-18 16:22:41.180035 | osd1 | Output suppressed because no_log was given 2026-04-18 16:22:41.195001 | 2026-04-18 16:22:41.195126 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-18 16:22:41.425790 | mon1 | ok: "logs" 2026-04-18 16:22:41.426794 | mon1 | ok: All items complete 2026-04-18 16:22:41.426838 | 2026-04-18 16:22:41.457338 | osd1 | ok: "logs" 2026-04-18 16:22:41.624221 | mon1 | ok: "artifacts" 2026-04-18 16:22:41.669096 | osd1 | ok: "artifacts" 2026-04-18 16:22:41.819874 | mon1 | ok: "docs" 2026-04-18 16:22:41.879885 | osd1 | ok: "docs" 2026-04-18 16:22:41.891813 | 2026-04-18 16:22:41.891973 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-18 16:22:42.114888 | mon1 | changed: "logs" 2026-04-18 16:22:42.115247 | mon1 | ok: All items complete 2026-04-18 16:22:42.115302 | 2026-04-18 16:22:42.150974 | osd1 | changed: "logs" 2026-04-18 16:22:42.325118 | mon1 | changed: "artifacts" 2026-04-18 16:22:42.347981 | osd1 | changed: "artifacts" 2026-04-18 16:22:42.548481 | mon1 | changed: "docs" 2026-04-18 16:22:42.555000 | osd1 | changed: "docs" 2026-04-18 16:22:42.573634 | 2026-04-18 16:22:42.573781 | PLAY RECAP 2026-04-18 16:22:42.573832 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-18 16:22:42.573863 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-18 16:22:42.573888 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-18 16:22:42.573907 | 2026-04-18 16:22:42.720368 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-18 16:22:42.725159 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-18 16:22:43.370797 | 2026-04-18 16:22:43.370953 | PLAY [all] 2026-04-18 16:22:43.384041 | 2026-04-18 16:22:43.384134 | TASK [setup-uv : Extract archive] 2026-04-18 16:22:45.885067 | mon1 | changed 2026-04-18 16:22:45.904884 | osd1 | changed 2026-04-18 16:22:45.911749 | 2026-04-18 16:22:45.911827 | TASK [setup-uv : Print version] 2026-04-18 16:22:45.723456 | osd1 | uv 0.8.13 2026-04-18 16:22:46.334245 | mon1 | uv 0.8.13 2026-04-18 16:22:46.476463 | mon1 | ok: Runtime: 0:00:00.014682 2026-04-18 16:22:46.486267 | osd1 | ok: Runtime: 0:00:00.014881 2026-04-18 16:22:46.497416 | 2026-04-18 16:22:46.497476 | PLAY RECAP 2026-04-18 16:22:46.497535 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-18 16:22:46.497575 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-18 16:22:46.497602 | 2026-04-18 16:22:46.633383 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-18 16:22:46.636914 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-18 16:22:47.225590 | 2026-04-18 16:22:47.225714 | PLAY [all] 2026-04-18 16:22:47.237495 | 2026-04-18 16:22:47.237573 | TASK [Copy inventory file for Zuul] 2026-04-18 16:22:48.230459 | mon1 | changed 2026-04-18 16:22:48.236239 | 2026-04-18 16:22:48.236325 | TASK [Switch "ansible_host" to private IP] 2026-04-18 16:22:48.601348 | mon1 | changed: 2 replacements made 2026-04-18 16:22:48.607385 | 2026-04-18 16:22:48.607458 | TASK [Run Molecule scenario] 2026-04-18 16:22:49.100598 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-04-18 16:22:49.100738 | mon1 | Creating virtual environment at: .venv 2026-04-18 16:22:49.361365 | mon1 | Downloading netaddr (2.2MiB) 2026-04-18 16:22:49.362560 | mon1 | Downloading pygments (1.2MiB) 2026-04-18 16:22:49.364485 | mon1 | Downloading cryptography (4.3MiB) 2026-04-18 16:22:49.365954 | mon1 | Downloading ansible-core (2.1MiB) 2026-04-18 16:22:49.559664 | mon1 | Downloading netaddr 2026-04-18 16:22:49.570405 | mon1 | Downloading cryptography 2026-04-18 16:22:49.629615 | mon1 | Downloading pygments 2026-04-18 16:22:49.794611 | mon1 | Downloading ansible-core 2026-04-18 16:22:49.846580 | mon1 | Installed 37 packages in 50ms 2026-04-18 16:22:50.625938 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-04-18 16:22:50.626048 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-04-18 16:22:51.259985 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-04-18 16:22:51.260072 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-04-18 16:23:02.638011 | mon1 | INFO [default > dependency] Executing 2026-04-18 16:23:02.638125 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-04-18 16:23:02.638306 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-04-18 16:23:02.638483 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-04-18 16:23:02.644241 | mon1 | INFO [default > cleanup] Executing 2026-04-18 16:23:02.644581 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-18 16:23:02.650120 | mon1 | INFO [default > destroy] Executing 2026-04-18 16:23:02.650153 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-04-18 16:23:02.650170 | mon1 | INFO [default > destroy] Executed: Successful 2026-04-18 16:23:02.655872 | mon1 | INFO [default > syntax] Executing 2026-04-18 16:23:03.746929 | mon1 | 2026-04-18 16:23:03.747269 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-04-18 16:23:03.799043 | mon1 | INFO [default > syntax] Executed: Successful 2026-04-18 16:23:03.809906 | mon1 | INFO [default > create] Executing 2026-04-18 16:23:03.811510 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-18 16:23:03.817428 | mon1 | INFO [default > prepare] Executing 2026-04-18 16:23:04.578404 | mon1 | 2026-04-18 16:23:04.578686 | mon1 | PLAY [Prepare] ***************************************************************** 2026-04-18 16:23:04.578913 | mon1 | 2026-04-18 16:23:04.579163 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-18 16:23:04.579447 | mon1 | Saturday 18 April 2026 16:23:04 +0000 (0:00:00.032) 0:00:00.032 ******** 2026-04-18 16:23:05.863296 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-04-18 16:23:05.863544 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-18 16:23:05.863788 | mon1 | interpreter could change the meaning of that path. See 2026-04-18 16:23:05.864045 | mon1 | https://docs.ansible.com/ansible- 2026-04-18 16:23:05.864305 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-18 16:23:05.884138 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-04-18 16:23:05.884375 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-18 16:23:05.884647 | mon1 | interpreter could change the meaning of that path. See 2026-04-18 16:23:05.884882 | mon1 | https://docs.ansible.com/ansible- 2026-04-18 16:23:05.885123 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-18 16:23:05.893775 | mon1 | ok: [mon1] 2026-04-18 16:23:05.893997 | mon1 | ok: [osd1] 2026-04-18 16:23:05.894213 | mon1 | 2026-04-18 16:23:05.894452 | mon1 | TASK [Configure short hostname] ************************************************ 2026-04-18 16:23:05.894728 | mon1 | Saturday 18 April 2026 16:23:05 +0000 (0:00:01.315) 0:00:01.348 ******** 2026-04-18 16:23:06.671663 | mon1 | changed: [osd1] 2026-04-18 16:23:06.671877 | mon1 | changed: [mon1] 2026-04-18 16:23:06.672091 | mon1 | 2026-04-18 16:23:06.672337 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-04-18 16:23:06.672706 | mon1 | Saturday 18 April 2026 16:23:06 +0000 (0:00:00.777) 0:00:02.125 ******** 2026-04-18 16:23:07.004124 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-04-18 16:23:07.004343 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-04-18 16:23:07.004675 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-18 16:23:07.016362 | mon1 | changed: [mon1] 2026-04-18 16:23:07.016683 | mon1 | changed: [osd1] 2026-04-18 16:23:07.016898 | mon1 | 2026-04-18 16:23:07.017129 | mon1 | TASK [Update apt cache] ******************************************************** 2026-04-18 16:23:07.017375 | mon1 | Saturday 18 April 2026 16:23:07 +0000 (0:00:00.343) 0:00:02.469 ******** 2026-04-18 16:23:16.413385 | mon1 | changed: [mon1] 2026-04-18 16:23:16.413657 | mon1 | changed: [osd1] 2026-04-18 16:23:16.413875 | mon1 | 2026-04-18 16:23:16.414117 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-04-18 16:23:16.414330 | mon1 | 2026-04-18 16:23:16.414614 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-18 16:23:16.414857 | mon1 | Saturday 18 April 2026 16:23:16 +0000 (0:00:09.397) 0:00:11.866 ******** 2026-04-18 16:23:17.240054 | mon1 | ok: [osd1] 2026-04-18 16:23:17.240213 | mon1 | 2026-04-18 16:23:17.240489 | mon1 | TASK [Install depedencies] ***************************************************** 2026-04-18 16:23:17.240738 | mon1 | Saturday 18 April 2026 16:23:17 +0000 (0:00:00.827) 0:00:12.694 ******** 2026-04-18 16:23:37.503642 | mon1 | changed: [osd1] 2026-04-18 16:23:37.503746 | mon1 | 2026-04-18 16:23:37.504020 | mon1 | TASK [Start up service] ******************************************************** 2026-04-18 16:23:37.504312 | mon1 | Saturday 18 April 2026 16:23:37 +0000 (0:00:20.263) 0:00:32.957 ******** 2026-04-18 16:23:38.168847 | mon1 | ok: [osd1] 2026-04-18 16:23:38.169035 | mon1 | 2026-04-18 16:23:38.169298 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-04-18 16:23:38.169624 | mon1 | Saturday 18 April 2026 16:23:38 +0000 (0:00:00.665) 0:00:33.623 ******** 2026-04-18 16:23:38.526644 | mon1 | ok: [osd1] 2026-04-18 16:23:38.526816 | mon1 | 2026-04-18 16:23:38.527057 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-04-18 16:23:38.527308 | mon1 | Saturday 18 April 2026 16:23:38 +0000 (0:00:00.357) 0:00:33.980 ******** 2026-04-18 16:23:39.331725 | mon1 | changed: [osd1] 2026-04-18 16:23:39.331902 | mon1 | 2026-04-18 16:23:39.332157 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-04-18 16:23:39.332405 | mon1 | Saturday 18 April 2026 16:23:39 +0000 (0:00:00.805) 0:00:34.786 ******** 2026-04-18 16:23:39.586188 | mon1 | ok: [osd1] 2026-04-18 16:23:39.586376 | mon1 | 2026-04-18 16:23:39.586672 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-04-18 16:23:39.586910 | mon1 | Saturday 18 April 2026 16:23:39 +0000 (0:00:00.254) 0:00:35.040 ******** 2026-04-18 16:23:39.614657 | mon1 | skipping: [osd1] 2026-04-18 16:23:39.614816 | mon1 | 2026-04-18 16:23:39.615066 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-04-18 16:23:39.615313 | mon1 | Saturday 18 April 2026 16:23:39 +0000 (0:00:00.029) 0:00:35.069 ******** 2026-04-18 16:23:40.319760 | mon1 | changed: [osd1] => (item=osd0) 2026-04-18 16:23:40.319960 | mon1 | changed: [osd1] => (item=osd1) 2026-04-18 16:23:40.320246 | mon1 | changed: [osd1] => (item=osd2) 2026-04-18 16:23:40.320517 | mon1 | 2026-04-18 16:23:40.320728 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-04-18 16:23:40.321039 | mon1 | Saturday 18 April 2026 16:23:40 +0000 (0:00:00.704) 0:00:35.773 ******** 2026-04-18 16:23:41.095701 | mon1 | changed: [osd1] => (item=osd0) 2026-04-18 16:23:41.095903 | mon1 | changed: [osd1] => (item=osd1) 2026-04-18 16:23:41.096137 | mon1 | changed: [osd1] => (item=osd2) 2026-04-18 16:23:41.096411 | mon1 | 2026-04-18 16:23:41.096717 | mon1 | TASK [Start loop devices] ****************************************************** 2026-04-18 16:23:41.096964 | mon1 | Saturday 18 April 2026 16:23:41 +0000 (0:00:00.776) 0:00:36.549 ******** 2026-04-18 16:23:41.958891 | mon1 | changed: [osd1] => (item=osd0) 2026-04-18 16:23:41.959309 | mon1 | changed: [osd1] => (item=osd1) 2026-04-18 16:23:41.959713 | mon1 | changed: [osd1] => (item=osd2) 2026-04-18 16:23:41.960206 | mon1 | 2026-04-18 16:23:41.960231 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-04-18 16:23:41.960428 | mon1 | Saturday 18 April 2026 16:23:41 +0000 (0:00:00.862) 0:00:37.412 ******** 2026-04-18 16:23:43.485811 | mon1 | changed: [osd1] => (item=osd0) 2026-04-18 16:23:43.485899 | mon1 | changed: [osd1] => (item=osd1) 2026-04-18 16:23:43.485943 | mon1 | changed: [osd1] => (item=osd2) 2026-04-18 16:23:43.486065 | mon1 | 2026-04-18 16:23:43.486174 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-04-18 16:23:43.486288 | mon1 | Saturday 18 April 2026 16:23:43 +0000 (0:00:01.527) 0:00:38.940 ******** 2026-04-18 16:23:44.837409 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-04-18 16:23:44.837790 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-04-18 16:23:44.838084 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-04-18 16:23:44.838308 | mon1 | 2026-04-18 16:23:44.838629 | mon1 | PLAY RECAP ********************************************************************* 2026-04-18 16:23:44.838919 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-18 16:23:44.839280 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-18 16:23:44.839582 | mon1 | 2026-04-18 16:23:44.839834 | mon1 | 2026-04-18 16:23:44.840117 | mon1 | TASKS RECAP ******************************************************************** 2026-04-18 16:23:44.840375 | mon1 | Saturday 18 April 2026 16:23:44 +0000 (0:00:01.351) 0:00:40.292 ******** 2026-04-18 16:23:44.840668 | mon1 | =============================================================================== 2026-04-18 16:23:44.840914 | mon1 | Install depedencies ---------------------------------------------------- 20.26s 2026-04-18 16:23:44.841155 | mon1 | Update apt cache -------------------------------------------------------- 9.40s 2026-04-18 16:23:44.841486 | mon1 | Create a volume group for each loop device ------------------------------ 1.53s 2026-04-18 16:23:44.841825 | mon1 | Create a logical volume for each loop device ---------------------------- 1.35s 2026-04-18 16:23:44.842076 | mon1 | Gathering Facts --------------------------------------------------------- 1.32s 2026-04-18 16:23:44.842320 | mon1 | Start loop devices ------------------------------------------------------ 0.86s 2026-04-18 16:23:44.842633 | mon1 | Gathering Facts --------------------------------------------------------- 0.83s 2026-04-18 16:23:44.842879 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.81s 2026-04-18 16:23:44.843119 | mon1 | Configure short hostname ------------------------------------------------ 0.78s 2026-04-18 16:23:44.843366 | mon1 | Set permissions on loopback devices ------------------------------------- 0.78s 2026-04-18 16:23:44.843777 | mon1 | Create devices for Ceph ------------------------------------------------- 0.70s 2026-04-18 16:23:44.844105 | mon1 | Start up service -------------------------------------------------------- 0.67s 2026-04-18 16:23:44.844349 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.36s 2026-04-18 16:23:44.844642 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.34s 2026-04-18 16:23:44.844997 | mon1 | Get list of all loopback devices ---------------------------------------- 0.25s 2026-04-18 16:23:44.845188 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-04-18 16:23:44.915450 | mon1 | INFO [default > prepare] Executed: Successful 2026-04-18 16:23:44.924967 | mon1 | INFO [default > converge] Executing 2026-04-18 16:23:45.926869 | mon1 | 2026-04-18 16:23:45.927089 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-04-18 16:23:45.927301 | mon1 | 2026-04-18 16:23:45.927574 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-18 16:23:45.927820 | mon1 | Saturday 18 April 2026 16:23:45 +0000 (0:00:00.052) 0:00:00.052 ******** 2026-04-18 16:23:46.990140 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-04-18 16:23:46.990232 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-18 16:23:46.990348 | mon1 | interpreter could change the meaning of that path. See 2026-04-18 16:23:46.990487 | mon1 | https://docs.ansible.com/ansible- 2026-04-18 16:23:46.990637 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-18 16:23:47.003377 | mon1 | ok: [mon1] 2026-04-18 16:23:47.003479 | mon1 | 2026-04-18 16:23:47.003633 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:23:47.003770 | mon1 | Saturday 18 April 2026 16:23:47 +0000 (0:00:01.076) 0:00:01.129 ******** 2026-04-18 16:23:47.362603 | mon1 | ok: [mon1] 2026-04-18 16:23:47.362684 | mon1 | 2026-04-18 16:23:47.362908 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:23:47.363161 | mon1 | Saturday 18 April 2026 16:23:47 +0000 (0:00:00.358) 0:00:01.487 ******** 2026-04-18 16:23:47.405304 | mon1 | skipping: [mon1] 2026-04-18 16:23:47.405376 | mon1 | 2026-04-18 16:23:47.405574 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-18 16:23:47.405743 | mon1 | Saturday 18 April 2026 16:23:47 +0000 (0:00:00.043) 0:00:01.531 ******** 2026-04-18 16:23:47.768964 | mon1 | changed: [mon1] 2026-04-18 16:23:47.769159 | mon1 | 2026-04-18 16:23:47.769443 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:23:47.769732 | mon1 | Saturday 18 April 2026 16:23:47 +0000 (0:00:00.363) 0:00:01.894 ******** 2026-04-18 16:23:47.871981 | mon1 | ok: [mon1] => { 2026-04-18 16:23:47.872231 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-18 16:23:47.872566 | mon1 | } 2026-04-18 16:23:47.872732 | mon1 | 2026-04-18 16:23:47.872976 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:23:47.873222 | mon1 | Saturday 18 April 2026 16:23:47 +0000 (0:00:00.103) 0:00:01.997 ******** 2026-04-18 16:23:48.772569 | mon1 | changed: [mon1] 2026-04-18 16:23:48.772763 | mon1 | 2026-04-18 16:23:48.773021 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:23:48.773273 | mon1 | Saturday 18 April 2026 16:23:48 +0000 (0:00:00.900) 0:00:02.897 ******** 2026-04-18 16:23:48.823105 | mon1 | skipping: [mon1] 2026-04-18 16:23:48.823282 | mon1 | 2026-04-18 16:23:48.823596 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:23:48.823852 | mon1 | Saturday 18 April 2026 16:23:48 +0000 (0:00:00.051) 0:00:02.949 ******** 2026-04-18 16:23:48.874410 | mon1 | skipping: [mon1] 2026-04-18 16:23:48.874643 | mon1 | 2026-04-18 16:23:48.874900 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:23:48.875149 | mon1 | Saturday 18 April 2026 16:23:48 +0000 (0:00:00.051) 0:00:03.000 ******** 2026-04-18 16:23:49.123269 | mon1 | ok: [mon1] 2026-04-18 16:23:49.123334 | mon1 | 2026-04-18 16:23:49.123490 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:23:49.123684 | mon1 | Saturday 18 April 2026 16:23:49 +0000 (0:00:00.247) 0:00:03.248 ******** 2026-04-18 16:23:50.206642 | mon1 | ok: [mon1] 2026-04-18 16:23:50.206743 | mon1 | 2026-04-18 16:23:50.207036 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:23:50.207436 | mon1 | Saturday 18 April 2026 16:23:50 +0000 (0:00:01.083) 0:00:04.332 ******** 2026-04-18 16:23:50.393359 | mon1 | ok: [mon1] => { 2026-04-18 16:23:50.393628 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz" 2026-04-18 16:23:50.393857 | mon1 | } 2026-04-18 16:23:50.394078 | mon1 | 2026-04-18 16:23:50.394334 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:23:50.394642 | mon1 | Saturday 18 April 2026 16:23:50 +0000 (0:00:00.186) 0:00:04.518 ******** 2026-04-18 16:23:51.459446 | mon1 | changed: [mon1] 2026-04-18 16:23:51.459686 | mon1 | 2026-04-18 16:23:51.459947 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:23:51.460199 | mon1 | Saturday 18 April 2026 16:23:51 +0000 (0:00:01.065) 0:00:05.584 ******** 2026-04-18 16:23:54.746219 | mon1 | changed: [mon1] 2026-04-18 16:23:54.746281 | mon1 | 2026-04-18 16:23:54.746294 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-18 16:23:54.746307 | mon1 | Saturday 18 April 2026 16:23:54 +0000 (0:00:03.285) 0:00:08.870 ******** 2026-04-18 16:23:54.785490 | mon1 | skipping: [mon1] 2026-04-18 16:23:54.785571 | mon1 | 2026-04-18 16:23:54.785585 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-18 16:23:54.785599 | mon1 | Saturday 18 April 2026 16:23:54 +0000 (0:00:00.038) 0:00:08.909 ******** 2026-04-18 16:23:54.822839 | mon1 | skipping: [mon1] 2026-04-18 16:23:54.822872 | mon1 | 2026-04-18 16:23:54.822885 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-18 16:23:54.822896 | mon1 | Saturday 18 April 2026 16:23:54 +0000 (0:00:00.038) 0:00:08.947 ******** 2026-04-18 16:23:54.857842 | mon1 | skipping: [mon1] 2026-04-18 16:23:54.857877 | mon1 | 2026-04-18 16:23:54.857891 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-18 16:23:54.857904 | mon1 | Saturday 18 April 2026 16:23:54 +0000 (0:00:00.034) 0:00:08.981 ******** 2026-04-18 16:24:02.369240 | mon1 | changed: [mon1] 2026-04-18 16:24:02.369363 | mon1 | 2026-04-18 16:24:02.369414 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-18 16:24:02.369433 | mon1 | Saturday 18 April 2026 16:24:02 +0000 (0:00:07.510) 0:00:16.492 ******** 2026-04-18 16:24:03.057151 | mon1 | changed: [mon1] 2026-04-18 16:24:03.057220 | mon1 | 2026-04-18 16:24:03.057233 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-18 16:24:03.057246 | mon1 | Saturday 18 April 2026 16:24:03 +0000 (0:00:00.688) 0:00:17.181 ******** 2026-04-18 16:24:04.188586 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-04-18 16:24:04.188708 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-18 16:24:04.188723 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-18 16:24:04.188735 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-18 16:24:04.188747 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-18 16:24:04.188759 | mon1 | 2026-04-18 16:24:04.188771 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-18 16:24:04.188783 | mon1 | Saturday 18 April 2026 16:24:04 +0000 (0:00:01.128) 0:00:18.309 ******** 2026-04-18 16:24:04.995846 | mon1 | changed: [mon1] 2026-04-18 16:24:04.995912 | mon1 | 2026-04-18 16:24:04.995927 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-18 16:24:04.995940 | mon1 | Saturday 18 April 2026 16:24:04 +0000 (0:00:00.800) 0:00:19.110 ******** 2026-04-18 16:24:04.995952 | mon1 | 2026-04-18 16:24:04.995963 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-18 16:24:04.995975 | mon1 | Saturday 18 April 2026 16:24:04 +0000 (0:00:00.008) 0:00:19.119 ******** 2026-04-18 16:24:06.144648 | mon1 | ok: [mon1] 2026-04-18 16:24:06.144708 | mon1 | 2026-04-18 16:24:06.145046 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-04-18 16:24:06.145080 | mon1 | Saturday 18 April 2026 16:24:06 +0000 (0:00:01.149) 0:00:20.269 ******** 2026-04-18 16:24:06.751593 | mon1 | changed: [mon1] 2026-04-18 16:24:06.751741 | mon1 | 2026-04-18 16:24:06.752542 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-18 16:24:06.752617 | mon1 | Saturday 18 April 2026 16:24:06 +0000 (0:00:00.607) 0:00:20.876 ******** 2026-04-18 16:24:07.460498 | mon1 | changed: [mon1] 2026-04-18 16:24:07.460550 | mon1 | 2026-04-18 16:24:07.460556 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:24:07.460561 | mon1 | Saturday 18 April 2026 16:24:07 +0000 (0:00:00.708) 0:00:21.585 ******** 2026-04-18 16:24:07.714094 | mon1 | ok: [mon1] 2026-04-18 16:24:07.714157 | mon1 | 2026-04-18 16:24:07.714168 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:24:07.714178 | mon1 | Saturday 18 April 2026 16:24:07 +0000 (0:00:00.253) 0:00:21.838 ******** 2026-04-18 16:24:07.787208 | mon1 | ok: [mon1] => { 2026-04-18 16:24:07.787364 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-18 16:24:07.787524 | mon1 | } 2026-04-18 16:24:07.787629 | mon1 | 2026-04-18 16:24:07.787746 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:24:07.787849 | mon1 | Saturday 18 April 2026 16:24:07 +0000 (0:00:00.073) 0:00:21.912 ******** 2026-04-18 16:24:08.786114 | mon1 | changed: [mon1] 2026-04-18 16:24:08.786197 | mon1 | 2026-04-18 16:24:08.786376 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:24:08.786570 | mon1 | Saturday 18 April 2026 16:24:08 +0000 (0:00:00.995) 0:00:22.907 ******** 2026-04-18 16:24:13.447386 | mon1 | changed: [mon1] 2026-04-18 16:24:13.447512 | mon1 | 2026-04-18 16:24:13.447553 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-18 16:24:13.447724 | mon1 | Saturday 18 April 2026 16:24:13 +0000 (0:00:04.665) 0:00:27.573 ******** 2026-04-18 16:24:14.523002 | mon1 | ok: [mon1] 2026-04-18 16:24:14.523091 | mon1 | 2026-04-18 16:24:14.523109 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-18 16:24:14.523252 | mon1 | Saturday 18 April 2026 16:24:14 +0000 (0:00:01.074) 0:00:28.647 ******** 2026-04-18 16:24:14.917107 | mon1 | changed: [mon1] 2026-04-18 16:24:14.917197 | mon1 | 2026-04-18 16:24:14.917212 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-18 16:24:14.917324 | mon1 | Saturday 18 April 2026 16:24:14 +0000 (0:00:00.395) 0:00:29.042 ******** 2026-04-18 16:24:15.514146 | mon1 | changed: [mon1] 2026-04-18 16:24:15.514205 | mon1 | 2026-04-18 16:24:15.514219 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-18 16:24:15.514231 | mon1 | Saturday 18 April 2026 16:24:15 +0000 (0:00:00.595) 0:00:29.638 ******** 2026-04-18 16:24:16.208526 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-04-18 16:24:16.208574 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-18 16:24:16.208581 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-18 16:24:16.208586 | mon1 | 2026-04-18 16:24:16.208591 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-18 16:24:16.208600 | mon1 | Saturday 18 April 2026 16:24:16 +0000 (0:00:00.692) 0:00:30.330 ******** 2026-04-18 16:24:16.780032 | mon1 | changed: [mon1] 2026-04-18 16:24:16.780123 | mon1 | 2026-04-18 16:24:16.780142 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-18 16:24:16.780276 | mon1 | Saturday 18 April 2026 16:24:16 +0000 (0:00:00.573) 0:00:30.904 ******** 2026-04-18 16:24:17.374186 | mon1 | changed: [mon1] 2026-04-18 16:24:17.374265 | mon1 | 2026-04-18 16:24:17.374339 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-18 16:24:17.374485 | mon1 | Saturday 18 April 2026 16:24:17 +0000 (0:00:00.586) 0:00:31.491 ******** 2026-04-18 16:24:17.374602 | mon1 | 2026-04-18 16:24:17.374739 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-18 16:24:17.374846 | mon1 | Saturday 18 April 2026 16:24:17 +0000 (0:00:00.008) 0:00:31.499 ******** 2026-04-18 16:24:18.282392 | mon1 | ok: [mon1] 2026-04-18 16:24:18.282584 | mon1 | 2026-04-18 16:24:18.282754 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-04-18 16:24:18.282907 | mon1 | Saturday 18 April 2026 16:24:18 +0000 (0:00:00.907) 0:00:32.407 ******** 2026-04-18 16:24:19.162411 | mon1 | changed: [mon1] 2026-04-18 16:24:19.162632 | mon1 | 2026-04-18 16:24:19.162887 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-18 16:24:19.163137 | mon1 | Saturday 18 April 2026 16:24:19 +0000 (0:00:00.880) 0:00:33.287 ******** 2026-04-18 16:24:19.850078 | mon1 | changed: [mon1] 2026-04-18 16:24:19.850168 | mon1 | 2026-04-18 16:24:19.850254 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-18 16:24:19.850367 | mon1 | Saturday 18 April 2026 16:24:19 +0000 (0:00:00.687) 0:00:33.975 ******** 2026-04-18 16:24:19.913442 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-04-18 16:24:19.913678 | mon1 | 2026-04-18 16:24:19.913947 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-18 16:24:19.914191 | mon1 | Saturday 18 April 2026 16:24:19 +0000 (0:00:00.063) 0:00:34.038 ******** 2026-04-18 16:24:38.842522 | mon1 | changed: [mon1] 2026-04-18 16:24:38.842601 | mon1 | 2026-04-18 16:24:38.842610 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-18 16:24:38.842618 | mon1 | Saturday 18 April 2026 16:24:38 +0000 (0:00:18.928) 0:00:52.967 ******** 2026-04-18 16:24:39.655032 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-04-18 16:24:39.655108 | mon1 | ok: [mon1] => (item=ssh) 2026-04-18 16:24:39.655210 | mon1 | 2026-04-18 16:24:39.655327 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-18 16:24:39.655443 | mon1 | Saturday 18 April 2026 16:24:39 +0000 (0:00:00.812) 0:00:53.780 ******** 2026-04-18 16:24:40.051670 | mon1 | changed: [mon1] 2026-04-18 16:24:40.051742 | mon1 | 2026-04-18 16:24:40.051893 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-18 16:24:40.052180 | mon1 | Saturday 18 April 2026 16:24:40 +0000 (0:00:00.396) 0:00:54.176 ******** 2026-04-18 16:24:40.304441 | mon1 | ok: [mon1] 2026-04-18 16:24:40.304735 | mon1 | 2026-04-18 16:24:40.305002 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-18 16:24:40.305250 | mon1 | Saturday 18 April 2026 16:24:40 +0000 (0:00:00.253) 0:00:54.429 ******** 2026-04-18 16:24:40.875625 | mon1 | changed: [mon1] 2026-04-18 16:24:40.875696 | mon1 | 2026-04-18 16:24:40.875718 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-18 16:24:40.875973 | mon1 | Saturday 18 April 2026 16:24:40 +0000 (0:00:00.570) 0:00:55.000 ******** 2026-04-18 16:24:41.297339 | mon1 | changed: [mon1] 2026-04-18 16:24:41.297572 | mon1 | 2026-04-18 16:24:41.297844 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-04-18 16:24:41.298073 | mon1 | Saturday 18 April 2026 16:24:41 +0000 (0:00:00.422) 0:00:55.422 ******** 2026-04-18 16:24:41.432280 | mon1 | ok: [mon1] 2026-04-18 16:24:41.432480 | mon1 | 2026-04-18 16:24:41.432790 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-04-18 16:24:41.433066 | mon1 | Saturday 18 April 2026 16:24:41 +0000 (0:00:00.135) 0:00:55.558 ******** 2026-04-18 16:24:41.703602 | mon1 | ok: [mon1] => (item=mon1) 2026-04-18 16:24:41.703696 | mon1 | 2026-04-18 16:24:41.703938 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-04-18 16:24:41.704189 | mon1 | Saturday 18 April 2026 16:24:41 +0000 (0:00:00.270) 0:00:55.829 ******** 2026-04-18 16:24:41.757634 | mon1 | ok: [mon1] 2026-04-18 16:24:41.757873 | mon1 | 2026-04-18 16:24:41.758172 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-04-18 16:24:41.758490 | mon1 | Saturday 18 April 2026 16:24:41 +0000 (0:00:00.053) 0:00:55.882 ******** 2026-04-18 16:24:41.884216 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-04-18 16:24:41.884285 | mon1 | 2026-04-18 16:24:41.884383 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-04-18 16:24:41.884525 | mon1 | Saturday 18 April 2026 16:24:41 +0000 (0:00:00.126) 0:00:56.009 ******** 2026-04-18 16:24:42.226049 | mon1 | changed: [mon1] 2026-04-18 16:24:42.226268 | mon1 | 2026-04-18 16:24:42.226574 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-04-18 16:24:42.226852 | mon1 | Saturday 18 April 2026 16:24:42 +0000 (0:00:00.341) 0:00:56.351 ******** 2026-04-18 16:24:43.028153 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-04-18 16:24:43.028424 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-04-18 16:24:43.028767 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-04-18 16:24:43.029033 | mon1 | 2026-04-18 16:24:43.029337 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-04-18 16:24:43.029708 | mon1 | Saturday 18 April 2026 16:24:43 +0000 (0:00:00.801) 0:00:57.152 ******** 2026-04-18 16:26:17.154103 | mon1 | ok: [mon1] 2026-04-18 16:26:17.154220 | mon1 | 2026-04-18 16:26:17.154235 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-04-18 16:26:17.154248 | mon1 | Saturday 18 April 2026 16:26:17 +0000 (0:01:34.125) 0:02:31.278 ******** 2026-04-18 16:26:17.439110 | mon1 | changed: [mon1] 2026-04-18 16:26:17.439181 | mon1 | 2026-04-18 16:26:17.439195 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-04-18 16:26:17.439208 | mon1 | Saturday 18 April 2026 16:26:17 +0000 (0:00:00.284) 0:02:31.563 ******** 2026-04-18 16:26:17.485581 | mon1 | ok: [mon1] 2026-04-18 16:26:17.485656 | mon1 | 2026-04-18 16:26:17.485677 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-18 16:26:17.485908 | mon1 | Saturday 18 April 2026 16:26:17 +0000 (0:00:00.047) 0:02:31.610 ******** 2026-04-18 16:26:17.559080 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-04-18 16:26:17.559136 | mon1 | 2026-04-18 16:26:17.559290 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-18 16:26:17.559345 | mon1 | Saturday 18 April 2026 16:26:17 +0000 (0:00:00.073) 0:02:31.684 ******** 2026-04-18 16:26:23.556618 | mon1 | ok: [mon1] 2026-04-18 16:26:23.556707 | mon1 | 2026-04-18 16:26:23.556722 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-18 16:26:23.556734 | mon1 | Saturday 18 April 2026 16:26:23 +0000 (0:00:05.998) 0:02:37.682 ******** 2026-04-18 16:26:23.620189 | mon1 | ok: [mon1] => (item=mon1) 2026-04-18 16:26:23.620262 | mon1 | 2026-04-18 16:26:23.620276 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-18 16:26:23.620288 | mon1 | Saturday 18 April 2026 16:26:23 +0000 (0:00:00.062) 0:02:37.744 ******** 2026-04-18 16:26:24.061976 | mon1 | ok: [mon1] 2026-04-18 16:26:24.062046 | mon1 | 2026-04-18 16:26:24.062060 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-18 16:26:24.062074 | mon1 | Saturday 18 April 2026 16:26:24 +0000 (0:00:00.441) 0:02:38.186 ******** 2026-04-18 16:26:31.016274 | mon1 | ok: [mon1] 2026-04-18 16:26:31.016339 | mon1 | 2026-04-18 16:26:31.016353 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-04-18 16:26:31.016366 | mon1 | Saturday 18 April 2026 16:26:31 +0000 (0:00:06.954) 0:02:45.140 ******** 2026-04-18 16:26:42.869007 | mon1 | changed: [mon1] 2026-04-18 16:26:42.869105 | mon1 | 2026-04-18 16:26:42.869158 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-04-18 16:26:42.869523 | mon1 | Saturday 18 April 2026 16:26:42 +0000 (0:00:11.850) 0:02:56.991 ******** 2026-04-18 16:26:57.265112 | mon1 | ok: [mon1] 2026-04-18 16:26:57.265269 | mon1 | 2026-04-18 16:26:57.265595 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-18 16:26:57.265848 | mon1 | Saturday 18 April 2026 16:26:57 +0000 (0:00:14.398) 0:03:11.389 ******** 2026-04-18 16:26:57.337398 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-04-18 16:26:57.337525 | mon1 | 2026-04-18 16:26:57.337549 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-18 16:26:57.337811 | mon1 | Saturday 18 April 2026 16:26:57 +0000 (0:00:00.072) 0:03:11.462 ******** 2026-04-18 16:26:57.387871 | mon1 | skipping: [mon1] 2026-04-18 16:26:57.388206 | mon1 | 2026-04-18 16:26:57.388687 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-18 16:26:57.389002 | mon1 | Saturday 18 April 2026 16:26:57 +0000 (0:00:00.049) 0:03:11.512 ******** 2026-04-18 16:26:57.442742 | mon1 | skipping: [mon1] => (item=mon1) 2026-04-18 16:26:57.442971 | mon1 | skipping: [mon1] 2026-04-18 16:26:57.443191 | mon1 | 2026-04-18 16:26:57.443441 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-18 16:26:57.443753 | mon1 | Saturday 18 April 2026 16:26:57 +0000 (0:00:00.055) 0:03:11.568 ******** 2026-04-18 16:26:57.757693 | mon1 | ok: [mon1] 2026-04-18 16:26:57.757887 | mon1 | 2026-04-18 16:26:57.758142 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-18 16:26:57.758395 | mon1 | Saturday 18 April 2026 16:26:57 +0000 (0:00:00.314) 0:03:11.883 ******** 2026-04-18 16:27:04.640543 | mon1 | ok: [mon1] 2026-04-18 16:27:04.640726 | mon1 | 2026-04-18 16:27:04.640987 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-04-18 16:27:04.641235 | mon1 | Saturday 18 April 2026 16:27:04 +0000 (0:00:06.882) 0:03:18.766 ******** 2026-04-18 16:27:17.086562 | mon1 | changed: [mon1] 2026-04-18 16:27:17.086675 | mon1 | 2026-04-18 16:27:17.087240 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-04-18 16:27:17.087306 | mon1 | Saturday 18 April 2026 16:27:17 +0000 (0:00:12.445) 0:03:31.212 ******** 2026-04-18 16:27:23.454547 | mon1 | ok: [mon1] 2026-04-18 16:27:23.454621 | mon1 | 2026-04-18 16:27:23.454635 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-04-18 16:27:23.454647 | mon1 | Saturday 18 April 2026 16:27:23 +0000 (0:00:06.367) 0:03:37.579 ******** 2026-04-18 16:27:29.699508 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-04-18 16:27:29.699566 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-04-18 16:27:29.699575 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-04-18 16:27:29.699582 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-04-18 16:27:29.699589 | mon1 | 2026-04-18 16:27:29.699602 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-04-18 16:27:29.699825 | mon1 | 2026-04-18 16:27:29.700064 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-18 16:27:29.700311 | mon1 | Saturday 18 April 2026 16:27:29 +0000 (0:00:06.244) 0:03:43.823 ******** 2026-04-18 16:27:31.928574 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-04-18 16:27:31.928721 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-18 16:27:31.930045 | mon1 | interpreter could change the meaning of that path. See 2026-04-18 16:27:31.930212 | mon1 | https://docs.ansible.com/ansible- 2026-04-18 16:27:31.930374 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-18 16:27:31.941808 | mon1 | ok: [osd1] 2026-04-18 16:27:31.941849 | mon1 | 2026-04-18 16:27:31.942004 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:27:31.942117 | mon1 | Saturday 18 April 2026 16:27:31 +0000 (0:00:02.244) 0:03:46.067 ******** 2026-04-18 16:27:32.209988 | mon1 | ok: [osd1] 2026-04-18 16:27:32.210081 | mon1 | 2026-04-18 16:27:32.210156 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:27:32.210284 | mon1 | Saturday 18 April 2026 16:27:32 +0000 (0:00:00.267) 0:03:46.335 ******** 2026-04-18 16:27:32.251976 | mon1 | skipping: [osd1] 2026-04-18 16:27:32.252018 | mon1 | 2026-04-18 16:27:32.252162 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-18 16:27:32.252282 | mon1 | Saturday 18 April 2026 16:27:32 +0000 (0:00:00.039) 0:03:46.374 ******** 2026-04-18 16:27:32.498716 | mon1 | changed: [osd1] 2026-04-18 16:27:32.498796 | mon1 | 2026-04-18 16:27:32.498848 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:27:32.498984 | mon1 | Saturday 18 April 2026 16:27:32 +0000 (0:00:00.249) 0:03:46.624 ******** 2026-04-18 16:27:32.572318 | mon1 | ok: [osd1] => { 2026-04-18 16:27:32.572493 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-18 16:27:32.572652 | mon1 | } 2026-04-18 16:27:32.572796 | mon1 | 2026-04-18 16:27:32.572965 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:27:32.573129 | mon1 | Saturday 18 April 2026 16:27:32 +0000 (0:00:00.073) 0:03:46.697 ******** 2026-04-18 16:27:33.258117 | mon1 | changed: [osd1] 2026-04-18 16:27:33.258200 | mon1 | 2026-04-18 16:27:33.258336 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:27:33.258575 | mon1 | Saturday 18 April 2026 16:27:33 +0000 (0:00:00.683) 0:03:47.381 ******** 2026-04-18 16:27:33.308135 | mon1 | skipping: [osd1] 2026-04-18 16:27:33.308199 | mon1 | 2026-04-18 16:27:33.308342 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:27:33.308444 | mon1 | Saturday 18 April 2026 16:27:33 +0000 (0:00:00.052) 0:03:47.433 ******** 2026-04-18 16:27:33.359140 | mon1 | skipping: [osd1] 2026-04-18 16:27:33.359213 | mon1 | 2026-04-18 16:27:33.359312 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:27:33.359420 | mon1 | Saturday 18 April 2026 16:27:33 +0000 (0:00:00.050) 0:03:47.484 ******** 2026-04-18 16:27:33.620993 | mon1 | ok: [osd1] 2026-04-18 16:27:33.621077 | mon1 | 2026-04-18 16:27:33.621092 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:27:33.621231 | mon1 | Saturday 18 April 2026 16:27:33 +0000 (0:00:00.260) 0:03:47.745 ******** 2026-04-18 16:27:34.959553 | mon1 | ok: [osd1] 2026-04-18 16:27:34.959621 | mon1 | 2026-04-18 16:27:34.959633 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:27:34.959643 | mon1 | Saturday 18 April 2026 16:27:34 +0000 (0:00:01.335) 0:03:49.081 ******** 2026-04-18 16:27:35.040756 | mon1 | ok: [osd1] => { 2026-04-18 16:27:35.040825 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz" 2026-04-18 16:27:35.040910 | mon1 | } 2026-04-18 16:27:35.041009 | mon1 | 2026-04-18 16:27:35.041141 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:27:35.041243 | mon1 | Saturday 18 April 2026 16:27:35 +0000 (0:00:00.084) 0:03:49.165 ******** 2026-04-18 16:27:35.913586 | mon1 | changed: [osd1] 2026-04-18 16:27:35.913666 | mon1 | 2026-04-18 16:27:35.913717 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:27:35.913848 | mon1 | Saturday 18 April 2026 16:27:35 +0000 (0:00:00.873) 0:03:50.039 ******** 2026-04-18 16:27:38.849834 | mon1 | changed: [osd1] 2026-04-18 16:27:38.849923 | mon1 | 2026-04-18 16:27:38.849937 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-18 16:27:38.849950 | mon1 | Saturday 18 April 2026 16:27:38 +0000 (0:00:02.935) 0:03:52.974 ******** 2026-04-18 16:27:38.884001 | mon1 | skipping: [osd1] 2026-04-18 16:27:38.884087 | mon1 | 2026-04-18 16:27:38.884166 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-18 16:27:38.884278 | mon1 | Saturday 18 April 2026 16:27:38 +0000 (0:00:00.032) 0:03:53.007 ******** 2026-04-18 16:27:38.918298 | mon1 | skipping: [osd1] 2026-04-18 16:27:38.918350 | mon1 | 2026-04-18 16:27:38.918484 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-18 16:27:38.918617 | mon1 | Saturday 18 April 2026 16:27:38 +0000 (0:00:00.037) 0:03:53.044 ******** 2026-04-18 16:27:38.954954 | mon1 | skipping: [osd1] 2026-04-18 16:27:38.955026 | mon1 | 2026-04-18 16:27:38.955136 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-18 16:27:38.955317 | mon1 | Saturday 18 April 2026 16:27:38 +0000 (0:00:00.036) 0:03:53.080 ******** 2026-04-18 16:27:46.492071 | mon1 | changed: [osd1] 2026-04-18 16:27:46.492141 | mon1 | 2026-04-18 16:27:46.492155 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-18 16:27:46.492167 | mon1 | Saturday 18 April 2026 16:27:46 +0000 (0:00:07.535) 0:04:00.616 ******** 2026-04-18 16:27:47.077599 | mon1 | changed: [osd1] 2026-04-18 16:27:47.078280 | mon1 | 2026-04-18 16:27:47.078576 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-18 16:27:47.078831 | mon1 | Saturday 18 April 2026 16:27:47 +0000 (0:00:00.586) 0:04:01.202 ******** 2026-04-18 16:27:48.217130 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-04-18 16:27:48.217434 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-18 16:27:48.217844 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-18 16:27:48.218203 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-18 16:27:48.218641 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-18 16:27:48.218936 | mon1 | 2026-04-18 16:27:48.219238 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-18 16:27:48.219495 | mon1 | Saturday 18 April 2026 16:27:48 +0000 (0:00:01.140) 0:04:02.342 ******** 2026-04-18 16:27:48.927490 | mon1 | changed: [osd1] 2026-04-18 16:27:48.927659 | mon1 | 2026-04-18 16:27:48.927957 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-18 16:27:48.928202 | mon1 | Saturday 18 April 2026 16:27:48 +0000 (0:00:00.700) 0:04:03.043 ******** 2026-04-18 16:27:48.928419 | mon1 | 2026-04-18 16:27:48.928941 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-18 16:27:48.929025 | mon1 | Saturday 18 April 2026 16:27:48 +0000 (0:00:00.009) 0:04:03.052 ******** 2026-04-18 16:27:49.843514 | mon1 | ok: [osd1] 2026-04-18 16:27:49.843603 | mon1 | 2026-04-18 16:27:49.843617 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-04-18 16:27:49.843631 | mon1 | Saturday 18 April 2026 16:27:49 +0000 (0:00:00.915) 0:04:03.967 ******** 2026-04-18 16:27:50.430588 | mon1 | changed: [osd1] 2026-04-18 16:27:50.430670 | mon1 | 2026-04-18 16:27:50.431058 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-18 16:27:50.431092 | mon1 | Saturday 18 April 2026 16:27:50 +0000 (0:00:00.587) 0:04:04.555 ******** 2026-04-18 16:27:51.162700 | mon1 | changed: [osd1] 2026-04-18 16:27:51.162795 | mon1 | 2026-04-18 16:27:51.163233 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:27:51.163318 | mon1 | Saturday 18 April 2026 16:27:51 +0000 (0:00:00.731) 0:04:05.287 ******** 2026-04-18 16:27:51.417239 | mon1 | ok: [osd1] 2026-04-18 16:27:51.417315 | mon1 | 2026-04-18 16:27:51.417328 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:27:51.417342 | mon1 | Saturday 18 April 2026 16:27:51 +0000 (0:00:00.253) 0:04:05.541 ******** 2026-04-18 16:27:51.484854 | mon1 | ok: [osd1] => { 2026-04-18 16:27:51.484935 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-18 16:27:51.484949 | mon1 | } 2026-04-18 16:27:51.484963 | mon1 | 2026-04-18 16:27:51.484991 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:27:51.485005 | mon1 | Saturday 18 April 2026 16:27:51 +0000 (0:00:00.067) 0:04:05.608 ******** 2026-04-18 16:27:52.395223 | mon1 | changed: [osd1] 2026-04-18 16:27:52.395287 | mon1 | 2026-04-18 16:27:52.395302 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:27:52.395315 | mon1 | Saturday 18 April 2026 16:27:52 +0000 (0:00:00.910) 0:04:06.518 ******** 2026-04-18 16:27:57.008238 | mon1 | changed: [osd1] 2026-04-18 16:27:57.008345 | mon1 | 2026-04-18 16:27:57.008356 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-18 16:27:57.008366 | mon1 | Saturday 18 April 2026 16:27:57 +0000 (0:00:04.613) 0:04:11.131 ******** 2026-04-18 16:27:58.144182 | mon1 | ok: [osd1] 2026-04-18 16:27:58.144251 | mon1 | 2026-04-18 16:27:58.144265 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-18 16:27:58.144278 | mon1 | Saturday 18 April 2026 16:27:58 +0000 (0:00:01.136) 0:04:12.268 ******** 2026-04-18 16:27:58.444001 | mon1 | changed: [osd1] 2026-04-18 16:27:58.444088 | mon1 | 2026-04-18 16:27:58.444097 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-18 16:27:58.444106 | mon1 | Saturday 18 April 2026 16:27:58 +0000 (0:00:00.299) 0:04:12.568 ******** 2026-04-18 16:27:59.056573 | mon1 | changed: [osd1] 2026-04-18 16:27:59.056655 | mon1 | 2026-04-18 16:27:59.056670 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-18 16:27:59.056684 | mon1 | Saturday 18 April 2026 16:27:59 +0000 (0:00:00.612) 0:04:13.180 ******** 2026-04-18 16:27:59.752895 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-04-18 16:27:59.752960 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-18 16:27:59.752970 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-18 16:27:59.752978 | mon1 | 2026-04-18 16:27:59.752985 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-18 16:27:59.752993 | mon1 | Saturday 18 April 2026 16:27:59 +0000 (0:00:00.696) 0:04:13.876 ******** 2026-04-18 16:28:00.326094 | mon1 | changed: [osd1] 2026-04-18 16:28:00.326154 | mon1 | 2026-04-18 16:28:00.326167 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-18 16:28:00.326180 | mon1 | Saturday 18 April 2026 16:28:00 +0000 (0:00:00.573) 0:04:14.450 ******** 2026-04-18 16:28:00.936601 | mon1 | changed: [osd1] 2026-04-18 16:28:00.936661 | mon1 | 2026-04-18 16:28:00.936674 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-18 16:28:00.936687 | mon1 | Saturday 18 April 2026 16:28:00 +0000 (0:00:00.600) 0:04:15.050 ******** 2026-04-18 16:28:00.936698 | mon1 | 2026-04-18 16:28:00.936709 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-18 16:28:00.936726 | mon1 | Saturday 18 April 2026 16:28:00 +0000 (0:00:00.008) 0:04:15.059 ******** 2026-04-18 16:28:01.874216 | mon1 | ok: [osd1] 2026-04-18 16:28:01.874283 | mon1 | 2026-04-18 16:28:01.874298 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-04-18 16:28:01.874310 | mon1 | Saturday 18 April 2026 16:28:01 +0000 (0:00:00.938) 0:04:15.998 ******** 2026-04-18 16:28:02.951298 | mon1 | changed: [osd1] 2026-04-18 16:28:02.951363 | mon1 | 2026-04-18 16:28:02.951377 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-18 16:28:02.951390 | mon1 | Saturday 18 April 2026 16:28:02 +0000 (0:00:01.077) 0:04:17.075 ******** 2026-04-18 16:28:03.676531 | mon1 | changed: [osd1] 2026-04-18 16:28:03.677361 | mon1 | 2026-04-18 16:28:03.677387 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-18 16:28:03.677400 | mon1 | Saturday 18 April 2026 16:28:03 +0000 (0:00:00.726) 0:04:17.801 ******** 2026-04-18 16:28:03.736592 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-04-18 16:28:03.736646 | mon1 | 2026-04-18 16:28:03.736665 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-18 16:28:03.736909 | mon1 | Saturday 18 April 2026 16:28:03 +0000 (0:00:00.059) 0:04:17.861 ******** 2026-04-18 16:28:04.719615 | mon1 | ok: [osd1] 2026-04-18 16:28:04.719680 | mon1 | 2026-04-18 16:28:04.719694 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-18 16:28:04.719865 | mon1 | Saturday 18 April 2026 16:28:04 +0000 (0:00:00.982) 0:04:18.844 ******** 2026-04-18 16:28:05.550574 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-04-18 16:28:05.550674 | mon1 | ok: [osd1] => (item=ssh) 2026-04-18 16:28:05.550686 | mon1 | 2026-04-18 16:28:05.550696 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-18 16:28:05.550713 | mon1 | Saturday 18 April 2026 16:28:05 +0000 (0:00:00.830) 0:04:19.675 ******** 2026-04-18 16:28:05.933038 | mon1 | changed: [osd1] 2026-04-18 16:28:05.933082 | mon1 | 2026-04-18 16:28:05.933087 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-18 16:28:05.933092 | mon1 | Saturday 18 April 2026 16:28:05 +0000 (0:00:00.382) 0:04:20.058 ******** 2026-04-18 16:28:06.174529 | mon1 | ok: [osd1] 2026-04-18 16:28:06.174583 | mon1 | 2026-04-18 16:28:06.174594 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-18 16:28:06.174605 | mon1 | Saturday 18 April 2026 16:28:06 +0000 (0:00:00.240) 0:04:20.298 ******** 2026-04-18 16:28:06.559557 | mon1 | changed: [osd1] 2026-04-18 16:28:06.559616 | mon1 | 2026-04-18 16:28:06.559623 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-18 16:28:06.559997 | mon1 | Saturday 18 April 2026 16:28:06 +0000 (0:00:00.385) 0:04:20.684 ******** 2026-04-18 16:28:06.825749 | mon1 | changed: [osd1] 2026-04-18 16:28:06.825833 | mon1 | 2026-04-18 16:28:06.825849 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-04-18 16:28:06.825872 | mon1 | Saturday 18 April 2026 16:28:06 +0000 (0:00:00.266) 0:04:20.950 ******** 2026-04-18 16:28:07.098631 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-04-18 16:28:07.098695 | mon1 | 2026-04-18 16:28:07.098706 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-04-18 16:28:07.098721 | mon1 | Saturday 18 April 2026 16:28:07 +0000 (0:00:00.272) 0:04:21.223 ******** 2026-04-18 16:28:07.151449 | mon1 | ok: [osd1] 2026-04-18 16:28:07.151555 | mon1 | 2026-04-18 16:28:07.151566 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-18 16:28:07.151576 | mon1 | Saturday 18 April 2026 16:28:07 +0000 (0:00:00.053) 0:04:21.276 ******** 2026-04-18 16:28:07.218577 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-04-18 16:28:07.218645 | mon1 | 2026-04-18 16:28:07.218651 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-18 16:28:07.218814 | mon1 | Saturday 18 April 2026 16:28:07 +0000 (0:00:00.067) 0:04:21.343 ******** 2026-04-18 16:28:13.525834 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-18 16:28:13.525896 | mon1 | 2026-04-18 16:28:13.525910 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-18 16:28:13.525923 | mon1 | Saturday 18 April 2026 16:28:13 +0000 (0:00:06.306) 0:04:27.650 ******** 2026-04-18 16:28:13.583628 | mon1 | ok: [osd1] => (item=osd1) 2026-04-18 16:28:13.583702 | mon1 | 2026-04-18 16:28:13.583717 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-18 16:28:13.583731 | mon1 | Saturday 18 April 2026 16:28:13 +0000 (0:00:00.058) 0:04:27.709 ******** 2026-04-18 16:28:13.908387 | mon1 | changed: [osd1] 2026-04-18 16:28:13.908447 | mon1 | 2026-04-18 16:28:13.908490 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-18 16:28:13.908508 | mon1 | Saturday 18 April 2026 16:28:13 +0000 (0:00:00.323) 0:04:28.033 ******** 2026-04-18 16:28:23.328663 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-18 16:28:23.328748 | mon1 | 2026-04-18 16:28:23.328768 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-04-18 16:28:23.329074 | mon1 | Saturday 18 April 2026 16:28:23 +0000 (0:00:09.420) 0:04:37.453 ******** 2026-04-18 16:28:24.995521 | mon1 | ok: [osd1] 2026-04-18 16:28:24.995572 | mon1 | 2026-04-18 16:28:24.995586 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-04-18 16:28:24.995599 | mon1 | Saturday 18 April 2026 16:28:24 +0000 (0:00:01.666) 0:04:39.120 ******** 2026-04-18 16:29:08.379421 | mon1 | ok: [osd1] 2026-04-18 16:29:08.379522 | mon1 | 2026-04-18 16:29:08.379537 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-04-18 16:29:08.379573 | mon1 | Saturday 18 April 2026 16:29:08 +0000 (0:00:43.383) 0:05:22.504 ******** 2026-04-18 16:30:43.443139 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-04-18 16:30:43.443236 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-04-18 16:30:43.443295 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-04-18 16:30:43.443682 | mon1 | 2026-04-18 16:30:43.443731 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-04-18 16:30:43.443738 | mon1 | Saturday 18 April 2026 16:30:43 +0000 (0:01:35.063) 0:06:57.567 ******** 2026-04-18 16:30:49.842314 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-18 16:30:49.842566 | mon1 | 2026-04-18 16:30:49.842825 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-04-18 16:30:49.843141 | mon1 | Saturday 18 April 2026 16:30:49 +0000 (0:00:06.398) 0:07:03.966 ******** 2026-04-18 16:30:56.256108 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-18 16:30:56.256157 | mon1 | 2026-04-18 16:30:56.256163 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-04-18 16:30:56.256170 | mon1 | Saturday 18 April 2026 16:30:56 +0000 (0:00:06.411) 0:07:10.378 ******** 2026-04-18 16:30:56.355098 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-04-18 16:30:56.355151 | mon1 | 2026-04-18 16:30:56.355165 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-04-18 16:30:56.355178 | mon1 | Saturday 18 April 2026 16:30:56 +0000 (0:00:00.101) 0:07:10.479 ******** 2026-04-18 16:30:56.406064 | mon1 | ok: [osd1] 2026-04-18 16:30:56.406115 | mon1 | 2026-04-18 16:30:56.406129 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-04-18 16:30:56.406142 | mon1 | Saturday 18 April 2026 16:30:56 +0000 (0:00:00.050) 0:07:10.530 ******** 2026-04-18 16:31:02.724527 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-18 16:31:02.725252 | mon1 | 2026-04-18 16:31:02.725302 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-04-18 16:31:02.725317 | mon1 | Saturday 18 April 2026 16:31:02 +0000 (0:00:06.317) 0:07:16.848 ******** 2026-04-18 16:31:02.774289 | mon1 | ok: [osd1] 2026-04-18 16:31:02.774351 | mon1 | 2026-04-18 16:31:02.774366 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-04-18 16:31:02.774378 | mon1 | Saturday 18 April 2026 16:31:02 +0000 (0:00:00.050) 0:07:16.899 ******** 2026-04-18 16:31:02.814647 | mon1 | skipping: [osd1] => (item=1) 2026-04-18 16:31:02.814726 | mon1 | skipping: [osd1] => (item=1) 2026-04-18 16:31:02.814739 | mon1 | skipping: [osd1] => (item=1) 2026-04-18 16:31:02.814750 | mon1 | skipping: [osd1] 2026-04-18 16:31:02.814769 | mon1 | 2026-04-18 16:31:02.815153 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-04-18 16:31:02.815189 | mon1 | Saturday 18 April 2026 16:31:02 +0000 (0:00:00.040) 0:07:16.939 ******** 2026-04-18 16:31:02.853583 | mon1 | skipping: [osd1] 2026-04-18 16:31:02.853638 | mon1 | 2026-04-18 16:31:02.856505 | mon1 | PLAY RECAP ********************************************************************* 2026-04-18 16:31:02.856531 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-04-18 16:31:02.856540 | mon1 | osd1 : ok=53 changed=23 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-04-18 16:31:02.856548 | mon1 | 2026-04-18 16:31:02.856555 | mon1 | 2026-04-18 16:31:02.856563 | mon1 | TASKS RECAP ******************************************************************** 2026-04-18 16:31:02.856571 | mon1 | Saturday 18 April 2026 16:31:02 +0000 (0:00:00.040) 0:07:16.979 ******** 2026-04-18 16:31:02.856578 | mon1 | =============================================================================== 2026-04-18 16:31:02.856585 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 95.06s 2026-04-18 16:31:02.856607 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 94.13s 2026-04-18 16:31:02.856613 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 43.38s 2026-04-18 16:31:02.856618 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 18.93s 2026-04-18 16:31:02.856623 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.40s 2026-04-18 16:31:02.856628 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.45s 2026-04-18 16:31:02.856634 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 11.85s 2026-04-18 16:31:02.856639 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 9.42s 2026-04-18 16:31:02.856644 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.54s 2026-04-18 16:31:02.856649 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.51s 2026-04-18 16:31:02.856654 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.95s 2026-04-18 16:31:02.856708 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.88s 2026-04-18 16:31:02.856902 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.41s 2026-04-18 16:31:02.857087 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.40s 2026-04-18 16:31:02.857280 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.37s 2026-04-18 16:31:02.857492 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.32s 2026-04-18 16:31:02.857695 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.31s 2026-04-18 16:31:02.857882 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 6.24s 2026-04-18 16:31:02.858071 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.00s 2026-04-18 16:31:02.858256 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.67s 2026-04-18 16:31:02.984222 | mon1 | INFO [default > converge] Executed: Successful 2026-04-18 16:31:02.995774 | mon1 | INFO [default > idempotence] Executing 2026-04-18 16:31:03.960173 | mon1 | 2026-04-18 16:31:03.960603 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-04-18 16:31:03.960906 | mon1 | 2026-04-18 16:31:03.961211 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-18 16:31:03.961545 | mon1 | Saturday 18 April 2026 16:31:03 +0000 (0:00:00.052) 0:00:00.052 ******** 2026-04-18 16:31:05.158295 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-04-18 16:31:05.158709 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-18 16:31:05.159027 | mon1 | interpreter could change the meaning of that path. See 2026-04-18 16:31:05.159358 | mon1 | https://docs.ansible.com/ansible- 2026-04-18 16:31:05.159822 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-18 16:31:05.172536 | mon1 | ok: [mon1] 2026-04-18 16:31:05.172846 | mon1 | 2026-04-18 16:31:05.173158 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:31:05.173500 | mon1 | Saturday 18 April 2026 16:31:05 +0000 (0:00:01.212) 0:00:01.264 ******** 2026-04-18 16:31:05.517608 | mon1 | ok: [mon1] 2026-04-18 16:31:05.517976 | mon1 | 2026-04-18 16:31:05.518304 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:31:05.518656 | mon1 | Saturday 18 April 2026 16:31:05 +0000 (0:00:00.344) 0:00:01.609 ******** 2026-04-18 16:31:05.555303 | mon1 | skipping: [mon1] 2026-04-18 16:31:05.555769 | mon1 | 2026-04-18 16:31:05.556177 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-18 16:31:05.556602 | mon1 | Saturday 18 April 2026 16:31:05 +0000 (0:00:00.038) 0:00:01.647 ******** 2026-04-18 16:31:05.933218 | mon1 | ok: [mon1] 2026-04-18 16:31:05.933612 | mon1 | 2026-04-18 16:31:05.933970 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:31:05.934335 | mon1 | Saturday 18 April 2026 16:31:05 +0000 (0:00:00.377) 0:00:02.025 ******** 2026-04-18 16:31:06.010930 | mon1 | ok: [mon1] => { 2026-04-18 16:31:06.011120 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-18 16:31:06.011273 | mon1 | } 2026-04-18 16:31:06.011421 | mon1 | 2026-04-18 16:31:06.011609 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:31:06.011773 | mon1 | Saturday 18 April 2026 16:31:06 +0000 (0:00:00.078) 0:00:02.103 ******** 2026-04-18 16:31:06.505742 | mon1 | ok: [mon1] 2026-04-18 16:31:06.506094 | mon1 | 2026-04-18 16:31:06.506408 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:31:06.506746 | mon1 | Saturday 18 April 2026 16:31:06 +0000 (0:00:00.494) 0:00:02.597 ******** 2026-04-18 16:31:06.555641 | mon1 | skipping: [mon1] 2026-04-18 16:31:06.555950 | mon1 | 2026-04-18 16:31:06.556316 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:31:06.556662 | mon1 | Saturday 18 April 2026 16:31:06 +0000 (0:00:00.050) 0:00:02.648 ******** 2026-04-18 16:31:06.603007 | mon1 | skipping: [mon1] 2026-04-18 16:31:06.603308 | mon1 | 2026-04-18 16:31:06.603661 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:31:06.604060 | mon1 | Saturday 18 April 2026 16:31:06 +0000 (0:00:00.047) 0:00:02.695 ******** 2026-04-18 16:31:06.852687 | mon1 | ok: [mon1] 2026-04-18 16:31:06.852790 | mon1 | 2026-04-18 16:31:06.853255 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:31:06.853308 | mon1 | Saturday 18 April 2026 16:31:06 +0000 (0:00:00.248) 0:00:02.944 ******** 2026-04-18 16:31:08.049619 | mon1 | ok: [mon1] 2026-04-18 16:31:08.049692 | mon1 | 2026-04-18 16:31:08.049723 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:31:08.049981 | mon1 | Saturday 18 April 2026 16:31:08 +0000 (0:00:01.196) 0:00:04.141 ******** 2026-04-18 16:31:08.255349 | mon1 | ok: [mon1] => { 2026-04-18 16:31:08.255398 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz" 2026-04-18 16:31:08.255404 | mon1 | } 2026-04-18 16:31:08.255410 | mon1 | 2026-04-18 16:31:08.255415 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:31:08.255421 | mon1 | Saturday 18 April 2026 16:31:08 +0000 (0:00:00.205) 0:00:04.347 ******** 2026-04-18 16:31:08.798636 | mon1 | ok: [mon1] 2026-04-18 16:31:08.798717 | mon1 | 2026-04-18 16:31:08.798731 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:31:08.798744 | mon1 | Saturday 18 April 2026 16:31:08 +0000 (0:00:00.542) 0:00:04.889 ******** 2026-04-18 16:31:11.280807 | mon1 | ok: [mon1] 2026-04-18 16:31:11.280953 | mon1 | 2026-04-18 16:31:11.281255 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-18 16:31:11.281502 | mon1 | Saturday 18 April 2026 16:31:11 +0000 (0:00:02.483) 0:00:07.372 ******** 2026-04-18 16:31:11.315555 | mon1 | skipping: [mon1] 2026-04-18 16:31:11.315614 | mon1 | 2026-04-18 16:31:11.315717 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-18 16:31:11.316034 | mon1 | Saturday 18 April 2026 16:31:11 +0000 (0:00:00.034) 0:00:07.407 ******** 2026-04-18 16:31:11.351683 | mon1 | skipping: [mon1] 2026-04-18 16:31:11.352006 | mon1 | 2026-04-18 16:31:11.352317 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-18 16:31:11.352679 | mon1 | Saturday 18 April 2026 16:31:11 +0000 (0:00:00.036) 0:00:07.444 ******** 2026-04-18 16:31:11.382264 | mon1 | skipping: [mon1] 2026-04-18 16:31:11.382721 | mon1 | 2026-04-18 16:31:11.383345 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-18 16:31:11.383370 | mon1 | Saturday 18 April 2026 16:31:11 +0000 (0:00:00.030) 0:00:07.474 ******** 2026-04-18 16:31:12.494693 | mon1 | ok: [mon1] 2026-04-18 16:31:12.494763 | mon1 | 2026-04-18 16:31:12.494805 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-18 16:31:12.494815 | mon1 | Saturday 18 April 2026 16:31:12 +0000 (0:00:01.111) 0:00:08.585 ******** 2026-04-18 16:31:13.033397 | mon1 | ok: [mon1] 2026-04-18 16:31:13.033492 | mon1 | 2026-04-18 16:31:13.033509 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-18 16:31:13.033518 | mon1 | Saturday 18 April 2026 16:31:13 +0000 (0:00:00.538) 0:00:09.124 ******** 2026-04-18 16:31:14.177613 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-04-18 16:31:14.177689 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-18 16:31:14.177700 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-18 16:31:14.177716 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-18 16:31:14.178536 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-18 16:31:14.178594 | mon1 | 2026-04-18 16:31:14.178807 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-18 16:31:14.179149 | mon1 | Saturday 18 April 2026 16:31:14 +0000 (0:00:01.142) 0:00:10.267 ******** 2026-04-18 16:31:14.877501 | mon1 | ok: [mon1] 2026-04-18 16:31:14.877535 | mon1 | 2026-04-18 16:31:14.877540 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-18 16:31:14.877545 | mon1 | Saturday 18 April 2026 16:31:14 +0000 (0:00:00.691) 0:00:10.958 ******** 2026-04-18 16:31:14.877549 | mon1 | 2026-04-18 16:31:14.877552 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-18 16:31:14.877556 | mon1 | Saturday 18 April 2026 16:31:14 +0000 (0:00:00.007) 0:00:10.966 ******** 2026-04-18 16:31:15.585993 | mon1 | ok: [mon1] 2026-04-18 16:31:15.586383 | mon1 | 2026-04-18 16:31:15.586787 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:31:15.587148 | mon1 | Saturday 18 April 2026 16:31:15 +0000 (0:00:00.711) 0:00:11.678 ******** 2026-04-18 16:31:15.844422 | mon1 | ok: [mon1] 2026-04-18 16:31:15.844883 | mon1 | 2026-04-18 16:31:15.845257 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:31:15.845634 | mon1 | Saturday 18 April 2026 16:31:15 +0000 (0:00:00.258) 0:00:11.936 ******** 2026-04-18 16:31:15.918648 | mon1 | ok: [mon1] => { 2026-04-18 16:31:15.918996 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-18 16:31:15.919289 | mon1 | } 2026-04-18 16:31:15.919598 | mon1 | 2026-04-18 16:31:15.919918 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:31:15.920221 | mon1 | Saturday 18 April 2026 16:31:15 +0000 (0:00:00.074) 0:00:12.011 ******** 2026-04-18 16:31:16.390381 | mon1 | ok: [mon1] 2026-04-18 16:31:16.390763 | mon1 | 2026-04-18 16:31:16.391098 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:31:16.391410 | mon1 | Saturday 18 April 2026 16:31:16 +0000 (0:00:00.471) 0:00:12.482 ******** 2026-04-18 16:31:19.647341 | mon1 | ok: [mon1] 2026-04-18 16:31:19.647738 | mon1 | 2026-04-18 16:31:19.648076 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-18 16:31:19.648380 | mon1 | Saturday 18 April 2026 16:31:19 +0000 (0:00:03.257) 0:00:15.739 ******** 2026-04-18 16:31:20.764383 | mon1 | ok: [mon1] 2026-04-18 16:31:20.764677 | mon1 | 2026-04-18 16:31:20.764903 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-18 16:31:20.765097 | mon1 | Saturday 18 April 2026 16:31:20 +0000 (0:00:01.117) 0:00:16.856 ******** 2026-04-18 16:31:21.097888 | mon1 | ok: [mon1] 2026-04-18 16:31:21.098262 | mon1 | 2026-04-18 16:31:21.098655 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-18 16:31:21.099022 | mon1 | Saturday 18 April 2026 16:31:21 +0000 (0:00:00.332) 0:00:17.189 ******** 2026-04-18 16:31:21.633737 | mon1 | ok: [mon1] 2026-04-18 16:31:21.633941 | mon1 | 2026-04-18 16:31:21.634090 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-18 16:31:21.634263 | mon1 | Saturday 18 April 2026 16:31:21 +0000 (0:00:00.536) 0:00:17.726 ******** 2026-04-18 16:31:22.340586 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-04-18 16:31:22.340977 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-18 16:31:22.341288 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-18 16:31:22.341598 | mon1 | 2026-04-18 16:31:22.341911 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-18 16:31:22.342240 | mon1 | Saturday 18 April 2026 16:31:22 +0000 (0:00:00.706) 0:00:18.432 ******** 2026-04-18 16:31:22.883000 | mon1 | ok: [mon1] 2026-04-18 16:31:22.883360 | mon1 | 2026-04-18 16:31:22.883730 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-18 16:31:22.884060 | mon1 | Saturday 18 April 2026 16:31:22 +0000 (0:00:00.542) 0:00:18.974 ******** 2026-04-18 16:31:23.460400 | mon1 | ok: [mon1] 2026-04-18 16:31:23.460847 | mon1 | 2026-04-18 16:31:23.461179 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-18 16:31:23.462525 | mon1 | Saturday 18 April 2026 16:31:23 +0000 (0:00:00.570) 0:00:19.544 ******** 2026-04-18 16:31:23.462563 | mon1 | 2026-04-18 16:31:23.462683 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-18 16:31:23.463053 | mon1 | Saturday 18 April 2026 16:31:23 +0000 (0:00:00.007) 0:00:19.552 ******** 2026-04-18 16:31:23.916917 | mon1 | ok: [mon1] 2026-04-18 16:31:23.916981 | mon1 | 2026-04-18 16:31:23.917089 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-18 16:31:23.917201 | mon1 | Saturday 18 April 2026 16:31:23 +0000 (0:00:00.457) 0:00:20.009 ******** 2026-04-18 16:31:23.972013 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-04-18 16:31:23.972067 | mon1 | 2026-04-18 16:31:23.972080 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-18 16:31:23.972089 | mon1 | Saturday 18 April 2026 16:31:23 +0000 (0:00:00.054) 0:00:20.063 ******** 2026-04-18 16:31:25.190934 | mon1 | ok: [mon1] 2026-04-18 16:31:25.190992 | mon1 | 2026-04-18 16:31:25.190999 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-18 16:31:25.191006 | mon1 | Saturday 18 April 2026 16:31:25 +0000 (0:00:01.218) 0:00:21.282 ******** 2026-04-18 16:31:25.995055 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-04-18 16:31:25.995115 | mon1 | ok: [mon1] => (item=ssh) 2026-04-18 16:31:25.995225 | mon1 | 2026-04-18 16:31:25.995339 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-18 16:31:25.995501 | mon1 | Saturday 18 April 2026 16:31:25 +0000 (0:00:00.804) 0:00:22.086 ******** 2026-04-18 16:31:26.378447 | mon1 | ok: [mon1] 2026-04-18 16:31:26.378542 | mon1 | 2026-04-18 16:31:26.378553 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-18 16:31:26.378562 | mon1 | Saturday 18 April 2026 16:31:26 +0000 (0:00:00.382) 0:00:22.469 ******** 2026-04-18 16:31:26.627016 | mon1 | ok: [mon1] 2026-04-18 16:31:26.627084 | mon1 | 2026-04-18 16:31:26.627191 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-18 16:31:26.627303 | mon1 | Saturday 18 April 2026 16:31:26 +0000 (0:00:00.248) 0:00:22.718 ******** 2026-04-18 16:31:27.070195 | mon1 | ok: [mon1] 2026-04-18 16:31:27.070244 | mon1 | 2026-04-18 16:31:27.070255 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-18 16:31:27.070265 | mon1 | Saturday 18 April 2026 16:31:27 +0000 (0:00:00.442) 0:00:23.160 ******** 2026-04-18 16:31:27.459201 | mon1 | ok: [mon1] 2026-04-18 16:31:27.459257 | mon1 | 2026-04-18 16:31:27.459282 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-04-18 16:31:27.459292 | mon1 | Saturday 18 April 2026 16:31:27 +0000 (0:00:00.389) 0:00:23.549 ******** 2026-04-18 16:31:27.543820 | mon1 | ok: [mon1] 2026-04-18 16:31:27.543857 | mon1 | 2026-04-18 16:31:27.543899 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-04-18 16:31:27.543913 | mon1 | Saturday 18 April 2026 16:31:27 +0000 (0:00:00.084) 0:00:23.634 ******** 2026-04-18 16:31:27.822028 | mon1 | ok: [mon1] => (item=mon1) 2026-04-18 16:31:27.822101 | mon1 | 2026-04-18 16:31:27.822190 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-04-18 16:31:27.822302 | mon1 | Saturday 18 April 2026 16:31:27 +0000 (0:00:00.277) 0:00:23.912 ******** 2026-04-18 16:31:27.872088 | mon1 | ok: [mon1] 2026-04-18 16:31:27.872129 | mon1 | 2026-04-18 16:31:27.872276 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-04-18 16:31:27.872385 | mon1 | Saturday 18 April 2026 16:31:27 +0000 (0:00:00.052) 0:00:23.964 ******** 2026-04-18 16:31:27.922149 | mon1 | skipping: [mon1] 2026-04-18 16:31:27.922184 | mon1 | 2026-04-18 16:31:27.922195 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-18 16:31:27.922205 | mon1 | Saturday 18 April 2026 16:31:27 +0000 (0:00:00.047) 0:00:24.012 ******** 2026-04-18 16:31:27.996527 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-04-18 16:31:27.996595 | mon1 | 2026-04-18 16:31:27.996606 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-18 16:31:27.996615 | mon1 | Saturday 18 April 2026 16:31:27 +0000 (0:00:00.075) 0:00:24.087 ******** 2026-04-18 16:31:34.481320 | mon1 | ok: [mon1] 2026-04-18 16:31:34.481397 | mon1 | 2026-04-18 16:31:34.481412 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-18 16:31:34.481425 | mon1 | Saturday 18 April 2026 16:31:34 +0000 (0:00:06.484) 0:00:30.572 ******** 2026-04-18 16:31:34.539687 | mon1 | ok: [mon1] => (item=mon1) 2026-04-18 16:31:34.539763 | mon1 | 2026-04-18 16:31:34.539784 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-18 16:31:34.539935 | mon1 | Saturday 18 April 2026 16:31:34 +0000 (0:00:00.059) 0:00:30.631 ******** 2026-04-18 16:31:35.041340 | mon1 | ok: [mon1] 2026-04-18 16:31:35.041605 | mon1 | 2026-04-18 16:31:35.041864 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-18 16:31:35.042108 | mon1 | Saturday 18 April 2026 16:31:35 +0000 (0:00:00.501) 0:00:31.133 ******** 2026-04-18 16:31:42.046956 | mon1 | ok: [mon1] 2026-04-18 16:31:42.047058 | mon1 | 2026-04-18 16:31:42.047165 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-04-18 16:31:42.047278 | mon1 | Saturday 18 April 2026 16:31:42 +0000 (0:00:07.003) 0:00:38.136 ******** 2026-04-18 16:31:48.489948 | mon1 | ok: [mon1] 2026-04-18 16:31:48.490651 | mon1 | 2026-04-18 16:31:48.490708 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-04-18 16:31:48.490722 | mon1 | Saturday 18 April 2026 16:31:48 +0000 (0:00:06.439) 0:00:44.576 ******** 2026-04-18 16:32:02.919814 | mon1 | ok: [mon1] 2026-04-18 16:32:02.919879 | mon1 | 2026-04-18 16:32:02.920123 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-18 16:32:02.920138 | mon1 | Saturday 18 April 2026 16:32:02 +0000 (0:00:14.436) 0:00:59.012 ******** 2026-04-18 16:32:02.996220 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-04-18 16:32:02.996295 | mon1 | 2026-04-18 16:32:02.996309 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-18 16:32:02.996321 | mon1 | Saturday 18 April 2026 16:32:02 +0000 (0:00:00.074) 0:00:59.086 ******** 2026-04-18 16:32:03.050138 | mon1 | skipping: [mon1] 2026-04-18 16:32:03.050193 | mon1 | 2026-04-18 16:32:03.050208 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-18 16:32:03.050220 | mon1 | Saturday 18 April 2026 16:32:03 +0000 (0:00:00.054) 0:00:59.141 ******** 2026-04-18 16:32:03.103102 | mon1 | skipping: [mon1] => (item=mon1) 2026-04-18 16:32:03.103145 | mon1 | skipping: [mon1] 2026-04-18 16:32:03.103160 | mon1 | 2026-04-18 16:32:03.103172 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-18 16:32:03.103184 | mon1 | Saturday 18 April 2026 16:32:03 +0000 (0:00:00.052) 0:00:59.193 ******** 2026-04-18 16:32:03.419629 | mon1 | ok: [mon1] 2026-04-18 16:32:03.419693 | mon1 | 2026-04-18 16:32:03.420173 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-18 16:32:03.420219 | mon1 | Saturday 18 April 2026 16:32:03 +0000 (0:00:00.316) 0:00:59.510 ******** 2026-04-18 16:32:10.213531 | mon1 | ok: [mon1] 2026-04-18 16:32:10.213591 | mon1 | 2026-04-18 16:32:10.213600 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-04-18 16:32:10.213608 | mon1 | Saturday 18 April 2026 16:32:10 +0000 (0:00:06.794) 0:01:06.304 ******** 2026-04-18 16:32:16.489092 | mon1 | ok: [mon1] 2026-04-18 16:32:16.489161 | mon1 | 2026-04-18 16:32:16.489175 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-04-18 16:32:16.489187 | mon1 | Saturday 18 April 2026 16:32:16 +0000 (0:00:06.275) 0:01:12.580 ******** 2026-04-18 16:32:22.770012 | mon1 | ok: [mon1] 2026-04-18 16:32:22.770079 | mon1 | 2026-04-18 16:32:22.770093 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-04-18 16:32:22.770106 | mon1 | Saturday 18 April 2026 16:32:22 +0000 (0:00:06.280) 0:01:18.860 ******** 2026-04-18 16:32:27.725600 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-04-18 16:32:27.725674 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-04-18 16:32:27.727507 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-04-18 16:32:27.727570 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-04-18 16:32:27.727584 | mon1 | 2026-04-18 16:32:27.727598 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-04-18 16:32:27.727612 | mon1 | 2026-04-18 16:32:27.727624 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-18 16:32:27.727637 | mon1 | Saturday 18 April 2026 16:32:27 +0000 (0:00:04.956) 0:01:23.817 ******** 2026-04-18 16:32:29.948659 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-04-18 16:32:29.948742 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-18 16:32:29.948763 | mon1 | interpreter could change the meaning of that path. See 2026-04-18 16:32:29.948782 | mon1 | https://docs.ansible.com/ansible- 2026-04-18 16:32:29.948799 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-18 16:32:29.962867 | mon1 | ok: [osd1] 2026-04-18 16:32:29.962996 | mon1 | 2026-04-18 16:32:29.963154 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:32:29.963313 | mon1 | Saturday 18 April 2026 16:32:29 +0000 (0:00:02.238) 0:01:26.055 ******** 2026-04-18 16:32:30.207745 | mon1 | ok: [osd1] 2026-04-18 16:32:30.207935 | mon1 | 2026-04-18 16:32:30.208187 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:32:30.208475 | mon1 | Saturday 18 April 2026 16:32:30 +0000 (0:00:00.244) 0:01:26.300 ******** 2026-04-18 16:32:30.247908 | mon1 | skipping: [osd1] 2026-04-18 16:32:30.248015 | mon1 | 2026-04-18 16:32:30.248145 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-18 16:32:30.248260 | mon1 | Saturday 18 April 2026 16:32:30 +0000 (0:00:00.040) 0:01:26.340 ******** 2026-04-18 16:32:30.507683 | mon1 | ok: [osd1] 2026-04-18 16:32:30.507810 | mon1 | 2026-04-18 16:32:30.508100 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:32:30.508359 | mon1 | Saturday 18 April 2026 16:32:30 +0000 (0:00:00.259) 0:01:26.599 ******** 2026-04-18 16:32:30.586040 | mon1 | ok: [osd1] => { 2026-04-18 16:32:30.586188 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-18 16:32:30.586332 | mon1 | } 2026-04-18 16:32:30.586600 | mon1 | 2026-04-18 16:32:30.586852 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:32:30.587101 | mon1 | Saturday 18 April 2026 16:32:30 +0000 (0:00:00.078) 0:01:26.678 ******** 2026-04-18 16:32:30.992512 | mon1 | ok: [osd1] 2026-04-18 16:32:30.992705 | mon1 | 2026-04-18 16:32:30.993022 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:32:30.993274 | mon1 | Saturday 18 April 2026 16:32:30 +0000 (0:00:00.406) 0:01:27.084 ******** 2026-04-18 16:32:31.041512 | mon1 | skipping: [osd1] 2026-04-18 16:32:31.041842 | mon1 | 2026-04-18 16:32:31.042171 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:32:31.042508 | mon1 | Saturday 18 April 2026 16:32:31 +0000 (0:00:00.048) 0:01:27.133 ******** 2026-04-18 16:32:31.089760 | mon1 | skipping: [osd1] 2026-04-18 16:32:31.089933 | mon1 | 2026-04-18 16:32:31.090221 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:32:31.090420 | mon1 | Saturday 18 April 2026 16:32:31 +0000 (0:00:00.048) 0:01:27.182 ******** 2026-04-18 16:32:31.342993 | mon1 | ok: [osd1] 2026-04-18 16:32:31.343157 | mon1 | 2026-04-18 16:32:31.343500 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:32:31.343750 | mon1 | Saturday 18 April 2026 16:32:31 +0000 (0:00:00.253) 0:01:27.435 ******** 2026-04-18 16:32:32.339671 | mon1 | ok: [osd1] 2026-04-18 16:32:32.339875 | mon1 | 2026-04-18 16:32:32.340127 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:32:32.340372 | mon1 | Saturday 18 April 2026 16:32:32 +0000 (0:00:00.996) 0:01:28.431 ******** 2026-04-18 16:32:32.524804 | mon1 | ok: [osd1] => { 2026-04-18 16:32:32.525059 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz" 2026-04-18 16:32:32.525275 | mon1 | } 2026-04-18 16:32:32.525563 | mon1 | 2026-04-18 16:32:32.525786 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:32:32.526157 | mon1 | Saturday 18 April 2026 16:32:32 +0000 (0:00:00.184) 0:01:28.616 ******** 2026-04-18 16:32:33.047091 | mon1 | ok: [osd1] 2026-04-18 16:32:33.047175 | mon1 | 2026-04-18 16:32:33.047344 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:32:33.047528 | mon1 | Saturday 18 April 2026 16:32:33 +0000 (0:00:00.522) 0:01:29.139 ******** 2026-04-18 16:32:35.346604 | mon1 | ok: [osd1] 2026-04-18 16:32:35.346709 | mon1 | 2026-04-18 16:32:35.346731 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-18 16:32:35.347107 | mon1 | Saturday 18 April 2026 16:32:35 +0000 (0:00:02.298) 0:01:31.438 ******** 2026-04-18 16:32:35.383864 | mon1 | skipping: [osd1] 2026-04-18 16:32:35.383912 | mon1 | 2026-04-18 16:32:35.383923 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-18 16:32:35.383933 | mon1 | Saturday 18 April 2026 16:32:35 +0000 (0:00:00.036) 0:01:31.474 ******** 2026-04-18 16:32:35.416867 | mon1 | skipping: [osd1] 2026-04-18 16:32:35.416897 | mon1 | 2026-04-18 16:32:35.416907 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-18 16:32:35.416916 | mon1 | Saturday 18 April 2026 16:32:35 +0000 (0:00:00.033) 0:01:31.508 ******** 2026-04-18 16:32:35.450576 | mon1 | skipping: [osd1] 2026-04-18 16:32:35.450645 | mon1 | 2026-04-18 16:32:35.451040 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-18 16:32:35.451089 | mon1 | Saturday 18 April 2026 16:32:35 +0000 (0:00:00.034) 0:01:31.542 ******** 2026-04-18 16:32:36.439432 | mon1 | ok: [osd1] 2026-04-18 16:32:36.439506 | mon1 | 2026-04-18 16:32:36.439514 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-18 16:32:36.439520 | mon1 | Saturday 18 April 2026 16:32:36 +0000 (0:00:00.988) 0:01:32.530 ******** 2026-04-18 16:32:36.996086 | mon1 | ok: [osd1] 2026-04-18 16:32:36.996166 | mon1 | 2026-04-18 16:32:36.996438 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-18 16:32:36.996738 | mon1 | Saturday 18 April 2026 16:32:36 +0000 (0:00:00.556) 0:01:33.087 ******** 2026-04-18 16:32:38.106028 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-04-18 16:32:38.106108 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-18 16:32:38.106278 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-18 16:32:38.106447 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-18 16:32:38.106641 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-18 16:32:38.106784 | mon1 | 2026-04-18 16:32:38.106964 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-18 16:32:38.107126 | mon1 | Saturday 18 April 2026 16:32:38 +0000 (0:00:01.110) 0:01:34.197 ******** 2026-04-18 16:32:38.810944 | mon1 | ok: [osd1] 2026-04-18 16:32:38.811003 | mon1 | 2026-04-18 16:32:38.811014 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-18 16:32:38.811023 | mon1 | Saturday 18 April 2026 16:32:38 +0000 (0:00:00.697) 0:01:34.894 ******** 2026-04-18 16:32:38.811032 | mon1 | 2026-04-18 16:32:38.811041 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-18 16:32:38.811049 | mon1 | Saturday 18 April 2026 16:32:38 +0000 (0:00:00.006) 0:01:34.900 ******** 2026-04-18 16:32:39.263563 | mon1 | ok: [osd1] 2026-04-18 16:32:39.263618 | mon1 | 2026-04-18 16:32:39.263630 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:32:39.263640 | mon1 | Saturday 18 April 2026 16:32:39 +0000 (0:00:00.454) 0:01:35.355 ******** 2026-04-18 16:32:39.522400 | mon1 | ok: [osd1] 2026-04-18 16:32:39.522488 | mon1 | 2026-04-18 16:32:39.522504 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:32:39.522514 | mon1 | Saturday 18 April 2026 16:32:39 +0000 (0:00:00.258) 0:01:35.613 ******** 2026-04-18 16:32:39.601642 | mon1 | ok: [osd1] => { 2026-04-18 16:32:39.601716 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-18 16:32:39.601951 | mon1 | } 2026-04-18 16:32:39.602171 | mon1 | 2026-04-18 16:32:39.602420 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:32:39.602703 | mon1 | Saturday 18 April 2026 16:32:39 +0000 (0:00:00.080) 0:01:35.693 ******** 2026-04-18 16:32:40.039254 | mon1 | ok: [osd1] 2026-04-18 16:32:40.039378 | mon1 | 2026-04-18 16:32:40.039763 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:32:40.040019 | mon1 | Saturday 18 April 2026 16:32:40 +0000 (0:00:00.437) 0:01:36.131 ******** 2026-04-18 16:32:43.296587 | mon1 | ok: [osd1] 2026-04-18 16:32:43.296668 | mon1 | 2026-04-18 16:32:43.297204 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-18 16:32:43.297228 | mon1 | Saturday 18 April 2026 16:32:43 +0000 (0:00:03.257) 0:01:39.388 ******** 2026-04-18 16:32:44.313509 | mon1 | ok: [osd1] 2026-04-18 16:32:44.313547 | mon1 | 2026-04-18 16:32:44.313552 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-18 16:32:44.313556 | mon1 | Saturday 18 April 2026 16:32:44 +0000 (0:00:01.014) 0:01:40.403 ******** 2026-04-18 16:32:44.554068 | mon1 | ok: [osd1] 2026-04-18 16:32:44.554176 | mon1 | 2026-04-18 16:32:44.554289 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-18 16:32:44.554439 | mon1 | Saturday 18 April 2026 16:32:44 +0000 (0:00:00.242) 0:01:40.645 ******** 2026-04-18 16:32:45.110878 | mon1 | ok: [osd1] 2026-04-18 16:32:45.110933 | mon1 | 2026-04-18 16:32:45.110945 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-18 16:32:45.110955 | mon1 | Saturday 18 April 2026 16:32:45 +0000 (0:00:00.554) 0:01:41.200 ******** 2026-04-18 16:32:45.804594 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-04-18 16:32:45.804655 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-18 16:32:45.804666 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-18 16:32:45.804676 | mon1 | 2026-04-18 16:32:45.804685 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-18 16:32:45.804701 | mon1 | Saturday 18 April 2026 16:32:45 +0000 (0:00:00.694) 0:01:41.895 ******** 2026-04-18 16:32:46.341166 | mon1 | ok: [osd1] 2026-04-18 16:32:46.341232 | mon1 | 2026-04-18 16:32:46.341243 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-18 16:32:46.341253 | mon1 | Saturday 18 April 2026 16:32:46 +0000 (0:00:00.536) 0:01:42.431 ******** 2026-04-18 16:32:46.893737 | mon1 | ok: [osd1] 2026-04-18 16:32:46.893781 | mon1 | 2026-04-18 16:32:46.893787 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-18 16:32:46.893792 | mon1 | Saturday 18 April 2026 16:32:46 +0000 (0:00:00.543) 0:01:42.975 ******** 2026-04-18 16:32:46.893797 | mon1 | 2026-04-18 16:32:46.893801 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-18 16:32:46.893806 | mon1 | Saturday 18 April 2026 16:32:46 +0000 (0:00:00.009) 0:01:42.985 ******** 2026-04-18 16:32:47.352079 | mon1 | ok: [osd1] 2026-04-18 16:32:47.352129 | mon1 | 2026-04-18 16:32:47.352140 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-18 16:32:47.352165 | mon1 | Saturday 18 April 2026 16:32:47 +0000 (0:00:00.458) 0:01:43.443 ******** 2026-04-18 16:32:47.408570 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-04-18 16:32:47.408630 | mon1 | 2026-04-18 16:32:47.409119 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-18 16:32:47.409164 | mon1 | Saturday 18 April 2026 16:32:47 +0000 (0:00:00.056) 0:01:43.499 ******** 2026-04-18 16:32:48.391124 | mon1 | ok: [osd1] 2026-04-18 16:32:48.391179 | mon1 | 2026-04-18 16:32:48.391190 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-18 16:32:48.391200 | mon1 | Saturday 18 April 2026 16:32:48 +0000 (0:00:00.982) 0:01:44.481 ******** 2026-04-18 16:32:49.185249 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-04-18 16:32:49.185306 | mon1 | ok: [osd1] => (item=ssh) 2026-04-18 16:32:49.185317 | mon1 | 2026-04-18 16:32:49.185326 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-18 16:32:49.185335 | mon1 | Saturday 18 April 2026 16:32:49 +0000 (0:00:00.793) 0:01:45.275 ******** 2026-04-18 16:32:49.557050 | mon1 | ok: [osd1] 2026-04-18 16:32:49.557100 | mon1 | 2026-04-18 16:32:49.557110 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-18 16:32:49.557120 | mon1 | Saturday 18 April 2026 16:32:49 +0000 (0:00:00.372) 0:01:45.648 ******** 2026-04-18 16:32:49.809393 | mon1 | ok: [osd1] 2026-04-18 16:32:49.809432 | mon1 | 2026-04-18 16:32:49.809604 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-18 16:32:49.809859 | mon1 | Saturday 18 April 2026 16:32:49 +0000 (0:00:00.251) 0:01:45.899 ******** 2026-04-18 16:32:50.119621 | mon1 | ok: [osd1] 2026-04-18 16:32:50.119728 | mon1 | 2026-04-18 16:32:50.119747 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-18 16:32:50.119988 | mon1 | Saturday 18 April 2026 16:32:50 +0000 (0:00:00.311) 0:01:46.211 ******** 2026-04-18 16:32:50.378063 | mon1 | ok: [osd1] 2026-04-18 16:32:50.378868 | mon1 | 2026-04-18 16:32:50.378901 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-04-18 16:32:50.378932 | mon1 | Saturday 18 April 2026 16:32:50 +0000 (0:00:00.258) 0:01:46.470 ******** 2026-04-18 16:32:50.656648 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-04-18 16:32:50.656864 | mon1 | 2026-04-18 16:32:50.657126 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-04-18 16:32:50.657428 | mon1 | Saturday 18 April 2026 16:32:50 +0000 (0:00:00.278) 0:01:46.748 ******** 2026-04-18 16:32:50.709218 | mon1 | ok: [osd1] 2026-04-18 16:32:50.709427 | mon1 | 2026-04-18 16:32:50.709725 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-18 16:32:50.709998 | mon1 | Saturday 18 April 2026 16:32:50 +0000 (0:00:00.052) 0:01:46.801 ******** 2026-04-18 16:32:50.771877 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-04-18 16:32:50.772102 | mon1 | 2026-04-18 16:32:50.772432 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-18 16:32:50.772778 | mon1 | Saturday 18 April 2026 16:32:50 +0000 (0:00:00.062) 0:01:46.864 ******** 2026-04-18 16:32:57.014641 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-18 16:32:57.014815 | mon1 | 2026-04-18 16:32:57.015090 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-18 16:32:57.015390 | mon1 | Saturday 18 April 2026 16:32:57 +0000 (0:00:06.242) 0:01:53.106 ******** 2026-04-18 16:32:57.070917 | mon1 | ok: [osd1] => (item=osd1) 2026-04-18 16:32:57.071050 | mon1 | 2026-04-18 16:32:57.071209 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-18 16:32:57.071414 | mon1 | Saturday 18 April 2026 16:32:57 +0000 (0:00:00.056) 0:01:53.163 ******** 2026-04-18 16:32:57.393975 | mon1 | ok: [osd1] 2026-04-18 16:32:57.394170 | mon1 | 2026-04-18 16:32:57.394423 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-18 16:32:57.394739 | mon1 | Saturday 18 April 2026 16:32:57 +0000 (0:00:00.322) 0:01:53.486 ******** 2026-04-18 16:33:04.199019 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-18 16:33:04.199491 | mon1 | 2026-04-18 16:33:04.199505 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-04-18 16:33:04.199731 | mon1 | Saturday 18 April 2026 16:33:04 +0000 (0:00:06.804) 0:02:00.291 ******** 2026-04-18 16:33:09.793660 | mon1 | ok: [osd1] 2026-04-18 16:33:09.793720 | mon1 | 2026-04-18 16:33:09.793729 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-04-18 16:33:09.793743 | mon1 | Saturday 18 April 2026 16:33:09 +0000 (0:00:05.593) 0:02:05.885 ******** 2026-04-18 16:33:32.110034 | mon1 | ok: [osd1] 2026-04-18 16:33:32.110110 | mon1 | 2026-04-18 16:33:32.110125 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-04-18 16:33:32.110138 | mon1 | Saturday 18 April 2026 16:33:32 +0000 (0:00:22.315) 0:02:28.201 ******** 2026-04-18 16:33:32.178084 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-04-18 16:33:32.178147 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-04-18 16:33:32.178159 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-04-18 16:33:32.178171 | mon1 | skipping: [osd1] 2026-04-18 16:33:32.178183 | mon1 | 2026-04-18 16:33:32.178195 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-04-18 16:33:32.178207 | mon1 | Saturday 18 April 2026 16:33:32 +0000 (0:00:00.066) 0:02:28.268 ******** 2026-04-18 16:33:38.575584 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-18 16:33:38.575644 | mon1 | 2026-04-18 16:33:38.575854 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-04-18 16:33:38.576111 | mon1 | Saturday 18 April 2026 16:33:38 +0000 (0:00:06.399) 0:02:34.667 ******** 2026-04-18 16:33:44.849667 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-18 16:33:44.849788 | mon1 | 2026-04-18 16:33:44.849802 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-04-18 16:33:44.849815 | mon1 | Saturday 18 April 2026 16:33:44 +0000 (0:00:06.273) 0:02:40.941 ******** 2026-04-18 16:33:44.913844 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-04-18 16:33:44.913906 | mon1 | 2026-04-18 16:33:44.913920 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-04-18 16:33:44.913932 | mon1 | Saturday 18 April 2026 16:33:44 +0000 (0:00:00.064) 0:02:41.005 ******** 2026-04-18 16:33:44.963696 | mon1 | ok: [osd1] 2026-04-18 16:33:44.963792 | mon1 | 2026-04-18 16:33:44.963813 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-04-18 16:33:44.964065 | mon1 | Saturday 18 April 2026 16:33:44 +0000 (0:00:00.049) 0:02:41.055 ******** 2026-04-18 16:33:51.268624 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-18 16:33:51.268711 | mon1 | 2026-04-18 16:33:51.269114 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-04-18 16:33:51.269174 | mon1 | Saturday 18 April 2026 16:33:51 +0000 (0:00:06.304) 0:02:47.359 ******** 2026-04-18 16:33:51.317621 | mon1 | ok: [osd1] 2026-04-18 16:33:51.318557 | mon1 | 2026-04-18 16:33:51.318645 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-04-18 16:33:51.318661 | mon1 | Saturday 18 April 2026 16:33:51 +0000 (0:00:00.048) 0:02:47.408 ******** 2026-04-18 16:33:51.367649 | mon1 | skipping: [osd1] => (item=1) 2026-04-18 16:33:51.367782 | mon1 | skipping: [osd1] => (item=1) 2026-04-18 16:33:51.369037 | mon1 | skipping: [osd1] => (item=1) 2026-04-18 16:33:51.369069 | mon1 | skipping: [osd1] 2026-04-18 16:33:51.369078 | mon1 | 2026-04-18 16:33:51.369088 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-04-18 16:33:51.369098 | mon1 | Saturday 18 April 2026 16:33:51 +0000 (0:00:00.050) 0:02:47.459 ******** 2026-04-18 16:33:51.409636 | mon1 | skipping: [osd1] 2026-04-18 16:33:51.409706 | mon1 | 2026-04-18 16:33:51.411529 | mon1 | PLAY RECAP ********************************************************************* 2026-04-18 16:33:51.411589 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-04-18 16:33:51.411600 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-04-18 16:33:51.411610 | mon1 | 2026-04-18 16:33:51.411620 | mon1 | 2026-04-18 16:33:51.411630 | mon1 | TASKS RECAP ******************************************************************** 2026-04-18 16:33:51.411640 | mon1 | Saturday 18 April 2026 16:33:51 +0000 (0:00:00.042) 0:02:47.501 ******** 2026-04-18 16:33:51.411792 | mon1 | =============================================================================== 2026-04-18 16:33:51.412118 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.32s 2026-04-18 16:33:51.412440 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.44s 2026-04-18 16:33:51.412812 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.00s 2026-04-18 16:33:51.413172 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.80s 2026-04-18 16:33:51.413523 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.79s 2026-04-18 16:33:51.413902 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.48s 2026-04-18 16:33:51.414229 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.44s 2026-04-18 16:33:51.414577 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.40s 2026-04-18 16:33:51.414905 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.30s 2026-04-18 16:33:51.415226 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.28s 2026-04-18 16:33:51.415579 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.28s 2026-04-18 16:33:51.415911 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.27s 2026-04-18 16:33:51.416234 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.24s 2026-04-18 16:33:51.416588 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.59s 2026-04-18 16:33:51.416971 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 4.96s 2026-04-18 16:33:51.417292 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.26s 2026-04-18 16:33:51.417430 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.26s 2026-04-18 16:33:51.417583 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.48s 2026-04-18 16:33:51.417720 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.30s 2026-04-18 16:33:51.417851 | mon1 | Gathering Facts --------------------------------------------------------- 2.24s 2026-04-18 16:33:51.531090 | mon1 | INFO [default > idempotence] Executed: Successful 2026-04-18 16:33:51.543281 | mon1 | INFO [default > side_effect] Executing 2026-04-18 16:33:51.543846 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-18 16:33:51.551224 | mon1 | INFO [default > verify] Executing 2026-04-18 16:33:52.346026 | mon1 | 2026-04-18 16:33:52.346397 | mon1 | PLAY [Verify] ****************************************************************** 2026-04-18 16:33:52.346762 | mon1 | 2026-04-18 16:33:52.347089 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-18 16:33:52.347408 | mon1 | Saturday 18 April 2026 16:33:52 +0000 (0:00:00.008) 0:00:00.008 ******** 2026-04-18 16:33:53.605623 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-04-18 16:33:53.606053 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-18 16:33:53.606924 | mon1 | interpreter could change the meaning of that path. See 2026-04-18 16:33:53.606950 | mon1 | https://docs.ansible.com/ansible- 2026-04-18 16:33:53.606960 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-18 16:33:53.614285 | mon1 | ok: [mon1] 2026-04-18 16:33:53.614312 | mon1 | 2026-04-18 16:33:53.614322 | mon1 | TASK [Get cluster health status] *********************************************** 2026-04-18 16:33:53.614332 | mon1 | Saturday 18 April 2026 16:33:53 +0000 (0:00:01.267) 0:00:01.276 ******** 2026-04-18 16:34:04.024570 | mon1 | ok: [mon1] 2026-04-18 16:34:04.024636 | mon1 | 2026-04-18 16:34:04.024651 | mon1 | TASK [Print cluster health status] ********************************************* 2026-04-18 16:34:04.024907 | mon1 | Saturday 18 April 2026 16:34:04 +0000 (0:00:10.409) 0:00:11.685 ******** 2026-04-18 16:34:04.062421 | mon1 | ok: [mon1] => { 2026-04-18 16:34:04.062639 | mon1 | "_ceph_health": { 2026-04-18 16:34:04.062895 | mon1 | "changed": false, 2026-04-18 16:34:04.063150 | mon1 | "cmd": [ 2026-04-18 16:34:04.063363 | mon1 | "cephadm", 2026-04-18 16:34:04.063670 | mon1 | "shell", 2026-04-18 16:34:04.063887 | mon1 | "--", 2026-04-18 16:34:04.064109 | mon1 | "ceph", 2026-04-18 16:34:04.064318 | mon1 | "health" 2026-04-18 16:34:04.064568 | mon1 | ], 2026-04-18 16:34:04.064830 | mon1 | "delta": "0:00:10.050410", 2026-04-18 16:34:04.065059 | mon1 | "end": "2026-04-18 16:34:03.976615", 2026-04-18 16:34:04.065275 | mon1 | "failed": false, 2026-04-18 16:34:04.065546 | mon1 | "msg": "", 2026-04-18 16:34:04.065794 | mon1 | "rc": 0, 2026-04-18 16:34:04.066018 | mon1 | "start": "2026-04-18 16:33:53.926205", 2026-04-18 16:34:04.066293 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-04-18 16:34:04.066548 | mon1 | "stderr_lines": [ 2026-04-18 16:34:04.066845 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-04-18 16:34:04.067102 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-04-18 16:34:04.067311 | mon1 | ], 2026-04-18 16:34:04.067602 | mon1 | "stdout": "HEALTH_OK", 2026-04-18 16:34:04.067847 | mon1 | "stdout_lines": [ 2026-04-18 16:34:04.068067 | mon1 | "HEALTH_OK" 2026-04-18 16:34:04.068301 | mon1 | ] 2026-04-18 16:34:04.068544 | mon1 | } 2026-04-18 16:34:04.068770 | mon1 | } 2026-04-18 16:34:04.068988 | mon1 | 2026-04-18 16:34:04.069238 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-04-18 16:34:04.069501 | mon1 | Saturday 18 April 2026 16:34:04 +0000 (0:00:00.039) 0:00:11.724 ******** 2026-04-18 16:34:04.101960 | mon1 | ok: [mon1] => { 2026-04-18 16:34:04.102137 | mon1 | "changed": false, 2026-04-18 16:34:04.102375 | mon1 | "msg": "All assertions passed" 2026-04-18 16:34:04.102650 | mon1 | } 2026-04-18 16:34:04.102867 | mon1 | 2026-04-18 16:34:04.103102 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-04-18 16:34:04.103342 | mon1 | Saturday 18 April 2026 16:34:04 +0000 (0:00:00.039) 0:00:11.764 ******** 2026-04-18 16:34:10.532118 | mon1 | changed: [mon1] 2026-04-18 16:34:10.532385 | mon1 | 2026-04-18 16:34:10.532707 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-04-18 16:34:10.533025 | mon1 | Saturday 18 April 2026 16:34:10 +0000 (0:00:06.430) 0:00:18.194 ******** 2026-04-18 16:34:12.763581 | mon1 | changed: [mon1] 2026-04-18 16:34:12.763778 | mon1 | 2026-04-18 16:34:12.764177 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-04-18 16:34:12.764568 | mon1 | Saturday 18 April 2026 16:34:12 +0000 (0:00:02.231) 0:00:20.426 ******** 2026-04-18 16:34:13.894143 | mon1 | ok: [mon1] 2026-04-18 16:34:13.894216 | mon1 | 2026-04-18 16:34:13.894663 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-04-18 16:34:13.894732 | mon1 | Saturday 18 April 2026 16:34:13 +0000 (0:00:01.130) 0:00:21.556 ******** 2026-04-18 16:34:13.938512 | mon1 | ok: [mon1] => { 2026-04-18 16:34:13.938563 | mon1 | "changed": false, 2026-04-18 16:34:13.938573 | mon1 | "msg": "All assertions passed" 2026-04-18 16:34:13.938580 | mon1 | } 2026-04-18 16:34:13.938588 | mon1 | 2026-04-18 16:34:13.938596 | mon1 | PLAY RECAP ********************************************************************* 2026-04-18 16:34:13.938605 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-18 16:34:13.938612 | mon1 | 2026-04-18 16:34:13.938620 | mon1 | 2026-04-18 16:34:13.938627 | mon1 | TASKS RECAP ******************************************************************** 2026-04-18 16:34:13.938635 | mon1 | Saturday 18 April 2026 16:34:13 +0000 (0:00:00.042) 0:00:21.599 ******** 2026-04-18 16:34:13.938642 | mon1 | =============================================================================== 2026-04-18 16:34:13.938649 | mon1 | Get cluster health status ---------------------------------------------- 10.41s 2026-04-18 16:34:13.938657 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.43s 2026-04-18 16:34:13.938664 | mon1 | Create a test Ceph key -------------------------------------------------- 2.23s 2026-04-18 16:34:13.938785 | mon1 | Gathering Facts --------------------------------------------------------- 1.27s 2026-04-18 16:34:13.938982 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.13s 2026-04-18 16:34:13.939180 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-04-18 16:34:13.939373 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.04s 2026-04-18 16:34:13.939587 | mon1 | Print cluster health status --------------------------------------------- 0.04s 2026-04-18 16:34:14.012648 | mon1 | INFO [default > verify] Executed: Successful 2026-04-18 16:34:14.023949 | mon1 | INFO [default > cleanup] Executing 2026-04-18 16:34:14.024300 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-18 16:34:14.030124 | mon1 | INFO [default > destroy] Executing 2026-04-18 16:34:14.030251 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-04-18 16:34:14.030348 | mon1 | INFO [default > destroy] Executed: Successful 2026-04-18 16:34:14.030669 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-04-18 16:34:14.621699 | mon1 | ok: Runtime: 0:11:25.084957 2026-04-18 16:34:14.637050 | 2026-04-18 16:34:14.637157 | PLAY RECAP 2026-04-18 16:34:14.637206 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-18 16:34:14.637229 | 2026-04-18 16:34:14.810431 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-18 16:34:14.816473 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-18 16:34:15.556134 | 2026-04-18 16:34:15.692812 | PLAY [all] 2026-04-18 16:34:15.711304 | 2026-04-18 16:34:15.711867 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-18 16:34:15.764070 | mon1 | ok 2026-04-18 16:34:15.813889 | osd1 | ok 2026-04-18 16:34:15.836238 | 2026-04-18 16:34:15.836516 | TASK [fetch-output : Set log path for single node] 2026-04-18 16:34:15.872382 | mon1 | skipping: Conditional result was False 2026-04-18 16:34:15.962409 | osd1 | skipping: Conditional result was False 2026-04-18 16:34:15.971034 | 2026-04-18 16:34:15.971153 | LOOP [fetch-output : Ensure local output dirs] 2026-04-18 16:34:16.601536 | osd1 -> localhost | changed: "/var/lib/zuul/builds/2c082c37bda94b58968c002c19ba70ce/work/logs/osd1" 2026-04-18 16:34:16.615260 | mon1 -> localhost | changed: "/var/lib/zuul/builds/2c082c37bda94b58968c002c19ba70ce/work/logs/mon1" 2026-04-18 16:34:16.917088 | osd1 -> localhost | changed: "/var/lib/zuul/builds/2c082c37bda94b58968c002c19ba70ce/work/artifacts" 2026-04-18 16:34:17.051487 | mon1 -> localhost | ok: "/var/lib/zuul/builds/2c082c37bda94b58968c002c19ba70ce/work/artifacts" 2026-04-18 16:34:17.242843 | osd1 -> localhost | changed: "/var/lib/zuul/builds/2c082c37bda94b58968c002c19ba70ce/work/docs" 2026-04-18 16:34:17.460666 | mon1 -> localhost | ok: "/var/lib/zuul/builds/2c082c37bda94b58968c002c19ba70ce/work/docs" 2026-04-18 16:34:17.460791 | mon1 -> localhost | changed: All items complete 2026-04-18 16:34:17.460819 | 2026-04-18 16:34:17.495305 | 2026-04-18 16:34:17.495479 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-18 16:34:18.253004 | mon1 | changed: .d..t...... ./ 2026-04-18 16:34:18.267879 | osd1 | changed: .d..t...... ./ 2026-04-18 16:34:18.970317 | osd1 | changed: .d..t...... ./ 2026-04-18 16:34:18.984138 | mon1 | changed: .d..t...... ./ 2026-04-18 16:34:19.544517 | mon1 | changed: .d..t...... ./ 2026-04-18 16:34:19.550398 | osd1 | changed: .d..t...... ./ 2026-04-18 16:34:19.585520 | 2026-04-18 16:34:19.698990 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-18 16:34:20.404044 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.016598 2026-04-18 16:34:20.404237 | mon1 -> localhost | changed: All items complete 2026-04-18 16:34:20.404266 | 2026-04-18 16:34:20.668204 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006994 2026-04-18 16:34:20.686594 | 2026-04-18 16:34:20.686754 | PLAY [all] 2026-04-18 16:34:20.694577 | 2026-04-18 16:34:20.694709 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-18 16:34:21.162101 | mon1 | changed 2026-04-18 16:34:21.393778 | osd1 | changed 2026-04-18 16:34:21.429504 | 2026-04-18 16:34:21.431215 | PLAY RECAP 2026-04-18 16:34:21.431287 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-18 16:34:21.431346 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-18 16:34:21.431377 | 2026-04-18 16:34:21.559010 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-18 16:34:21.563462 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-18 16:34:22.244281 | 2026-04-18 16:34:22.244414 | PLAY [localhost] 2026-04-18 16:34:22.255228 | 2026-04-18 16:34:22.255322 | TASK [Generate Zuul manifest] 2026-04-18 16:34:22.276622 | localhost | ok 2026-04-18 16:34:22.294038 | 2026-04-18 16:34:22.294196 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-18 16:34:22.640822 | localhost | changed 2026-04-18 16:34:22.656382 | 2026-04-18 16:34:22.656508 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-18 16:34:22.685146 | localhost | ok 2026-04-18 16:34:22.693470 | 2026-04-18 16:34:22.693576 | TASK [Upload logs] 2026-04-18 16:34:22.719238 | localhost | ok 2026-04-18 16:34:22.784736 | 2026-04-18 16:34:22.784838 | TASK [Set zuul-log-path fact] 2026-04-18 16:34:22.808202 | localhost | ok 2026-04-18 16:34:22.820613 | 2026-04-18 16:34:22.820683 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-18 16:34:22.851415 | localhost | ok 2026-04-18 16:34:22.861506 | 2026-04-18 16:34:22.861588 | TASK [upload-logs : Create log directories] 2026-04-18 16:34:23.292345 | localhost | changed 2026-04-18 16:34:23.300384 | 2026-04-18 16:34:23.300502 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-18 16:34:23.823288 | localhost -> localhost | ok: Runtime: 0:00:00.005892 2026-04-18 16:34:23.832761 | 2026-04-18 16:34:23.832872 | TASK [upload-logs : Upload logs to log server] 2026-04-18 16:34:24.362432 | localhost | Output suppressed because no_log was given 2026-04-18 16:34:24.365932 | 2026-04-18 16:34:24.365999 | LOOP [upload-logs : Compress console log and json output] 2026-04-18 16:34:24.424871 | localhost | skipping: Conditional result was False 2026-04-18 16:34:24.437561 | localhost | skipping: Conditional result was False 2026-04-18 16:34:24.446666 | 2026-04-18 16:34:24.446797 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-18 16:34:24.488869 | localhost | skipping: Conditional result was False 2026-04-18 16:34:24.489128 | 2026-04-18 16:34:24.494334 | localhost | skipping: Conditional result was False 2026-04-18 16:34:24.507677 | 2026-04-18 16:34:24.507908 | LOOP [upload-logs : Upload console log and json output]