2026-04-18 16:22:26.161733 | Job console starting 2026-04-18 16:22:26.181492 | Updating git repos 2026-04-18 16:22:26.297153 | Cloning repos into workspace 2026-04-18 16:22:26.376180 | Restoring repo states 2026-04-18 16:22:26.384407 | Merging changes 2026-04-18 16:22:27.139600 | Checking out repos 2026-04-18 16:22:27.169222 | Preparing playbooks 2026-04-18 16:22:28.779855 | Running Ansible setup 2026-04-18 16:22:33.073239 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-18 16:22:33.722935 | 2026-04-18 16:22:33.723092 | PLAY [localhost] 2026-04-18 16:22:33.731712 | 2026-04-18 16:22:33.731793 | TASK [Gathering Facts] 2026-04-18 16:22:34.635603 | localhost | ok 2026-04-18 16:22:34.642695 | 2026-04-18 16:22:34.642775 | TASK [Setup log path fact] 2026-04-18 16:22:34.661901 | localhost | ok 2026-04-18 16:22:34.672064 | 2026-04-18 16:22:34.672137 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-18 16:22:34.699946 | localhost | ok 2026-04-18 16:22:34.706266 | 2026-04-18 16:22:34.706343 | TASK [emit-job-header : Print job information] 2026-04-18 16:22:34.749360 | # Job Information 2026-04-18 16:22:34.749658 | Ansible Version: 2.16.16 2026-04-18 16:22:34.749748 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-04-18 16:22:34.749803 | Pipeline: check 2026-04-18 16:22:34.749851 | Executor: 0a8996d2b663 2026-04-18 16:22:34.749896 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/98 2026-04-18 16:22:34.749963 | Event ID: aaf30690-3b42-11f1-8507-cd2bc4fcb791 2026-04-18 16:22:34.754324 | 2026-04-18 16:22:34.754423 | LOOP [emit-job-header : Print node information] 2026-04-18 16:22:34.848462 | localhost | ok: 2026-04-18 16:22:34.848888 | localhost | # Node Information 2026-04-18 16:22:34.848922 | localhost | Inventory Hostname: mon1 2026-04-18 16:22:34.848946 | localhost | Hostname: np0000167304 2026-04-18 16:22:34.848987 | localhost | Username: zuul 2026-04-18 16:22:34.849018 | localhost | Distro: Ubuntu 22.04 2026-04-18 16:22:34.849040 | localhost | Provider: yul1 2026-04-18 16:22:34.849060 | localhost | Region: ca-ymq-1 2026-04-18 16:22:34.849080 | localhost | Label: ubuntu-jammy 2026-04-18 16:22:34.849099 | localhost | Product Name: OpenStack Nova 2026-04-18 16:22:34.849118 | localhost | Interface IP: 199.204.45.74 2026-04-18 16:22:34.913660 | localhost | ok: 2026-04-18 16:22:34.913922 | localhost | # Node Information 2026-04-18 16:22:34.913990 | localhost | Inventory Hostname: osd1 2026-04-18 16:22:34.914039 | localhost | Hostname: np0000167305 2026-04-18 16:22:34.914082 | localhost | Username: zuul 2026-04-18 16:22:34.914125 | localhost | Distro: Ubuntu 22.04 2026-04-18 16:22:34.914167 | localhost | Provider: yul1 2026-04-18 16:22:34.914209 | localhost | Region: ca-ymq-1 2026-04-18 16:22:34.914250 | localhost | Label: ubuntu-jammy 2026-04-18 16:22:34.914292 | localhost | Product Name: OpenStack Nova 2026-04-18 16:22:34.914335 | localhost | Interface IP: 199.204.45.72 2026-04-18 16:22:34.932654 | 2026-04-18 16:22:34.932817 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-18 16:22:35.311618 | localhost -> localhost | changed 2026-04-18 16:22:35.317176 | 2026-04-18 16:22:35.317290 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-18 16:22:36.197199 | localhost -> localhost | changed 2026-04-18 16:22:36.210388 | 2026-04-18 16:22:36.210449 | PLAY [all] 2026-04-18 16:22:36.232884 | 2026-04-18 16:22:36.233115 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-18 16:22:36.832937 | mon1 -> localhost | ok 2026-04-18 16:22:36.849732 | 2026-04-18 16:22:36.849921 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-18 16:22:36.886532 | mon1 | ok 2026-04-18 16:22:36.901115 | osd1 | ok 2026-04-18 16:22:36.921276 | mon1 | included: /var/lib/zuul/builds/d665a5e30f9d44139c098a0f6d499917/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-18 16:22:36.921340 | osd1 | included: /var/lib/zuul/builds/d665a5e30f9d44139c098a0f6d499917/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-18 16:22:36.929130 | 2026-04-18 16:22:36.929233 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-18 16:22:37.883381 | mon1 -> localhost | Generating public/private rsa key pair. 2026-04-18 16:22:37.883587 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/d665a5e30f9d44139c098a0f6d499917/work/d665a5e30f9d44139c098a0f6d499917_id_rsa 2026-04-18 16:22:37.883632 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/d665a5e30f9d44139c098a0f6d499917/work/d665a5e30f9d44139c098a0f6d499917_id_rsa.pub 2026-04-18 16:22:37.883666 | mon1 -> localhost | The key fingerprint is: 2026-04-18 16:22:37.883699 | mon1 -> localhost | SHA256:kua7+YHmsVaEUucXxh3uAcA/df/8syOGGn3yzrsfXNU zuul-build-sshkey 2026-04-18 16:22:37.883731 | mon1 -> localhost | The key's randomart image is: 2026-04-18 16:22:37.883762 | mon1 -> localhost | +---[RSA 3072]----+ 2026-04-18 16:22:37.883791 | mon1 -> localhost | | ..o.... | 2026-04-18 16:22:37.883822 | mon1 -> localhost | | . o +oo . .| 2026-04-18 16:22:37.883851 | mon1 -> localhost | | . + o oo. .E| 2026-04-18 16:22:37.883881 | mon1 -> localhost | | . ..o +. . o| 2026-04-18 16:22:37.883910 | mon1 -> localhost | | .+.S. .. .o| 2026-04-18 16:22:37.883939 | mon1 -> localhost | | o o. . . +| 2026-04-18 16:22:37.883968 | mon1 -> localhost | | =... o.. o.| 2026-04-18 16:22:37.883996 | mon1 -> localhost | | o.= ...=o oo| 2026-04-18 16:22:37.884024 | mon1 -> localhost | | .*o... o*=o+| 2026-04-18 16:22:37.884052 | mon1 -> localhost | +----[SHA256]-----+ 2026-04-18 16:22:37.884121 | mon1 -> localhost | ok: Runtime: 0:00:00.496698 2026-04-18 16:22:37.891281 | 2026-04-18 16:22:37.891353 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-18 16:22:37.926282 | mon1 | ok 2026-04-18 16:22:37.930502 | osd1 | ok 2026-04-18 16:22:37.942894 | mon1 | included: /var/lib/zuul/builds/d665a5e30f9d44139c098a0f6d499917/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-18 16:22:37.942944 | osd1 | included: /var/lib/zuul/builds/d665a5e30f9d44139c098a0f6d499917/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-18 16:22:37.952856 | 2026-04-18 16:22:37.952917 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-18 16:22:37.977851 | mon1 | skipping: Conditional result was False 2026-04-18 16:22:37.989458 | osd1 | skipping: Conditional result was False 2026-04-18 16:22:38.001489 | 2026-04-18 16:22:38.001589 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-18 16:22:38.490024 | mon1 | changed 2026-04-18 16:22:38.494713 | osd1 | changed 2026-04-18 16:22:38.499552 | 2026-04-18 16:22:38.499633 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-18 16:22:38.698514 | mon1 | ok 2026-04-18 16:22:38.704736 | osd1 | ok 2026-04-18 16:22:38.711303 | 2026-04-18 16:22:38.711369 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-18 16:22:39.183783 | mon1 | changed 2026-04-18 16:22:39.203015 | osd1 | changed 2026-04-18 16:22:39.209223 | 2026-04-18 16:22:39.209295 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-18 16:22:39.630049 | mon1 | changed 2026-04-18 16:22:39.668660 | osd1 | changed 2026-04-18 16:22:39.676726 | 2026-04-18 16:22:39.676849 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-18 16:22:39.702185 | mon1 | skipping: Conditional result was False 2026-04-18 16:22:39.723393 | osd1 | skipping: Conditional result was False 2026-04-18 16:22:39.788634 | 2026-04-18 16:22:39.788780 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-18 16:22:40.128642 | mon1 -> localhost | changed 2026-04-18 16:22:40.147545 | 2026-04-18 16:22:40.147640 | TASK [add-build-sshkey : Add back temp key] 2026-04-18 16:22:40.424488 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/d665a5e30f9d44139c098a0f6d499917/work/d665a5e30f9d44139c098a0f6d499917_id_rsa (zuul-build-sshkey) 2026-04-18 16:22:40.424735 | mon1 -> localhost | ok: Runtime: 0:00:00.013964 2026-04-18 16:22:40.431443 | 2026-04-18 16:22:40.431514 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-18 16:22:40.689836 | mon1 | ok 2026-04-18 16:22:40.708942 | osd1 | ok 2026-04-18 16:22:40.714424 | 2026-04-18 16:22:40.714497 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-18 16:22:40.747934 | mon1 | skipping: Conditional result was False 2026-04-18 16:22:40.759471 | osd1 | skipping: Conditional result was False 2026-04-18 16:22:40.781498 | 2026-04-18 16:22:40.781567 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-18 16:22:41.066523 | mon1 | ok 2026-04-18 16:22:41.072690 | osd1 | ok 2026-04-18 16:22:41.078888 | 2026-04-18 16:22:41.078961 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-18 16:22:41.745808 | osd1 | Output suppressed because no_log was given 2026-04-18 16:22:41.750515 | mon1 | Output suppressed because no_log was given 2026-04-18 16:22:41.779714 | 2026-04-18 16:22:41.779909 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-18 16:22:41.964946 | mon1 | ok: "logs" 2026-04-18 16:22:41.965272 | mon1 | ok: All items complete 2026-04-18 16:22:41.965302 | 2026-04-18 16:22:41.999533 | osd1 | ok: "logs" 2026-04-18 16:22:42.122510 | mon1 | ok: "artifacts" 2026-04-18 16:22:42.157811 | osd1 | ok: "artifacts" 2026-04-18 16:22:42.280398 | mon1 | ok: "docs" 2026-04-18 16:22:42.317944 | osd1 | ok: "docs" 2026-04-18 16:22:42.326950 | 2026-04-18 16:22:42.327048 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-18 16:22:42.511293 | mon1 | changed: "logs" 2026-04-18 16:22:42.511794 | mon1 | ok: All items complete 2026-04-18 16:22:42.511829 | 2026-04-18 16:22:42.518699 | osd1 | changed: "logs" 2026-04-18 16:22:42.666833 | mon1 | changed: "artifacts" 2026-04-18 16:22:42.679613 | osd1 | changed: "artifacts" 2026-04-18 16:22:42.819437 | mon1 | changed: "docs" 2026-04-18 16:22:42.844944 | osd1 | changed: "docs" 2026-04-18 16:22:42.866528 | 2026-04-18 16:22:42.867096 | PLAY RECAP 2026-04-18 16:22:42.867147 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-18 16:22:42.867177 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-18 16:22:42.867203 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-18 16:22:42.867222 | 2026-04-18 16:22:43.055536 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-18 16:22:43.059908 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-18 16:22:43.693269 | 2026-04-18 16:22:43.693441 | PLAY [all] 2026-04-18 16:22:43.705438 | 2026-04-18 16:22:43.705530 | TASK [setup-uv : Extract archive] 2026-04-18 16:22:46.051271 | mon1 | changed 2026-04-18 16:22:46.056719 | osd1 | changed 2026-04-18 16:22:46.062616 | 2026-04-18 16:22:46.062739 | TASK [setup-uv : Print version] 2026-04-18 16:22:45.806046 | mon1 | uv 0.8.13 2026-04-18 16:22:45.555697 | osd1 | uv 0.8.13 2026-04-18 16:22:46.623599 | mon1 | ok: Runtime: 0:00:00.010235 2026-04-18 16:22:46.633987 | osd1 | ok: Runtime: 0:00:00.011965 2026-04-18 16:22:46.644495 | 2026-04-18 16:22:46.644559 | PLAY RECAP 2026-04-18 16:22:46.644607 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-18 16:22:46.644635 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-18 16:22:46.644654 | 2026-04-18 16:22:46.778916 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-18 16:22:46.784076 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-18 16:22:47.367397 | 2026-04-18 16:22:47.367594 | PLAY [all] 2026-04-18 16:22:47.379340 | 2026-04-18 16:22:47.379421 | TASK [Copy inventory file for Zuul] 2026-04-18 16:22:48.258482 | mon1 | changed 2026-04-18 16:22:48.263531 | 2026-04-18 16:22:48.263612 | TASK [Switch "ansible_host" to private IP] 2026-04-18 16:22:48.549525 | mon1 | changed: 2 replacements made 2026-04-18 16:22:48.555910 | 2026-04-18 16:22:48.555977 | TASK [Run Molecule scenario] 2026-04-18 16:22:48.507413 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-04-18 16:22:49.131885 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-04-18 16:22:49.324763 | mon1 | Using CPython 3.13.7 2026-04-18 16:22:49.324895 | mon1 | Creating virtual environment at: .venv 2026-04-18 16:22:49.574591 | mon1 | Downloading cryptography (4.3MiB) 2026-04-18 16:22:49.582065 | mon1 | Downloading ansible-core (2.1MiB) 2026-04-18 16:22:49.582461 | mon1 | Downloading pygments (1.2MiB) 2026-04-18 16:22:49.585145 | mon1 | Downloading netaddr (2.2MiB) 2026-04-18 16:22:49.757528 | mon1 | Downloading netaddr 2026-04-18 16:22:49.767847 | mon1 | Downloading cryptography 2026-04-18 16:22:49.810577 | mon1 | Downloading pygments 2026-04-18 16:22:49.940189 | mon1 | Downloading ansible-core 2026-04-18 16:22:49.970323 | mon1 | Installed 36 packages in 29ms 2026-04-18 16:22:51.778901 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-04-18 16:22:51.778983 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-04-18 16:22:52.417347 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-04-18 16:22:52.417500 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-04-18 16:23:04.448928 | mon1 | INFO [default > dependency] Executing 2026-04-18 16:23:04.449126 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-04-18 16:23:04.449368 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-04-18 16:23:04.449527 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-04-18 16:23:04.456593 | mon1 | INFO [default > cleanup] Executing 2026-04-18 16:23:04.456955 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-18 16:23:04.483481 | mon1 | INFO [default > destroy] Executing 2026-04-18 16:23:04.483623 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-04-18 16:23:04.483751 | mon1 | INFO [default > destroy] Executed: Successful 2026-04-18 16:23:04.493584 | mon1 | INFO [default > syntax] Executing 2026-04-18 16:23:05.438935 | mon1 | 2026-04-18 16:23:05.439807 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-04-18 16:23:05.496035 | mon1 | INFO [default > syntax] Executed: Successful 2026-04-18 16:23:05.505698 | mon1 | INFO [default > create] Executing 2026-04-18 16:23:05.507531 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-18 16:23:05.514564 | mon1 | INFO [default > prepare] Executing 2026-04-18 16:23:06.159141 | mon1 | 2026-04-18 16:23:06.159358 | mon1 | PLAY [Prepare] ***************************************************************** 2026-04-18 16:23:06.159553 | mon1 | 2026-04-18 16:23:06.159793 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-18 16:23:06.159999 | mon1 | Saturday 18 April 2026 16:23:06 +0000 (0:00:00.029) 0:00:00.029 ******** 2026-04-18 16:23:07.276988 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-04-18 16:23:07.277144 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-18 16:23:07.277359 | mon1 | interpreter could change the meaning of that path. See 2026-04-18 16:23:07.277580 | mon1 | https://docs.ansible.com/ansible- 2026-04-18 16:23:07.277797 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-18 16:23:07.347897 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-04-18 16:23:07.348126 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-18 16:23:07.348407 | mon1 | interpreter could change the meaning of that path. See 2026-04-18 16:23:07.348682 | mon1 | https://docs.ansible.com/ansible- 2026-04-18 16:23:07.348916 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-18 16:23:07.356385 | mon1 | ok: [mon1] 2026-04-18 16:23:07.356592 | mon1 | ok: [osd1] 2026-04-18 16:23:07.356843 | mon1 | 2026-04-18 16:23:07.357050 | mon1 | TASK [Configure short hostname] ************************************************ 2026-04-18 16:23:07.357268 | mon1 | Saturday 18 April 2026 16:23:07 +0000 (0:00:01.197) 0:00:01.227 ******** 2026-04-18 16:23:08.084224 | mon1 | changed: [mon1] 2026-04-18 16:23:08.084406 | mon1 | changed: [osd1] 2026-04-18 16:23:08.084588 | mon1 | 2026-04-18 16:23:08.084913 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-04-18 16:23:08.085132 | mon1 | Saturday 18 April 2026 16:23:08 +0000 (0:00:00.727) 0:00:01.955 ******** 2026-04-18 16:23:08.353093 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-04-18 16:23:08.353150 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-04-18 16:23:08.353258 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-18 16:23:08.377876 | mon1 | changed: [mon1] 2026-04-18 16:23:08.377945 | mon1 | changed: [osd1] 2026-04-18 16:23:08.378026 | mon1 | 2026-04-18 16:23:08.378119 | mon1 | TASK [Update apt cache] ******************************************************** 2026-04-18 16:23:08.378211 | mon1 | Saturday 18 April 2026 16:23:08 +0000 (0:00:00.294) 0:00:02.249 ******** 2026-04-18 16:23:19.468489 | mon1 | changed: [osd1] 2026-04-18 16:23:19.468710 | mon1 | changed: [mon1] 2026-04-18 16:23:19.468785 | mon1 | 2026-04-18 16:23:19.468923 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-04-18 16:23:19.469045 | mon1 | 2026-04-18 16:23:19.469180 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-18 16:23:19.469312 | mon1 | Saturday 18 April 2026 16:23:19 +0000 (0:00:11.090) 0:00:13.339 ******** 2026-04-18 16:23:20.147652 | mon1 | ok: [osd1] 2026-04-18 16:23:20.147748 | mon1 | 2026-04-18 16:23:20.147883 | mon1 | TASK [Install depedencies] ***************************************************** 2026-04-18 16:23:20.148008 | mon1 | Saturday 18 April 2026 16:23:20 +0000 (0:00:00.679) 0:00:14.019 ******** 2026-04-18 16:23:44.184565 | mon1 | changed: [osd1] 2026-04-18 16:23:44.185449 | mon1 | 2026-04-18 16:23:44.185476 | mon1 | TASK [Start up service] ******************************************************** 2026-04-18 16:23:44.185487 | mon1 | Saturday 18 April 2026 16:23:44 +0000 (0:00:24.035) 0:00:38.054 ******** 2026-04-18 16:23:44.745520 | mon1 | ok: [osd1] 2026-04-18 16:23:44.745639 | mon1 | 2026-04-18 16:23:44.745769 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-04-18 16:23:44.745913 | mon1 | Saturday 18 April 2026 16:23:44 +0000 (0:00:00.562) 0:00:38.616 ******** 2026-04-18 16:23:45.049371 | mon1 | ok: [osd1] 2026-04-18 16:23:45.049571 | mon1 | 2026-04-18 16:23:45.049928 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-04-18 16:23:45.050255 | mon1 | Saturday 18 April 2026 16:23:45 +0000 (0:00:00.303) 0:00:38.920 ******** 2026-04-18 16:23:45.725827 | mon1 | changed: [osd1] 2026-04-18 16:23:45.725990 | mon1 | 2026-04-18 16:23:45.726010 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-04-18 16:23:45.726101 | mon1 | Saturday 18 April 2026 16:23:45 +0000 (0:00:00.676) 0:00:39.597 ******** 2026-04-18 16:23:45.927922 | mon1 | ok: [osd1] 2026-04-18 16:23:45.928052 | mon1 | 2026-04-18 16:23:45.928067 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-04-18 16:23:45.928204 | mon1 | Saturday 18 April 2026 16:23:45 +0000 (0:00:00.202) 0:00:39.799 ******** 2026-04-18 16:23:45.949190 | mon1 | skipping: [osd1] 2026-04-18 16:23:45.949324 | mon1 | 2026-04-18 16:23:45.949524 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-04-18 16:23:45.949727 | mon1 | Saturday 18 April 2026 16:23:45 +0000 (0:00:00.021) 0:00:39.820 ******** 2026-04-18 16:23:46.511775 | mon1 | changed: [osd1] => (item=osd0) 2026-04-18 16:23:46.511931 | mon1 | changed: [osd1] => (item=osd1) 2026-04-18 16:23:46.512133 | mon1 | changed: [osd1] => (item=osd2) 2026-04-18 16:23:46.512320 | mon1 | 2026-04-18 16:23:46.512530 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-04-18 16:23:46.512800 | mon1 | Saturday 18 April 2026 16:23:46 +0000 (0:00:00.561) 0:00:40.382 ******** 2026-04-18 16:23:47.172554 | mon1 | changed: [osd1] => (item=osd0) 2026-04-18 16:23:47.172906 | mon1 | changed: [osd1] => (item=osd1) 2026-04-18 16:23:47.173239 | mon1 | changed: [osd1] => (item=osd2) 2026-04-18 16:23:47.173486 | mon1 | 2026-04-18 16:23:47.173695 | mon1 | TASK [Start loop devices] ****************************************************** 2026-04-18 16:23:47.174266 | mon1 | Saturday 18 April 2026 16:23:47 +0000 (0:00:00.660) 0:00:41.043 ******** 2026-04-18 16:23:47.910916 | mon1 | changed: [osd1] => (item=osd0) 2026-04-18 16:23:47.911028 | mon1 | changed: [osd1] => (item=osd1) 2026-04-18 16:23:47.911164 | mon1 | changed: [osd1] => (item=osd2) 2026-04-18 16:23:47.911289 | mon1 | 2026-04-18 16:23:47.911450 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-04-18 16:23:47.911564 | mon1 | Saturday 18 April 2026 16:23:47 +0000 (0:00:00.738) 0:00:41.782 ******** 2026-04-18 16:23:51.061171 | mon1 | changed: [osd1] => (item=osd0) 2026-04-18 16:23:51.061341 | mon1 | changed: [osd1] => (item=osd1) 2026-04-18 16:23:51.061579 | mon1 | changed: [osd1] => (item=osd2) 2026-04-18 16:23:51.061780 | mon1 | 2026-04-18 16:23:51.061997 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-04-18 16:23:51.062205 | mon1 | Saturday 18 April 2026 16:23:51 +0000 (0:00:03.149) 0:00:44.931 ******** 2026-04-18 16:23:53.049170 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-04-18 16:23:53.050320 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-04-18 16:23:53.051009 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-04-18 16:23:53.051263 | mon1 | 2026-04-18 16:23:53.051509 | mon1 | PLAY RECAP ********************************************************************* 2026-04-18 16:23:53.051818 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-18 16:23:53.052069 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-18 16:23:53.052385 | mon1 | 2026-04-18 16:23:53.052693 | mon1 | 2026-04-18 16:23:53.052989 | mon1 | TASKS RECAP ******************************************************************** 2026-04-18 16:23:53.053228 | mon1 | Saturday 18 April 2026 16:23:53 +0000 (0:00:01.988) 0:00:46.920 ******** 2026-04-18 16:23:53.053476 | mon1 | =============================================================================== 2026-04-18 16:23:53.053705 | mon1 | Install depedencies ---------------------------------------------------- 24.04s 2026-04-18 16:23:53.053929 | mon1 | Update apt cache ------------------------------------------------------- 11.09s 2026-04-18 16:23:53.054149 | mon1 | Create a volume group for each loop device ------------------------------ 3.15s 2026-04-18 16:23:53.054373 | mon1 | Create a logical volume for each loop device ---------------------------- 1.99s 2026-04-18 16:23:53.054594 | mon1 | Gathering Facts --------------------------------------------------------- 1.20s 2026-04-18 16:23:53.054813 | mon1 | Start loop devices ------------------------------------------------------ 0.74s 2026-04-18 16:23:53.055036 | mon1 | Configure short hostname ------------------------------------------------ 0.73s 2026-04-18 16:23:53.055251 | mon1 | Gathering Facts --------------------------------------------------------- 0.68s 2026-04-18 16:23:53.055469 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.68s 2026-04-18 16:23:53.055710 | mon1 | Set permissions on loopback devices ------------------------------------- 0.66s 2026-04-18 16:23:53.055977 | mon1 | Start up service -------------------------------------------------------- 0.56s 2026-04-18 16:23:53.056200 | mon1 | Create devices for Ceph ------------------------------------------------- 0.56s 2026-04-18 16:23:53.056413 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.30s 2026-04-18 16:23:53.056671 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.29s 2026-04-18 16:23:53.056949 | mon1 | Get list of all loopback devices ---------------------------------------- 0.20s 2026-04-18 16:23:53.057176 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-04-18 16:23:53.118109 | mon1 | INFO [default > prepare] Executed: Successful 2026-04-18 16:23:53.126896 | mon1 | INFO [default > converge] Executing 2026-04-18 16:23:53.945643 | mon1 | 2026-04-18 16:23:53.945780 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-04-18 16:23:53.945953 | mon1 | 2026-04-18 16:23:53.946173 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-18 16:23:53.946519 | mon1 | Saturday 18 April 2026 16:23:53 +0000 (0:00:00.045) 0:00:00.045 ******** 2026-04-18 16:23:54.932015 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-04-18 16:23:54.932091 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-18 16:23:54.932210 | mon1 | interpreter could change the meaning of that path. See 2026-04-18 16:23:54.932305 | mon1 | https://docs.ansible.com/ansible- 2026-04-18 16:23:54.932405 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-18 16:23:54.946489 | mon1 | ok: [mon1] 2026-04-18 16:23:54.946696 | mon1 | 2026-04-18 16:23:54.946959 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:23:54.947172 | mon1 | Saturday 18 April 2026 16:23:54 +0000 (0:00:01.000) 0:00:01.045 ******** 2026-04-18 16:23:55.235464 | mon1 | ok: [mon1] 2026-04-18 16:23:55.235641 | mon1 | 2026-04-18 16:23:55.235878 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:23:55.236115 | mon1 | Saturday 18 April 2026 16:23:55 +0000 (0:00:00.289) 0:00:01.334 ******** 2026-04-18 16:23:55.270759 | mon1 | skipping: [mon1] 2026-04-18 16:23:55.270949 | mon1 | 2026-04-18 16:23:55.271361 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-18 16:23:55.271537 | mon1 | Saturday 18 April 2026 16:23:55 +0000 (0:00:00.035) 0:00:01.370 ******** 2026-04-18 16:23:55.613236 | mon1 | changed: [mon1] 2026-04-18 16:23:55.613392 | mon1 | 2026-04-18 16:23:55.613648 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:23:55.613938 | mon1 | Saturday 18 April 2026 16:23:55 +0000 (0:00:00.342) 0:00:01.712 ******** 2026-04-18 16:23:55.708442 | mon1 | ok: [mon1] => { 2026-04-18 16:23:55.708598 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-18 16:23:55.708846 | mon1 | } 2026-04-18 16:23:55.709034 | mon1 | 2026-04-18 16:23:55.709310 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:23:55.709570 | mon1 | Saturday 18 April 2026 16:23:55 +0000 (0:00:00.095) 0:00:01.807 ******** 2026-04-18 16:23:56.361128 | mon1 | changed: [mon1] 2026-04-18 16:23:56.361264 | mon1 | 2026-04-18 16:23:56.361277 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:23:56.361288 | mon1 | Saturday 18 April 2026 16:23:56 +0000 (0:00:00.651) 0:00:02.459 ******** 2026-04-18 16:23:56.405264 | mon1 | skipping: [mon1] 2026-04-18 16:23:56.405383 | mon1 | 2026-04-18 16:23:56.405611 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:23:56.405821 | mon1 | Saturday 18 April 2026 16:23:56 +0000 (0:00:00.044) 0:00:02.504 ******** 2026-04-18 16:23:56.447847 | mon1 | skipping: [mon1] 2026-04-18 16:23:56.448101 | mon1 | 2026-04-18 16:23:56.448285 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:23:56.448498 | mon1 | Saturday 18 April 2026 16:23:56 +0000 (0:00:00.042) 0:00:02.547 ******** 2026-04-18 16:23:56.642652 | mon1 | ok: [mon1] 2026-04-18 16:23:56.642767 | mon1 | 2026-04-18 16:23:56.642955 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-18 16:23:56.643161 | mon1 | Saturday 18 April 2026 16:23:56 +0000 (0:00:00.194) 0:00:02.742 ******** 2026-04-18 16:23:57.768045 | mon1 | ok: [mon1] 2026-04-18 16:23:57.768164 | mon1 | 2026-04-18 16:23:57.768386 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:23:57.768711 | mon1 | Saturday 18 April 2026 16:23:57 +0000 (0:00:01.125) 0:00:03.867 ******** 2026-04-18 16:23:57.838307 | mon1 | ok: [mon1] => { 2026-04-18 16:23:57.838478 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz" 2026-04-18 16:23:57.838701 | mon1 | } 2026-04-18 16:23:57.838909 | mon1 | 2026-04-18 16:23:57.839144 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:23:57.839369 | mon1 | Saturday 18 April 2026 16:23:57 +0000 (0:00:00.070) 0:00:03.937 ******** 2026-04-18 16:23:58.487414 | mon1 | changed: [mon1] 2026-04-18 16:23:58.487613 | mon1 | 2026-04-18 16:23:58.487849 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:23:58.488070 | mon1 | Saturday 18 April 2026 16:23:58 +0000 (0:00:00.648) 0:00:04.586 ******** 2026-04-18 16:24:01.443604 | mon1 | changed: [mon1] 2026-04-18 16:24:01.443738 | mon1 | 2026-04-18 16:24:01.443910 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-18 16:24:01.444098 | mon1 | Saturday 18 April 2026 16:24:01 +0000 (0:00:02.956) 0:00:07.543 ******** 2026-04-18 16:24:01.472561 | mon1 | skipping: [mon1] 2026-04-18 16:24:01.472769 | mon1 | 2026-04-18 16:24:01.472981 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-18 16:24:01.473182 | mon1 | Saturday 18 April 2026 16:24:01 +0000 (0:00:00.029) 0:00:07.572 ******** 2026-04-18 16:24:01.496854 | mon1 | skipping: [mon1] 2026-04-18 16:24:01.497037 | mon1 | 2026-04-18 16:24:01.497245 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-18 16:24:01.497469 | mon1 | Saturday 18 April 2026 16:24:01 +0000 (0:00:00.024) 0:00:07.596 ******** 2026-04-18 16:24:01.526705 | mon1 | skipping: [mon1] 2026-04-18 16:24:01.526862 | mon1 | 2026-04-18 16:24:01.527065 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-18 16:24:01.527268 | mon1 | Saturday 18 April 2026 16:24:01 +0000 (0:00:00.029) 0:00:07.626 ******** 2026-04-18 16:24:06.957330 | mon1 | changed: [mon1] 2026-04-18 16:24:06.957729 | mon1 | 2026-04-18 16:24:06.957744 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-18 16:24:06.957755 | mon1 | Saturday 18 April 2026 16:24:06 +0000 (0:00:05.430) 0:00:13.057 ******** 2026-04-18 16:24:07.496805 | mon1 | changed: [mon1] 2026-04-18 16:24:07.496892 | mon1 | 2026-04-18 16:24:07.497260 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-18 16:24:07.497323 | mon1 | Saturday 18 April 2026 16:24:07 +0000 (0:00:00.539) 0:00:13.596 ******** 2026-04-18 16:24:08.441219 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-04-18 16:24:08.441368 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-18 16:24:08.442273 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-18 16:24:08.442468 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-18 16:24:08.442476 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-18 16:24:08.442485 | mon1 | 2026-04-18 16:24:08.442492 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-18 16:24:08.442499 | mon1 | Saturday 18 April 2026 16:24:08 +0000 (0:00:00.944) 0:00:14.540 ******** 2026-04-18 16:24:09.029441 | mon1 | changed: [mon1] 2026-04-18 16:24:09.030493 | mon1 | 2026-04-18 16:24:09.030506 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-18 16:24:09.030513 | mon1 | Saturday 18 April 2026 16:24:09 +0000 (0:00:00.582) 0:00:15.123 ******** 2026-04-18 16:24:09.030519 | mon1 | 2026-04-18 16:24:09.030525 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-18 16:24:09.030531 | mon1 | Saturday 18 April 2026 16:24:09 +0000 (0:00:00.005) 0:00:15.129 ******** 2026-04-18 16:24:09.934515 | mon1 | ok: [mon1] 2026-04-18 16:24:09.934618 | mon1 | 2026-04-18 16:24:09.934635 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-04-18 16:24:09.934787 | mon1 | Saturday 18 April 2026 16:24:09 +0000 (0:00:00.905) 0:00:16.034 ******** 2026-04-18 16:24:10.383939 | mon1 | changed: [mon1] 2026-04-18 16:24:10.384057 | mon1 | 2026-04-18 16:24:10.384088 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-18 16:24:10.384182 | mon1 | Saturday 18 April 2026 16:24:10 +0000 (0:00:00.449) 0:00:16.483 ******** 2026-04-18 16:24:10.919979 | mon1 | changed: [mon1] 2026-04-18 16:24:10.920055 | mon1 | 2026-04-18 16:24:10.920270 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-18 16:24:10.920322 | mon1 | Saturday 18 April 2026 16:24:10 +0000 (0:00:00.536) 0:00:17.019 ******** 2026-04-18 16:24:11.118654 | mon1 | ok: [mon1] 2026-04-18 16:24:11.118727 | mon1 | 2026-04-18 16:24:11.118938 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-18 16:24:11.118993 | mon1 | Saturday 18 April 2026 16:24:11 +0000 (0:00:00.198) 0:00:17.218 ******** 2026-04-18 16:24:11.197361 | mon1 | ok: [mon1] => { 2026-04-18 16:24:11.197448 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-18 16:24:11.198002 | mon1 | } 2026-04-18 16:24:11.198080 | mon1 | 2026-04-18 16:24:11.198088 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-18 16:24:11.198095 | mon1 | Saturday 18 April 2026 16:24:11 +0000 (0:00:00.078) 0:00:17.296 ******** 2026-04-18 16:24:12.024325 | mon1 | changed: [mon1] 2026-04-18 16:24:12.024395 | mon1 | 2026-04-18 16:24:12.024854 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-18 16:24:12.024936 | mon1 | Saturday 18 April 2026 16:24:12 +0000 (0:00:00.826) 0:00:18.123 ******** 2026-04-18 16:24:16.483777 | mon1 | changed: [mon1] 2026-04-18 16:24:16.483895 | mon1 | 2026-04-18 16:24:16.483910 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-18 16:24:16.484102 | mon1 | Saturday 18 April 2026 16:24:16 +0000 (0:00:04.459) 0:00:22.583 ******** 2026-04-18 16:24:17.503633 | mon1 | ok: [mon1] 2026-04-18 16:24:17.503755 | mon1 | 2026-04-18 16:24:17.503773 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-18 16:24:17.503896 | mon1 | Saturday 18 April 2026 16:24:17 +0000 (0:00:01.020) 0:00:23.603 ******** 2026-04-18 16:24:17.853235 | mon1 | changed: [mon1] 2026-04-18 16:24:17.853301 | mon1 | 2026-04-18 16:24:17.853308 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-18 16:24:17.853315 | mon1 | Saturday 18 April 2026 16:24:17 +0000 (0:00:00.348) 0:00:23.952 ******** 2026-04-18 16:24:18.302612 | mon1 | changed: [mon1] 2026-04-18 16:24:18.302685 | mon1 | 2026-04-18 16:24:18.302743 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-18 16:24:18.302876 | mon1 | Saturday 18 April 2026 16:24:18 +0000 (0:00:00.450) 0:00:24.402 ******** 2026-04-18 16:24:18.841041 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-04-18 16:24:18.841985 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-18 16:24:18.842036 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-18 16:24:18.842043 | mon1 | 2026-04-18 16:24:18.842050 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-18 16:24:18.842056 | mon1 | Saturday 18 April 2026 16:24:18 +0000 (0:00:00.538) 0:00:24.940 ******** 2026-04-18 16:24:19.281462 | mon1 | changed: [mon1] 2026-04-18 16:24:19.281525 | mon1 | 2026-04-18 16:24:19.281615 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-18 16:24:19.281718 | mon1 | Saturday 18 April 2026 16:24:19 +0000 (0:00:00.440) 0:00:25.381 ******** 2026-04-18 16:24:19.746047 | mon1 | changed: [mon1] 2026-04-18 16:24:19.746089 | mon1 | 2026-04-18 16:24:19.746095 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-18 16:24:19.746100 | mon1 | Saturday 18 April 2026 16:24:19 +0000 (0:00:00.458) 0:00:25.839 ******** 2026-04-18 16:24:19.746104 | mon1 | 2026-04-18 16:24:19.746108 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-18 16:24:19.746121 | mon1 | Saturday 18 April 2026 16:24:19 +0000 (0:00:00.005) 0:00:25.845 ******** 2026-04-18 16:24:20.389101 | mon1 | ok: [mon1] 2026-04-18 16:24:20.389180 | mon1 | 2026-04-18 16:24:20.389485 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-04-18 16:24:20.389536 | mon1 | Saturday 18 April 2026 16:24:20 +0000 (0:00:00.643) 0:00:26.488 ******** 2026-04-18 16:24:21.884613 | mon1 | changed: [mon1] 2026-04-18 16:24:21.884748 | mon1 | 2026-04-18 16:24:21.885021 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-18 16:24:21.885095 | mon1 | Saturday 18 April 2026 16:24:21 +0000 (0:00:01.495) 0:00:27.983 ******** 2026-04-18 16:24:22.425887 | mon1 | changed: [mon1] 2026-04-18 16:24:22.425963 | mon1 | 2026-04-18 16:24:22.426197 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-18 16:24:22.426243 | mon1 | Saturday 18 April 2026 16:24:22 +0000 (0:00:00.541) 0:00:28.525 ******** 2026-04-18 16:24:22.475196 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-04-18 16:24:22.475277 | mon1 | 2026-04-18 16:24:22.475581 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-18 16:24:22.475616 | mon1 | Saturday 18 April 2026 16:24:22 +0000 (0:00:00.049) 0:00:28.574 ******** 2026-04-18 16:24:48.607039 | mon1 | changed: [mon1] 2026-04-18 16:24:48.607280 | mon1 | 2026-04-18 16:24:48.607293 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-18 16:24:48.607304 | mon1 | Saturday 18 April 2026 16:24:48 +0000 (0:00:26.132) 0:00:54.706 ******** 2026-04-18 16:24:49.237433 | mon1 | ok: [mon1] => (item=chronyd) 2026-04-18 16:24:49.237507 | mon1 | ok: [mon1] => (item=sshd) 2026-04-18 16:24:49.237798 | mon1 | 2026-04-18 16:24:49.237944 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-18 16:24:49.237950 | mon1 | Saturday 18 April 2026 16:24:49 +0000 (0:00:00.630) 0:00:55.337 ******** 2026-04-18 16:24:49.490193 | mon1 | fatal: [mon1]: FAILED! => {"changed": false, "dest": "/usr/bin/cephadm", "elapsed": 0, "msg": "Request failed", "response": "HTTP Error 404: Not Found", "status_code": 404, "url": "https://download.ceph.com/rpm-21.0.0/el9/noarch/cephadm"} 2026-04-18 16:24:49.493208 | mon1 | 2026-04-18 16:24:49.496763 | mon1 | PLAY RECAP ********************************************************************* 2026-04-18 16:24:49.496811 | mon1 | mon1 : ok=33 changed=20 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0 2026-04-18 16:24:49.496840 | mon1 | 2026-04-18 16:24:49.496846 | mon1 | 2026-04-18 16:24:49.496852 | mon1 | TASKS RECAP ******************************************************************** 2026-04-18 16:24:49.496858 | mon1 | Saturday 18 April 2026 16:24:49 +0000 (0:00:00.255) 0:00:55.593 ******** 2026-04-18 16:24:49.496864 | mon1 | =============================================================================== 2026-04-18 16:24:49.496869 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 26.13s 2026-04-18 16:24:49.496875 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.43s 2026-04-18 16:24:49.496880 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.46s 2026-04-18 16:24:49.496885 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.96s 2026-04-18 16:24:49.496891 | mon1 | vexxhost.containers.containerd : Reload systemd ------------------------- 1.55s 2026-04-18 16:24:49.496896 | mon1 | vexxhost.containers.docker : Restart docker ----------------------------- 1.50s 2026-04-18 16:24:49.496901 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 1.13s 2026-04-18 16:24:49.496907 | mon1 | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.02s 2026-04-18 16:24:49.496912 | mon1 | Gathering Facts --------------------------------------------------------- 1.00s 2026-04-18 16:24:49.496917 | mon1 | vexxhost.containers.containerd : Create folders for configuration ------- 0.94s 2026-04-18 16:24:49.496937 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.83s 2026-04-18 16:24:49.496942 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.65s 2026-04-18 16:24:49.496953 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.65s 2026-04-18 16:24:49.498083 | mon1 | vexxhost.ceph.cephadm : Ensure services are started --------------------- 0.63s 2026-04-18 16:24:49.498115 | mon1 | vexxhost.containers.containerd : Create containerd config file ---------- 0.58s 2026-04-18 16:24:49.498125 | mon1 | vexxhost.containers.docker : Enable and start service ------------------- 0.54s 2026-04-18 16:24:49.498134 | mon1 | vexxhost.containers.containerd : Create systemd service file for containerd --- 0.54s 2026-04-18 16:24:49.498143 | mon1 | vexxhost.containers.docker : Create folders for configuration ----------- 0.54s 2026-04-18 16:24:49.498151 | mon1 | vexxhost.containers.containerd : Enable and start service --------------- 0.54s 2026-04-18 16:24:49.498160 | mon1 | vexxhost.containers.docker : Create docker daemon config file ----------- 0.46s 2026-04-18 16:24:49.570535 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-04-18 16:24:49.570808 | mon1 | ERROR [default > converge] Executed: Failed 2026-04-18 16:24:49.570984 | mon1 | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-04-18 16:24:49.776414 | mon1 | ERROR 2026-04-18 16:24:49.776590 | mon1 | { 2026-04-18 16:24:49.776620 | mon1 | "delta": "0:02:01.347193", 2026-04-18 16:24:49.776641 | mon1 | "end": "2026-04-18 16:24:49.639924", 2026-04-18 16:24:49.776660 | mon1 | "msg": "non-zero return code", 2026-04-18 16:24:49.776678 | mon1 | "rc": 2, 2026-04-18 16:24:49.776698 | mon1 | "start": "2026-04-18 16:22:48.292731" 2026-04-18 16:24:49.776716 | mon1 | } failure 2026-04-18 16:24:49.780577 | 2026-04-18 16:24:49.780622 | PLAY RECAP 2026-04-18 16:24:49.780667 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-04-18 16:24:49.780688 | 2026-04-18 16:24:49.949897 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-18 16:24:49.955448 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-18 16:24:50.556181 | 2026-04-18 16:24:50.556344 | PLAY [all] 2026-04-18 16:24:50.568549 | 2026-04-18 16:24:50.568628 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-18 16:24:50.623616 | mon1 | ok 2026-04-18 16:24:50.629323 | osd1 | ok 2026-04-18 16:24:50.634521 | 2026-04-18 16:24:50.634598 | TASK [fetch-output : Set log path for single node] 2026-04-18 16:24:50.662317 | mon1 | skipping: Conditional result was False 2026-04-18 16:24:50.673757 | osd1 | skipping: Conditional result was False 2026-04-18 16:24:50.683104 | 2026-04-18 16:24:50.683200 | LOOP [fetch-output : Ensure local output dirs] 2026-04-18 16:24:51.089671 | mon1 -> localhost | changed: "/var/lib/zuul/builds/d665a5e30f9d44139c098a0f6d499917/work/logs/mon1" 2026-04-18 16:24:51.091654 | osd1 -> localhost | changed: "/var/lib/zuul/builds/d665a5e30f9d44139c098a0f6d499917/work/logs/osd1" 2026-04-18 16:24:51.288084 | osd1 -> localhost | changed: "/var/lib/zuul/builds/d665a5e30f9d44139c098a0f6d499917/work/artifacts" 2026-04-18 16:24:51.307163 | mon1 -> localhost | ok: "/var/lib/zuul/builds/d665a5e30f9d44139c098a0f6d499917/work/artifacts" 2026-04-18 16:24:51.492475 | osd1 -> localhost | changed: "/var/lib/zuul/builds/d665a5e30f9d44139c098a0f6d499917/work/docs" 2026-04-18 16:24:51.510340 | mon1 -> localhost | ok: "/var/lib/zuul/builds/d665a5e30f9d44139c098a0f6d499917/work/docs" 2026-04-18 16:24:51.510513 | mon1 -> localhost | changed: All items complete 2026-04-18 16:24:51.510570 | 2026-04-18 16:24:51.527403 | 2026-04-18 16:24:51.527539 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-18 16:24:52.141575 | mon1 | changed: .d..t...... ./ 2026-04-18 16:24:52.146276 | osd1 | changed: .d..t...... ./ 2026-04-18 16:24:52.581154 | mon1 | changed: .d..t...... ./ 2026-04-18 16:24:52.593938 | osd1 | changed: .d..t...... ./ 2026-04-18 16:24:53.015564 | mon1 | changed: .d..t...... ./ 2026-04-18 16:24:53.036058 | osd1 | changed: .d..t...... ./ 2026-04-18 16:24:53.036139 | osd1 | changed: All items complete 2026-04-18 16:24:53.036179 | 2026-04-18 16:24:53.058177 | 2026-04-18 16:24:53.058302 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-18 16:24:53.446196 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006548 2026-04-18 16:24:53.666797 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006641 2026-04-18 16:24:53.684635 | 2026-04-18 16:24:53.684734 | PLAY [all] 2026-04-18 16:24:53.690457 | 2026-04-18 16:24:53.690514 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-18 16:24:54.109937 | mon1 | changed 2026-04-18 16:24:54.291350 | osd1 | changed 2026-04-18 16:24:54.301847 | 2026-04-18 16:24:54.301897 | PLAY RECAP 2026-04-18 16:24:54.301942 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-18 16:24:54.301971 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-18 16:24:54.301990 | 2026-04-18 16:24:54.414939 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-18 16:24:54.420196 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-18 16:24:55.004356 | 2026-04-18 16:24:55.005044 | PLAY [localhost] 2026-04-18 16:24:55.015009 | 2026-04-18 16:24:55.015082 | TASK [Generate Zuul manifest] 2026-04-18 16:24:55.036176 | localhost | ok 2026-04-18 16:24:55.050217 | 2026-04-18 16:24:55.050289 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-18 16:24:55.354299 | localhost | changed 2026-04-18 16:24:55.367078 | 2026-04-18 16:24:55.367157 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-18 16:24:55.399472 | localhost | ok 2026-04-18 16:24:55.408208 | 2026-04-18 16:24:55.408270 | TASK [Upload logs] 2026-04-18 16:24:55.440806 | localhost | ok 2026-04-18 16:24:55.501451 | 2026-04-18 16:24:55.501542 | TASK [Set zuul-log-path fact] 2026-04-18 16:24:55.524747 | localhost | ok 2026-04-18 16:24:55.538408 | 2026-04-18 16:24:55.538478 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-18 16:24:55.569918 | localhost | ok 2026-04-18 16:24:55.579039 | 2026-04-18 16:24:55.579137 | TASK [upload-logs : Create log directories] 2026-04-18 16:24:55.957060 | localhost | changed 2026-04-18 16:24:55.963133 | 2026-04-18 16:24:55.963199 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-18 16:24:56.361640 | localhost -> localhost | ok: Runtime: 0:00:00.005723 2026-04-18 16:24:56.367739 | 2026-04-18 16:24:56.367804 | TASK [upload-logs : Upload logs to log server] 2026-04-18 16:24:56.826470 | localhost | Output suppressed because no_log was given 2026-04-18 16:24:56.830565 | 2026-04-18 16:24:56.830634 | LOOP [upload-logs : Compress console log and json output] 2026-04-18 16:24:56.874229 | localhost | skipping: Conditional result was False 2026-04-18 16:24:56.881139 | localhost | skipping: Conditional result was False 2026-04-18 16:24:56.893313 | 2026-04-18 16:24:56.893405 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-18 16:24:56.935482 | localhost | skipping: Conditional result was False 2026-04-18 16:24:56.935874 | 2026-04-18 16:24:56.939580 | localhost | skipping: Conditional result was False 2026-04-18 16:24:56.957016 | 2026-04-18 16:24:56.957091 | LOOP [upload-logs : Upload console log and json output]