2026-03-05 21:38:27.536239 | Job console starting 2026-03-05 21:38:27.553788 | Updating git repos 2026-03-05 21:38:27.585689 | Cloning repos into workspace 2026-03-05 21:38:27.716184 | Restoring repo states 2026-03-05 21:38:27.725406 | Merging changes 2026-03-05 21:38:28.037379 | Checking out repos 2026-03-05 21:38:28.106658 | Preparing playbooks 2026-03-05 21:38:29.918050 | Running Ansible setup 2026-03-05 21:38:33.850087 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 21:38:34.430000 | 2026-03-05 21:38:34.430105 | PLAY [localhost] 2026-03-05 21:38:34.437689 | 2026-03-05 21:38:34.437757 | TASK [Gathering Facts] 2026-03-05 21:38:35.319588 | localhost | ok 2026-03-05 21:38:35.330863 | 2026-03-05 21:38:35.330970 | TASK [Setup log path fact] 2026-03-05 21:38:35.351072 | localhost | ok 2026-03-05 21:38:35.363827 | 2026-03-05 21:38:35.363893 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 21:38:35.393157 | localhost | ok 2026-03-05 21:38:35.401036 | 2026-03-05 21:38:35.401110 | TASK [emit-job-header : Print job information] 2026-03-05 21:38:35.451463 | # Job Information 2026-03-05 21:38:35.451665 | Ansible Version: 2.16.16 2026-03-05 21:38:35.451736 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-03-05 21:38:35.451785 | Pipeline: check 2026-03-05 21:38:35.451898 | Executor: 0a8996d2b663 2026-03-05 21:38:35.451958 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/95 2026-03-05 21:38:35.452009 | Event ID: 753cf340-18d7-11f1-84a2-1dadd23b4000 2026-03-05 21:38:35.455945 | 2026-03-05 21:38:35.456030 | LOOP [emit-job-header : Print node information] 2026-03-05 21:38:35.545260 | localhost | ok: 2026-03-05 21:38:35.545568 | localhost | # Node Information 2026-03-05 21:38:35.545634 | localhost | Inventory Hostname: mon1 2026-03-05 21:38:35.545683 | localhost | Hostname: np0000157958 2026-03-05 21:38:35.545727 | localhost | Username: zuul 2026-03-05 21:38:35.545777 | localhost | Distro: Ubuntu 22.04 2026-03-05 21:38:35.545821 | localhost | Provider: yul1 2026-03-05 21:38:35.545864 | localhost | Region: ca-ymq-1 2026-03-05 21:38:35.545905 | localhost | Label: ubuntu-jammy 2026-03-05 21:38:35.545946 | localhost | Product Name: OpenStack Nova 2026-03-05 21:38:35.545986 | localhost | Interface IP: 162.253.55.36 2026-03-05 21:38:35.587600 | localhost | ok: 2026-03-05 21:38:35.587718 | localhost | # Node Information 2026-03-05 21:38:35.587759 | localhost | Inventory Hostname: osd1 2026-03-05 21:38:35.587793 | localhost | Hostname: np0000157959 2026-03-05 21:38:35.587824 | localhost | Username: zuul 2026-03-05 21:38:35.587854 | localhost | Distro: Ubuntu 22.04 2026-03-05 21:38:35.587884 | localhost | Provider: yul1 2026-03-05 21:38:35.587914 | localhost | Region: ca-ymq-1 2026-03-05 21:38:35.587944 | localhost | Label: ubuntu-jammy 2026-03-05 21:38:35.587974 | localhost | Product Name: OpenStack Nova 2026-03-05 21:38:35.588005 | localhost | Interface IP: 199.204.45.22 2026-03-05 21:38:35.603818 | 2026-03-05 21:38:35.603969 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-05 21:38:35.983704 | localhost -> localhost | changed 2026-03-05 21:38:35.989885 | 2026-03-05 21:38:35.989993 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-05 21:38:36.803643 | localhost -> localhost | changed 2026-03-05 21:38:36.812816 | 2026-03-05 21:38:36.812893 | PLAY [all] 2026-03-05 21:38:36.825110 | 2026-03-05 21:38:36.825211 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-05 21:38:37.063100 | mon1 -> localhost | ok 2026-03-05 21:38:37.071509 | 2026-03-05 21:38:37.071626 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-05 21:38:37.104430 | mon1 | ok 2026-03-05 21:38:37.108596 | osd1 | ok 2026-03-05 21:38:37.137410 | mon1 | included: /var/lib/zuul/builds/e11d1a6c8f1646e7affb48b68678e0c7/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 21:38:37.137502 | osd1 | included: /var/lib/zuul/builds/e11d1a6c8f1646e7affb48b68678e0c7/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 21:38:37.143093 | 2026-03-05 21:38:37.143155 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-05 21:38:38.229978 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-05 21:38:38.230478 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/e11d1a6c8f1646e7affb48b68678e0c7/work/e11d1a6c8f1646e7affb48b68678e0c7_id_rsa 2026-03-05 21:38:38.230540 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/e11d1a6c8f1646e7affb48b68678e0c7/work/e11d1a6c8f1646e7affb48b68678e0c7_id_rsa.pub 2026-03-05 21:38:38.230577 | mon1 -> localhost | The key fingerprint is: 2026-03-05 21:38:38.230609 | mon1 -> localhost | SHA256:9ad1dbNJo1hGvfXjcQ8ypZO/1BM2TMHpsv6XhhT+Abw zuul-build-sshkey 2026-03-05 21:38:38.230639 | mon1 -> localhost | The key's randomart image is: 2026-03-05 21:38:38.230667 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-05 21:38:38.230696 | mon1 -> localhost | | .o.o| 2026-03-05 21:38:38.230725 | mon1 -> localhost | | . .=.| 2026-03-05 21:38:38.230754 | mon1 -> localhost | | . .*++*| 2026-03-05 21:38:38.230783 | mon1 -> localhost | | . .X=+XX| 2026-03-05 21:38:38.230812 | mon1 -> localhost | | S .o*@=O| 2026-03-05 21:38:38.230840 | mon1 -> localhost | | Eo=o| 2026-03-05 21:38:38.230867 | mon1 -> localhost | | +.o.+| 2026-03-05 21:38:38.230895 | mon1 -> localhost | | o.+.| 2026-03-05 21:38:38.231028 | mon1 -> localhost | | o..| 2026-03-05 21:38:38.231178 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-05 21:38:38.232398 | mon1 -> localhost | ok: Runtime: 0:00:00.701252 2026-03-05 21:38:38.238173 | 2026-03-05 21:38:38.238423 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-05 21:38:38.284541 | mon1 | ok 2026-03-05 21:38:38.288554 | osd1 | ok 2026-03-05 21:38:38.300283 | mon1 | included: /var/lib/zuul/builds/e11d1a6c8f1646e7affb48b68678e0c7/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 21:38:38.300329 | osd1 | included: /var/lib/zuul/builds/e11d1a6c8f1646e7affb48b68678e0c7/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 21:38:38.310111 | 2026-03-05 21:38:38.310175 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-05 21:38:38.333464 | mon1 | skipping: Conditional result was False 2026-03-05 21:38:38.344341 | osd1 | skipping: Conditional result was False 2026-03-05 21:38:38.351970 | 2026-03-05 21:38:38.352052 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-05 21:38:38.775186 | mon1 | changed 2026-03-05 21:38:38.781870 | osd1 | changed 2026-03-05 21:38:38.789512 | 2026-03-05 21:38:38.789726 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-05 21:38:38.973568 | mon1 | ok 2026-03-05 21:38:38.977839 | osd1 | ok 2026-03-05 21:38:38.982477 | 2026-03-05 21:38:38.982538 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-05 21:38:39.456280 | mon1 | changed 2026-03-05 21:38:39.460627 | osd1 | changed 2026-03-05 21:38:39.465779 | 2026-03-05 21:38:39.465838 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-05 21:38:39.904028 | mon1 | changed 2026-03-05 21:38:39.912922 | osd1 | changed 2026-03-05 21:38:39.917629 | 2026-03-05 21:38:39.917691 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-05 21:38:39.951619 | mon1 | skipping: Conditional result was False 2026-03-05 21:38:39.952242 | osd1 | skipping: Conditional result was False 2026-03-05 21:38:39.995476 | 2026-03-05 21:38:39.995602 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-05 21:38:40.316277 | mon1 -> localhost | changed 2026-03-05 21:38:40.341789 | 2026-03-05 21:38:40.341859 | TASK [add-build-sshkey : Add back temp key] 2026-03-05 21:38:40.617657 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/e11d1a6c8f1646e7affb48b68678e0c7/work/e11d1a6c8f1646e7affb48b68678e0c7_id_rsa (zuul-build-sshkey) 2026-03-05 21:38:40.617877 | mon1 -> localhost | ok: Runtime: 0:00:00.013976 2026-03-05 21:38:40.623033 | 2026-03-05 21:38:40.623094 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-05 21:38:40.877677 | mon1 | ok 2026-03-05 21:38:40.883623 | osd1 | ok 2026-03-05 21:38:40.887874 | 2026-03-05 21:38:40.887935 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-05 21:38:40.912151 | mon1 | skipping: Conditional result was False 2026-03-05 21:38:40.923099 | osd1 | skipping: Conditional result was False 2026-03-05 21:38:40.939574 | 2026-03-05 21:38:40.939660 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-05 21:38:41.205675 | mon1 | ok 2026-03-05 21:38:41.222283 | osd1 | ok 2026-03-05 21:38:41.230375 | 2026-03-05 21:38:41.230472 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-05 21:38:41.891874 | osd1 | Output suppressed because no_log was given 2026-03-05 21:38:41.927810 | mon1 | Output suppressed because no_log was given 2026-03-05 21:38:41.941393 | 2026-03-05 21:38:41.941494 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-05 21:38:42.125246 | mon1 | ok: "logs" 2026-03-05 21:38:42.125680 | mon1 | ok: All items complete 2026-03-05 21:38:42.125742 | 2026-03-05 21:38:42.130517 | osd1 | ok: "logs" 2026-03-05 21:38:42.271557 | mon1 | ok: "artifacts" 2026-03-05 21:38:42.286331 | osd1 | ok: "artifacts" 2026-03-05 21:38:42.430402 | mon1 | ok: "docs" 2026-03-05 21:38:42.464895 | osd1 | ok: "docs" 2026-03-05 21:38:42.481740 | 2026-03-05 21:38:42.481898 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-05 21:38:42.665001 | mon1 | changed: "logs" 2026-03-05 21:38:42.665306 | mon1 | ok: All items complete 2026-03-05 21:38:42.665363 | 2026-03-05 21:38:42.674662 | osd1 | changed: "logs" 2026-03-05 21:38:42.820125 | mon1 | changed: "artifacts" 2026-03-05 21:38:42.829109 | osd1 | changed: "artifacts" 2026-03-05 21:38:42.977239 | mon1 | changed: "docs" 2026-03-05 21:38:42.995474 | osd1 | changed: "docs" 2026-03-05 21:38:43.019032 | 2026-03-05 21:38:43.019134 | PLAY RECAP 2026-03-05 21:38:43.019179 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:38:43.019209 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 21:38:43.019233 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 21:38:43.019251 | 2026-03-05 21:38:43.152740 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 21:38:43.157757 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 21:38:43.708378 | 2026-03-05 21:38:43.708494 | PLAY [all] 2026-03-05 21:38:43.719569 | 2026-03-05 21:38:43.719643 | TASK [setup-uv : Extract archive] 2026-03-05 21:38:45.806220 | mon1 | changed 2026-03-05 21:38:45.937580 | osd1 | changed 2026-03-05 21:38:45.944044 | 2026-03-05 21:38:45.944123 | TASK [setup-uv : Print version] 2026-03-05 21:38:45.154611 | mon1 | uv 0.8.13 2026-03-05 21:38:45.041435 | osd1 | uv 0.8.13 2026-03-05 21:38:46.504724 | mon1 | ok: Runtime: 0:00:00.017126 2026-03-05 21:38:46.515728 | osd1 | ok: Runtime: 0:00:00.011488 2026-03-05 21:38:46.525004 | 2026-03-05 21:38:46.525052 | PLAY RECAP 2026-03-05 21:38:46.525098 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:38:46.525126 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:38:46.525145 | 2026-03-05 21:38:46.621192 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 21:38:46.626053 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 21:38:47.171446 | 2026-03-05 21:38:47.171589 | PLAY [all] 2026-03-05 21:38:47.182435 | 2026-03-05 21:38:47.182509 | TASK [Copy inventory file for Zuul] 2026-03-05 21:38:47.966744 | mon1 | changed 2026-03-05 21:38:47.973536 | 2026-03-05 21:38:47.973626 | TASK [Switch "ansible_host" to private IP] 2026-03-05 21:38:48.229228 | mon1 | changed: 2 replacements made 2026-03-05 21:38:48.236410 | 2026-03-05 21:38:48.236506 | TASK [Run Molecule scenario] 2026-03-05 21:38:48.798210 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-03-05 21:38:49.533742 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-03-05 21:38:49.731009 | mon1 | Using CPython 3.13.7 2026-03-05 21:38:49.731074 | mon1 | Creating virtual environment at: .venv 2026-03-05 21:38:49.960926 | mon1 | Downloading cryptography (4.3MiB) 2026-03-05 21:38:49.963044 | mon1 | Downloading pygments (1.2MiB) 2026-03-05 21:38:49.966486 | mon1 | Downloading netaddr (2.2MiB) 2026-03-05 21:38:49.981961 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-05 21:38:50.134044 | mon1 | Downloading netaddr 2026-03-05 21:38:50.146862 | mon1 | Downloading cryptography 2026-03-05 21:38:50.194270 | mon1 | Downloading pygments 2026-03-05 21:38:50.324699 | mon1 | Downloading ansible-core 2026-03-05 21:38:50.353583 | mon1 | Installed 36 packages in 28ms 2026-03-05 21:38:51.433421 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-05 21:38:51.433570 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-05 21:38:52.015313 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-05 21:38:52.015429 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-05 21:39:04.016301 | mon1 | INFO [default > dependency] Executing 2026-03-05 21:39:04.016456 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-05 21:39:04.016568 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-05 21:39:04.016688 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-05 21:39:04.021656 | mon1 | INFO [default > cleanup] Executing 2026-03-05 21:39:04.021900 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:39:04.026854 | mon1 | INFO [default > destroy] Executing 2026-03-05 21:39:04.026880 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 21:39:04.026962 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 21:39:04.037762 | mon1 | INFO [default > syntax] Executing 2026-03-05 21:39:05.010043 | mon1 | 2026-03-05 21:39:05.010319 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-05 21:39:05.063730 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-05 21:39:05.074227 | mon1 | INFO [default > create] Executing 2026-03-05 21:39:05.076395 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:39:05.082908 | mon1 | INFO [default > prepare] Executing 2026-03-05 21:39:05.746071 | mon1 | 2026-03-05 21:39:05.746205 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-05 21:39:05.746407 | mon1 | 2026-03-05 21:39:05.746613 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:39:05.746818 | mon1 | Thursday 05 March 2026 21:39:05 +0000 (0:00:00.030) 0:00:00.030 ******** 2026-03-05 21:39:06.918450 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:39:06.918561 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:39:06.918702 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:39:06.918833 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:39:06.918970 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:39:06.964224 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:39:06.964407 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:39:06.964611 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:39:06.964862 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:39:06.965069 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:39:06.972724 | mon1 | ok: [osd1] 2026-03-05 21:39:06.973006 | mon1 | ok: [mon1] 2026-03-05 21:39:06.973256 | mon1 | 2026-03-05 21:39:06.973467 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-05 21:39:06.973694 | mon1 | Thursday 05 March 2026 21:39:06 +0000 (0:00:01.227) 0:00:01.257 ******** 2026-03-05 21:39:07.654444 | mon1 | changed: [mon1] 2026-03-05 21:39:07.654560 | mon1 | changed: [osd1] 2026-03-05 21:39:07.654685 | mon1 | 2026-03-05 21:39:07.654817 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-05 21:39:07.654955 | mon1 | Thursday 05 March 2026 21:39:07 +0000 (0:00:00.681) 0:00:01.939 ******** 2026-03-05 21:39:07.921279 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-05 21:39:07.921443 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-05 21:39:07.921645 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-05 21:39:07.939680 | mon1 | changed: [mon1] 2026-03-05 21:39:07.939871 | mon1 | changed: [osd1] 2026-03-05 21:39:07.940052 | mon1 | 2026-03-05 21:39:07.940249 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-05 21:39:07.940485 | mon1 | Thursday 05 March 2026 21:39:07 +0000 (0:00:00.285) 0:00:02.225 ******** 2026-03-05 21:39:15.997897 | mon1 | changed: [mon1] 2026-03-05 21:39:15.997991 | mon1 | changed: [osd1] 2026-03-05 21:39:15.998004 | mon1 | 2026-03-05 21:39:15.998098 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-05 21:39:15.998176 | mon1 | 2026-03-05 21:39:15.998267 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:39:15.998357 | mon1 | Thursday 05 March 2026 21:39:15 +0000 (0:00:08.058) 0:00:10.283 ******** 2026-03-05 21:39:16.709020 | mon1 | ok: [osd1] 2026-03-05 21:39:16.709166 | mon1 | 2026-03-05 21:39:16.709371 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-05 21:39:16.709572 | mon1 | Thursday 05 March 2026 21:39:16 +0000 (0:00:00.710) 0:00:10.993 ******** 2026-03-05 21:39:39.531179 | mon1 | changed: [osd1] 2026-03-05 21:39:39.531261 | mon1 | 2026-03-05 21:39:39.531391 | mon1 | TASK [Start up service] ******************************************************** 2026-03-05 21:39:39.531514 | mon1 | Thursday 05 March 2026 21:39:39 +0000 (0:00:22.822) 0:00:33.816 ******** 2026-03-05 21:39:40.074918 | mon1 | ok: [osd1] 2026-03-05 21:39:40.075090 | mon1 | 2026-03-05 21:39:40.075313 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-05 21:39:40.075518 | mon1 | Thursday 05 March 2026 21:39:40 +0000 (0:00:00.543) 0:00:34.359 ******** 2026-03-05 21:39:40.378930 | mon1 | ok: [osd1] 2026-03-05 21:39:40.379092 | mon1 | 2026-03-05 21:39:40.379295 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-05 21:39:40.379503 | mon1 | Thursday 05 March 2026 21:39:40 +0000 (0:00:00.304) 0:00:34.664 ******** 2026-03-05 21:39:41.036724 | mon1 | changed: [osd1] 2026-03-05 21:39:41.036924 | mon1 | 2026-03-05 21:39:41.037141 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-05 21:39:41.037368 | mon1 | Thursday 05 March 2026 21:39:41 +0000 (0:00:00.657) 0:00:35.321 ******** 2026-03-05 21:39:41.229755 | mon1 | ok: [osd1] 2026-03-05 21:39:41.229927 | mon1 | 2026-03-05 21:39:41.230155 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-05 21:39:41.230369 | mon1 | Thursday 05 March 2026 21:39:41 +0000 (0:00:00.192) 0:00:35.514 ******** 2026-03-05 21:39:41.249604 | mon1 | skipping: [osd1] 2026-03-05 21:39:41.249785 | mon1 | 2026-03-05 21:39:41.249983 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-05 21:39:41.250180 | mon1 | Thursday 05 March 2026 21:39:41 +0000 (0:00:00.020) 0:00:35.534 ******** 2026-03-05 21:39:41.777977 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:39:41.778134 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:39:41.778334 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:39:41.778510 | mon1 | 2026-03-05 21:39:41.778715 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-05 21:39:41.778918 | mon1 | Thursday 05 March 2026 21:39:41 +0000 (0:00:00.527) 0:00:36.062 ******** 2026-03-05 21:39:42.395587 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:39:42.395701 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:39:42.395880 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:39:42.396005 | mon1 | 2026-03-05 21:39:42.396143 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-05 21:39:42.396285 | mon1 | Thursday 05 March 2026 21:39:42 +0000 (0:00:00.617) 0:00:36.680 ******** 2026-03-05 21:39:43.118156 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:39:43.118343 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:39:43.118544 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:39:43.118732 | mon1 | 2026-03-05 21:39:43.118957 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-05 21:39:43.119211 | mon1 | Thursday 05 March 2026 21:39:43 +0000 (0:00:00.722) 0:00:37.403 ******** 2026-03-05 21:39:46.078121 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:39:46.078305 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:39:46.078503 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:39:46.078684 | mon1 | 2026-03-05 21:39:46.078921 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-05 21:39:46.079114 | mon1 | Thursday 05 March 2026 21:39:46 +0000 (0:00:02.960) 0:00:40.363 ******** 2026-03-05 21:39:47.918520 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-05 21:39:47.919504 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-05 21:39:47.919523 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-05 21:39:47.919534 | mon1 | 2026-03-05 21:39:47.919545 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:39:47.919568 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 21:39:47.919580 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-05 21:39:47.919591 | mon1 | 2026-03-05 21:39:47.919602 | mon1 | 2026-03-05 21:39:47.919611 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:39:47.919624 | mon1 | Thursday 05 March 2026 21:39:47 +0000 (0:00:01.840) 0:00:42.203 ******** 2026-03-05 21:39:47.919633 | mon1 | =============================================================================== 2026-03-05 21:39:47.919734 | mon1 | Install depedencies ---------------------------------------------------- 22.82s 2026-03-05 21:39:47.919803 | mon1 | Update apt cache -------------------------------------------------------- 8.06s 2026-03-05 21:39:47.919890 | mon1 | Create a volume group for each loop device ------------------------------ 2.96s 2026-03-05 21:39:47.919981 | mon1 | Create a logical volume for each loop device ---------------------------- 1.84s 2026-03-05 21:39:47.920056 | mon1 | Gathering Facts --------------------------------------------------------- 1.23s 2026-03-05 21:39:47.920145 | mon1 | Start loop devices ------------------------------------------------------ 0.72s 2026-03-05 21:39:47.920232 | mon1 | Gathering Facts --------------------------------------------------------- 0.71s 2026-03-05 21:39:47.920319 | mon1 | Configure short hostname ------------------------------------------------ 0.68s 2026-03-05 21:39:47.920414 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.66s 2026-03-05 21:39:47.920493 | mon1 | Set permissions on loopback devices ------------------------------------- 0.62s 2026-03-05 21:39:47.920584 | mon1 | Start up service -------------------------------------------------------- 0.54s 2026-03-05 21:39:47.920672 | mon1 | Create devices for Ceph ------------------------------------------------- 0.53s 2026-03-05 21:39:47.920759 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.30s 2026-03-05 21:39:47.920872 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.29s 2026-03-05 21:39:47.920961 | mon1 | Get list of all loopback devices ---------------------------------------- 0.19s 2026-03-05 21:39:47.921050 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-03-05 21:39:47.992162 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-05 21:39:47.997581 | mon1 | INFO [default > converge] Executing 2026-03-05 21:39:48.814278 | mon1 | 2026-03-05 21:39:48.814419 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 21:39:48.814606 | mon1 | 2026-03-05 21:39:48.814807 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:39:48.815028 | mon1 | Thursday 05 March 2026 21:39:48 +0000 (0:00:00.048) 0:00:00.048 ******** 2026-03-05 21:39:49.752665 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:39:49.752887 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:39:49.753090 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:39:49.753285 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:39:49.753489 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:39:49.763133 | mon1 | ok: [mon1] 2026-03-05 21:39:49.763319 | mon1 | 2026-03-05 21:39:49.763539 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:39:49.763742 | mon1 | Thursday 05 March 2026 21:39:49 +0000 (0:00:00.948) 0:00:00.997 ******** 2026-03-05 21:39:50.047277 | mon1 | ok: [mon1] 2026-03-05 21:39:50.047425 | mon1 | 2026-03-05 21:39:50.047647 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:39:50.047840 | mon1 | Thursday 05 March 2026 21:39:50 +0000 (0:00:00.283) 0:00:01.281 ******** 2026-03-05 21:39:50.079221 | mon1 | skipping: [mon1] 2026-03-05 21:39:50.079424 | mon1 | 2026-03-05 21:39:50.079676 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:39:50.079901 | mon1 | Thursday 05 March 2026 21:39:50 +0000 (0:00:00.032) 0:00:01.313 ******** 2026-03-05 21:39:50.372284 | mon1 | changed: [mon1] 2026-03-05 21:39:50.372367 | mon1 | 2026-03-05 21:39:50.372382 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:39:50.372499 | mon1 | Thursday 05 March 2026 21:39:50 +0000 (0:00:00.292) 0:00:01.606 ******** 2026-03-05 21:39:50.465991 | mon1 | ok: [mon1] => { 2026-03-05 21:39:50.466196 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:39:50.466386 | mon1 | } 2026-03-05 21:39:50.466568 | mon1 | 2026-03-05 21:39:50.466776 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:39:50.466981 | mon1 | Thursday 05 March 2026 21:39:50 +0000 (0:00:00.093) 0:00:01.700 ******** 2026-03-05 21:39:51.137260 | mon1 | changed: [mon1] 2026-03-05 21:39:51.137411 | mon1 | 2026-03-05 21:39:51.137630 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:39:51.137837 | mon1 | Thursday 05 March 2026 21:39:51 +0000 (0:00:00.671) 0:00:02.371 ******** 2026-03-05 21:39:51.175780 | mon1 | skipping: [mon1] 2026-03-05 21:39:51.175959 | mon1 | 2026-03-05 21:39:51.176174 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:39:51.176396 | mon1 | Thursday 05 March 2026 21:39:51 +0000 (0:00:00.038) 0:00:02.410 ******** 2026-03-05 21:39:51.215583 | mon1 | skipping: [mon1] 2026-03-05 21:39:51.215753 | mon1 | 2026-03-05 21:39:51.215956 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:39:51.216155 | mon1 | Thursday 05 March 2026 21:39:51 +0000 (0:00:00.039) 0:00:02.450 ******** 2026-03-05 21:39:51.413332 | mon1 | ok: [mon1] 2026-03-05 21:39:51.413533 | mon1 | 2026-03-05 21:39:51.413760 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:39:51.413972 | mon1 | Thursday 05 March 2026 21:39:51 +0000 (0:00:00.197) 0:00:02.647 ******** 2026-03-05 21:39:52.464749 | mon1 | ok: [mon1] 2026-03-05 21:39:52.465095 | mon1 | 2026-03-05 21:39:52.465315 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:39:52.465513 | mon1 | Thursday 05 March 2026 21:39:52 +0000 (0:00:01.051) 0:00:03.699 ******** 2026-03-05 21:39:52.535412 | mon1 | ok: [mon1] => { 2026-03-05 21:39:52.535603 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:39:52.535793 | mon1 | } 2026-03-05 21:39:52.536052 | mon1 | 2026-03-05 21:39:52.536259 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:39:52.536462 | mon1 | Thursday 05 March 2026 21:39:52 +0000 (0:00:00.071) 0:00:03.770 ******** 2026-03-05 21:39:53.252486 | mon1 | changed: [mon1] 2026-03-05 21:39:53.252661 | mon1 | 2026-03-05 21:39:53.252921 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:39:53.253153 | mon1 | Thursday 05 March 2026 21:39:53 +0000 (0:00:00.716) 0:00:04.486 ******** 2026-03-05 21:39:56.049006 | mon1 | changed: [mon1] 2026-03-05 21:39:56.049172 | mon1 | 2026-03-05 21:39:56.049407 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:39:56.049609 | mon1 | Thursday 05 March 2026 21:39:56 +0000 (0:00:02.796) 0:00:07.283 ******** 2026-03-05 21:39:56.073222 | mon1 | skipping: [mon1] 2026-03-05 21:39:56.073400 | mon1 | 2026-03-05 21:39:56.073628 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:39:56.073818 | mon1 | Thursday 05 March 2026 21:39:56 +0000 (0:00:00.024) 0:00:07.308 ******** 2026-03-05 21:39:56.098982 | mon1 | skipping: [mon1] 2026-03-05 21:39:56.099030 | mon1 | 2026-03-05 21:39:56.099134 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:39:56.099222 | mon1 | Thursday 05 March 2026 21:39:56 +0000 (0:00:00.025) 0:00:07.333 ******** 2026-03-05 21:39:56.126240 | mon1 | skipping: [mon1] 2026-03-05 21:39:56.126277 | mon1 | 2026-03-05 21:39:56.126385 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:39:56.126471 | mon1 | Thursday 05 March 2026 21:39:56 +0000 (0:00:00.027) 0:00:07.361 ******** 2026-03-05 21:40:01.730808 | mon1 | changed: [mon1] 2026-03-05 21:40:01.730848 | mon1 | 2026-03-05 21:40:01.730854 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:40:01.730863 | mon1 | Thursday 05 March 2026 21:40:01 +0000 (0:00:05.603) 0:00:12.964 ******** 2026-03-05 21:40:02.243017 | mon1 | changed: [mon1] 2026-03-05 21:40:02.243057 | mon1 | 2026-03-05 21:40:02.243068 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:40:02.243073 | mon1 | Thursday 05 March 2026 21:40:02 +0000 (0:00:00.512) 0:00:13.477 ******** 2026-03-05 21:40:03.091311 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:40:03.091358 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:40:03.091366 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:40:03.091373 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:40:03.091379 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:40:03.091384 | mon1 | 2026-03-05 21:40:03.091389 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:40:03.091394 | mon1 | Thursday 05 March 2026 21:40:03 +0000 (0:00:00.847) 0:00:14.325 ******** 2026-03-05 21:40:03.625110 | mon1 | changed: [mon1] 2026-03-05 21:40:03.625171 | mon1 | 2026-03-05 21:40:03.625603 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:40:03.625733 | mon1 | Thursday 05 March 2026 21:40:03 +0000 (0:00:00.528) 0:00:14.853 ******** 2026-03-05 21:40:03.625739 | mon1 | 2026-03-05 21:40:03.625744 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:40:03.625748 | mon1 | Thursday 05 March 2026 21:40:03 +0000 (0:00:00.006) 0:00:14.859 ******** 2026-03-05 21:40:04.464691 | mon1 | ok: [mon1] 2026-03-05 21:40:04.464779 | mon1 | 2026-03-05 21:40:04.465058 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 21:40:04.465123 | mon1 | Thursday 05 March 2026 21:40:04 +0000 (0:00:00.839) 0:00:15.699 ******** 2026-03-05 21:40:04.910418 | mon1 | changed: [mon1] 2026-03-05 21:40:04.910509 | mon1 | 2026-03-05 21:40:04.910566 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:40:04.910690 | mon1 | Thursday 05 March 2026 21:40:04 +0000 (0:00:00.445) 0:00:16.145 ******** 2026-03-05 21:40:05.417935 | mon1 | changed: [mon1] 2026-03-05 21:40:05.418000 | mon1 | 2026-03-05 21:40:05.418080 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:40:05.418210 | mon1 | Thursday 05 March 2026 21:40:05 +0000 (0:00:00.507) 0:00:16.652 ******** 2026-03-05 21:40:05.606265 | mon1 | ok: [mon1] 2026-03-05 21:40:05.606341 | mon1 | 2026-03-05 21:40:05.606398 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:40:05.606518 | mon1 | Thursday 05 March 2026 21:40:05 +0000 (0:00:00.188) 0:00:16.841 ******** 2026-03-05 21:40:05.674062 | mon1 | ok: [mon1] => { 2026-03-05 21:40:05.674162 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:40:05.674539 | mon1 | } 2026-03-05 21:40:05.674562 | mon1 | 2026-03-05 21:40:05.674567 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:40:05.674572 | mon1 | Thursday 05 March 2026 21:40:05 +0000 (0:00:00.067) 0:00:16.908 ******** 2026-03-05 21:40:06.719587 | mon1 | changed: [mon1] 2026-03-05 21:40:06.719635 | mon1 | 2026-03-05 21:40:06.719642 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:40:06.719649 | mon1 | Thursday 05 March 2026 21:40:06 +0000 (0:00:01.044) 0:00:17.953 ******** 2026-03-05 21:40:11.040375 | mon1 | changed: [mon1] 2026-03-05 21:40:11.040447 | mon1 | 2026-03-05 21:40:11.040653 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:40:11.040700 | mon1 | Thursday 05 March 2026 21:40:11 +0000 (0:00:04.320) 0:00:22.273 ******** 2026-03-05 21:40:11.954747 | mon1 | ok: [mon1] 2026-03-05 21:40:11.954808 | mon1 | 2026-03-05 21:40:11.955075 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:40:11.955288 | mon1 | Thursday 05 March 2026 21:40:11 +0000 (0:00:00.915) 0:00:23.189 ******** 2026-03-05 21:40:12.268810 | mon1 | changed: [mon1] 2026-03-05 21:40:12.268968 | mon1 | 2026-03-05 21:40:12.268983 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:40:12.269092 | mon1 | Thursday 05 March 2026 21:40:12 +0000 (0:00:00.314) 0:00:23.503 ******** 2026-03-05 21:40:12.690200 | mon1 | changed: [mon1] 2026-03-05 21:40:12.690282 | mon1 | 2026-03-05 21:40:12.690409 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:40:12.690578 | mon1 | Thursday 05 March 2026 21:40:12 +0000 (0:00:00.421) 0:00:23.925 ******** 2026-03-05 21:40:13.205012 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 21:40:13.205067 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:40:13.205178 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:40:13.205471 | mon1 | 2026-03-05 21:40:13.205511 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:40:13.205517 | mon1 | Thursday 05 March 2026 21:40:13 +0000 (0:00:00.514) 0:00:24.439 ******** 2026-03-05 21:40:13.650904 | mon1 | changed: [mon1] 2026-03-05 21:40:13.650952 | mon1 | 2026-03-05 21:40:13.651258 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:40:13.651342 | mon1 | Thursday 05 March 2026 21:40:13 +0000 (0:00:00.445) 0:00:24.885 ******** 2026-03-05 21:40:14.096760 | mon1 | changed: [mon1] 2026-03-05 21:40:14.096893 | mon1 | 2026-03-05 21:40:14.096907 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:40:14.096955 | mon1 | Thursday 05 March 2026 21:40:14 +0000 (0:00:00.440) 0:00:25.325 ******** 2026-03-05 21:40:14.097259 | mon1 | 2026-03-05 21:40:14.097314 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:40:14.097329 | mon1 | Thursday 05 March 2026 21:40:14 +0000 (0:00:00.005) 0:00:25.331 ******** 2026-03-05 21:40:14.730355 | mon1 | ok: [mon1] 2026-03-05 21:40:14.730422 | mon1 | 2026-03-05 21:40:14.730739 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 21:40:14.730790 | mon1 | Thursday 05 March 2026 21:40:14 +0000 (0:00:00.633) 0:00:25.965 ******** 2026-03-05 21:40:15.549324 | mon1 | changed: [mon1] 2026-03-05 21:40:15.549399 | mon1 | 2026-03-05 21:40:15.549711 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:40:15.549767 | mon1 | Thursday 05 March 2026 21:40:15 +0000 (0:00:00.818) 0:00:26.783 ******** 2026-03-05 21:40:16.057937 | mon1 | changed: [mon1] 2026-03-05 21:40:16.058002 | mon1 | 2026-03-05 21:40:16.058255 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:40:16.058294 | mon1 | Thursday 05 March 2026 21:40:16 +0000 (0:00:00.508) 0:00:27.292 ******** 2026-03-05 21:40:16.100499 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:40:16.100562 | mon1 | 2026-03-05 21:40:16.100747 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:40:16.100773 | mon1 | Thursday 05 March 2026 21:40:16 +0000 (0:00:00.042) 0:00:27.335 ******** 2026-03-05 21:40:42.968494 | mon1 | changed: [mon1] 2026-03-05 21:40:42.968716 | mon1 | 2026-03-05 21:40:42.968872 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:40:42.968957 | mon1 | Thursday 05 March 2026 21:40:42 +0000 (0:00:26.867) 0:00:54.202 ******** 2026-03-05 21:40:43.584717 | mon1 | ok: [mon1] => (item=chronyd) 2026-03-05 21:40:43.584810 | mon1 | ok: [mon1] => (item=sshd) 2026-03-05 21:40:43.584900 | mon1 | 2026-03-05 21:40:43.585120 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:40:43.585159 | mon1 | Thursday 05 March 2026 21:40:43 +0000 (0:00:00.616) 0:00:54.819 ******** 2026-03-05 21:40:43.855082 | mon1 | changed: [mon1] 2026-03-05 21:40:43.855153 | mon1 | 2026-03-05 21:40:43.855270 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:40:43.855427 | mon1 | Thursday 05 March 2026 21:40:43 +0000 (0:00:00.270) 0:00:55.089 ******** 2026-03-05 21:40:44.051345 | mon1 | ok: [mon1] 2026-03-05 21:40:44.051404 | mon1 | 2026-03-05 21:40:44.051608 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:40:44.051654 | mon1 | Thursday 05 March 2026 21:40:44 +0000 (0:00:00.196) 0:00:55.285 ******** 2026-03-05 21:40:44.535604 | mon1 | changed: [mon1] 2026-03-05 21:40:44.535655 | mon1 | 2026-03-05 21:40:44.535758 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:40:44.535892 | mon1 | Thursday 05 March 2026 21:40:44 +0000 (0:00:00.484) 0:00:55.770 ******** 2026-03-05 21:40:44.851209 | mon1 | changed: [mon1] 2026-03-05 21:40:44.851252 | mon1 | 2026-03-05 21:40:44.851371 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:40:44.851507 | mon1 | Thursday 05 March 2026 21:40:44 +0000 (0:00:00.315) 0:00:56.086 ******** 2026-03-05 21:40:44.969187 | mon1 | ok: [mon1] 2026-03-05 21:40:44.969264 | mon1 | 2026-03-05 21:40:44.969499 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:40:44.969547 | mon1 | Thursday 05 March 2026 21:40:44 +0000 (0:00:00.117) 0:00:56.203 ******** 2026-03-05 21:40:45.162685 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:40:45.162754 | mon1 | 2026-03-05 21:40:45.162830 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:40:45.162956 | mon1 | Thursday 05 March 2026 21:40:45 +0000 (0:00:00.193) 0:00:56.397 ******** 2026-03-05 21:40:45.208029 | mon1 | ok: [mon1] 2026-03-05 21:40:45.208099 | mon1 | 2026-03-05 21:40:45.208159 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:40:45.208259 | mon1 | Thursday 05 March 2026 21:40:45 +0000 (0:00:00.045) 0:00:56.442 ******** 2026-03-05 21:40:45.303351 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-03-05 21:40:45.303411 | mon1 | 2026-03-05 21:40:45.303472 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-05 21:40:45.303600 | mon1 | Thursday 05 March 2026 21:40:45 +0000 (0:00:00.095) 0:00:56.538 ******** 2026-03-05 21:40:45.580687 | mon1 | changed: [mon1] 2026-03-05 21:40:45.580894 | mon1 | 2026-03-05 21:40:45.580909 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-05 21:40:45.581005 | mon1 | Thursday 05 March 2026 21:40:45 +0000 (0:00:00.277) 0:00:56.815 ******** 2026-03-05 21:40:46.207580 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-05 21:40:46.207668 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-05 21:40:46.207723 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-05 21:40:46.208013 | mon1 | 2026-03-05 21:40:46.208056 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-05 21:40:46.208062 | mon1 | Thursday 05 March 2026 21:40:46 +0000 (0:00:00.626) 0:00:57.442 ******** 2026-03-05 21:42:54.506496 | mon1 | ok: [mon1] 2026-03-05 21:42:54.506572 | mon1 | 2026-03-05 21:42:54.506779 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-05 21:42:54.506828 | mon1 | Thursday 05 March 2026 21:42:54 +0000 (0:02:08.298) 0:03:05.741 ******** 2026-03-05 21:42:54.701167 | mon1 | changed: [mon1] 2026-03-05 21:42:54.701228 | mon1 | 2026-03-05 21:42:54.701443 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-05 21:42:54.701573 | mon1 | Thursday 05 March 2026 21:42:54 +0000 (0:00:00.194) 0:03:05.935 ******** 2026-03-05 21:42:54.736106 | mon1 | ok: [mon1] 2026-03-05 21:42:54.736176 | mon1 | 2026-03-05 21:42:54.736373 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:42:54.736417 | mon1 | Thursday 05 March 2026 21:42:54 +0000 (0:00:00.035) 0:03:05.970 ******** 2026-03-05 21:42:54.801717 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:42:54.801801 | mon1 | 2026-03-05 21:42:54.802043 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:42:54.802091 | mon1 | Thursday 05 March 2026 21:42:54 +0000 (0:00:00.065) 0:03:06.036 ******** 2026-03-05 21:43:00.266043 | mon1 | ok: [mon1] 2026-03-05 21:43:00.266134 | mon1 | 2026-03-05 21:43:00.266143 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:43:00.266289 | mon1 | Thursday 05 March 2026 21:43:00 +0000 (0:00:05.464) 0:03:11.500 ******** 2026-03-05 21:43:00.318931 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:43:00.319024 | mon1 | 2026-03-05 21:43:00.319030 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:43:00.319036 | mon1 | Thursday 05 March 2026 21:43:00 +0000 (0:00:00.051) 0:03:11.552 ******** 2026-03-05 21:43:00.696554 | mon1 | ok: [mon1] 2026-03-05 21:43:00.696607 | mon1 | 2026-03-05 21:43:00.696613 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:43:00.696618 | mon1 | Thursday 05 March 2026 21:43:00 +0000 (0:00:00.378) 0:03:11.931 ******** 2026-03-05 21:43:08.190275 | mon1 | ok: [mon1] 2026-03-05 21:43:08.190346 | mon1 | 2026-03-05 21:43:08.190530 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:43:08.190574 | mon1 | Thursday 05 March 2026 21:43:08 +0000 (0:00:07.493) 0:03:19.425 ******** 2026-03-05 21:43:20.622714 | mon1 | changed: [mon1] 2026-03-05 21:43:20.622784 | mon1 | 2026-03-05 21:43:20.622799 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:43:20.622941 | mon1 | Thursday 05 March 2026 21:43:20 +0000 (0:00:12.431) 0:03:31.857 ******** 2026-03-05 21:43:34.830224 | mon1 | ok: [mon1] 2026-03-05 21:43:34.830268 | mon1 | 2026-03-05 21:43:34.830282 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:43:34.830287 | mon1 | Thursday 05 March 2026 21:43:34 +0000 (0:00:14.207) 0:03:46.064 ******** 2026-03-05 21:43:34.891116 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:43:34.891138 | mon1 | 2026-03-05 21:43:34.891143 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:43:34.891148 | mon1 | Thursday 05 March 2026 21:43:34 +0000 (0:00:00.061) 0:03:46.126 ******** 2026-03-05 21:43:34.931144 | mon1 | skipping: [mon1] 2026-03-05 21:43:34.931167 | mon1 | 2026-03-05 21:43:34.931174 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:43:34.931180 | mon1 | Thursday 05 March 2026 21:43:34 +0000 (0:00:00.039) 0:03:46.165 ******** 2026-03-05 21:43:34.970652 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 21:43:34.970668 | mon1 | skipping: [mon1] 2026-03-05 21:43:34.970673 | mon1 | 2026-03-05 21:43:34.970677 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:43:34.970682 | mon1 | Thursday 05 March 2026 21:43:34 +0000 (0:00:00.039) 0:03:46.205 ******** 2026-03-05 21:43:35.210810 | mon1 | ok: [mon1] 2026-03-05 21:43:35.211206 | mon1 | 2026-03-05 21:43:35.211269 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:43:35.211286 | mon1 | Thursday 05 March 2026 21:43:35 +0000 (0:00:00.239) 0:03:46.445 ******** 2026-03-05 21:43:41.691703 | mon1 | ok: [mon1] 2026-03-05 21:43:41.691770 | mon1 | 2026-03-05 21:43:41.691954 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:43:41.691996 | mon1 | Thursday 05 March 2026 21:43:41 +0000 (0:00:06.481) 0:03:52.926 ******** 2026-03-05 21:43:53.697547 | mon1 | changed: [mon1] 2026-03-05 21:43:53.697619 | mon1 | 2026-03-05 21:43:53.697701 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:43:53.697828 | mon1 | Thursday 05 March 2026 21:43:53 +0000 (0:00:12.005) 0:04:04.932 ******** 2026-03-05 21:43:59.854619 | mon1 | ok: [mon1] 2026-03-05 21:43:59.854663 | mon1 | 2026-03-05 21:43:59.854770 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:43:59.854901 | mon1 | Thursday 05 March 2026 21:43:59 +0000 (0:00:06.157) 0:04:11.089 ******** 2026-03-05 21:44:07.290528 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:44:07.290570 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 21:44:07.290576 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 21:44:07.290580 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 21:44:07.290585 | mon1 | 2026-03-05 21:44:07.290590 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:44:07.290594 | mon1 | 2026-03-05 21:44:07.290598 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:44:07.290602 | mon1 | Thursday 05 March 2026 21:44:07 +0000 (0:00:07.435) 0:04:18.524 ******** 2026-03-05 21:44:08.369077 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:44:08.369144 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:44:08.369156 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:44:08.369166 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:44:08.369175 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:44:08.383966 | mon1 | ok: [osd1] 2026-03-05 21:44:08.384017 | mon1 | 2026-03-05 21:44:08.384024 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:44:08.384030 | mon1 | Thursday 05 March 2026 21:44:08 +0000 (0:00:01.093) 0:04:19.618 ******** 2026-03-05 21:44:08.598561 | mon1 | ok: [osd1] 2026-03-05 21:44:08.598658 | mon1 | 2026-03-05 21:44:08.598665 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:44:08.598671 | mon1 | Thursday 05 March 2026 21:44:08 +0000 (0:00:00.214) 0:04:19.832 ******** 2026-03-05 21:44:08.637355 | mon1 | skipping: [osd1] 2026-03-05 21:44:08.637407 | mon1 | 2026-03-05 21:44:08.637414 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:44:08.637420 | mon1 | Thursday 05 March 2026 21:44:08 +0000 (0:00:00.039) 0:04:19.871 ******** 2026-03-05 21:44:08.838896 | mon1 | changed: [osd1] 2026-03-05 21:44:08.838952 | mon1 | 2026-03-05 21:44:08.838959 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:44:08.838999 | mon1 | Thursday 05 March 2026 21:44:08 +0000 (0:00:00.200) 0:04:20.071 ******** 2026-03-05 21:44:08.896325 | mon1 | ok: [osd1] => { 2026-03-05 21:44:08.896371 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:44:08.896377 | mon1 | } 2026-03-05 21:44:08.896382 | mon1 | 2026-03-05 21:44:08.896386 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:44:08.896391 | mon1 | Thursday 05 March 2026 21:44:08 +0000 (0:00:00.058) 0:04:20.130 ******** 2026-03-05 21:44:09.446873 | mon1 | changed: [osd1] 2026-03-05 21:44:09.446922 | mon1 | 2026-03-05 21:44:09.446930 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:44:09.446936 | mon1 | Thursday 05 March 2026 21:44:09 +0000 (0:00:00.550) 0:04:20.681 ******** 2026-03-05 21:44:09.482752 | mon1 | skipping: [osd1] 2026-03-05 21:44:09.482782 | mon1 | 2026-03-05 21:44:09.482788 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:44:09.482792 | mon1 | Thursday 05 March 2026 21:44:09 +0000 (0:00:00.036) 0:04:20.717 ******** 2026-03-05 21:44:09.516549 | mon1 | skipping: [osd1] 2026-03-05 21:44:09.516574 | mon1 | 2026-03-05 21:44:09.516584 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:44:09.516589 | mon1 | Thursday 05 March 2026 21:44:09 +0000 (0:00:00.033) 0:04:20.751 ******** 2026-03-05 21:44:09.714528 | mon1 | ok: [osd1] 2026-03-05 21:44:09.714582 | mon1 | 2026-03-05 21:44:09.714588 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:44:09.714593 | mon1 | Thursday 05 March 2026 21:44:09 +0000 (0:00:00.197) 0:04:20.949 ******** 2026-03-05 21:44:10.848707 | mon1 | ok: [osd1] 2026-03-05 21:44:10.848769 | mon1 | 2026-03-05 21:44:10.848776 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:44:10.848780 | mon1 | Thursday 05 March 2026 21:44:10 +0000 (0:00:01.133) 0:04:22.083 ******** 2026-03-05 21:44:10.909636 | mon1 | ok: [osd1] => { 2026-03-05 21:44:10.909654 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:44:10.909660 | mon1 | } 2026-03-05 21:44:10.909664 | mon1 | 2026-03-05 21:44:10.909668 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:44:10.909672 | mon1 | Thursday 05 March 2026 21:44:10 +0000 (0:00:00.061) 0:04:22.144 ******** 2026-03-05 21:44:11.684339 | mon1 | changed: [osd1] 2026-03-05 21:44:11.684380 | mon1 | 2026-03-05 21:44:11.684385 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:44:11.684390 | mon1 | Thursday 05 March 2026 21:44:11 +0000 (0:00:00.774) 0:04:22.918 ******** 2026-03-05 21:44:14.372802 | mon1 | changed: [osd1] 2026-03-05 21:44:14.372848 | mon1 | 2026-03-05 21:44:14.372854 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:44:14.372859 | mon1 | Thursday 05 March 2026 21:44:14 +0000 (0:00:02.688) 0:04:25.607 ******** 2026-03-05 21:44:14.400525 | mon1 | skipping: [osd1] 2026-03-05 21:44:14.400907 | mon1 | 2026-03-05 21:44:14.400958 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:44:14.400964 | mon1 | Thursday 05 March 2026 21:44:14 +0000 (0:00:00.027) 0:04:25.635 ******** 2026-03-05 21:44:14.432922 | mon1 | skipping: [osd1] 2026-03-05 21:44:14.433222 | mon1 | 2026-03-05 21:44:14.433267 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:44:14.433273 | mon1 | Thursday 05 March 2026 21:44:14 +0000 (0:00:00.032) 0:04:25.667 ******** 2026-03-05 21:44:14.461625 | mon1 | skipping: [osd1] 2026-03-05 21:44:14.461707 | mon1 | 2026-03-05 21:44:14.461843 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:44:14.461970 | mon1 | Thursday 05 March 2026 21:44:14 +0000 (0:00:00.029) 0:04:25.696 ******** 2026-03-05 21:44:19.535499 | mon1 | changed: [osd1] 2026-03-05 21:44:19.535804 | mon1 | 2026-03-05 21:44:19.536510 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:44:19.536524 | mon1 | Thursday 05 March 2026 21:44:19 +0000 (0:00:05.073) 0:04:30.769 ******** 2026-03-05 21:44:19.995371 | mon1 | changed: [osd1] 2026-03-05 21:44:19.995439 | mon1 | 2026-03-05 21:44:19.995492 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:44:19.995581 | mon1 | Thursday 05 March 2026 21:44:19 +0000 (0:00:00.460) 0:04:31.230 ******** 2026-03-05 21:44:20.879427 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:44:20.879493 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:44:20.879505 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:44:20.879515 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:44:20.879525 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:44:20.879535 | mon1 | 2026-03-05 21:44:20.879544 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:44:20.879553 | mon1 | Thursday 05 March 2026 21:44:20 +0000 (0:00:00.882) 0:04:32.112 ******** 2026-03-05 21:44:21.405462 | mon1 | changed: [osd1] 2026-03-05 21:44:21.405539 | mon1 | 2026-03-05 21:44:21.405671 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:44:21.405800 | mon1 | Thursday 05 March 2026 21:44:21 +0000 (0:00:00.521) 0:04:32.633 ******** 2026-03-05 21:44:21.405918 | mon1 | 2026-03-05 21:44:21.406047 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:44:21.406175 | mon1 | Thursday 05 March 2026 21:44:21 +0000 (0:00:00.006) 0:04:32.640 ******** 2026-03-05 21:44:22.128656 | mon1 | ok: [osd1] 2026-03-05 21:44:22.128767 | mon1 | 2026-03-05 21:44:22.128796 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 21:44:22.128906 | mon1 | Thursday 05 March 2026 21:44:22 +0000 (0:00:00.723) 0:04:33.363 ******** 2026-03-05 21:44:22.569928 | mon1 | changed: [osd1] 2026-03-05 21:44:22.569996 | mon1 | 2026-03-05 21:44:22.570110 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:44:22.570286 | mon1 | Thursday 05 March 2026 21:44:22 +0000 (0:00:00.441) 0:04:33.804 ******** 2026-03-05 21:44:23.111851 | mon1 | changed: [osd1] 2026-03-05 21:44:23.111923 | mon1 | 2026-03-05 21:44:23.111987 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:44:23.112084 | mon1 | Thursday 05 March 2026 21:44:23 +0000 (0:00:00.542) 0:04:34.346 ******** 2026-03-05 21:44:23.302925 | mon1 | ok: [osd1] 2026-03-05 21:44:23.303011 | mon1 | 2026-03-05 21:44:23.303027 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:44:23.303133 | mon1 | Thursday 05 March 2026 21:44:23 +0000 (0:00:00.191) 0:04:34.537 ******** 2026-03-05 21:44:23.344667 | mon1 | ok: [osd1] => { 2026-03-05 21:44:23.344770 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:44:23.344872 | mon1 | } 2026-03-05 21:44:23.344956 | mon1 | 2026-03-05 21:44:23.345056 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:44:23.345143 | mon1 | Thursday 05 March 2026 21:44:23 +0000 (0:00:00.041) 0:04:34.579 ******** 2026-03-05 21:44:24.169738 | mon1 | changed: [osd1] 2026-03-05 21:44:24.169808 | mon1 | 2026-03-05 21:44:24.169858 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:44:24.169946 | mon1 | Thursday 05 March 2026 21:44:24 +0000 (0:00:00.825) 0:04:35.404 ******** 2026-03-05 21:44:28.522993 | mon1 | changed: [osd1] 2026-03-05 21:44:28.523068 | mon1 | 2026-03-05 21:44:28.523135 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:44:28.523228 | mon1 | Thursday 05 March 2026 21:44:28 +0000 (0:00:04.353) 0:04:39.757 ******** 2026-03-05 21:44:29.549885 | mon1 | ok: [osd1] 2026-03-05 21:44:29.549958 | mon1 | 2026-03-05 21:44:29.550047 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:44:29.550180 | mon1 | Thursday 05 March 2026 21:44:29 +0000 (0:00:01.026) 0:04:40.784 ******** 2026-03-05 21:44:29.781528 | mon1 | changed: [osd1] 2026-03-05 21:44:29.781610 | mon1 | 2026-03-05 21:44:29.781929 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:44:29.781969 | mon1 | Thursday 05 March 2026 21:44:29 +0000 (0:00:00.231) 0:04:41.016 ******** 2026-03-05 21:44:30.225104 | mon1 | changed: [osd1] 2026-03-05 21:44:30.225156 | mon1 | 2026-03-05 21:44:30.225250 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:44:30.225381 | mon1 | Thursday 05 March 2026 21:44:30 +0000 (0:00:00.443) 0:04:41.459 ******** 2026-03-05 21:44:30.770377 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 21:44:30.770473 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:44:30.770819 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:44:30.770863 | mon1 | 2026-03-05 21:44:30.770869 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:44:30.770874 | mon1 | Thursday 05 March 2026 21:44:30 +0000 (0:00:00.545) 0:04:42.005 ******** 2026-03-05 21:44:31.214256 | mon1 | changed: [osd1] 2026-03-05 21:44:31.214374 | mon1 | 2026-03-05 21:44:31.214389 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:44:31.214575 | mon1 | Thursday 05 March 2026 21:44:31 +0000 (0:00:00.443) 0:04:42.448 ******** 2026-03-05 21:44:31.672868 | mon1 | changed: [osd1] 2026-03-05 21:44:31.672962 | mon1 | 2026-03-05 21:44:31.672974 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:44:31.672985 | mon1 | Thursday 05 March 2026 21:44:31 +0000 (0:00:00.450) 0:04:42.899 ******** 2026-03-05 21:44:31.672995 | mon1 | 2026-03-05 21:44:31.673013 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:44:31.673023 | mon1 | Thursday 05 March 2026 21:44:31 +0000 (0:00:00.007) 0:04:42.907 ******** 2026-03-05 21:44:32.316017 | mon1 | ok: [osd1] 2026-03-05 21:44:32.316141 | mon1 | 2026-03-05 21:44:32.316153 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 21:44:32.316165 | mon1 | Thursday 05 March 2026 21:44:32 +0000 (0:00:00.643) 0:04:43.550 ******** 2026-03-05 21:44:33.165652 | mon1 | changed: [osd1] 2026-03-05 21:44:33.165770 | mon1 | 2026-03-05 21:44:33.165795 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:44:33.165806 | mon1 | Thursday 05 March 2026 21:44:33 +0000 (0:00:00.849) 0:04:44.400 ******** 2026-03-05 21:44:33.716833 | mon1 | changed: [osd1] 2026-03-05 21:44:33.716897 | mon1 | 2026-03-05 21:44:33.716906 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:44:33.717056 | mon1 | Thursday 05 March 2026 21:44:33 +0000 (0:00:00.550) 0:04:44.950 ******** 2026-03-05 21:44:33.760840 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:44:33.760922 | mon1 | 2026-03-05 21:44:33.761069 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:44:33.761234 | mon1 | Thursday 05 March 2026 21:44:33 +0000 (0:00:00.044) 0:04:44.995 ******** 2026-03-05 21:44:38.797854 | mon1 | changed: [osd1] 2026-03-05 21:44:38.797978 | mon1 | 2026-03-05 21:44:38.798035 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:44:38.798048 | mon1 | Thursday 05 March 2026 21:44:38 +0000 (0:00:05.037) 0:04:50.032 ******** 2026-03-05 21:44:39.436870 | mon1 | ok: [osd1] => (item=chronyd) 2026-03-05 21:44:39.436978 | mon1 | ok: [osd1] => (item=sshd) 2026-03-05 21:44:39.437077 | mon1 | 2026-03-05 21:44:39.437206 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:44:39.437339 | mon1 | Thursday 05 March 2026 21:44:39 +0000 (0:00:00.638) 0:04:50.671 ******** 2026-03-05 21:44:39.743857 | mon1 | changed: [osd1] 2026-03-05 21:44:39.743970 | mon1 | 2026-03-05 21:44:39.744207 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:44:39.744420 | mon1 | Thursday 05 March 2026 21:44:39 +0000 (0:00:00.306) 0:04:50.978 ******** 2026-03-05 21:44:39.951060 | mon1 | ok: [osd1] 2026-03-05 21:44:39.951129 | mon1 | 2026-03-05 21:44:39.951141 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:44:39.951151 | mon1 | Thursday 05 March 2026 21:44:39 +0000 (0:00:00.206) 0:04:51.184 ******** 2026-03-05 21:44:40.250177 | mon1 | changed: [osd1] 2026-03-05 21:44:40.250218 | mon1 | 2026-03-05 21:44:40.250351 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:44:40.250526 | mon1 | Thursday 05 March 2026 21:44:40 +0000 (0:00:00.300) 0:04:51.484 ******** 2026-03-05 21:44:40.463941 | mon1 | changed: [osd1] 2026-03-05 21:44:40.464018 | mon1 | 2026-03-05 21:44:40.464030 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:44:40.464187 | mon1 | Thursday 05 March 2026 21:44:40 +0000 (0:00:00.213) 0:04:51.698 ******** 2026-03-05 21:44:40.675445 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 21:44:40.675574 | mon1 | 2026-03-05 21:44:40.675608 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:44:40.675688 | mon1 | Thursday 05 March 2026 21:44:40 +0000 (0:00:00.211) 0:04:51.910 ******** 2026-03-05 21:44:40.725449 | mon1 | ok: [osd1] 2026-03-05 21:44:40.725500 | mon1 | 2026-03-05 21:44:40.725509 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:44:40.725516 | mon1 | Thursday 05 March 2026 21:44:40 +0000 (0:00:00.049) 0:04:51.959 ******** 2026-03-05 21:44:40.773488 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 21:44:40.773543 | mon1 | 2026-03-05 21:44:40.773550 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:44:40.773556 | mon1 | Thursday 05 March 2026 21:44:40 +0000 (0:00:00.048) 0:04:52.007 ******** 2026-03-05 21:44:46.876412 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:44:46.876480 | mon1 | 2026-03-05 21:44:46.876555 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:44:46.876644 | mon1 | Thursday 05 March 2026 21:44:46 +0000 (0:00:06.103) 0:04:58.110 ******** 2026-03-05 21:44:46.922385 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 21:44:46.922465 | mon1 | 2026-03-05 21:44:46.922563 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:44:46.922656 | mon1 | Thursday 05 March 2026 21:44:46 +0000 (0:00:00.046) 0:04:58.157 ******** 2026-03-05 21:44:47.176247 | mon1 | changed: [osd1] 2026-03-05 21:44:47.176291 | mon1 | 2026-03-05 21:44:47.176578 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:44:47.176626 | mon1 | Thursday 05 March 2026 21:44:47 +0000 (0:00:00.253) 0:04:58.410 ******** 2026-03-05 21:44:57.202639 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:44:57.202691 | mon1 | 2026-03-05 21:44:57.202697 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:44:57.202701 | mon1 | Thursday 05 March 2026 21:44:57 +0000 (0:00:10.026) 0:05:08.437 ******** 2026-03-05 21:44:58.731142 | mon1 | ok: [osd1] 2026-03-05 21:44:58.731208 | mon1 | 2026-03-05 21:44:58.731281 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:44:58.731400 | mon1 | Thursday 05 March 2026 21:44:58 +0000 (0:00:01.528) 0:05:09.966 ******** 2026-03-05 21:45:44.647083 | mon1 | ok: [osd1] 2026-03-05 21:45:44.647146 | mon1 | 2026-03-05 21:45:44.647155 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:45:44.647161 | mon1 | Thursday 05 March 2026 21:45:44 +0000 (0:00:45.915) 0:05:55.881 ******** 2026-03-05 21:47:28.005156 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 21:47:28.006027 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 21:47:28.006053 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 21:47:28.006063 | mon1 | 2026-03-05 21:47:28.006071 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:47:28.006080 | mon1 | Thursday 05 March 2026 21:47:27 +0000 (0:01:43.358) 0:07:39.239 ******** 2026-03-05 21:47:34.304215 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:47:34.304290 | mon1 | 2026-03-05 21:47:34.304358 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:47:34.304493 | mon1 | Thursday 05 March 2026 21:47:34 +0000 (0:00:06.299) 0:07:45.539 ******** 2026-03-05 21:47:40.530807 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:47:40.531273 | mon1 | 2026-03-05 21:47:40.531504 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:47:40.531513 | mon1 | Thursday 05 March 2026 21:47:40 +0000 (0:00:06.226) 0:07:51.765 ******** 2026-03-05 21:47:40.584632 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 21:47:40.584709 | mon1 | 2026-03-05 21:47:40.584864 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:47:40.584957 | mon1 | Thursday 05 March 2026 21:47:40 +0000 (0:00:00.053) 0:07:51.819 ******** 2026-03-05 21:47:40.626377 | mon1 | ok: [osd1] 2026-03-05 21:47:40.626748 | mon1 | 2026-03-05 21:47:40.626768 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:47:40.626775 | mon1 | Thursday 05 March 2026 21:47:40 +0000 (0:00:00.041) 0:07:51.861 ******** 2026-03-05 21:47:46.808303 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:47:46.808349 | mon1 | 2026-03-05 21:47:46.808358 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:47:46.808364 | mon1 | Thursday 05 March 2026 21:47:46 +0000 (0:00:06.181) 0:07:58.042 ******** 2026-03-05 21:47:46.846267 | mon1 | ok: [osd1] 2026-03-05 21:47:46.846290 | mon1 | 2026-03-05 21:47:46.846297 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:47:46.846303 | mon1 | Thursday 05 March 2026 21:47:46 +0000 (0:00:00.038) 0:07:58.080 ******** 2026-03-05 21:47:46.888886 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:47:46.888954 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:47:46.888965 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:47:46.888975 | mon1 | skipping: [osd1] 2026-03-05 21:47:46.888984 | mon1 | 2026-03-05 21:47:46.888994 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:47:46.889004 | mon1 | Thursday 05 March 2026 21:47:46 +0000 (0:00:00.042) 0:07:58.123 ******** 2026-03-05 21:47:46.920946 | mon1 | skipping: [osd1] 2026-03-05 21:47:46.924227 | mon1 | 2026-03-05 21:47:46.924283 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:47:46.924290 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 21:47:46.924295 | mon1 | osd1 : ok=53 changed=24 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 21:47:46.924299 | mon1 | 2026-03-05 21:47:46.924303 | mon1 | 2026-03-05 21:47:46.924307 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:47:46.924311 | mon1 | Thursday 05 March 2026 21:47:46 +0000 (0:00:00.032) 0:07:58.155 ******** 2026-03-05 21:47:46.924316 | mon1 | =============================================================================== 2026-03-05 21:47:46.924335 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 128.30s 2026-03-05 21:47:46.924340 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 103.36s 2026-03-05 21:47:46.924344 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 45.92s 2026-03-05 21:47:46.924348 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 26.87s 2026-03-05 21:47:46.924352 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.21s 2026-03-05 21:47:46.924356 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 12.43s 2026-03-05 21:47:46.924360 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.01s 2026-03-05 21:47:46.924370 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 10.03s 2026-03-05 21:47:46.924374 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.49s 2026-03-05 21:47:46.924378 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.44s 2026-03-05 21:47:46.924383 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.48s 2026-03-05 21:47:46.924387 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.30s 2026-03-05 21:47:46.924391 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.23s 2026-03-05 21:47:46.924395 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.18s 2026-03-05 21:47:46.924399 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.16s 2026-03-05 21:47:46.924403 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.10s 2026-03-05 21:47:46.924407 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.60s 2026-03-05 21:47:46.924416 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.46s 2026-03-05 21:47:46.924420 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.07s 2026-03-05 21:47:46.924425 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.04s 2026-03-05 21:47:47.015629 | mon1 | INFO [default > converge] Executed: Successful 2026-03-05 21:47:47.025876 | mon1 | INFO [default > idempotence] Executing 2026-03-05 21:47:47.821753 | mon1 | 2026-03-05 21:47:47.822104 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 21:47:47.822361 | mon1 | 2026-03-05 21:47:47.822626 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:47:47.822889 | mon1 | Thursday 05 March 2026 21:47:47 +0000 (0:00:00.044) 0:00:00.044 ******** 2026-03-05 21:47:48.963987 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:47:48.964035 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:47:48.964041 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:47:48.964046 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:47:48.964050 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:47:48.979137 | mon1 | ok: [mon1] 2026-03-05 21:47:48.979170 | mon1 | 2026-03-05 21:47:48.979182 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:47:48.979191 | mon1 | Thursday 05 March 2026 21:47:48 +0000 (0:00:01.157) 0:00:01.201 ******** 2026-03-05 21:47:49.262747 | mon1 | ok: [mon1] 2026-03-05 21:47:49.262794 | mon1 | 2026-03-05 21:47:49.262918 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:47:49.263129 | mon1 | Thursday 05 March 2026 21:47:49 +0000 (0:00:00.283) 0:00:01.485 ******** 2026-03-05 21:47:49.292199 | mon1 | skipping: [mon1] 2026-03-05 21:47:49.292431 | mon1 | 2026-03-05 21:47:49.292714 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:47:49.292992 | mon1 | Thursday 05 March 2026 21:47:49 +0000 (0:00:00.029) 0:00:01.515 ******** 2026-03-05 21:47:49.583046 | mon1 | ok: [mon1] 2026-03-05 21:47:49.583241 | mon1 | 2026-03-05 21:47:49.583470 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:47:49.583692 | mon1 | Thursday 05 March 2026 21:47:49 +0000 (0:00:00.290) 0:00:01.806 ******** 2026-03-05 21:47:49.648266 | mon1 | ok: [mon1] => { 2026-03-05 21:47:49.648484 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:47:49.648704 | mon1 | } 2026-03-05 21:47:49.648968 | mon1 | 2026-03-05 21:47:49.649190 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:47:49.649405 | mon1 | Thursday 05 March 2026 21:47:49 +0000 (0:00:00.065) 0:00:01.871 ******** 2026-03-05 21:47:50.038202 | mon1 | ok: [mon1] 2026-03-05 21:47:50.038372 | mon1 | 2026-03-05 21:47:50.038667 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:47:50.038901 | mon1 | Thursday 05 March 2026 21:47:50 +0000 (0:00:00.389) 0:00:02.261 ******** 2026-03-05 21:47:50.080673 | mon1 | skipping: [mon1] 2026-03-05 21:47:50.080887 | mon1 | 2026-03-05 21:47:50.081120 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:47:50.081363 | mon1 | Thursday 05 March 2026 21:47:50 +0000 (0:00:00.042) 0:00:02.303 ******** 2026-03-05 21:47:50.122655 | mon1 | skipping: [mon1] 2026-03-05 21:47:50.122816 | mon1 | 2026-03-05 21:47:50.123019 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:47:50.123224 | mon1 | Thursday 05 March 2026 21:47:50 +0000 (0:00:00.042) 0:00:02.345 ******** 2026-03-05 21:47:50.330438 | mon1 | ok: [mon1] 2026-03-05 21:47:50.330623 | mon1 | 2026-03-05 21:47:50.330842 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:47:50.331058 | mon1 | Thursday 05 March 2026 21:47:50 +0000 (0:00:00.208) 0:00:02.553 ******** 2026-03-05 21:47:51.379320 | mon1 | ok: [mon1] 2026-03-05 21:47:51.379391 | mon1 | 2026-03-05 21:47:51.379403 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:47:51.379414 | mon1 | Thursday 05 March 2026 21:47:51 +0000 (0:00:01.048) 0:00:03.601 ******** 2026-03-05 21:47:51.449698 | mon1 | ok: [mon1] => { 2026-03-05 21:47:51.449781 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:47:51.450288 | mon1 | } 2026-03-05 21:47:51.450337 | mon1 | 2026-03-05 21:47:51.450344 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:47:51.450351 | mon1 | Thursday 05 March 2026 21:47:51 +0000 (0:00:00.071) 0:00:03.672 ******** 2026-03-05 21:47:51.791133 | mon1 | ok: [mon1] 2026-03-05 21:47:51.791192 | mon1 | 2026-03-05 21:47:51.791252 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:47:51.791380 | mon1 | Thursday 05 March 2026 21:47:51 +0000 (0:00:00.341) 0:00:04.014 ******** 2026-03-05 21:47:53.955367 | mon1 | ok: [mon1] 2026-03-05 21:47:53.955410 | mon1 | 2026-03-05 21:47:53.955416 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:47:53.955421 | mon1 | Thursday 05 March 2026 21:47:53 +0000 (0:00:02.164) 0:00:06.178 ******** 2026-03-05 21:47:53.983281 | mon1 | skipping: [mon1] 2026-03-05 21:47:53.983324 | mon1 | 2026-03-05 21:47:53.983329 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:47:53.983334 | mon1 | Thursday 05 March 2026 21:47:53 +0000 (0:00:00.027) 0:00:06.206 ******** 2026-03-05 21:47:54.011800 | mon1 | skipping: [mon1] 2026-03-05 21:47:54.011828 | mon1 | 2026-03-05 21:47:54.011835 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:47:54.011841 | mon1 | Thursday 05 March 2026 21:47:54 +0000 (0:00:00.028) 0:00:06.234 ******** 2026-03-05 21:47:54.040876 | mon1 | skipping: [mon1] 2026-03-05 21:47:54.040962 | mon1 | 2026-03-05 21:47:54.040975 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:47:54.040995 | mon1 | Thursday 05 March 2026 21:47:54 +0000 (0:00:00.028) 0:00:06.263 ******** 2026-03-05 21:47:55.004922 | mon1 | ok: [mon1] 2026-03-05 21:47:55.004995 | mon1 | 2026-03-05 21:47:55.005210 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:47:55.005252 | mon1 | Thursday 05 March 2026 21:47:54 +0000 (0:00:00.964) 0:00:07.228 ******** 2026-03-05 21:47:55.421789 | mon1 | ok: [mon1] 2026-03-05 21:47:55.421849 | mon1 | 2026-03-05 21:47:55.421950 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:47:55.422079 | mon1 | Thursday 05 March 2026 21:47:55 +0000 (0:00:00.416) 0:00:07.645 ******** 2026-03-05 21:47:56.311872 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:47:56.311949 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:47:56.312839 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:47:56.312886 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:47:56.312894 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:47:56.312902 | mon1 | 2026-03-05 21:47:56.312908 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:47:56.312914 | mon1 | Thursday 05 March 2026 21:47:56 +0000 (0:00:00.889) 0:00:08.535 ******** 2026-03-05 21:47:56.774778 | mon1 | ok: [mon1] 2026-03-05 21:47:56.774871 | mon1 | 2026-03-05 21:47:56.774887 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:47:56.775260 | mon1 | Thursday 05 March 2026 21:47:56 +0000 (0:00:00.457) 0:00:08.992 ******** 2026-03-05 21:47:56.775308 | mon1 | 2026-03-05 21:47:56.775314 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:47:56.775319 | mon1 | Thursday 05 March 2026 21:47:56 +0000 (0:00:00.006) 0:00:08.998 ******** 2026-03-05 21:47:57.327728 | mon1 | ok: [mon1] 2026-03-05 21:47:57.327791 | mon1 | 2026-03-05 21:47:57.327865 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:47:57.327988 | mon1 | Thursday 05 March 2026 21:47:57 +0000 (0:00:00.553) 0:00:09.551 ******** 2026-03-05 21:47:57.517697 | mon1 | ok: [mon1] 2026-03-05 21:47:57.517771 | mon1 | 2026-03-05 21:47:57.517829 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:47:57.517921 | mon1 | Thursday 05 March 2026 21:47:57 +0000 (0:00:00.189) 0:00:09.741 ******** 2026-03-05 21:47:57.585604 | mon1 | ok: [mon1] => { 2026-03-05 21:47:57.586245 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:47:57.586296 | mon1 | } 2026-03-05 21:47:57.586304 | mon1 | 2026-03-05 21:47:57.586311 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:47:57.586318 | mon1 | Thursday 05 March 2026 21:47:57 +0000 (0:00:00.067) 0:00:09.808 ******** 2026-03-05 21:47:57.932913 | mon1 | ok: [mon1] 2026-03-05 21:47:57.932971 | mon1 | 2026-03-05 21:47:57.933063 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:47:57.933194 | mon1 | Thursday 05 March 2026 21:47:57 +0000 (0:00:00.347) 0:00:10.156 ******** 2026-03-05 21:48:00.975652 | mon1 | ok: [mon1] 2026-03-05 21:48:00.975723 | mon1 | 2026-03-05 21:48:00.975909 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:48:00.975952 | mon1 | Thursday 05 March 2026 21:48:00 +0000 (0:00:03.042) 0:00:13.199 ******** 2026-03-05 21:48:01.944908 | mon1 | ok: [mon1] 2026-03-05 21:48:01.944975 | mon1 | 2026-03-05 21:48:01.945251 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:48:01.945298 | mon1 | Thursday 05 March 2026 21:48:01 +0000 (0:00:00.968) 0:00:14.168 ******** 2026-03-05 21:48:02.216240 | mon1 | ok: [mon1] 2026-03-05 21:48:02.216303 | mon1 | 2026-03-05 21:48:02.216397 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:48:02.216540 | mon1 | Thursday 05 March 2026 21:48:02 +0000 (0:00:00.271) 0:00:14.439 ******** 2026-03-05 21:48:02.635078 | mon1 | ok: [mon1] 2026-03-05 21:48:02.635151 | mon1 | 2026-03-05 21:48:02.635240 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:48:02.635344 | mon1 | Thursday 05 March 2026 21:48:02 +0000 (0:00:00.418) 0:00:14.858 ******** 2026-03-05 21:48:03.177271 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 21:48:03.177347 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:48:03.177457 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:48:03.177773 | mon1 | 2026-03-05 21:48:03.177811 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:48:03.177817 | mon1 | Thursday 05 March 2026 21:48:03 +0000 (0:00:00.542) 0:00:15.400 ******** 2026-03-05 21:48:03.572557 | mon1 | ok: [mon1] 2026-03-05 21:48:03.572629 | mon1 | 2026-03-05 21:48:03.572703 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:48:03.572854 | mon1 | Thursday 05 March 2026 21:48:03 +0000 (0:00:00.395) 0:00:15.796 ******** 2026-03-05 21:48:03.974683 | mon1 | ok: [mon1] 2026-03-05 21:48:03.974741 | mon1 | 2026-03-05 21:48:03.974811 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:48:03.975202 | mon1 | Thursday 05 March 2026 21:48:03 +0000 (0:00:00.394) 0:00:16.190 ******** 2026-03-05 21:48:03.975243 | mon1 | 2026-03-05 21:48:03.975248 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:48:03.975253 | mon1 | Thursday 05 March 2026 21:48:03 +0000 (0:00:00.007) 0:00:16.198 ******** 2026-03-05 21:48:04.314091 | mon1 | ok: [mon1] 2026-03-05 21:48:04.314168 | mon1 | 2026-03-05 21:48:04.314184 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:48:04.314309 | mon1 | Thursday 05 March 2026 21:48:04 +0000 (0:00:00.339) 0:00:16.537 ******** 2026-03-05 21:48:04.358078 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:48:04.358115 | mon1 | 2026-03-05 21:48:04.358228 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:48:04.358349 | mon1 | Thursday 05 March 2026 21:48:04 +0000 (0:00:00.043) 0:00:16.581 ******** 2026-03-05 21:48:05.319412 | mon1 | ok: [mon1] 2026-03-05 21:48:05.319485 | mon1 | 2026-03-05 21:48:05.319764 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:48:05.319812 | mon1 | Thursday 05 March 2026 21:48:05 +0000 (0:00:00.961) 0:00:17.542 ******** 2026-03-05 21:48:05.942542 | mon1 | ok: [mon1] => (item=chronyd) 2026-03-05 21:48:05.942620 | mon1 | ok: [mon1] => (item=sshd) 2026-03-05 21:48:05.942631 | mon1 | 2026-03-05 21:48:05.942851 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:48:05.942894 | mon1 | Thursday 05 March 2026 21:48:05 +0000 (0:00:00.623) 0:00:18.165 ******** 2026-03-05 21:48:06.219820 | mon1 | ok: [mon1] 2026-03-05 21:48:06.219876 | mon1 | 2026-03-05 21:48:06.220090 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:48:06.220234 | mon1 | Thursday 05 March 2026 21:48:06 +0000 (0:00:00.277) 0:00:18.443 ******** 2026-03-05 21:48:06.408912 | mon1 | ok: [mon1] 2026-03-05 21:48:06.408975 | mon1 | 2026-03-05 21:48:06.409144 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:48:06.409159 | mon1 | Thursday 05 March 2026 21:48:06 +0000 (0:00:00.189) 0:00:18.632 ******** 2026-03-05 21:48:06.802463 | mon1 | ok: [mon1] 2026-03-05 21:48:06.802520 | mon1 | 2026-03-05 21:48:06.802613 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:48:06.802739 | mon1 | Thursday 05 March 2026 21:48:06 +0000 (0:00:00.393) 0:00:19.025 ******** 2026-03-05 21:48:07.109769 | mon1 | ok: [mon1] 2026-03-05 21:48:07.109845 | mon1 | 2026-03-05 21:48:07.109915 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:48:07.110045 | mon1 | Thursday 05 March 2026 21:48:07 +0000 (0:00:00.307) 0:00:19.333 ******** 2026-03-05 21:48:07.182418 | mon1 | ok: [mon1] 2026-03-05 21:48:07.182471 | mon1 | 2026-03-05 21:48:07.182604 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:48:07.182622 | mon1 | Thursday 05 March 2026 21:48:07 +0000 (0:00:00.072) 0:00:19.405 ******** 2026-03-05 21:48:07.393131 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:48:07.393182 | mon1 | 2026-03-05 21:48:07.393297 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:48:07.393429 | mon1 | Thursday 05 March 2026 21:48:07 +0000 (0:00:00.210) 0:00:19.616 ******** 2026-03-05 21:48:07.433164 | mon1 | ok: [mon1] 2026-03-05 21:48:07.433549 | mon1 | 2026-03-05 21:48:07.433575 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:48:07.433583 | mon1 | Thursday 05 March 2026 21:48:07 +0000 (0:00:00.039) 0:00:19.656 ******** 2026-03-05 21:48:07.469503 | mon1 | skipping: [mon1] 2026-03-05 21:48:07.469907 | mon1 | 2026-03-05 21:48:07.469989 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:48:07.469997 | mon1 | Thursday 05 March 2026 21:48:07 +0000 (0:00:00.036) 0:00:19.692 ******** 2026-03-05 21:48:07.528555 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:48:07.528593 | mon1 | 2026-03-05 21:48:07.528868 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:48:07.528958 | mon1 | Thursday 05 March 2026 21:48:07 +0000 (0:00:00.059) 0:00:19.751 ******** 2026-03-05 21:48:13.810834 | mon1 | ok: [mon1] 2026-03-05 21:48:13.810899 | mon1 | 2026-03-05 21:48:13.811217 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:48:13.811262 | mon1 | Thursday 05 March 2026 21:48:13 +0000 (0:00:06.282) 0:00:26.034 ******** 2026-03-05 21:48:13.855475 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:48:13.855545 | mon1 | 2026-03-05 21:48:13.855831 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:48:13.855855 | mon1 | Thursday 05 March 2026 21:48:13 +0000 (0:00:00.044) 0:00:26.078 ******** 2026-03-05 21:48:14.229471 | mon1 | ok: [mon1] 2026-03-05 21:48:14.229553 | mon1 | 2026-03-05 21:48:14.229829 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:48:14.229873 | mon1 | Thursday 05 March 2026 21:48:14 +0000 (0:00:00.373) 0:00:26.452 ******** 2026-03-05 21:48:20.807572 | mon1 | ok: [mon1] 2026-03-05 21:48:20.807618 | mon1 | 2026-03-05 21:48:20.807624 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:48:20.807629 | mon1 | Thursday 05 March 2026 21:48:20 +0000 (0:00:06.578) 0:00:33.030 ******** 2026-03-05 21:48:27.029266 | mon1 | ok: [mon1] 2026-03-05 21:48:27.029503 | mon1 | 2026-03-05 21:48:27.029517 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:48:27.029529 | mon1 | Thursday 05 March 2026 21:48:27 +0000 (0:00:06.222) 0:00:39.252 ******** 2026-03-05 21:48:41.237477 | mon1 | ok: [mon1] 2026-03-05 21:48:41.237537 | mon1 | 2026-03-05 21:48:41.237622 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:48:41.237757 | mon1 | Thursday 05 March 2026 21:48:41 +0000 (0:00:14.208) 0:00:53.460 ******** 2026-03-05 21:48:41.312896 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:48:41.312980 | mon1 | 2026-03-05 21:48:41.313083 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:48:41.313190 | mon1 | Thursday 05 March 2026 21:48:41 +0000 (0:00:00.075) 0:00:53.536 ******** 2026-03-05 21:48:41.353084 | mon1 | skipping: [mon1] 2026-03-05 21:48:41.353175 | mon1 | 2026-03-05 21:48:41.353187 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:48:41.353298 | mon1 | Thursday 05 March 2026 21:48:41 +0000 (0:00:00.040) 0:00:53.576 ******** 2026-03-05 21:48:41.388286 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 21:48:41.388390 | mon1 | skipping: [mon1] 2026-03-05 21:48:41.388403 | mon1 | 2026-03-05 21:48:41.388548 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:48:41.388568 | mon1 | Thursday 05 March 2026 21:48:41 +0000 (0:00:00.035) 0:00:53.612 ******** 2026-03-05 21:48:41.628233 | mon1 | ok: [mon1] 2026-03-05 21:48:41.628385 | mon1 | 2026-03-05 21:48:41.628591 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:48:41.628832 | mon1 | Thursday 05 March 2026 21:48:41 +0000 (0:00:00.239) 0:00:53.851 ******** 2026-03-05 21:48:48.127033 | mon1 | ok: [mon1] 2026-03-05 21:48:48.127216 | mon1 | 2026-03-05 21:48:48.127445 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:48:48.127661 | mon1 | Thursday 05 March 2026 21:48:48 +0000 (0:00:06.498) 0:01:00.350 ******** 2026-03-05 21:48:54.246684 | mon1 | ok: [mon1] 2026-03-05 21:48:54.246858 | mon1 | 2026-03-05 21:48:54.247074 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:48:54.247293 | mon1 | Thursday 05 March 2026 21:48:54 +0000 (0:00:06.119) 0:01:06.469 ******** 2026-03-05 21:49:00.410019 | mon1 | ok: [mon1] 2026-03-05 21:49:00.410086 | mon1 | 2026-03-05 21:49:00.410098 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:49:00.410108 | mon1 | Thursday 05 March 2026 21:49:00 +0000 (0:00:06.162) 0:01:12.632 ******** 2026-03-05 21:49:08.350068 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:49:08.350141 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 21:49:08.350154 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 21:49:08.350770 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 21:49:08.351123 | mon1 | 2026-03-05 21:49:08.351132 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:49:08.351138 | mon1 | 2026-03-05 21:49:08.351142 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:49:08.351147 | mon1 | Thursday 05 March 2026 21:49:08 +0000 (0:00:07.940) 0:01:20.573 ******** 2026-03-05 21:49:09.467319 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:49:09.467429 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:49:09.468119 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:49:09.468193 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:49:09.468205 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:49:09.476416 | mon1 | ok: [osd1] 2026-03-05 21:49:09.476713 | mon1 | 2026-03-05 21:49:09.476736 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:49:09.476757 | mon1 | Thursday 05 March 2026 21:49:09 +0000 (0:00:01.126) 0:01:21.699 ******** 2026-03-05 21:49:09.676642 | mon1 | ok: [osd1] 2026-03-05 21:49:09.676805 | mon1 | 2026-03-05 21:49:09.676833 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:49:09.676844 | mon1 | Thursday 05 March 2026 21:49:09 +0000 (0:00:00.200) 0:01:21.899 ******** 2026-03-05 21:49:09.707636 | mon1 | skipping: [osd1] 2026-03-05 21:49:09.707677 | mon1 | 2026-03-05 21:49:09.707907 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:49:09.707971 | mon1 | Thursday 05 March 2026 21:49:09 +0000 (0:00:00.031) 0:01:21.930 ******** 2026-03-05 21:49:09.902774 | mon1 | ok: [osd1] 2026-03-05 21:49:09.902829 | mon1 | 2026-03-05 21:49:09.902836 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:49:09.902841 | mon1 | Thursday 05 March 2026 21:49:09 +0000 (0:00:00.194) 0:01:22.125 ******** 2026-03-05 21:49:09.979551 | mon1 | ok: [osd1] => { 2026-03-05 21:49:09.979615 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:49:09.979666 | mon1 | } 2026-03-05 21:49:09.979920 | mon1 | 2026-03-05 21:49:09.979936 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:49:09.979942 | mon1 | Thursday 05 March 2026 21:49:09 +0000 (0:00:00.077) 0:01:22.202 ******** 2026-03-05 21:49:10.279036 | mon1 | ok: [osd1] 2026-03-05 21:49:10.279148 | mon1 | 2026-03-05 21:49:10.279423 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:49:10.279474 | mon1 | Thursday 05 March 2026 21:49:10 +0000 (0:00:00.299) 0:01:22.502 ******** 2026-03-05 21:49:10.316088 | mon1 | skipping: [osd1] 2026-03-05 21:49:10.316137 | mon1 | 2026-03-05 21:49:10.316368 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:49:10.316408 | mon1 | Thursday 05 March 2026 21:49:10 +0000 (0:00:00.037) 0:01:22.539 ******** 2026-03-05 21:49:10.352719 | mon1 | skipping: [osd1] 2026-03-05 21:49:10.352800 | mon1 | 2026-03-05 21:49:10.352887 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:49:10.352991 | mon1 | Thursday 05 March 2026 21:49:10 +0000 (0:00:00.036) 0:01:22.576 ******** 2026-03-05 21:49:10.556986 | mon1 | ok: [osd1] 2026-03-05 21:49:10.557027 | mon1 | 2026-03-05 21:49:10.557229 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:49:10.557275 | mon1 | Thursday 05 March 2026 21:49:10 +0000 (0:00:00.204) 0:01:22.780 ******** 2026-03-05 21:49:11.487565 | mon1 | ok: [osd1] 2026-03-05 21:49:11.487641 | mon1 | 2026-03-05 21:49:11.487698 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:49:11.487814 | mon1 | Thursday 05 March 2026 21:49:11 +0000 (0:00:00.930) 0:01:23.710 ******** 2026-03-05 21:49:11.559394 | mon1 | ok: [osd1] => { 2026-03-05 21:49:11.559472 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:49:11.559822 | mon1 | } 2026-03-05 21:49:11.559843 | mon1 | 2026-03-05 21:49:11.559848 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:49:11.559853 | mon1 | Thursday 05 March 2026 21:49:11 +0000 (0:00:00.071) 0:01:23.782 ******** 2026-03-05 21:49:11.888468 | mon1 | ok: [osd1] 2026-03-05 21:49:11.888531 | mon1 | 2026-03-05 21:49:11.888589 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:49:11.888722 | mon1 | Thursday 05 March 2026 21:49:11 +0000 (0:00:00.329) 0:01:24.111 ******** 2026-03-05 21:49:13.817425 | mon1 | ok: [osd1] 2026-03-05 21:49:13.817508 | mon1 | 2026-03-05 21:49:13.817533 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:49:13.817602 | mon1 | Thursday 05 March 2026 21:49:13 +0000 (0:00:01.928) 0:01:26.040 ******** 2026-03-05 21:49:13.848274 | mon1 | skipping: [osd1] 2026-03-05 21:49:13.848425 | mon1 | 2026-03-05 21:49:13.848552 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:49:13.848675 | mon1 | Thursday 05 March 2026 21:49:13 +0000 (0:00:00.031) 0:01:26.071 ******** 2026-03-05 21:49:13.883092 | mon1 | skipping: [osd1] 2026-03-05 21:49:13.883128 | mon1 | 2026-03-05 21:49:13.883133 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:49:13.883138 | mon1 | Thursday 05 March 2026 21:49:13 +0000 (0:00:00.034) 0:01:26.106 ******** 2026-03-05 21:49:13.915040 | mon1 | skipping: [osd1] 2026-03-05 21:49:13.915085 | mon1 | 2026-03-05 21:49:13.915093 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:49:13.915100 | mon1 | Thursday 05 March 2026 21:49:13 +0000 (0:00:00.031) 0:01:26.137 ******** 2026-03-05 21:49:14.884381 | mon1 | ok: [osd1] 2026-03-05 21:49:14.884429 | mon1 | 2026-03-05 21:49:14.884437 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:49:14.884444 | mon1 | Thursday 05 March 2026 21:49:14 +0000 (0:00:00.969) 0:01:27.107 ******** 2026-03-05 21:49:15.283717 | mon1 | ok: [osd1] 2026-03-05 21:49:15.283768 | mon1 | 2026-03-05 21:49:15.283773 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:49:15.283778 | mon1 | Thursday 05 March 2026 21:49:15 +0000 (0:00:00.399) 0:01:27.506 ******** 2026-03-05 21:49:16.146869 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:49:16.146930 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:49:16.146939 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:49:16.146945 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:49:16.146951 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:49:16.146957 | mon1 | 2026-03-05 21:49:16.146963 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:49:16.146969 | mon1 | Thursday 05 March 2026 21:49:16 +0000 (0:00:00.862) 0:01:28.369 ******** 2026-03-05 21:49:16.610168 | mon1 | ok: [osd1] 2026-03-05 21:49:16.610214 | mon1 | 2026-03-05 21:49:16.610219 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:49:16.610224 | mon1 | Thursday 05 March 2026 21:49:16 +0000 (0:00:00.456) 0:01:28.825 ******** 2026-03-05 21:49:16.610228 | mon1 | 2026-03-05 21:49:16.610232 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:49:16.610236 | mon1 | Thursday 05 March 2026 21:49:16 +0000 (0:00:00.007) 0:01:28.832 ******** 2026-03-05 21:49:16.948374 | mon1 | ok: [osd1] 2026-03-05 21:49:16.948414 | mon1 | 2026-03-05 21:49:16.948421 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:49:16.948428 | mon1 | Thursday 05 March 2026 21:49:16 +0000 (0:00:00.338) 0:01:29.171 ******** 2026-03-05 21:49:17.143050 | mon1 | ok: [osd1] 2026-03-05 21:49:17.143081 | mon1 | 2026-03-05 21:49:17.143086 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:49:17.143091 | mon1 | Thursday 05 March 2026 21:49:17 +0000 (0:00:00.194) 0:01:29.366 ******** 2026-03-05 21:49:17.203474 | mon1 | ok: [osd1] => { 2026-03-05 21:49:17.203515 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:49:17.203912 | mon1 | } 2026-03-05 21:49:17.203959 | mon1 | 2026-03-05 21:49:17.203965 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:49:17.203970 | mon1 | Thursday 05 March 2026 21:49:17 +0000 (0:00:00.060) 0:01:29.426 ******** 2026-03-05 21:49:17.554904 | mon1 | ok: [osd1] 2026-03-05 21:49:17.554977 | mon1 | 2026-03-05 21:49:17.555030 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:49:17.555202 | mon1 | Thursday 05 March 2026 21:49:17 +0000 (0:00:00.351) 0:01:29.778 ******** 2026-03-05 21:49:20.644071 | mon1 | ok: [osd1] 2026-03-05 21:49:20.644119 | mon1 | 2026-03-05 21:49:20.644125 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:49:20.644129 | mon1 | Thursday 05 March 2026 21:49:20 +0000 (0:00:03.089) 0:01:32.867 ******** 2026-03-05 21:49:21.821686 | mon1 | ok: [osd1] 2026-03-05 21:49:21.821759 | mon1 | 2026-03-05 21:49:21.821841 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:49:21.821957 | mon1 | Thursday 05 March 2026 21:49:21 +0000 (0:00:01.177) 0:01:34.045 ******** 2026-03-05 21:49:22.009477 | mon1 | ok: [osd1] 2026-03-05 21:49:22.009543 | mon1 | 2026-03-05 21:49:22.009558 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:49:22.009707 | mon1 | Thursday 05 March 2026 21:49:22 +0000 (0:00:00.187) 0:01:34.232 ******** 2026-03-05 21:49:22.421478 | mon1 | ok: [osd1] 2026-03-05 21:49:22.421552 | mon1 | 2026-03-05 21:49:22.421776 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:49:22.421823 | mon1 | Thursday 05 March 2026 21:49:22 +0000 (0:00:00.411) 0:01:34.644 ******** 2026-03-05 21:49:22.960475 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 21:49:22.960547 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:49:22.960562 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:49:22.960904 | mon1 | 2026-03-05 21:49:22.960950 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:49:22.960966 | mon1 | Thursday 05 March 2026 21:49:22 +0000 (0:00:00.539) 0:01:35.183 ******** 2026-03-05 21:49:23.353342 | mon1 | ok: [osd1] 2026-03-05 21:49:23.353404 | mon1 | 2026-03-05 21:49:23.353492 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:49:23.353590 | mon1 | Thursday 05 March 2026 21:49:23 +0000 (0:00:00.392) 0:01:35.576 ******** 2026-03-05 21:49:23.754442 | mon1 | ok: [osd1] 2026-03-05 21:49:23.754505 | mon1 | 2026-03-05 21:49:23.754557 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:49:23.754912 | mon1 | Thursday 05 March 2026 21:49:23 +0000 (0:00:00.396) 0:01:35.972 ******** 2026-03-05 21:49:23.754927 | mon1 | 2026-03-05 21:49:23.754932 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:49:23.754936 | mon1 | Thursday 05 March 2026 21:49:23 +0000 (0:00:00.004) 0:01:35.977 ******** 2026-03-05 21:49:24.091583 | mon1 | ok: [osd1] 2026-03-05 21:49:24.091631 | mon1 | 2026-03-05 21:49:24.091708 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:49:24.091795 | mon1 | Thursday 05 March 2026 21:49:24 +0000 (0:00:00.337) 0:01:36.315 ******** 2026-03-05 21:49:24.130369 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:49:24.130410 | mon1 | 2026-03-05 21:49:24.130651 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:49:24.130699 | mon1 | Thursday 05 March 2026 21:49:24 +0000 (0:00:00.038) 0:01:36.353 ******** 2026-03-05 21:49:25.046146 | mon1 | ok: [osd1] 2026-03-05 21:49:25.046228 | mon1 | 2026-03-05 21:49:25.046286 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:49:25.046411 | mon1 | Thursday 05 March 2026 21:49:25 +0000 (0:00:00.915) 0:01:37.269 ******** 2026-03-05 21:49:25.707662 | mon1 | ok: [osd1] => (item=chronyd) 2026-03-05 21:49:25.707735 | mon1 | ok: [osd1] => (item=sshd) 2026-03-05 21:49:25.707749 | mon1 | 2026-03-05 21:49:25.707978 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:49:25.708026 | mon1 | Thursday 05 March 2026 21:49:25 +0000 (0:00:00.661) 0:01:37.930 ******** 2026-03-05 21:49:25.976476 | mon1 | ok: [osd1] 2026-03-05 21:49:25.976534 | mon1 | 2026-03-05 21:49:25.976591 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:49:25.976706 | mon1 | Thursday 05 March 2026 21:49:25 +0000 (0:00:00.269) 0:01:38.199 ******** 2026-03-05 21:49:26.161723 | mon1 | ok: [osd1] 2026-03-05 21:49:26.161790 | mon1 | 2026-03-05 21:49:26.161809 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:49:26.161898 | mon1 | Thursday 05 March 2026 21:49:26 +0000 (0:00:00.185) 0:01:38.385 ******** 2026-03-05 21:49:26.392482 | mon1 | ok: [osd1] 2026-03-05 21:49:26.392557 | mon1 | 2026-03-05 21:49:26.392574 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:49:26.392762 | mon1 | Thursday 05 March 2026 21:49:26 +0000 (0:00:00.230) 0:01:38.615 ******** 2026-03-05 21:49:26.590198 | mon1 | ok: [osd1] 2026-03-05 21:49:26.590327 | mon1 | 2026-03-05 21:49:26.590367 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:49:26.590381 | mon1 | Thursday 05 March 2026 21:49:26 +0000 (0:00:00.198) 0:01:38.813 ******** 2026-03-05 21:49:26.799775 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 21:49:26.799897 | mon1 | 2026-03-05 21:49:26.799911 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:49:26.799924 | mon1 | Thursday 05 March 2026 21:49:26 +0000 (0:00:00.209) 0:01:39.023 ******** 2026-03-05 21:49:26.840017 | mon1 | ok: [osd1] 2026-03-05 21:49:26.840092 | mon1 | 2026-03-05 21:49:26.840240 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:49:26.840412 | mon1 | Thursday 05 March 2026 21:49:26 +0000 (0:00:00.040) 0:01:39.063 ******** 2026-03-05 21:49:26.895116 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 21:49:26.895176 | mon1 | 2026-03-05 21:49:26.895426 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:49:26.895474 | mon1 | Thursday 05 March 2026 21:49:26 +0000 (0:00:00.054) 0:01:39.118 ******** 2026-03-05 21:49:33.087600 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:49:33.087680 | mon1 | 2026-03-05 21:49:33.087904 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:49:33.087972 | mon1 | Thursday 05 March 2026 21:49:33 +0000 (0:00:06.191) 0:01:45.310 ******** 2026-03-05 21:49:33.137818 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 21:49:33.137901 | mon1 | 2026-03-05 21:49:33.138118 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:49:33.138146 | mon1 | Thursday 05 March 2026 21:49:33 +0000 (0:00:00.050) 0:01:45.360 ******** 2026-03-05 21:49:33.385343 | mon1 | ok: [osd1] 2026-03-05 21:49:33.385390 | mon1 | 2026-03-05 21:49:33.385499 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:49:33.385594 | mon1 | Thursday 05 March 2026 21:49:33 +0000 (0:00:00.247) 0:01:45.608 ******** 2026-03-05 21:49:39.939795 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:49:39.939882 | mon1 | 2026-03-05 21:49:39.939897 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:49:39.940012 | mon1 | Thursday 05 March 2026 21:49:39 +0000 (0:00:06.554) 0:01:52.162 ******** 2026-03-05 21:49:45.247579 | mon1 | ok: [osd1] 2026-03-05 21:49:45.247671 | mon1 | 2026-03-05 21:49:45.247683 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:49:45.247694 | mon1 | Thursday 05 March 2026 21:49:45 +0000 (0:00:05.306) 0:01:57.469 ******** 2026-03-05 21:50:07.660343 | mon1 | ok: [osd1] 2026-03-05 21:50:07.660427 | mon1 | 2026-03-05 21:50:07.660669 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:50:07.660725 | mon1 | Thursday 05 March 2026 21:50:07 +0000 (0:00:22.413) 0:02:19.883 ******** 2026-03-05 21:50:07.728842 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 21:50:07.728936 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 21:50:07.729376 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 21:50:07.729415 | mon1 | skipping: [osd1] 2026-03-05 21:50:07.729421 | mon1 | 2026-03-05 21:50:07.729425 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:50:07.729431 | mon1 | Thursday 05 March 2026 21:50:07 +0000 (0:00:00.068) 0:02:19.952 ******** 2026-03-05 21:50:13.969113 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:50:13.969186 | mon1 | 2026-03-05 21:50:13.969434 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:50:13.969510 | mon1 | Thursday 05 March 2026 21:50:13 +0000 (0:00:06.239) 0:02:26.192 ******** 2026-03-05 21:50:20.126143 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:50:20.126189 | mon1 | 2026-03-05 21:50:20.126194 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:50:20.126199 | mon1 | Thursday 05 March 2026 21:50:20 +0000 (0:00:06.157) 0:02:32.349 ******** 2026-03-05 21:50:20.180722 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 21:50:20.181837 | mon1 | 2026-03-05 21:50:20.181845 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:50:20.181851 | mon1 | Thursday 05 March 2026 21:50:20 +0000 (0:00:00.054) 0:02:32.404 ******** 2026-03-05 21:50:20.225943 | mon1 | ok: [osd1] 2026-03-05 21:50:20.225990 | mon1 | 2026-03-05 21:50:20.225995 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:50:20.226000 | mon1 | Thursday 05 March 2026 21:50:20 +0000 (0:00:00.044) 0:02:32.448 ******** 2026-03-05 21:50:26.427972 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:50:26.428080 | mon1 | 2026-03-05 21:50:26.428350 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:50:26.428410 | mon1 | Thursday 05 March 2026 21:50:26 +0000 (0:00:06.202) 0:02:38.651 ******** 2026-03-05 21:50:26.463017 | mon1 | ok: [osd1] 2026-03-05 21:50:26.463078 | mon1 | 2026-03-05 21:50:26.463321 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:50:26.463396 | mon1 | Thursday 05 March 2026 21:50:26 +0000 (0:00:00.035) 0:02:38.686 ******** 2026-03-05 21:50:26.505416 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:50:26.505494 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:50:26.506014 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:50:26.506073 | mon1 | skipping: [osd1] 2026-03-05 21:50:26.506079 | mon1 | 2026-03-05 21:50:26.506085 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:50:26.506090 | mon1 | Thursday 05 March 2026 21:50:26 +0000 (0:00:00.042) 0:02:38.728 ******** 2026-03-05 21:50:26.543312 | mon1 | skipping: [osd1] 2026-03-05 21:50:26.544933 | mon1 | 2026-03-05 21:50:26.545013 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:50:26.545026 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 21:50:26.545037 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 21:50:26.545046 | mon1 | 2026-03-05 21:50:26.545055 | mon1 | 2026-03-05 21:50:26.545065 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:50:26.545074 | mon1 | Thursday 05 March 2026 21:50:26 +0000 (0:00:00.038) 0:02:38.766 ******** 2026-03-05 21:50:26.545101 | mon1 | =============================================================================== 2026-03-05 21:50:26.545111 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.41s 2026-03-05 21:50:26.545120 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.21s 2026-03-05 21:50:26.545139 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.94s 2026-03-05 21:50:26.545148 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.58s 2026-03-05 21:50:26.545159 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.55s 2026-03-05 21:50:26.545317 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.50s 2026-03-05 21:50:26.545532 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.28s 2026-03-05 21:50:26.545699 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.24s 2026-03-05 21:50:26.545902 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.22s 2026-03-05 21:50:26.546033 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.20s 2026-03-05 21:50:26.546152 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.19s 2026-03-05 21:50:26.546268 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.16s 2026-03-05 21:50:26.546385 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.16s 2026-03-05 21:50:26.546504 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.12s 2026-03-05 21:50:26.546628 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.31s 2026-03-05 21:50:26.546747 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.09s 2026-03-05 21:50:26.546864 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.04s 2026-03-05 21:50:26.546982 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.16s 2026-03-05 21:50:26.547100 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.93s 2026-03-05 21:50:26.547218 | mon1 | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.18s 2026-03-05 21:50:26.671160 | mon1 | INFO [default > idempotence] Executed: Successful 2026-03-05 21:50:26.682622 | mon1 | INFO [default > side_effect] Executing 2026-03-05 21:50:26.682991 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:50:26.687955 | mon1 | INFO [default > verify] Executing 2026-03-05 21:50:27.318404 | mon1 | 2026-03-05 21:50:27.318486 | mon1 | PLAY [Verify] ****************************************************************** 2026-03-05 21:50:27.318492 | mon1 | 2026-03-05 21:50:27.318497 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:50:27.318501 | mon1 | Thursday 05 March 2026 21:50:27 +0000 (0:00:00.007) 0:00:00.007 ******** 2026-03-05 21:50:28.474844 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:50:28.474920 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:50:28.474929 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:50:28.474936 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:50:28.474943 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:50:28.488887 | mon1 | ok: [mon1] 2026-03-05 21:50:28.488969 | mon1 | 2026-03-05 21:50:28.488981 | mon1 | TASK [Get cluster health status] *********************************************** 2026-03-05 21:50:28.489001 | mon1 | Thursday 05 March 2026 21:50:28 +0000 (0:00:01.170) 0:00:01.178 ******** 2026-03-05 21:50:38.861143 | mon1 | ok: [mon1] 2026-03-05 21:50:38.861218 | mon1 | 2026-03-05 21:50:38.861360 | mon1 | TASK [Print cluster health status] ********************************************* 2026-03-05 21:50:38.861486 | mon1 | Thursday 05 March 2026 21:50:38 +0000 (0:00:10.371) 0:00:11.550 ******** 2026-03-05 21:50:38.898927 | mon1 | ok: [mon1] => { 2026-03-05 21:50:38.899221 | mon1 | "_ceph_health": { 2026-03-05 21:50:38.899435 | mon1 | "changed": false, 2026-03-05 21:50:38.899635 | mon1 | "cmd": [ 2026-03-05 21:50:38.899835 | mon1 | "cephadm", 2026-03-05 21:50:38.900038 | mon1 | "shell", 2026-03-05 21:50:38.900236 | mon1 | "--", 2026-03-05 21:50:38.900434 | mon1 | "ceph", 2026-03-05 21:50:38.900633 | mon1 | "health" 2026-03-05 21:50:38.900874 | mon1 | ], 2026-03-05 21:50:38.901080 | mon1 | "delta": "0:00:10.103849", 2026-03-05 21:50:38.901292 | mon1 | "end": "2026-03-05 21:50:38.824051", 2026-03-05 21:50:38.901488 | mon1 | "failed": false, 2026-03-05 21:50:38.901686 | mon1 | "msg": "", 2026-03-05 21:50:38.901884 | mon1 | "rc": 0, 2026-03-05 21:50:38.902093 | mon1 | "start": "2026-03-05 21:50:28.720202", 2026-03-05 21:50:38.902323 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-03-05 21:50:38.902523 | mon1 | "stderr_lines": [ 2026-03-05 21:50:38.902731 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-05 21:50:38.902962 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-03-05 21:50:38.903198 | mon1 | ], 2026-03-05 21:50:38.903401 | mon1 | "stdout": "HEALTH_OK", 2026-03-05 21:50:38.903603 | mon1 | "stdout_lines": [ 2026-03-05 21:50:38.903806 | mon1 | "HEALTH_OK" 2026-03-05 21:50:38.904005 | mon1 | ] 2026-03-05 21:50:38.904201 | mon1 | } 2026-03-05 21:50:38.904395 | mon1 | } 2026-03-05 21:50:38.904583 | mon1 | 2026-03-05 21:50:38.904831 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-05 21:50:38.905047 | mon1 | Thursday 05 March 2026 21:50:38 +0000 (0:00:00.038) 0:00:11.589 ******** 2026-03-05 21:50:38.926357 | mon1 | ok: [mon1] => { 2026-03-05 21:50:38.926482 | mon1 | "changed": false, 2026-03-05 21:50:38.926605 | mon1 | "msg": "All assertions passed" 2026-03-05 21:50:38.926721 | mon1 | } 2026-03-05 21:50:38.926831 | mon1 | 2026-03-05 21:50:38.926954 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-03-05 21:50:38.927105 | mon1 | Thursday 05 March 2026 21:50:38 +0000 (0:00:00.027) 0:00:11.616 ******** 2026-03-05 21:50:45.890176 | mon1 | changed: [mon1] 2026-03-05 21:50:45.890364 | mon1 | 2026-03-05 21:50:45.890597 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-03-05 21:50:45.890851 | mon1 | Thursday 05 March 2026 21:50:45 +0000 (0:00:06.962) 0:00:18.579 ******** 2026-03-05 21:50:48.353323 | mon1 | changed: [mon1] 2026-03-05 21:50:48.353499 | mon1 | 2026-03-05 21:50:48.353712 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-05 21:50:48.353919 | mon1 | Thursday 05 March 2026 21:50:48 +0000 (0:00:02.462) 0:00:21.042 ******** 2026-03-05 21:50:49.568548 | mon1 | ok: [mon1] 2026-03-05 21:50:49.568668 | mon1 | 2026-03-05 21:50:49.568681 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-03-05 21:50:49.568692 | mon1 | Thursday 05 March 2026 21:50:49 +0000 (0:00:01.214) 0:00:22.257 ******** 2026-03-05 21:50:49.594805 | mon1 | ok: [mon1] => { 2026-03-05 21:50:49.596814 | mon1 | "changed": false, 2026-03-05 21:50:49.596872 | mon1 | "msg": "All assertions passed" 2026-03-05 21:50:49.596879 | mon1 | } 2026-03-05 21:50:49.596884 | mon1 | 2026-03-05 21:50:49.596889 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:50:49.596895 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 21:50:49.596899 | mon1 | 2026-03-05 21:50:49.596903 | mon1 | 2026-03-05 21:50:49.596907 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:50:49.596911 | mon1 | Thursday 05 March 2026 21:50:49 +0000 (0:00:00.027) 0:00:22.285 ******** 2026-03-05 21:50:49.596916 | mon1 | =============================================================================== 2026-03-05 21:50:49.596920 | mon1 | Get cluster health status ---------------------------------------------- 10.37s 2026-03-05 21:50:49.596924 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.96s 2026-03-05 21:50:49.596928 | mon1 | Create a test Ceph key -------------------------------------------------- 2.46s 2026-03-05 21:50:49.596932 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.21s 2026-03-05 21:50:49.596941 | mon1 | Gathering Facts --------------------------------------------------------- 1.17s 2026-03-05 21:50:49.597261 | mon1 | Print cluster health status --------------------------------------------- 0.04s 2026-03-05 21:50:49.597286 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.03s 2026-03-05 21:50:49.597293 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-03-05 21:50:49.687706 | mon1 | INFO [default > verify] Executed: Successful 2026-03-05 21:50:49.698520 | mon1 | INFO [default > cleanup] Executing 2026-03-05 21:50:49.698851 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:50:49.703916 | mon1 | INFO [default > destroy] Executing 2026-03-05 21:50:49.704009 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 21:50:49.704090 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 21:50:49.704408 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-05 21:50:50.011148 | mon1 | ok: Runtime: 0:12:01.206976 2026-03-05 21:50:50.024885 | 2026-03-05 21:50:50.024947 | PLAY RECAP 2026-03-05 21:50:50.025020 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:50:50.025043 | 2026-03-05 21:50:50.210050 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 21:50:50.215236 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:50:50.824550 | 2026-03-05 21:50:50.824692 | PLAY [all] 2026-03-05 21:50:50.837900 | 2026-03-05 21:50:50.837974 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-05 21:50:50.886627 | mon1 | ok 2026-03-05 21:50:50.896440 | osd1 | ok 2026-03-05 21:50:50.902623 | 2026-03-05 21:50:50.902732 | TASK [fetch-output : Set log path for single node] 2026-03-05 21:50:50.929418 | mon1 | skipping: Conditional result was False 2026-03-05 21:50:50.940659 | osd1 | skipping: Conditional result was False 2026-03-05 21:50:50.950952 | 2026-03-05 21:50:50.951145 | LOOP [fetch-output : Ensure local output dirs] 2026-03-05 21:50:51.309513 | osd1 -> localhost | changed: "/var/lib/zuul/builds/e11d1a6c8f1646e7affb48b68678e0c7/work/logs/osd1" 2026-03-05 21:50:51.340679 | mon1 -> localhost | changed: "/var/lib/zuul/builds/e11d1a6c8f1646e7affb48b68678e0c7/work/logs/mon1" 2026-03-05 21:50:51.547882 | mon1 -> localhost | changed: "/var/lib/zuul/builds/e11d1a6c8f1646e7affb48b68678e0c7/work/artifacts" 2026-03-05 21:50:51.559285 | osd1 -> localhost | ok: "/var/lib/zuul/builds/e11d1a6c8f1646e7affb48b68678e0c7/work/artifacts" 2026-03-05 21:50:51.776848 | osd1 -> localhost | changed: "/var/lib/zuul/builds/e11d1a6c8f1646e7affb48b68678e0c7/work/docs" 2026-03-05 21:50:51.779775 | mon1 -> localhost | ok: "/var/lib/zuul/builds/e11d1a6c8f1646e7affb48b68678e0c7/work/docs" 2026-03-05 21:50:51.796811 | 2026-03-05 21:50:51.796991 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-05 21:50:52.393006 | osd1 | changed: .d..t...... ./ 2026-03-05 21:50:52.393249 | osd1 | changed: All items complete 2026-03-05 21:50:52.393284 | 2026-03-05 21:50:52.400257 | mon1 | changed: .d..t...... ./ 2026-03-05 21:50:52.833461 | osd1 | changed: .d..t...... ./ 2026-03-05 21:50:52.843650 | mon1 | ok 2026-03-05 21:50:53.285880 | osd1 | changed: .d..t...... ./ 2026-03-05 21:50:53.296945 | mon1 | ok 2026-03-05 21:50:53.319260 | 2026-03-05 21:50:53.319400 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-05 21:50:53.699104 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006382 2026-03-05 21:50:53.699389 | mon1 -> localhost | changed: All items complete 2026-03-05 21:50:53.699433 | 2026-03-05 21:50:53.908785 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006584 2026-03-05 21:50:53.935189 | 2026-03-05 21:50:53.935300 | PLAY [all] 2026-03-05 21:50:53.941197 | 2026-03-05 21:50:53.941260 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-05 21:50:54.338937 | mon1 | changed 2026-03-05 21:50:54.511316 | osd1 | changed 2026-03-05 21:50:54.521263 | 2026-03-05 21:50:54.521312 | PLAY RECAP 2026-03-05 21:50:54.521354 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 21:50:54.521396 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 21:50:54.521416 | 2026-03-05 21:50:54.637044 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:50:54.642272 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-05 21:50:55.185791 | 2026-03-05 21:50:55.185906 | PLAY [localhost] 2026-03-05 21:50:55.195152 | 2026-03-05 21:50:55.195218 | TASK [Generate Zuul manifest] 2026-03-05 21:50:55.216482 | localhost | ok 2026-03-05 21:50:55.232401 | 2026-03-05 21:50:55.232473 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-05 21:50:55.536236 | localhost | changed 2026-03-05 21:50:55.549652 | 2026-03-05 21:50:55.549750 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-05 21:50:55.592194 | localhost | ok 2026-03-05 21:50:55.601243 | 2026-03-05 21:50:55.601334 | TASK [Upload logs] 2026-03-05 21:50:55.623802 | localhost | ok 2026-03-05 21:50:55.680801 | 2026-03-05 21:50:55.680910 | TASK [Set zuul-log-path fact] 2026-03-05 21:50:55.703395 | localhost | ok 2026-03-05 21:50:55.718088 | 2026-03-05 21:50:55.718156 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 21:50:55.750348 | localhost | ok 2026-03-05 21:50:55.760051 | 2026-03-05 21:50:55.760134 | TASK [upload-logs : Create log directories] 2026-03-05 21:50:56.147420 | localhost | changed 2026-03-05 21:50:56.152711 | 2026-03-05 21:50:56.152778 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-05 21:50:56.539267 | localhost -> localhost | ok: Runtime: 0:00:00.004821 2026-03-05 21:50:56.544823 | 2026-03-05 21:50:56.544887 | TASK [upload-logs : Upload logs to log server] 2026-03-05 21:50:56.993833 | localhost | Output suppressed because no_log was given 2026-03-05 21:50:56.998521 | 2026-03-05 21:50:56.998608 | LOOP [upload-logs : Compress console log and json output] 2026-03-05 21:50:57.044391 | localhost | skipping: Conditional result was False 2026-03-05 21:50:57.051570 | localhost | skipping: Conditional result was False 2026-03-05 21:50:57.063648 | 2026-03-05 21:50:57.063817 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-05 21:50:57.110513 | localhost | skipping: Conditional result was False 2026-03-05 21:50:57.110864 | 2026-03-05 21:50:57.114731 | localhost | skipping: Conditional result was False 2026-03-05 21:50:57.127686 | 2026-03-05 21:50:57.127858 | LOOP [upload-logs : Upload console log and json output]