2026-03-05 21:37:32.683840 | Job console starting 2026-03-05 21:37:32.695650 | Updating git repos 2026-03-05 21:37:32.724723 | Cloning repos into workspace 2026-03-05 21:37:32.775028 | Restoring repo states 2026-03-05 21:37:32.782536 | Merging changes 2026-03-05 21:37:33.025144 | Checking out repos 2026-03-05 21:37:33.059093 | Preparing playbooks 2026-03-05 21:37:34.486417 | Running Ansible setup 2026-03-05 21:37:38.495730 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 21:37:39.096756 | 2026-03-05 21:37:39.096901 | PLAY [localhost] 2026-03-05 21:37:39.105226 | 2026-03-05 21:37:39.105317 | TASK [Gathering Facts] 2026-03-05 21:37:40.941762 | localhost | ok 2026-03-05 21:37:40.952873 | 2026-03-05 21:37:40.952945 | TASK [Setup log path fact] 2026-03-05 21:37:40.972111 | localhost | ok 2026-03-05 21:37:40.982757 | 2026-03-05 21:37:40.982821 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 21:37:41.012681 | localhost | ok 2026-03-05 21:37:41.019203 | 2026-03-05 21:37:41.019269 | TASK [emit-job-header : Print job information] 2026-03-05 21:37:41.048497 | # Job Information 2026-03-05 21:37:41.048633 | Ansible Version: 2.16.16 2026-03-05 21:37:41.048676 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-03-05 21:37:41.048707 | Pipeline: check 2026-03-05 21:37:41.048736 | Executor: 0a8996d2b663 2026-03-05 21:37:41.048764 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/94 2026-03-05 21:37:41.048796 | Event ID: 73f33530-18d7-11f1-9201-aa96ba466095 2026-03-05 21:37:41.052339 | 2026-03-05 21:37:41.052423 | LOOP [emit-job-header : Print node information] 2026-03-05 21:37:41.144233 | localhost | ok: 2026-03-05 21:37:41.144412 | localhost | # Node Information 2026-03-05 21:37:41.144442 | localhost | Inventory Hostname: mon1 2026-03-05 21:37:41.144464 | localhost | Hostname: np0000157950 2026-03-05 21:37:41.144483 | localhost | Username: zuul 2026-03-05 21:37:41.144526 | localhost | Distro: Ubuntu 22.04 2026-03-05 21:37:41.144552 | localhost | Provider: yul1 2026-03-05 21:37:41.144572 | localhost | Region: ca-ymq-1 2026-03-05 21:37:41.144590 | localhost | Label: ubuntu-jammy 2026-03-05 21:37:41.144609 | localhost | Product Name: OpenStack Nova 2026-03-05 21:37:41.144627 | localhost | Interface IP: 162.253.55.70 2026-03-05 21:37:41.183754 | localhost | ok: 2026-03-05 21:37:41.183819 | localhost | # Node Information 2026-03-05 21:37:41.183855 | localhost | Inventory Hostname: osd1 2026-03-05 21:37:41.183883 | localhost | Hostname: np0000157951 2026-03-05 21:37:41.183911 | localhost | Username: zuul 2026-03-05 21:37:41.183937 | localhost | Distro: Ubuntu 22.04 2026-03-05 21:37:41.183963 | localhost | Provider: yul1 2026-03-05 21:37:41.183989 | localhost | Region: ca-ymq-1 2026-03-05 21:37:41.184014 | localhost | Label: ubuntu-jammy 2026-03-05 21:37:41.184039 | localhost | Product Name: OpenStack Nova 2026-03-05 21:37:41.184065 | localhost | Interface IP: 162.253.55.209 2026-03-05 21:37:41.192443 | 2026-03-05 21:37:41.192506 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-05 21:37:41.596401 | localhost -> localhost | changed 2026-03-05 21:37:41.603097 | 2026-03-05 21:37:41.603209 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-05 21:37:42.529653 | localhost -> localhost | changed 2026-03-05 21:37:42.536640 | 2026-03-05 21:37:42.536695 | PLAY [all] 2026-03-05 21:37:42.545407 | 2026-03-05 21:37:42.545475 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-05 21:37:42.781605 | mon1 -> localhost | ok 2026-03-05 21:37:42.787891 | 2026-03-05 21:37:42.834544 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-05 21:37:42.862879 | mon1 | ok 2026-03-05 21:37:42.869012 | osd1 | ok 2026-03-05 21:37:42.887760 | mon1 | included: /var/lib/zuul/builds/270af7299b8a41c0a02d9c032c5ec777/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 21:37:42.887812 | osd1 | included: /var/lib/zuul/builds/270af7299b8a41c0a02d9c032c5ec777/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 21:37:42.893576 | 2026-03-05 21:37:42.893639 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-05 21:37:43.500870 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-05 21:37:43.501046 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/270af7299b8a41c0a02d9c032c5ec777/work/270af7299b8a41c0a02d9c032c5ec777_id_rsa 2026-03-05 21:37:43.501079 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/270af7299b8a41c0a02d9c032c5ec777/work/270af7299b8a41c0a02d9c032c5ec777_id_rsa.pub 2026-03-05 21:37:43.501102 | mon1 -> localhost | The key fingerprint is: 2026-03-05 21:37:43.501125 | mon1 -> localhost | SHA256:ZA/QsJXF+fHWkg9YhgKKecnzPrb8iDGPo4IjhpO0kgA zuul-build-sshkey 2026-03-05 21:37:43.501146 | mon1 -> localhost | The key's randomart image is: 2026-03-05 21:37:43.501167 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-05 21:37:43.501187 | mon1 -> localhost | | ooo=.. . | 2026-03-05 21:37:43.501208 | mon1 -> localhost | | + *o + o o | 2026-03-05 21:37:43.501228 | mon1 -> localhost | | o B + o * o | 2026-03-05 21:37:43.501248 | mon1 -> localhost | |E . = o o * .| 2026-03-05 21:37:43.501268 | mon1 -> localhost | |. S . . + | 2026-03-05 21:37:43.501289 | mon1 -> localhost | |.. . .| 2026-03-05 21:37:43.501308 | mon1 -> localhost | |++. o + | 2026-03-05 21:37:43.501328 | mon1 -> localhost | |Xo. .O + | 2026-03-05 21:37:43.501348 | mon1 -> localhost | |+o ...o.=.. | 2026-03-05 21:37:43.501370 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-05 21:37:43.501418 | mon1 -> localhost | ok: Runtime: 0:00:00.204757 2026-03-05 21:37:43.506566 | 2026-03-05 21:37:43.506628 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-05 21:37:43.536772 | mon1 | ok 2026-03-05 21:37:43.555507 | osd1 | ok 2026-03-05 21:37:43.571680 | mon1 | included: /var/lib/zuul/builds/270af7299b8a41c0a02d9c032c5ec777/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 21:37:43.571729 | osd1 | included: /var/lib/zuul/builds/270af7299b8a41c0a02d9c032c5ec777/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 21:37:43.581292 | 2026-03-05 21:37:43.581351 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-05 21:37:43.603261 | mon1 | skipping: Conditional result was False 2026-03-05 21:37:43.615097 | osd1 | skipping: Conditional result was False 2026-03-05 21:37:43.624464 | 2026-03-05 21:37:43.624643 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-05 21:37:44.039318 | mon1 | changed 2026-03-05 21:37:44.045723 | osd1 | changed 2026-03-05 21:37:44.051969 | 2026-03-05 21:37:44.052038 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-05 21:37:44.234838 | mon1 | ok 2026-03-05 21:37:44.254437 | osd1 | ok 2026-03-05 21:37:44.261712 | 2026-03-05 21:37:44.261775 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-05 21:37:44.690965 | mon1 | changed 2026-03-05 21:37:44.731072 | osd1 | changed 2026-03-05 21:37:44.737452 | 2026-03-05 21:37:44.737521 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-05 21:37:45.218040 | mon1 | changed 2026-03-05 21:37:45.226722 | osd1 | changed 2026-03-05 21:37:45.232596 | 2026-03-05 21:37:45.232671 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-05 21:37:45.255823 | mon1 | skipping: Conditional result was False 2026-03-05 21:37:45.266789 | osd1 | skipping: Conditional result was False 2026-03-05 21:37:45.313183 | 2026-03-05 21:37:45.313348 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-05 21:37:45.634185 | mon1 -> localhost | changed 2026-03-05 21:37:45.653362 | 2026-03-05 21:37:45.653501 | TASK [add-build-sshkey : Add back temp key] 2026-03-05 21:37:45.943827 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/270af7299b8a41c0a02d9c032c5ec777/work/270af7299b8a41c0a02d9c032c5ec777_id_rsa (zuul-build-sshkey) 2026-03-05 21:37:46.036235 | mon1 -> localhost | ok: Runtime: 0:00:00.014414 2026-03-05 21:37:46.048749 | 2026-03-05 21:37:46.048832 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-05 21:37:46.311291 | mon1 | ok 2026-03-05 21:37:46.317482 | osd1 | ok 2026-03-05 21:37:46.322023 | 2026-03-05 21:37:46.322087 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-05 21:37:46.350000 | mon1 | skipping: Conditional result was False 2026-03-05 21:37:46.361084 | osd1 | skipping: Conditional result was False 2026-03-05 21:37:46.379897 | 2026-03-05 21:37:46.380012 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-05 21:37:46.673428 | mon1 | ok 2026-03-05 21:37:46.679483 | osd1 | ok 2026-03-05 21:37:46.684713 | 2026-03-05 21:37:46.684775 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-05 21:37:47.381256 | mon1 | Output suppressed because no_log was given 2026-03-05 21:37:47.434848 | osd1 | Output suppressed because no_log was given 2026-03-05 21:37:47.449227 | 2026-03-05 21:37:47.449295 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-05 21:37:47.632334 | mon1 | ok: "logs" 2026-03-05 21:37:47.635192 | mon1 | ok: All items complete 2026-03-05 21:37:47.635273 | 2026-03-05 21:37:47.643105 | osd1 | ok: "logs" 2026-03-05 21:37:47.779963 | mon1 | ok: "artifacts" 2026-03-05 21:37:47.805785 | osd1 | ok: "artifacts" 2026-03-05 21:37:47.943045 | mon1 | ok: "docs" 2026-03-05 21:37:47.964362 | osd1 | ok: "docs" 2026-03-05 21:37:47.986029 | 2026-03-05 21:37:47.986132 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-05 21:37:48.177564 | mon1 | changed: "logs" 2026-03-05 21:37:48.177802 | mon1 | ok: All items complete 2026-03-05 21:37:48.177842 | 2026-03-05 21:37:48.183138 | osd1 | changed: "logs" 2026-03-05 21:37:48.330791 | osd1 | changed: "artifacts" 2026-03-05 21:37:48.337266 | mon1 | changed: "artifacts" 2026-03-05 21:37:48.483009 | osd1 | changed: "docs" 2026-03-05 21:37:48.497733 | mon1 | changed: "docs" 2026-03-05 21:37:48.527904 | 2026-03-05 21:37:48.527951 | PLAY RECAP 2026-03-05 21:37:48.527992 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:37:48.528020 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 21:37:48.528046 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 21:37:48.528065 | 2026-03-05 21:37:48.672367 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 21:37:48.692808 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 21:37:49.319265 | 2026-03-05 21:37:49.319500 | PLAY [all] 2026-03-05 21:37:49.331912 | 2026-03-05 21:37:49.332017 | TASK [setup-uv : Extract archive] 2026-03-05 21:37:51.464582 | osd1 | changed 2026-03-05 21:37:51.514176 | mon1 | changed 2026-03-05 21:37:51.520586 | 2026-03-05 21:37:51.520672 | TASK [setup-uv : Print version] 2026-03-05 21:37:50.489173 | mon1 | uv 0.8.13 2026-03-05 21:37:50.982155 | osd1 | uv 0.8.13 2026-03-05 21:37:52.224828 | osd1 | ok: Runtime: 0:00:00.010962 2026-03-05 21:37:52.233413 | mon1 | ok: Runtime: 0:00:00.010407 2026-03-05 21:37:52.244299 | 2026-03-05 21:37:52.244352 | PLAY RECAP 2026-03-05 21:37:52.244398 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:37:52.244425 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:37:52.244444 | 2026-03-05 21:37:52.379451 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 21:37:52.585317 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 21:37:53.136560 | 2026-03-05 21:37:53.136687 | PLAY [all] 2026-03-05 21:37:53.147241 | 2026-03-05 21:37:53.147311 | TASK [Copy inventory file for Zuul] 2026-03-05 21:37:53.949593 | mon1 | changed 2026-03-05 21:37:53.954468 | 2026-03-05 21:37:53.954541 | TASK [Switch "ansible_host" to private IP] 2026-03-05 21:37:54.211374 | mon1 | changed: 2 replacements made 2026-03-05 21:37:54.216621 | 2026-03-05 21:37:54.216689 | TASK [Run Molecule scenario] 2026-03-05 21:37:53.385569 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-03-05 21:37:54.222668 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-03-05 21:37:54.406680 | mon1 | Using CPython 3.13.7 2026-03-05 21:37:54.406768 | mon1 | Creating virtual environment at: .venv 2026-03-05 21:37:54.763243 | mon1 | Downloading cryptography (4.3MiB) 2026-03-05 21:37:54.763732 | mon1 | Downloading pygments (1.2MiB) 2026-03-05 21:37:54.766220 | mon1 | Downloading netaddr (2.2MiB) 2026-03-05 21:37:54.813029 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-05 21:37:54.938630 | mon1 | Downloading netaddr 2026-03-05 21:37:54.948679 | mon1 | Downloading cryptography 2026-03-05 21:37:55.000358 | mon1 | Downloading pygments 2026-03-05 21:37:55.133781 | mon1 | Downloading ansible-core 2026-03-05 21:37:55.161169 | mon1 | Installed 36 packages in 26ms 2026-03-05 21:37:56.244357 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-05 21:37:56.244501 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-05 21:37:56.839977 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-05 21:37:56.840064 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-05 21:38:11.715260 | mon1 | INFO [default > dependency] Executing 2026-03-05 21:38:11.715492 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-05 21:38:11.715737 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-05 21:38:11.715911 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-05 21:38:11.721530 | mon1 | INFO [default > cleanup] Executing 2026-03-05 21:38:11.721825 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:38:11.726837 | mon1 | INFO [default > destroy] Executing 2026-03-05 21:38:11.726874 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 21:38:11.726951 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 21:38:11.731893 | mon1 | INFO [default > syntax] Executing 2026-03-05 21:38:12.691689 | mon1 | 2026-03-05 21:38:12.692008 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-05 21:38:12.752863 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-05 21:38:12.763048 | mon1 | INFO [default > create] Executing 2026-03-05 21:38:12.764416 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:38:12.769428 | mon1 | INFO [default > prepare] Executing 2026-03-05 21:38:13.475091 | mon1 | 2026-03-05 21:38:13.475323 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-05 21:38:13.475472 | mon1 | 2026-03-05 21:38:13.475691 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:38:13.475912 | mon1 | Thursday 05 March 2026 21:38:13 +0000 (0:00:00.029) 0:00:00.029 ******** 2026-03-05 21:38:14.593822 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:38:14.593916 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:38:14.593994 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:38:14.594128 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:38:14.594261 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:38:14.630401 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:38:14.630645 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:38:14.630863 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:38:14.631076 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:38:14.631294 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:38:14.639137 | mon1 | ok: [osd1] 2026-03-05 21:38:14.639349 | mon1 | ok: [mon1] 2026-03-05 21:38:14.639544 | mon1 | 2026-03-05 21:38:14.639763 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-05 21:38:14.639977 | mon1 | Thursday 05 March 2026 21:38:14 +0000 (0:00:01.164) 0:00:01.194 ******** 2026-03-05 21:38:15.340634 | mon1 | changed: [mon1] 2026-03-05 21:38:15.340850 | mon1 | changed: [osd1] 2026-03-05 21:38:15.341065 | mon1 | 2026-03-05 21:38:15.341304 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-05 21:38:15.341529 | mon1 | Thursday 05 March 2026 21:38:15 +0000 (0:00:00.700) 0:00:01.895 ******** 2026-03-05 21:38:15.655967 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-05 21:38:15.656056 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-05 21:38:15.656068 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-05 21:38:15.664848 | mon1 | changed: [mon1] 2026-03-05 21:38:15.665185 | mon1 | changed: [osd1] 2026-03-05 21:38:15.665506 | mon1 | 2026-03-05 21:38:15.665795 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-05 21:38:15.666117 | mon1 | Thursday 05 March 2026 21:38:15 +0000 (0:00:00.324) 0:00:02.220 ******** 2026-03-05 21:38:22.954351 | mon1 | changed: [mon1] 2026-03-05 21:38:22.954624 | mon1 | changed: [osd1] 2026-03-05 21:38:22.954801 | mon1 | 2026-03-05 21:38:22.954998 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-05 21:38:22.955166 | mon1 | 2026-03-05 21:38:22.955458 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:38:22.955701 | mon1 | Thursday 05 March 2026 21:38:22 +0000 (0:00:07.289) 0:00:09.509 ******** 2026-03-05 21:38:23.681444 | mon1 | ok: [osd1] 2026-03-05 21:38:23.681728 | mon1 | 2026-03-05 21:38:23.681947 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-05 21:38:23.682161 | mon1 | Thursday 05 March 2026 21:38:23 +0000 (0:00:00.726) 0:00:10.236 ******** 2026-03-05 21:38:43.642233 | mon1 | changed: [osd1] 2026-03-05 21:38:43.642583 | mon1 | 2026-03-05 21:38:43.643564 | mon1 | TASK [Start up service] ******************************************************** 2026-03-05 21:38:43.643843 | mon1 | Thursday 05 March 2026 21:38:43 +0000 (0:00:19.961) 0:00:30.197 ******** 2026-03-05 21:38:44.209940 | mon1 | ok: [osd1] 2026-03-05 21:38:44.210018 | mon1 | 2026-03-05 21:38:44.210030 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-05 21:38:44.210041 | mon1 | Thursday 05 March 2026 21:38:44 +0000 (0:00:00.567) 0:00:30.764 ******** 2026-03-05 21:38:44.524318 | mon1 | ok: [osd1] 2026-03-05 21:38:44.524422 | mon1 | 2026-03-05 21:38:44.524435 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-05 21:38:44.524447 | mon1 | Thursday 05 March 2026 21:38:44 +0000 (0:00:00.314) 0:00:31.079 ******** 2026-03-05 21:38:45.199574 | mon1 | changed: [osd1] 2026-03-05 21:38:45.199667 | mon1 | 2026-03-05 21:38:45.199679 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-05 21:38:45.199689 | mon1 | Thursday 05 March 2026 21:38:45 +0000 (0:00:00.674) 0:00:31.753 ******** 2026-03-05 21:38:45.392278 | mon1 | ok: [osd1] 2026-03-05 21:38:45.392308 | mon1 | 2026-03-05 21:38:45.392313 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-05 21:38:45.392318 | mon1 | Thursday 05 March 2026 21:38:45 +0000 (0:00:00.193) 0:00:31.947 ******** 2026-03-05 21:38:45.411595 | mon1 | skipping: [osd1] 2026-03-05 21:38:45.411623 | mon1 | 2026-03-05 21:38:45.411634 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-05 21:38:45.411643 | mon1 | Thursday 05 March 2026 21:38:45 +0000 (0:00:00.019) 0:00:31.966 ******** 2026-03-05 21:38:45.928599 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:38:45.928672 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:38:45.928679 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:38:45.928685 | mon1 | 2026-03-05 21:38:45.928692 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-05 21:38:45.928708 | mon1 | Thursday 05 March 2026 21:38:45 +0000 (0:00:00.515) 0:00:32.482 ******** 2026-03-05 21:38:46.527702 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:38:46.527877 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:38:46.528083 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:38:46.528315 | mon1 | 2026-03-05 21:38:46.528581 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-05 21:38:46.528799 | mon1 | Thursday 05 March 2026 21:38:46 +0000 (0:00:00.599) 0:00:33.082 ******** 2026-03-05 21:38:47.245345 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:38:47.245507 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:38:47.245709 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:38:47.245898 | mon1 | 2026-03-05 21:38:47.246110 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-05 21:38:47.246310 | mon1 | Thursday 05 March 2026 21:38:47 +0000 (0:00:00.717) 0:00:33.800 ******** 2026-03-05 21:38:50.250689 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:38:50.250818 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:38:50.251031 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:38:50.251167 | mon1 | 2026-03-05 21:38:50.251386 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-05 21:38:50.251569 | mon1 | Thursday 05 March 2026 21:38:50 +0000 (0:00:03.005) 0:00:36.805 ******** 2026-03-05 21:38:52.143460 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-05 21:38:52.143644 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-05 21:38:52.143847 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-05 21:38:52.144046 | mon1 | 2026-03-05 21:38:52.144292 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:38:52.144569 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 21:38:52.144796 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-05 21:38:52.144974 | mon1 | 2026-03-05 21:38:52.145153 | mon1 | 2026-03-05 21:38:52.145386 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:38:52.145605 | mon1 | Thursday 05 March 2026 21:38:52 +0000 (0:00:01.893) 0:00:38.698 ******** 2026-03-05 21:38:52.145800 | mon1 | =============================================================================== 2026-03-05 21:38:52.145995 | mon1 | Install depedencies ---------------------------------------------------- 19.96s 2026-03-05 21:38:52.146196 | mon1 | Update apt cache -------------------------------------------------------- 7.29s 2026-03-05 21:38:52.146408 | mon1 | Create a volume group for each loop device ------------------------------ 3.01s 2026-03-05 21:38:52.146654 | mon1 | Create a logical volume for each loop device ---------------------------- 1.89s 2026-03-05 21:38:52.146861 | mon1 | Gathering Facts --------------------------------------------------------- 1.16s 2026-03-05 21:38:52.147059 | mon1 | Gathering Facts --------------------------------------------------------- 0.73s 2026-03-05 21:38:52.147288 | mon1 | Start loop devices ------------------------------------------------------ 0.72s 2026-03-05 21:38:52.147493 | mon1 | Configure short hostname ------------------------------------------------ 0.70s 2026-03-05 21:38:52.147733 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.67s 2026-03-05 21:38:52.147965 | mon1 | Set permissions on loopback devices ------------------------------------- 0.60s 2026-03-05 21:38:52.148169 | mon1 | Start up service -------------------------------------------------------- 0.57s 2026-03-05 21:38:52.148392 | mon1 | Create devices for Ceph ------------------------------------------------- 0.52s 2026-03-05 21:38:52.148602 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.32s 2026-03-05 21:38:52.148909 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.31s 2026-03-05 21:38:52.149085 | mon1 | Get list of all loopback devices ---------------------------------------- 0.19s 2026-03-05 21:38:52.149284 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-03-05 21:38:52.215457 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-05 21:38:52.225674 | mon1 | INFO [default > converge] Executing 2026-03-05 21:38:53.062937 | mon1 | 2026-03-05 21:38:53.063117 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 21:38:53.063290 | mon1 | 2026-03-05 21:38:53.063487 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:38:53.063700 | mon1 | Thursday 05 March 2026 21:38:53 +0000 (0:00:00.061) 0:00:00.061 ******** 2026-03-05 21:38:54.032319 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:38:54.032593 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:38:54.032819 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:38:54.033028 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:38:54.033235 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:38:54.043777 | mon1 | ok: [mon1] 2026-03-05 21:38:54.043972 | mon1 | 2026-03-05 21:38:54.044182 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:38:54.044452 | mon1 | Thursday 05 March 2026 21:38:54 +0000 (0:00:00.981) 0:00:01.042 ******** 2026-03-05 21:38:54.349179 | mon1 | ok: [mon1] 2026-03-05 21:38:54.349294 | mon1 | 2026-03-05 21:38:54.349509 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:38:54.349709 | mon1 | Thursday 05 March 2026 21:38:54 +0000 (0:00:00.304) 0:00:01.347 ******** 2026-03-05 21:38:54.387025 | mon1 | skipping: [mon1] 2026-03-05 21:38:54.387123 | mon1 | 2026-03-05 21:38:54.387327 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:38:54.387525 | mon1 | Thursday 05 March 2026 21:38:54 +0000 (0:00:00.038) 0:00:01.386 ******** 2026-03-05 21:38:54.705737 | mon1 | changed: [mon1] 2026-03-05 21:38:54.705815 | mon1 | 2026-03-05 21:38:54.705890 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:38:54.705983 | mon1 | Thursday 05 March 2026 21:38:54 +0000 (0:00:00.318) 0:00:01.704 ******** 2026-03-05 21:38:54.814299 | mon1 | ok: [mon1] => { 2026-03-05 21:38:54.814374 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:38:54.814381 | mon1 | } 2026-03-05 21:38:54.814386 | mon1 | 2026-03-05 21:38:54.814543 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:38:54.814762 | mon1 | Thursday 05 March 2026 21:38:54 +0000 (0:00:00.106) 0:00:01.810 ******** 2026-03-05 21:38:55.486632 | mon1 | changed: [mon1] 2026-03-05 21:38:55.486723 | mon1 | 2026-03-05 21:38:55.486867 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:38:55.486995 | mon1 | Thursday 05 March 2026 21:38:55 +0000 (0:00:00.674) 0:00:02.485 ******** 2026-03-05 21:38:55.526902 | mon1 | skipping: [mon1] 2026-03-05 21:38:55.527080 | mon1 | 2026-03-05 21:38:55.527309 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:38:55.527514 | mon1 | Thursday 05 March 2026 21:38:55 +0000 (0:00:00.040) 0:00:02.526 ******** 2026-03-05 21:38:55.561605 | mon1 | skipping: [mon1] 2026-03-05 21:38:55.561798 | mon1 | 2026-03-05 21:38:55.561997 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:38:55.562199 | mon1 | Thursday 05 March 2026 21:38:55 +0000 (0:00:00.034) 0:00:02.560 ******** 2026-03-05 21:38:55.762479 | mon1 | ok: [mon1] 2026-03-05 21:38:55.762653 | mon1 | 2026-03-05 21:38:55.762760 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:38:55.762975 | mon1 | Thursday 05 March 2026 21:38:55 +0000 (0:00:00.200) 0:00:02.761 ******** 2026-03-05 21:38:56.825085 | mon1 | ok: [mon1] 2026-03-05 21:38:56.825542 | mon1 | 2026-03-05 21:38:56.825823 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:38:56.826091 | mon1 | Thursday 05 March 2026 21:38:56 +0000 (0:00:01.062) 0:00:03.823 ******** 2026-03-05 21:38:56.904334 | mon1 | ok: [mon1] => { 2026-03-05 21:38:56.904435 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:38:56.904561 | mon1 | } 2026-03-05 21:38:56.904733 | mon1 | 2026-03-05 21:38:56.904874 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:38:56.905001 | mon1 | Thursday 05 March 2026 21:38:56 +0000 (0:00:00.079) 0:00:03.903 ******** 2026-03-05 21:38:57.637733 | mon1 | changed: [mon1] 2026-03-05 21:38:57.637820 | mon1 | 2026-03-05 21:38:57.637987 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:38:57.638222 | mon1 | Thursday 05 March 2026 21:38:57 +0000 (0:00:00.733) 0:00:04.636 ******** 2026-03-05 21:39:00.547600 | mon1 | changed: [mon1] 2026-03-05 21:39:00.547683 | mon1 | 2026-03-05 21:39:00.547927 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:39:00.548105 | mon1 | Thursday 05 March 2026 21:39:00 +0000 (0:00:02.910) 0:00:07.546 ******** 2026-03-05 21:39:00.574539 | mon1 | skipping: [mon1] 2026-03-05 21:39:00.574968 | mon1 | 2026-03-05 21:39:00.575023 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:39:00.575031 | mon1 | Thursday 05 March 2026 21:39:00 +0000 (0:00:00.026) 0:00:07.573 ******** 2026-03-05 21:39:00.597145 | mon1 | skipping: [mon1] 2026-03-05 21:39:00.597460 | mon1 | 2026-03-05 21:39:00.597513 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:39:00.597519 | mon1 | Thursday 05 March 2026 21:39:00 +0000 (0:00:00.022) 0:00:07.596 ******** 2026-03-05 21:39:00.626879 | mon1 | skipping: [mon1] 2026-03-05 21:39:00.626934 | mon1 | 2026-03-05 21:39:00.627181 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:39:00.627231 | mon1 | Thursday 05 March 2026 21:39:00 +0000 (0:00:00.029) 0:00:07.625 ******** 2026-03-05 21:39:06.116982 | mon1 | changed: [mon1] 2026-03-05 21:39:06.117063 | mon1 | 2026-03-05 21:39:06.117393 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:39:06.117479 | mon1 | Thursday 05 March 2026 21:39:06 +0000 (0:00:05.489) 0:00:13.115 ******** 2026-03-05 21:39:06.644050 | mon1 | changed: [mon1] 2026-03-05 21:39:06.644121 | mon1 | 2026-03-05 21:39:06.644465 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:39:06.644715 | mon1 | Thursday 05 March 2026 21:39:06 +0000 (0:00:00.527) 0:00:13.643 ******** 2026-03-05 21:39:07.565195 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:39:07.565283 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:39:07.566077 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:39:07.566130 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:39:07.566140 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:39:07.566148 | mon1 | 2026-03-05 21:39:07.566157 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:39:07.566164 | mon1 | Thursday 05 March 2026 21:39:07 +0000 (0:00:00.921) 0:00:14.564 ******** 2026-03-05 21:39:08.089550 | mon1 | changed: [mon1] 2026-03-05 21:39:08.089621 | mon1 | 2026-03-05 21:39:08.090070 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:39:08.090088 | mon1 | Thursday 05 March 2026 21:39:08 +0000 (0:00:00.515) 0:00:15.079 ******** 2026-03-05 21:39:08.090094 | mon1 | 2026-03-05 21:39:08.090099 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:39:08.090103 | mon1 | Thursday 05 March 2026 21:39:08 +0000 (0:00:00.008) 0:00:15.088 ******** 2026-03-05 21:39:08.937561 | mon1 | ok: [mon1] 2026-03-05 21:39:08.937656 | mon1 | 2026-03-05 21:39:08.937677 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 21:39:08.937811 | mon1 | Thursday 05 March 2026 21:39:08 +0000 (0:00:00.848) 0:00:15.936 ******** 2026-03-05 21:39:09.367616 | mon1 | changed: [mon1] 2026-03-05 21:39:09.367672 | mon1 | 2026-03-05 21:39:09.367678 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:39:09.367684 | mon1 | Thursday 05 March 2026 21:39:09 +0000 (0:00:00.429) 0:00:16.366 ******** 2026-03-05 21:39:09.881271 | mon1 | changed: [mon1] 2026-03-05 21:39:09.881354 | mon1 | 2026-03-05 21:39:09.881391 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:39:09.881535 | mon1 | Thursday 05 March 2026 21:39:09 +0000 (0:00:00.513) 0:00:16.880 ******** 2026-03-05 21:39:10.086147 | mon1 | ok: [mon1] 2026-03-05 21:39:10.086217 | mon1 | 2026-03-05 21:39:10.086427 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:39:10.086478 | mon1 | Thursday 05 March 2026 21:39:10 +0000 (0:00:00.204) 0:00:17.085 ******** 2026-03-05 21:39:10.157534 | mon1 | ok: [mon1] => { 2026-03-05 21:39:10.158252 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:39:10.158292 | mon1 | } 2026-03-05 21:39:10.158300 | mon1 | 2026-03-05 21:39:10.158307 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:39:10.158314 | mon1 | Thursday 05 March 2026 21:39:10 +0000 (0:00:00.071) 0:00:17.156 ******** 2026-03-05 21:39:11.075262 | mon1 | changed: [mon1] 2026-03-05 21:39:11.075334 | mon1 | 2026-03-05 21:39:11.075633 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:39:11.075689 | mon1 | Thursday 05 March 2026 21:39:11 +0000 (0:00:00.917) 0:00:18.074 ******** 2026-03-05 21:39:15.431575 | mon1 | changed: [mon1] 2026-03-05 21:39:15.431759 | mon1 | 2026-03-05 21:39:15.431892 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:39:15.432032 | mon1 | Thursday 05 March 2026 21:39:15 +0000 (0:00:04.347) 0:00:22.421 ******** 2026-03-05 21:39:16.326314 | mon1 | ok: [mon1] 2026-03-05 21:39:16.326390 | mon1 | 2026-03-05 21:39:16.326458 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:39:16.326585 | mon1 | Thursday 05 March 2026 21:39:16 +0000 (0:00:00.903) 0:00:23.325 ******** 2026-03-05 21:39:16.640294 | mon1 | changed: [mon1] 2026-03-05 21:39:16.640396 | mon1 | 2026-03-05 21:39:16.640724 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:39:16.640775 | mon1 | Thursday 05 March 2026 21:39:16 +0000 (0:00:00.313) 0:00:23.639 ******** 2026-03-05 21:39:17.084053 | mon1 | changed: [mon1] 2026-03-05 21:39:17.084442 | mon1 | 2026-03-05 21:39:17.084512 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:39:17.084638 | mon1 | Thursday 05 March 2026 21:39:17 +0000 (0:00:00.443) 0:00:24.083 ******** 2026-03-05 21:39:17.633872 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 21:39:17.634553 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:39:17.634574 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:39:17.634583 | mon1 | 2026-03-05 21:39:17.634589 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:39:17.634595 | mon1 | Thursday 05 March 2026 21:39:17 +0000 (0:00:00.549) 0:00:24.632 ******** 2026-03-05 21:39:18.080507 | mon1 | changed: [mon1] 2026-03-05 21:39:18.080763 | mon1 | 2026-03-05 21:39:18.080776 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:39:18.080786 | mon1 | Thursday 05 March 2026 21:39:18 +0000 (0:00:00.446) 0:00:25.079 ******** 2026-03-05 21:39:18.526452 | mon1 | changed: [mon1] 2026-03-05 21:39:18.526523 | mon1 | 2026-03-05 21:39:18.526583 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:39:18.526984 | mon1 | Thursday 05 March 2026 21:39:18 +0000 (0:00:00.439) 0:00:25.518 ******** 2026-03-05 21:39:18.527038 | mon1 | 2026-03-05 21:39:18.527044 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:39:18.527060 | mon1 | Thursday 05 March 2026 21:39:18 +0000 (0:00:00.007) 0:00:25.525 ******** 2026-03-05 21:39:19.201026 | mon1 | ok: [mon1] 2026-03-05 21:39:19.201477 | mon1 | 2026-03-05 21:39:19.201531 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 21:39:19.201539 | mon1 | Thursday 05 March 2026 21:39:19 +0000 (0:00:00.674) 0:00:26.200 ******** 2026-03-05 21:39:19.928799 | mon1 | changed: [mon1] 2026-03-05 21:39:19.928864 | mon1 | 2026-03-05 21:39:19.928964 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:39:19.929069 | mon1 | Thursday 05 March 2026 21:39:19 +0000 (0:00:00.727) 0:00:26.928 ******** 2026-03-05 21:39:20.432682 | mon1 | changed: [mon1] 2026-03-05 21:39:20.432763 | mon1 | 2026-03-05 21:39:20.432832 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:39:20.432938 | mon1 | Thursday 05 March 2026 21:39:20 +0000 (0:00:00.503) 0:00:27.431 ******** 2026-03-05 21:39:20.482395 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:39:20.482460 | mon1 | 2026-03-05 21:39:20.482634 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:39:20.482663 | mon1 | Thursday 05 March 2026 21:39:20 +0000 (0:00:00.049) 0:00:27.481 ******** 2026-03-05 21:39:44.506386 | mon1 | changed: [mon1] 2026-03-05 21:39:44.506595 | mon1 | 2026-03-05 21:39:44.506608 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:39:44.506619 | mon1 | Thursday 05 March 2026 21:39:44 +0000 (0:00:24.023) 0:00:51.505 ******** 2026-03-05 21:39:45.124127 | mon1 | ok: [mon1] => (item=chronyd) 2026-03-05 21:39:45.124213 | mon1 | ok: [mon1] => (item=sshd) 2026-03-05 21:39:45.124443 | mon1 | 2026-03-05 21:39:45.124762 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:39:45.124779 | mon1 | Thursday 05 March 2026 21:39:45 +0000 (0:00:00.617) 0:00:52.123 ******** 2026-03-05 21:39:45.387952 | mon1 | changed: [mon1] 2026-03-05 21:39:45.387997 | mon1 | 2026-03-05 21:39:45.388145 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:39:45.388438 | mon1 | Thursday 05 March 2026 21:39:45 +0000 (0:00:00.263) 0:00:52.386 ******** 2026-03-05 21:39:45.582626 | mon1 | ok: [mon1] 2026-03-05 21:39:45.582802 | mon1 | 2026-03-05 21:39:45.583025 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:39:45.583237 | mon1 | Thursday 05 March 2026 21:39:45 +0000 (0:00:00.194) 0:00:52.581 ******** 2026-03-05 21:39:46.035594 | mon1 | changed: [mon1] 2026-03-05 21:39:46.035736 | mon1 | 2026-03-05 21:39:46.036308 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:39:46.036632 | mon1 | Thursday 05 March 2026 21:39:46 +0000 (0:00:00.452) 0:00:53.034 ******** 2026-03-05 21:39:46.365923 | mon1 | changed: [mon1] 2026-03-05 21:39:46.365985 | mon1 | 2026-03-05 21:39:46.366092 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:39:46.366184 | mon1 | Thursday 05 March 2026 21:39:46 +0000 (0:00:00.330) 0:00:53.365 ******** 2026-03-05 21:39:46.481541 | mon1 | ok: [mon1] 2026-03-05 21:39:46.481730 | mon1 | 2026-03-05 21:39:46.481965 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:39:46.482180 | mon1 | Thursday 05 March 2026 21:39:46 +0000 (0:00:00.115) 0:00:53.480 ******** 2026-03-05 21:39:46.681844 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:39:46.681940 | mon1 | 2026-03-05 21:39:46.682086 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:39:46.682223 | mon1 | Thursday 05 March 2026 21:39:46 +0000 (0:00:00.200) 0:00:53.681 ******** 2026-03-05 21:39:46.725159 | mon1 | ok: [mon1] 2026-03-05 21:39:46.725260 | mon1 | 2026-03-05 21:39:46.725386 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:39:46.725523 | mon1 | Thursday 05 March 2026 21:39:46 +0000 (0:00:00.043) 0:00:53.724 ******** 2026-03-05 21:39:46.816106 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-03-05 21:39:46.816275 | mon1 | 2026-03-05 21:39:46.816541 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-05 21:39:46.816793 | mon1 | Thursday 05 March 2026 21:39:46 +0000 (0:00:00.090) 0:00:53.815 ******** 2026-03-05 21:39:47.078037 | mon1 | changed: [mon1] 2026-03-05 21:39:47.078225 | mon1 | 2026-03-05 21:39:47.078612 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-05 21:39:47.078847 | mon1 | Thursday 05 March 2026 21:39:47 +0000 (0:00:00.261) 0:00:54.077 ******** 2026-03-05 21:39:47.714061 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-05 21:39:47.714132 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-05 21:39:47.714147 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-05 21:39:47.714161 | mon1 | 2026-03-05 21:39:47.714175 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-05 21:39:47.714188 | mon1 | Thursday 05 March 2026 21:39:47 +0000 (0:00:00.634) 0:00:54.711 ******** 2026-03-05 21:41:48.153445 | mon1 | ok: [mon1] 2026-03-05 21:41:48.153513 | mon1 | 2026-03-05 21:41:48.153699 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-05 21:41:48.153744 | mon1 | Thursday 05 March 2026 21:41:48 +0000 (0:02:00.440) 0:02:55.152 ******** 2026-03-05 21:41:48.348065 | mon1 | changed: [mon1] 2026-03-05 21:41:48.348138 | mon1 | 2026-03-05 21:41:48.348208 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-05 21:41:48.348383 | mon1 | Thursday 05 March 2026 21:41:48 +0000 (0:00:00.195) 0:02:55.347 ******** 2026-03-05 21:41:48.386892 | mon1 | ok: [mon1] 2026-03-05 21:41:48.387323 | mon1 | 2026-03-05 21:41:48.387356 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:41:48.387364 | mon1 | Thursday 05 March 2026 21:41:48 +0000 (0:00:00.038) 0:02:55.385 ******** 2026-03-05 21:41:48.455613 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:41:48.455683 | mon1 | 2026-03-05 21:41:48.455869 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:41:48.455905 | mon1 | Thursday 05 March 2026 21:41:48 +0000 (0:00:00.068) 0:02:55.454 ******** 2026-03-05 21:41:54.107622 | mon1 | ok: [mon1] 2026-03-05 21:41:54.107703 | mon1 | 2026-03-05 21:41:54.107771 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:41:54.107867 | mon1 | Thursday 05 March 2026 21:41:54 +0000 (0:00:05.651) 0:03:01.106 ******** 2026-03-05 21:41:54.157796 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:41:54.157873 | mon1 | 2026-03-05 21:41:54.158038 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:41:54.158183 | mon1 | Thursday 05 March 2026 21:41:54 +0000 (0:00:00.050) 0:03:01.156 ******** 2026-03-05 21:41:54.521068 | mon1 | ok: [mon1] 2026-03-05 21:41:54.521334 | mon1 | 2026-03-05 21:41:54.521349 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:41:54.521521 | mon1 | Thursday 05 March 2026 21:41:54 +0000 (0:00:00.363) 0:03:01.520 ******** 2026-03-05 21:42:01.104415 | mon1 | ok: [mon1] 2026-03-05 21:42:01.104488 | mon1 | 2026-03-05 21:42:01.104569 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:42:01.104665 | mon1 | Thursday 05 March 2026 21:42:01 +0000 (0:00:06.583) 0:03:08.103 ******** 2026-03-05 21:42:13.603402 | mon1 | changed: [mon1] 2026-03-05 21:42:13.603450 | mon1 | 2026-03-05 21:42:13.603456 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:42:13.603461 | mon1 | Thursday 05 March 2026 21:42:13 +0000 (0:00:12.498) 0:03:20.602 ******** 2026-03-05 21:42:27.795464 | mon1 | ok: [mon1] 2026-03-05 21:42:27.795538 | mon1 | 2026-03-05 21:42:27.795568 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:42:27.795757 | mon1 | Thursday 05 March 2026 21:42:27 +0000 (0:00:14.192) 0:03:34.794 ******** 2026-03-05 21:42:27.859578 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:42:27.859629 | mon1 | 2026-03-05 21:42:27.859735 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:42:27.859838 | mon1 | Thursday 05 March 2026 21:42:27 +0000 (0:00:00.064) 0:03:34.858 ******** 2026-03-05 21:42:27.902440 | mon1 | skipping: [mon1] 2026-03-05 21:42:27.902521 | mon1 | 2026-03-05 21:42:27.902636 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:42:27.902727 | mon1 | Thursday 05 March 2026 21:42:27 +0000 (0:00:00.043) 0:03:34.901 ******** 2026-03-05 21:42:27.936827 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 21:42:27.936884 | mon1 | skipping: [mon1] 2026-03-05 21:42:27.936927 | mon1 | 2026-03-05 21:42:27.937128 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:42:27.937146 | mon1 | Thursday 05 March 2026 21:42:27 +0000 (0:00:00.034) 0:03:34.936 ******** 2026-03-05 21:42:28.171830 | mon1 | ok: [mon1] 2026-03-05 21:42:28.171887 | mon1 | 2026-03-05 21:42:28.171988 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:42:28.172123 | mon1 | Thursday 05 March 2026 21:42:28 +0000 (0:00:00.234) 0:03:35.171 ******** 2026-03-05 21:42:33.712433 | mon1 | ok: [mon1] 2026-03-05 21:42:33.712515 | mon1 | 2026-03-05 21:42:33.712530 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:42:33.712663 | mon1 | Thursday 05 March 2026 21:42:33 +0000 (0:00:05.540) 0:03:40.711 ******** 2026-03-05 21:42:45.634741 | mon1 | changed: [mon1] 2026-03-05 21:42:45.634811 | mon1 | 2026-03-05 21:42:45.635018 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:42:45.635057 | mon1 | Thursday 05 March 2026 21:42:45 +0000 (0:00:11.922) 0:03:52.633 ******** 2026-03-05 21:42:51.786568 | mon1 | ok: [mon1] 2026-03-05 21:42:51.786648 | mon1 | 2026-03-05 21:42:51.786875 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:42:51.786957 | mon1 | Thursday 05 March 2026 21:42:51 +0000 (0:00:06.151) 0:03:58.785 ******** 2026-03-05 21:42:58.605138 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:42:58.605204 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 21:42:58.605268 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 21:42:58.605356 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 21:42:58.605441 | mon1 | 2026-03-05 21:42:58.605531 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:42:58.605606 | mon1 | 2026-03-05 21:42:58.605693 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:42:58.605783 | mon1 | Thursday 05 March 2026 21:42:58 +0000 (0:00:06.818) 0:04:05.604 ******** 2026-03-05 21:42:59.667204 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:42:59.667481 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:42:59.667773 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:42:59.668018 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:42:59.668306 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:42:59.681674 | mon1 | ok: [osd1] 2026-03-05 21:42:59.681751 | mon1 | 2026-03-05 21:42:59.681836 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:42:59.681964 | mon1 | Thursday 05 March 2026 21:42:59 +0000 (0:00:01.076) 0:04:06.681 ******** 2026-03-05 21:42:59.871644 | mon1 | ok: [osd1] 2026-03-05 21:42:59.871713 | mon1 | 2026-03-05 21:42:59.871793 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:42:59.871925 | mon1 | Thursday 05 March 2026 21:42:59 +0000 (0:00:00.189) 0:04:06.870 ******** 2026-03-05 21:42:59.905217 | mon1 | skipping: [osd1] 2026-03-05 21:42:59.905254 | mon1 | 2026-03-05 21:42:59.905379 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:42:59.905468 | mon1 | Thursday 05 March 2026 21:42:59 +0000 (0:00:00.033) 0:04:06.904 ******** 2026-03-05 21:43:00.104934 | mon1 | changed: [osd1] 2026-03-05 21:43:00.105009 | mon1 | 2026-03-05 21:43:00.105082 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:43:00.105206 | mon1 | Thursday 05 March 2026 21:43:00 +0000 (0:00:00.199) 0:04:07.104 ******** 2026-03-05 21:43:00.155015 | mon1 | ok: [osd1] => { 2026-03-05 21:43:00.155087 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:43:00.155222 | mon1 | } 2026-03-05 21:43:00.155339 | mon1 | 2026-03-05 21:43:00.155480 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:43:00.155688 | mon1 | Thursday 05 March 2026 21:43:00 +0000 (0:00:00.050) 0:04:07.154 ******** 2026-03-05 21:43:00.679706 | mon1 | changed: [osd1] 2026-03-05 21:43:00.679782 | mon1 | 2026-03-05 21:43:00.679826 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:43:00.679935 | mon1 | Thursday 05 March 2026 21:43:00 +0000 (0:00:00.524) 0:04:07.678 ******** 2026-03-05 21:43:00.717688 | mon1 | skipping: [osd1] 2026-03-05 21:43:00.717754 | mon1 | 2026-03-05 21:43:00.717797 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:43:00.717908 | mon1 | Thursday 05 March 2026 21:43:00 +0000 (0:00:00.037) 0:04:07.716 ******** 2026-03-05 21:43:00.754803 | mon1 | skipping: [osd1] 2026-03-05 21:43:00.754869 | mon1 | 2026-03-05 21:43:00.754989 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:43:00.755070 | mon1 | Thursday 05 March 2026 21:43:00 +0000 (0:00:00.037) 0:04:07.754 ******** 2026-03-05 21:43:00.954507 | mon1 | ok: [osd1] 2026-03-05 21:43:00.954581 | mon1 | 2026-03-05 21:43:00.954652 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:43:00.954747 | mon1 | Thursday 05 March 2026 21:43:00 +0000 (0:00:00.199) 0:04:07.953 ******** 2026-03-05 21:43:01.934778 | mon1 | ok: [osd1] 2026-03-05 21:43:01.934840 | mon1 | 2026-03-05 21:43:01.934934 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:43:01.935046 | mon1 | Thursday 05 March 2026 21:43:01 +0000 (0:00:00.980) 0:04:08.934 ******** 2026-03-05 21:43:01.994614 | mon1 | ok: [osd1] => { 2026-03-05 21:43:01.994679 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:43:01.994827 | mon1 | } 2026-03-05 21:43:01.994949 | mon1 | 2026-03-05 21:43:01.995094 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:43:01.995228 | mon1 | Thursday 05 March 2026 21:43:01 +0000 (0:00:00.059) 0:04:08.993 ******** 2026-03-05 21:43:02.766600 | mon1 | changed: [osd1] 2026-03-05 21:43:02.766677 | mon1 | 2026-03-05 21:43:02.766823 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:43:02.766951 | mon1 | Thursday 05 March 2026 21:43:02 +0000 (0:00:00.772) 0:04:09.765 ******** 2026-03-05 21:43:05.402794 | mon1 | changed: [osd1] 2026-03-05 21:43:05.402874 | mon1 | 2026-03-05 21:43:05.402925 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:43:05.403031 | mon1 | Thursday 05 March 2026 21:43:05 +0000 (0:00:02.636) 0:04:12.401 ******** 2026-03-05 21:43:05.426834 | mon1 | skipping: [osd1] 2026-03-05 21:43:05.426969 | mon1 | 2026-03-05 21:43:05.427091 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:43:05.427190 | mon1 | Thursday 05 March 2026 21:43:05 +0000 (0:00:00.023) 0:04:12.425 ******** 2026-03-05 21:43:05.453791 | mon1 | skipping: [osd1] 2026-03-05 21:43:05.453869 | mon1 | 2026-03-05 21:43:05.453967 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:43:05.454082 | mon1 | Thursday 05 March 2026 21:43:05 +0000 (0:00:00.027) 0:04:12.453 ******** 2026-03-05 21:43:05.480753 | mon1 | skipping: [osd1] 2026-03-05 21:43:05.480879 | mon1 | 2026-03-05 21:43:05.481022 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:43:05.481216 | mon1 | Thursday 05 March 2026 21:43:05 +0000 (0:00:00.026) 0:04:12.479 ******** 2026-03-05 21:43:10.679158 | mon1 | changed: [osd1] 2026-03-05 21:43:10.679231 | mon1 | 2026-03-05 21:43:10.679385 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:43:10.679589 | mon1 | Thursday 05 March 2026 21:43:10 +0000 (0:00:05.198) 0:04:17.677 ******** 2026-03-05 21:43:11.135324 | mon1 | changed: [osd1] 2026-03-05 21:43:11.135396 | mon1 | 2026-03-05 21:43:11.135562 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:43:11.135710 | mon1 | Thursday 05 March 2026 21:43:11 +0000 (0:00:00.456) 0:04:18.134 ******** 2026-03-05 21:43:12.078878 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:43:12.078955 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:43:12.079027 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:43:12.079127 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:43:12.079230 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:43:12.079319 | mon1 | 2026-03-05 21:43:12.079412 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:43:12.079507 | mon1 | Thursday 05 March 2026 21:43:12 +0000 (0:00:00.943) 0:04:19.078 ******** 2026-03-05 21:43:12.618382 | mon1 | changed: [osd1] 2026-03-05 21:43:12.618437 | mon1 | 2026-03-05 21:43:12.618589 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:43:12.618732 | mon1 | Thursday 05 March 2026 21:43:12 +0000 (0:00:00.533) 0:04:19.611 ******** 2026-03-05 21:43:12.618768 | mon1 | 2026-03-05 21:43:12.618915 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:43:12.618989 | mon1 | Thursday 05 March 2026 21:43:12 +0000 (0:00:00.006) 0:04:19.617 ******** 2026-03-05 21:43:13.265199 | mon1 | ok: [osd1] 2026-03-05 21:43:13.265275 | mon1 | 2026-03-05 21:43:13.265431 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 21:43:13.265572 | mon1 | Thursday 05 March 2026 21:43:13 +0000 (0:00:00.646) 0:04:20.264 ******** 2026-03-05 21:43:13.713495 | mon1 | changed: [osd1] 2026-03-05 21:43:13.713571 | mon1 | 2026-03-05 21:43:13.713647 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:43:13.713744 | mon1 | Thursday 05 March 2026 21:43:13 +0000 (0:00:00.448) 0:04:20.712 ******** 2026-03-05 21:43:14.218885 | mon1 | changed: [osd1] 2026-03-05 21:43:14.218956 | mon1 | 2026-03-05 21:43:14.219032 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:43:14.219128 | mon1 | Thursday 05 March 2026 21:43:14 +0000 (0:00:00.505) 0:04:21.218 ******** 2026-03-05 21:43:14.411221 | mon1 | ok: [osd1] 2026-03-05 21:43:14.411288 | mon1 | 2026-03-05 21:43:14.411385 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:43:14.411485 | mon1 | Thursday 05 March 2026 21:43:14 +0000 (0:00:00.192) 0:04:21.410 ******** 2026-03-05 21:43:14.465962 | mon1 | ok: [osd1] => { 2026-03-05 21:43:14.466100 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:43:14.466264 | mon1 | } 2026-03-05 21:43:14.466413 | mon1 | 2026-03-05 21:43:14.466585 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:43:14.466751 | mon1 | Thursday 05 March 2026 21:43:14 +0000 (0:00:00.054) 0:04:21.464 ******** 2026-03-05 21:43:15.607128 | mon1 | changed: [osd1] 2026-03-05 21:43:15.607210 | mon1 | 2026-03-05 21:43:15.607357 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:43:15.607470 | mon1 | Thursday 05 March 2026 21:43:15 +0000 (0:00:01.140) 0:04:22.605 ******** 2026-03-05 21:43:19.981387 | mon1 | changed: [osd1] 2026-03-05 21:43:19.981461 | mon1 | 2026-03-05 21:43:19.981475 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:43:19.981595 | mon1 | Thursday 05 March 2026 21:43:19 +0000 (0:00:04.374) 0:04:26.980 ******** 2026-03-05 21:43:20.987012 | mon1 | ok: [osd1] 2026-03-05 21:43:20.987068 | mon1 | 2026-03-05 21:43:20.987305 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:43:20.987350 | mon1 | Thursday 05 March 2026 21:43:20 +0000 (0:00:01.005) 0:04:27.986 ******** 2026-03-05 21:43:21.208344 | mon1 | changed: [osd1] 2026-03-05 21:43:21.208470 | mon1 | 2026-03-05 21:43:21.208529 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:43:21.208630 | mon1 | Thursday 05 March 2026 21:43:21 +0000 (0:00:00.221) 0:04:28.207 ******** 2026-03-05 21:43:21.684185 | mon1 | changed: [osd1] 2026-03-05 21:43:21.684259 | mon1 | 2026-03-05 21:43:21.684409 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:43:21.684581 | mon1 | Thursday 05 March 2026 21:43:21 +0000 (0:00:00.475) 0:04:28.683 ******** 2026-03-05 21:43:22.223985 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 21:43:22.224057 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:43:22.224138 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:43:22.224226 | mon1 | 2026-03-05 21:43:22.224320 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:43:22.224448 | mon1 | Thursday 05 March 2026 21:43:22 +0000 (0:00:00.539) 0:04:29.222 ******** 2026-03-05 21:43:22.671681 | mon1 | changed: [osd1] 2026-03-05 21:43:22.671758 | mon1 | 2026-03-05 21:43:22.672058 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:43:22.672110 | mon1 | Thursday 05 March 2026 21:43:22 +0000 (0:00:00.447) 0:04:29.670 ******** 2026-03-05 21:43:23.117002 | mon1 | changed: [osd1] 2026-03-05 21:43:23.117058 | mon1 | 2026-03-05 21:43:23.117163 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:43:23.117565 | mon1 | Thursday 05 March 2026 21:43:23 +0000 (0:00:00.439) 0:04:30.109 ******** 2026-03-05 21:43:23.117613 | mon1 | 2026-03-05 21:43:23.117619 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:43:23.117623 | mon1 | Thursday 05 March 2026 21:43:23 +0000 (0:00:00.006) 0:04:30.116 ******** 2026-03-05 21:43:23.768307 | mon1 | ok: [osd1] 2026-03-05 21:43:23.768430 | mon1 | 2026-03-05 21:43:23.768537 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 21:43:23.768656 | mon1 | Thursday 05 March 2026 21:43:23 +0000 (0:00:00.651) 0:04:30.767 ******** 2026-03-05 21:43:24.472303 | mon1 | changed: [osd1] 2026-03-05 21:43:24.472537 | mon1 | 2026-03-05 21:43:24.472755 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:43:24.472985 | mon1 | Thursday 05 March 2026 21:43:24 +0000 (0:00:00.703) 0:04:31.471 ******** 2026-03-05 21:43:24.977833 | mon1 | changed: [osd1] 2026-03-05 21:43:24.977992 | mon1 | 2026-03-05 21:43:24.978208 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:43:24.978454 | mon1 | Thursday 05 March 2026 21:43:24 +0000 (0:00:00.505) 0:04:31.976 ******** 2026-03-05 21:43:25.012134 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:43:25.012329 | mon1 | 2026-03-05 21:43:25.012585 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:43:25.012793 | mon1 | Thursday 05 March 2026 21:43:25 +0000 (0:00:00.034) 0:04:32.011 ******** 2026-03-05 21:43:29.768481 | mon1 | changed: [osd1] 2026-03-05 21:43:29.768549 | mon1 | 2026-03-05 21:43:29.768571 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:43:29.768591 | mon1 | Thursday 05 March 2026 21:43:29 +0000 (0:00:04.755) 0:04:36.766 ******** 2026-03-05 21:43:30.410292 | mon1 | ok: [osd1] => (item=chronyd) 2026-03-05 21:43:30.410378 | mon1 | ok: [osd1] => (item=sshd) 2026-03-05 21:43:30.410390 | mon1 | 2026-03-05 21:43:30.410607 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:43:30.410649 | mon1 | Thursday 05 March 2026 21:43:30 +0000 (0:00:00.643) 0:04:37.409 ******** 2026-03-05 21:43:30.675661 | mon1 | changed: [osd1] 2026-03-05 21:43:30.675737 | mon1 | 2026-03-05 21:43:30.675752 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:43:30.675891 | mon1 | Thursday 05 March 2026 21:43:30 +0000 (0:00:00.265) 0:04:37.674 ******** 2026-03-05 21:43:30.867782 | mon1 | ok: [osd1] 2026-03-05 21:43:30.867833 | mon1 | 2026-03-05 21:43:30.868439 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:43:30.868718 | mon1 | Thursday 05 March 2026 21:43:30 +0000 (0:00:00.191) 0:04:37.866 ******** 2026-03-05 21:43:31.148950 | mon1 | changed: [osd1] 2026-03-05 21:43:31.149031 | mon1 | 2026-03-05 21:43:31.149046 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:43:31.149197 | mon1 | Thursday 05 March 2026 21:43:31 +0000 (0:00:00.281) 0:04:38.148 ******** 2026-03-05 21:43:31.352144 | mon1 | changed: [osd1] 2026-03-05 21:43:31.352225 | mon1 | 2026-03-05 21:43:31.352236 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:43:31.352345 | mon1 | Thursday 05 March 2026 21:43:31 +0000 (0:00:00.203) 0:04:38.351 ******** 2026-03-05 21:43:31.554416 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 21:43:31.554489 | mon1 | 2026-03-05 21:43:31.554732 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:43:31.554776 | mon1 | Thursday 05 March 2026 21:43:31 +0000 (0:00:00.202) 0:04:38.553 ******** 2026-03-05 21:43:31.594586 | mon1 | ok: [osd1] 2026-03-05 21:43:31.594652 | mon1 | 2026-03-05 21:43:31.594751 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:43:31.594858 | mon1 | Thursday 05 March 2026 21:43:31 +0000 (0:00:00.040) 0:04:38.593 ******** 2026-03-05 21:43:31.646564 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 21:43:31.646953 | mon1 | 2026-03-05 21:43:31.647026 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:43:31.647046 | mon1 | Thursday 05 March 2026 21:43:31 +0000 (0:00:00.051) 0:04:38.645 ******** 2026-03-05 21:43:37.717526 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:43:37.718018 | mon1 | 2026-03-05 21:43:37.718072 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:43:37.718080 | mon1 | Thursday 05 March 2026 21:43:37 +0000 (0:00:06.070) 0:04:44.716 ******** 2026-03-05 21:43:37.764871 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 21:43:37.765305 | mon1 | 2026-03-05 21:43:37.765354 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:43:37.765364 | mon1 | Thursday 05 March 2026 21:43:37 +0000 (0:00:00.047) 0:04:44.763 ******** 2026-03-05 21:43:38.013103 | mon1 | changed: [osd1] 2026-03-05 21:43:38.013168 | mon1 | 2026-03-05 21:43:38.013230 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:43:38.013362 | mon1 | Thursday 05 March 2026 21:43:38 +0000 (0:00:00.248) 0:04:45.012 ******** 2026-03-05 21:43:48.011118 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:43:48.011244 | mon1 | 2026-03-05 21:43:48.011521 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:43:48.011542 | mon1 | Thursday 05 March 2026 21:43:48 +0000 (0:00:09.998) 0:04:55.010 ******** 2026-03-05 21:43:49.539541 | mon1 | ok: [osd1] 2026-03-05 21:43:49.539621 | mon1 | 2026-03-05 21:43:49.539820 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:43:49.539865 | mon1 | Thursday 05 March 2026 21:43:49 +0000 (0:00:01.528) 0:04:56.538 ******** 2026-03-05 21:44:26.262796 | mon1 | ok: [osd1] 2026-03-05 21:44:26.263061 | mon1 | 2026-03-05 21:44:26.263073 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:44:26.263132 | mon1 | Thursday 05 March 2026 21:44:26 +0000 (0:00:36.723) 0:05:33.261 ******** 2026-03-05 21:46:01.750362 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 21:46:01.750686 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 21:46:01.750700 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 21:46:01.750710 | mon1 | 2026-03-05 21:46:01.750981 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:46:01.751039 | mon1 | Thursday 05 March 2026 21:46:01 +0000 (0:01:35.487) 0:07:08.749 ******** 2026-03-05 21:46:07.908049 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:46:07.908095 | mon1 | 2026-03-05 21:46:07.908101 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:46:07.908106 | mon1 | Thursday 05 March 2026 21:46:07 +0000 (0:00:06.157) 0:07:14.906 ******** 2026-03-05 21:46:14.010448 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:46:14.010898 | mon1 | 2026-03-05 21:46:14.010951 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:46:14.010959 | mon1 | Thursday 05 March 2026 21:46:14 +0000 (0:00:06.102) 0:07:21.009 ******** 2026-03-05 21:46:14.064460 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 21:46:14.064555 | mon1 | 2026-03-05 21:46:14.064792 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:46:14.064836 | mon1 | Thursday 05 March 2026 21:46:14 +0000 (0:00:00.054) 0:07:21.063 ******** 2026-03-05 21:46:14.105832 | mon1 | ok: [osd1] 2026-03-05 21:46:14.105950 | mon1 | 2026-03-05 21:46:14.106092 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:46:14.106246 | mon1 | Thursday 05 March 2026 21:46:14 +0000 (0:00:00.041) 0:07:21.105 ******** 2026-03-05 21:46:20.190982 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:46:20.191052 | mon1 | 2026-03-05 21:46:20.191152 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:46:20.191255 | mon1 | Thursday 05 March 2026 21:46:20 +0000 (0:00:06.084) 0:07:27.189 ******** 2026-03-05 21:46:20.222928 | mon1 | ok: [osd1] 2026-03-05 21:46:20.223118 | mon1 | 2026-03-05 21:46:20.223361 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:46:20.223590 | mon1 | Thursday 05 March 2026 21:46:20 +0000 (0:00:00.032) 0:07:27.222 ******** 2026-03-05 21:46:20.261279 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:46:20.261512 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:46:20.261729 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:46:20.261941 | mon1 | skipping: [osd1] 2026-03-05 21:46:20.262130 | mon1 | 2026-03-05 21:46:20.262389 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:46:20.262659 | mon1 | Thursday 05 March 2026 21:46:20 +0000 (0:00:00.038) 0:07:27.260 ******** 2026-03-05 21:46:20.291312 | mon1 | skipping: [osd1] 2026-03-05 21:46:20.291505 | mon1 | 2026-03-05 21:46:20.291740 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:46:20.291964 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 21:46:20.292188 | mon1 | osd1 : ok=53 changed=24 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 21:46:20.292467 | mon1 | 2026-03-05 21:46:20.292670 | mon1 | 2026-03-05 21:46:20.292862 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:46:20.293079 | mon1 | Thursday 05 March 2026 21:46:20 +0000 (0:00:00.030) 0:07:27.290 ******** 2026-03-05 21:46:20.293270 | mon1 | =============================================================================== 2026-03-05 21:46:20.293505 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 120.44s 2026-03-05 21:46:20.293721 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 95.49s 2026-03-05 21:46:20.293922 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 36.72s 2026-03-05 21:46:20.294121 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 24.02s 2026-03-05 21:46:20.294333 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.19s 2026-03-05 21:46:20.294546 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 12.50s 2026-03-05 21:46:20.294818 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 11.92s 2026-03-05 21:46:20.295024 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 10.00s 2026-03-05 21:46:20.295252 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 6.82s 2026-03-05 21:46:20.295482 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.58s 2026-03-05 21:46:20.295684 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.16s 2026-03-05 21:46:20.295888 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.15s 2026-03-05 21:46:20.296089 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.10s 2026-03-05 21:46:20.296289 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.08s 2026-03-05 21:46:20.296901 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.07s 2026-03-05 21:46:20.297188 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.65s 2026-03-05 21:46:20.297437 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 5.54s 2026-03-05 21:46:20.297651 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.49s 2026-03-05 21:46:20.297851 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.20s 2026-03-05 21:46:20.298074 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 4.76s 2026-03-05 21:46:20.376769 | mon1 | INFO [default > converge] Executed: Successful 2026-03-05 21:46:20.385933 | mon1 | INFO [default > idempotence] Executing 2026-03-05 21:46:21.186011 | mon1 | 2026-03-05 21:46:21.186196 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 21:46:21.186430 | mon1 | 2026-03-05 21:46:21.186638 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:46:21.186795 | mon1 | Thursday 05 March 2026 21:46:21 +0000 (0:00:00.045) 0:00:00.045 ******** 2026-03-05 21:46:22.334624 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:46:22.334712 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:46:22.334839 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:46:22.334953 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:46:22.335073 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:46:22.347116 | mon1 | ok: [mon1] 2026-03-05 21:46:22.347352 | mon1 | 2026-03-05 21:46:22.347583 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:46:22.347815 | mon1 | Thursday 05 March 2026 21:46:22 +0000 (0:00:01.161) 0:00:01.206 ******** 2026-03-05 21:46:22.668491 | mon1 | ok: [mon1] 2026-03-05 21:46:22.668691 | mon1 | 2026-03-05 21:46:22.668931 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:46:22.669155 | mon1 | Thursday 05 March 2026 21:46:22 +0000 (0:00:00.321) 0:00:01.527 ******** 2026-03-05 21:46:22.701337 | mon1 | skipping: [mon1] 2026-03-05 21:46:22.701538 | mon1 | 2026-03-05 21:46:22.701824 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:46:22.702141 | mon1 | Thursday 05 March 2026 21:46:22 +0000 (0:00:00.033) 0:00:01.560 ******** 2026-03-05 21:46:22.996085 | mon1 | ok: [mon1] 2026-03-05 21:46:22.996253 | mon1 | 2026-03-05 21:46:22.996555 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:46:22.996791 | mon1 | Thursday 05 March 2026 21:46:22 +0000 (0:00:00.294) 0:00:01.855 ******** 2026-03-05 21:46:23.063204 | mon1 | ok: [mon1] => { 2026-03-05 21:46:23.063412 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:46:23.063685 | mon1 | } 2026-03-05 21:46:23.064821 | mon1 | 2026-03-05 21:46:23.065161 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:46:23.065400 | mon1 | Thursday 05 March 2026 21:46:23 +0000 (0:00:00.067) 0:00:01.922 ******** 2026-03-05 21:46:23.462078 | mon1 | ok: [mon1] 2026-03-05 21:46:23.462262 | mon1 | 2026-03-05 21:46:23.462486 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:46:23.462702 | mon1 | Thursday 05 March 2026 21:46:23 +0000 (0:00:00.398) 0:00:02.321 ******** 2026-03-05 21:46:23.502104 | mon1 | skipping: [mon1] 2026-03-05 21:46:23.502298 | mon1 | 2026-03-05 21:46:23.502519 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:46:23.502734 | mon1 | Thursday 05 March 2026 21:46:23 +0000 (0:00:00.040) 0:00:02.361 ******** 2026-03-05 21:46:23.540031 | mon1 | skipping: [mon1] 2026-03-05 21:46:23.540174 | mon1 | 2026-03-05 21:46:23.540387 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:46:23.540618 | mon1 | Thursday 05 March 2026 21:46:23 +0000 (0:00:00.037) 0:00:02.399 ******** 2026-03-05 21:46:23.742853 | mon1 | ok: [mon1] 2026-03-05 21:46:23.743053 | mon1 | 2026-03-05 21:46:23.743304 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:46:23.743538 | mon1 | Thursday 05 March 2026 21:46:23 +0000 (0:00:00.202) 0:00:02.602 ******** 2026-03-05 21:46:24.896161 | mon1 | ok: [mon1] 2026-03-05 21:46:24.896336 | mon1 | 2026-03-05 21:46:24.896629 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:46:24.896778 | mon1 | Thursday 05 March 2026 21:46:24 +0000 (0:00:01.153) 0:00:03.755 ******** 2026-03-05 21:46:24.973368 | mon1 | ok: [mon1] => { 2026-03-05 21:46:24.973586 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:46:24.973820 | mon1 | } 2026-03-05 21:46:24.974020 | mon1 | 2026-03-05 21:46:24.974237 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:46:24.974451 | mon1 | Thursday 05 March 2026 21:46:24 +0000 (0:00:00.077) 0:00:03.832 ******** 2026-03-05 21:46:25.307409 | mon1 | ok: [mon1] 2026-03-05 21:46:25.307629 | mon1 | 2026-03-05 21:46:25.307924 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:46:25.308289 | mon1 | Thursday 05 March 2026 21:46:25 +0000 (0:00:00.333) 0:00:04.166 ******** 2026-03-05 21:46:27.474079 | mon1 | ok: [mon1] 2026-03-05 21:46:27.474137 | mon1 | 2026-03-05 21:46:27.474149 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:46:27.474159 | mon1 | Thursday 05 March 2026 21:46:27 +0000 (0:00:02.166) 0:00:06.332 ******** 2026-03-05 21:46:27.498378 | mon1 | skipping: [mon1] 2026-03-05 21:46:27.498485 | mon1 | 2026-03-05 21:46:27.498618 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:46:27.498754 | mon1 | Thursday 05 March 2026 21:46:27 +0000 (0:00:00.025) 0:00:06.358 ******** 2026-03-05 21:46:27.524927 | mon1 | skipping: [mon1] 2026-03-05 21:46:27.524991 | mon1 | 2026-03-05 21:46:27.525141 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:46:27.525282 | mon1 | Thursday 05 March 2026 21:46:27 +0000 (0:00:00.026) 0:00:06.384 ******** 2026-03-05 21:46:27.548344 | mon1 | skipping: [mon1] 2026-03-05 21:46:27.548768 | mon1 | 2026-03-05 21:46:27.548792 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:46:27.548799 | mon1 | Thursday 05 March 2026 21:46:27 +0000 (0:00:00.023) 0:00:06.407 ******** 2026-03-05 21:46:28.498232 | mon1 | ok: [mon1] 2026-03-05 21:46:28.498578 | mon1 | 2026-03-05 21:46:28.498593 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:46:28.498604 | mon1 | Thursday 05 March 2026 21:46:28 +0000 (0:00:00.949) 0:00:07.357 ******** 2026-03-05 21:46:28.915201 | mon1 | ok: [mon1] 2026-03-05 21:46:28.915309 | mon1 | 2026-03-05 21:46:28.915619 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:46:28.915669 | mon1 | Thursday 05 March 2026 21:46:28 +0000 (0:00:00.416) 0:00:07.774 ******** 2026-03-05 21:46:29.800057 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:46:29.800129 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:46:29.800145 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:46:29.800533 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:46:29.800601 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:46:29.800614 | mon1 | 2026-03-05 21:46:29.800631 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:46:29.800641 | mon1 | Thursday 05 March 2026 21:46:29 +0000 (0:00:00.885) 0:00:08.659 ******** 2026-03-05 21:46:30.258087 | mon1 | ok: [mon1] 2026-03-05 21:46:30.258162 | mon1 | 2026-03-05 21:46:30.258659 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:46:30.258706 | mon1 | Thursday 05 March 2026 21:46:30 +0000 (0:00:00.451) 0:00:09.110 ******** 2026-03-05 21:46:30.258713 | mon1 | 2026-03-05 21:46:30.258724 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:46:30.258737 | mon1 | Thursday 05 March 2026 21:46:30 +0000 (0:00:00.006) 0:00:09.117 ******** 2026-03-05 21:46:30.858004 | mon1 | ok: [mon1] 2026-03-05 21:46:30.858064 | mon1 | 2026-03-05 21:46:30.858172 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:46:30.858251 | mon1 | Thursday 05 March 2026 21:46:30 +0000 (0:00:00.599) 0:00:09.717 ******** 2026-03-05 21:46:31.049592 | mon1 | ok: [mon1] 2026-03-05 21:46:31.049660 | mon1 | 2026-03-05 21:46:31.049744 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:46:31.049878 | mon1 | Thursday 05 March 2026 21:46:31 +0000 (0:00:00.191) 0:00:09.909 ******** 2026-03-05 21:46:31.118287 | mon1 | ok: [mon1] => { 2026-03-05 21:46:31.118370 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:46:31.118745 | mon1 | } 2026-03-05 21:46:31.118790 | mon1 | 2026-03-05 21:46:31.118796 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:46:31.118801 | mon1 | Thursday 05 March 2026 21:46:31 +0000 (0:00:00.068) 0:00:09.977 ******** 2026-03-05 21:46:31.478607 | mon1 | ok: [mon1] 2026-03-05 21:46:31.478679 | mon1 | 2026-03-05 21:46:31.479014 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:46:31.479062 | mon1 | Thursday 05 March 2026 21:46:31 +0000 (0:00:00.360) 0:00:10.338 ******** 2026-03-05 21:46:34.525600 | mon1 | ok: [mon1] 2026-03-05 21:46:34.525685 | mon1 | 2026-03-05 21:46:34.525751 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:46:34.525861 | mon1 | Thursday 05 March 2026 21:46:34 +0000 (0:00:03.047) 0:00:13.385 ******** 2026-03-05 21:46:35.489836 | mon1 | ok: [mon1] 2026-03-05 21:46:35.489914 | mon1 | 2026-03-05 21:46:35.490114 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:46:35.490131 | mon1 | Thursday 05 March 2026 21:46:35 +0000 (0:00:00.964) 0:00:14.349 ******** 2026-03-05 21:46:35.762178 | mon1 | ok: [mon1] 2026-03-05 21:46:35.762575 | mon1 | 2026-03-05 21:46:35.762599 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:46:35.762610 | mon1 | Thursday 05 March 2026 21:46:35 +0000 (0:00:00.272) 0:00:14.621 ******** 2026-03-05 21:46:36.166603 | mon1 | ok: [mon1] 2026-03-05 21:46:36.166662 | mon1 | 2026-03-05 21:46:36.166754 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:46:36.166868 | mon1 | Thursday 05 March 2026 21:46:36 +0000 (0:00:00.404) 0:00:15.026 ******** 2026-03-05 21:46:36.700261 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 21:46:36.700337 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:46:36.700531 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:46:36.700595 | mon1 | 2026-03-05 21:46:36.700614 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:46:36.700713 | mon1 | Thursday 05 March 2026 21:46:36 +0000 (0:00:00.533) 0:00:15.559 ******** 2026-03-05 21:46:37.103009 | mon1 | ok: [mon1] 2026-03-05 21:46:37.103080 | mon1 | 2026-03-05 21:46:37.103163 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:46:37.103294 | mon1 | Thursday 05 March 2026 21:46:37 +0000 (0:00:00.402) 0:00:15.962 ******** 2026-03-05 21:46:37.523732 | mon1 | ok: [mon1] 2026-03-05 21:46:37.523800 | mon1 | 2026-03-05 21:46:37.523878 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:46:37.524301 | mon1 | Thursday 05 March 2026 21:46:37 +0000 (0:00:00.414) 0:00:16.377 ******** 2026-03-05 21:46:37.524343 | mon1 | 2026-03-05 21:46:37.524349 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:46:37.524353 | mon1 | Thursday 05 March 2026 21:46:37 +0000 (0:00:00.006) 0:00:16.383 ******** 2026-03-05 21:46:37.861293 | mon1 | ok: [mon1] 2026-03-05 21:46:37.861354 | mon1 | 2026-03-05 21:46:37.861441 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:46:37.861571 | mon1 | Thursday 05 March 2026 21:46:37 +0000 (0:00:00.337) 0:00:16.720 ******** 2026-03-05 21:46:37.906552 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:46:37.906593 | mon1 | 2026-03-05 21:46:37.906702 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:46:37.906804 | mon1 | Thursday 05 March 2026 21:46:37 +0000 (0:00:00.045) 0:00:16.766 ******** 2026-03-05 21:46:38.864937 | mon1 | ok: [mon1] 2026-03-05 21:46:38.865003 | mon1 | 2026-03-05 21:46:38.865086 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:46:38.865215 | mon1 | Thursday 05 March 2026 21:46:38 +0000 (0:00:00.958) 0:00:17.724 ******** 2026-03-05 21:46:39.496756 | mon1 | ok: [mon1] => (item=chronyd) 2026-03-05 21:46:39.496826 | mon1 | ok: [mon1] => (item=sshd) 2026-03-05 21:46:39.496865 | mon1 | 2026-03-05 21:46:39.497098 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:46:39.497143 | mon1 | Thursday 05 March 2026 21:46:39 +0000 (0:00:00.631) 0:00:18.356 ******** 2026-03-05 21:46:39.774129 | mon1 | ok: [mon1] 2026-03-05 21:46:39.774202 | mon1 | 2026-03-05 21:46:39.774214 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:46:39.774333 | mon1 | Thursday 05 March 2026 21:46:39 +0000 (0:00:00.277) 0:00:18.633 ******** 2026-03-05 21:46:39.959256 | mon1 | ok: [mon1] 2026-03-05 21:46:39.959329 | mon1 | 2026-03-05 21:46:39.959391 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:46:39.959507 | mon1 | Thursday 05 March 2026 21:46:39 +0000 (0:00:00.185) 0:00:18.818 ******** 2026-03-05 21:46:40.347620 | mon1 | ok: [mon1] 2026-03-05 21:46:40.347681 | mon1 | 2026-03-05 21:46:40.347772 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:46:40.347900 | mon1 | Thursday 05 March 2026 21:46:40 +0000 (0:00:00.388) 0:00:19.207 ******** 2026-03-05 21:46:40.652855 | mon1 | ok: [mon1] 2026-03-05 21:46:40.652917 | mon1 | 2026-03-05 21:46:40.653012 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:46:40.653143 | mon1 | Thursday 05 March 2026 21:46:40 +0000 (0:00:00.305) 0:00:19.512 ******** 2026-03-05 21:46:40.719535 | mon1 | ok: [mon1] 2026-03-05 21:46:40.719617 | mon1 | 2026-03-05 21:46:40.719630 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:46:40.719751 | mon1 | Thursday 05 March 2026 21:46:40 +0000 (0:00:00.066) 0:00:19.579 ******** 2026-03-05 21:46:40.931431 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:46:40.931498 | mon1 | 2026-03-05 21:46:40.931741 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:46:40.931786 | mon1 | Thursday 05 March 2026 21:46:40 +0000 (0:00:00.211) 0:00:19.790 ******** 2026-03-05 21:46:40.974179 | mon1 | ok: [mon1] 2026-03-05 21:46:40.974256 | mon1 | 2026-03-05 21:46:40.974427 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:46:40.974449 | mon1 | Thursday 05 March 2026 21:46:40 +0000 (0:00:00.042) 0:00:19.833 ******** 2026-03-05 21:46:41.007603 | mon1 | skipping: [mon1] 2026-03-05 21:46:41.008030 | mon1 | 2026-03-05 21:46:41.008078 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:46:41.008088 | mon1 | Thursday 05 March 2026 21:46:41 +0000 (0:00:00.033) 0:00:19.866 ******** 2026-03-05 21:46:41.070969 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:46:41.071047 | mon1 | 2026-03-05 21:46:41.071146 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:46:41.071262 | mon1 | Thursday 05 March 2026 21:46:41 +0000 (0:00:00.063) 0:00:19.930 ******** 2026-03-05 21:46:47.283562 | mon1 | ok: [mon1] 2026-03-05 21:46:47.283633 | mon1 | 2026-03-05 21:46:47.283720 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:46:47.283856 | mon1 | Thursday 05 March 2026 21:46:47 +0000 (0:00:06.212) 0:00:26.143 ******** 2026-03-05 21:46:47.327557 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:46:47.327632 | mon1 | 2026-03-05 21:46:47.327808 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:46:47.327834 | mon1 | Thursday 05 March 2026 21:46:47 +0000 (0:00:00.043) 0:00:26.187 ******** 2026-03-05 21:46:47.700549 | mon1 | ok: [mon1] 2026-03-05 21:46:47.700622 | mon1 | 2026-03-05 21:46:47.700828 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:46:47.700871 | mon1 | Thursday 05 March 2026 21:46:47 +0000 (0:00:00.372) 0:00:26.559 ******** 2026-03-05 21:46:54.213691 | mon1 | ok: [mon1] 2026-03-05 21:46:54.213759 | mon1 | 2026-03-05 21:46:54.213826 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:46:54.213922 | mon1 | Thursday 05 March 2026 21:46:54 +0000 (0:00:06.513) 0:00:33.073 ******** 2026-03-05 21:47:00.411750 | mon1 | ok: [mon1] 2026-03-05 21:47:00.411820 | mon1 | 2026-03-05 21:47:00.411907 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:47:00.412027 | mon1 | Thursday 05 March 2026 21:47:00 +0000 (0:00:06.198) 0:00:39.271 ******** 2026-03-05 21:47:14.589509 | mon1 | ok: [mon1] 2026-03-05 21:47:14.589719 | mon1 | 2026-03-05 21:47:14.589738 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:47:14.589756 | mon1 | Thursday 05 March 2026 21:47:14 +0000 (0:00:14.177) 0:00:53.449 ******** 2026-03-05 21:47:14.670653 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:47:14.670699 | mon1 | 2026-03-05 21:47:14.670704 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:47:14.670709 | mon1 | Thursday 05 March 2026 21:47:14 +0000 (0:00:00.080) 0:00:53.529 ******** 2026-03-05 21:47:14.713130 | mon1 | skipping: [mon1] 2026-03-05 21:47:14.713162 | mon1 | 2026-03-05 21:47:14.713170 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:47:14.713176 | mon1 | Thursday 05 March 2026 21:47:14 +0000 (0:00:00.042) 0:00:53.572 ******** 2026-03-05 21:47:14.755978 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 21:47:14.756018 | mon1 | skipping: [mon1] 2026-03-05 21:47:14.756025 | mon1 | 2026-03-05 21:47:14.756043 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:47:14.756050 | mon1 | Thursday 05 March 2026 21:47:14 +0000 (0:00:00.042) 0:00:53.614 ******** 2026-03-05 21:47:14.996536 | mon1 | ok: [mon1] 2026-03-05 21:47:14.996608 | mon1 | 2026-03-05 21:47:14.996801 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:47:14.996849 | mon1 | Thursday 05 March 2026 21:47:14 +0000 (0:00:00.241) 0:00:53.856 ******** 2026-03-05 21:47:21.451457 | mon1 | ok: [mon1] 2026-03-05 21:47:21.451532 | mon1 | 2026-03-05 21:47:21.451618 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:47:21.451751 | mon1 | Thursday 05 March 2026 21:47:21 +0000 (0:00:06.454) 0:01:00.311 ******** 2026-03-05 21:47:27.563883 | mon1 | ok: [mon1] 2026-03-05 21:47:27.563972 | mon1 | 2026-03-05 21:47:27.564033 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:47:27.564172 | mon1 | Thursday 05 March 2026 21:47:27 +0000 (0:00:06.112) 0:01:06.423 ******** 2026-03-05 21:47:33.662652 | mon1 | ok: [mon1] 2026-03-05 21:47:33.662728 | mon1 | 2026-03-05 21:47:33.662782 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:47:33.662901 | mon1 | Thursday 05 March 2026 21:47:33 +0000 (0:00:06.098) 0:01:12.522 ******** 2026-03-05 21:47:41.243757 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:47:41.243830 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 21:47:41.244552 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 21:47:41.244808 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 21:47:41.244824 | mon1 | 2026-03-05 21:47:41.244836 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:47:41.244846 | mon1 | 2026-03-05 21:47:41.244854 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:47:41.244863 | mon1 | Thursday 05 March 2026 21:47:41 +0000 (0:00:07.581) 0:01:20.103 ******** 2026-03-05 21:47:42.317787 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:47:42.317922 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:47:42.318305 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:47:42.318362 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:47:42.318369 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:47:42.331134 | mon1 | ok: [osd1] 2026-03-05 21:47:42.331203 | mon1 | 2026-03-05 21:47:42.331401 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:47:42.331420 | mon1 | Thursday 05 March 2026 21:47:42 +0000 (0:00:01.087) 0:01:21.190 ******** 2026-03-05 21:47:42.527562 | mon1 | ok: [osd1] 2026-03-05 21:47:42.527613 | mon1 | 2026-03-05 21:47:42.527830 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:47:42.527889 | mon1 | Thursday 05 March 2026 21:47:42 +0000 (0:00:00.196) 0:01:21.387 ******** 2026-03-05 21:47:42.563442 | mon1 | skipping: [osd1] 2026-03-05 21:47:42.563504 | mon1 | 2026-03-05 21:47:42.563597 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:47:42.563713 | mon1 | Thursday 05 March 2026 21:47:42 +0000 (0:00:00.035) 0:01:21.423 ******** 2026-03-05 21:47:42.766568 | mon1 | ok: [osd1] 2026-03-05 21:47:42.766645 | mon1 | 2026-03-05 21:47:42.766659 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:47:42.766807 | mon1 | Thursday 05 March 2026 21:47:42 +0000 (0:00:00.202) 0:01:21.626 ******** 2026-03-05 21:47:42.834839 | mon1 | ok: [osd1] => { 2026-03-05 21:47:42.835488 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:47:42.835539 | mon1 | } 2026-03-05 21:47:42.835546 | mon1 | 2026-03-05 21:47:42.835552 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:47:42.835559 | mon1 | Thursday 05 March 2026 21:47:42 +0000 (0:00:00.068) 0:01:21.694 ******** 2026-03-05 21:47:43.138730 | mon1 | ok: [osd1] 2026-03-05 21:47:43.138813 | mon1 | 2026-03-05 21:47:43.139000 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:47:43.139069 | mon1 | Thursday 05 March 2026 21:47:43 +0000 (0:00:00.303) 0:01:21.998 ******** 2026-03-05 21:47:43.178936 | mon1 | skipping: [osd1] 2026-03-05 21:47:43.179021 | mon1 | 2026-03-05 21:47:43.179136 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:47:43.179289 | mon1 | Thursday 05 March 2026 21:47:43 +0000 (0:00:00.040) 0:01:22.038 ******** 2026-03-05 21:47:43.221572 | mon1 | skipping: [osd1] 2026-03-05 21:47:43.221622 | mon1 | 2026-03-05 21:47:43.221734 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:47:43.221843 | mon1 | Thursday 05 March 2026 21:47:43 +0000 (0:00:00.042) 0:01:22.081 ******** 2026-03-05 21:47:43.425647 | mon1 | ok: [osd1] 2026-03-05 21:47:43.425711 | mon1 | 2026-03-05 21:47:43.425799 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:47:43.425889 | mon1 | Thursday 05 March 2026 21:47:43 +0000 (0:00:00.204) 0:01:22.285 ******** 2026-03-05 21:47:44.369246 | mon1 | ok: [osd1] 2026-03-05 21:47:44.369321 | mon1 | 2026-03-05 21:47:44.369380 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:47:44.369543 | mon1 | Thursday 05 March 2026 21:47:44 +0000 (0:00:00.943) 0:01:23.228 ******** 2026-03-05 21:47:44.444876 | mon1 | ok: [osd1] => { 2026-03-05 21:47:44.445040 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:47:44.445238 | mon1 | } 2026-03-05 21:47:44.445399 | mon1 | 2026-03-05 21:47:44.445593 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:47:44.445770 | mon1 | Thursday 05 March 2026 21:47:44 +0000 (0:00:00.074) 0:01:23.303 ******** 2026-03-05 21:47:44.782027 | mon1 | ok: [osd1] 2026-03-05 21:47:44.782119 | mon1 | 2026-03-05 21:47:44.782288 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:47:44.782511 | mon1 | Thursday 05 March 2026 21:47:44 +0000 (0:00:00.338) 0:01:23.641 ******** 2026-03-05 21:47:46.710241 | mon1 | ok: [osd1] 2026-03-05 21:47:46.710300 | mon1 | 2026-03-05 21:47:46.710402 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:47:46.710542 | mon1 | Thursday 05 March 2026 21:47:46 +0000 (0:00:01.928) 0:01:25.569 ******** 2026-03-05 21:47:46.737877 | mon1 | skipping: [osd1] 2026-03-05 21:47:46.738271 | mon1 | 2026-03-05 21:47:46.738298 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:47:46.738306 | mon1 | Thursday 05 March 2026 21:47:46 +0000 (0:00:00.027) 0:01:25.597 ******** 2026-03-05 21:47:46.765336 | mon1 | skipping: [osd1] 2026-03-05 21:47:46.765400 | mon1 | 2026-03-05 21:47:46.765412 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:47:46.765423 | mon1 | Thursday 05 March 2026 21:47:46 +0000 (0:00:00.026) 0:01:25.623 ******** 2026-03-05 21:47:46.789968 | mon1 | skipping: [osd1] 2026-03-05 21:47:46.790524 | mon1 | 2026-03-05 21:47:46.790572 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:47:46.790578 | mon1 | Thursday 05 March 2026 21:47:46 +0000 (0:00:00.025) 0:01:25.648 ******** 2026-03-05 21:47:47.735963 | mon1 | ok: [osd1] 2026-03-05 21:47:47.736043 | mon1 | 2026-03-05 21:47:47.736175 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:47:47.736323 | mon1 | Thursday 05 March 2026 21:47:47 +0000 (0:00:00.946) 0:01:26.595 ******** 2026-03-05 21:47:48.143746 | mon1 | ok: [osd1] 2026-03-05 21:47:48.143818 | mon1 | 2026-03-05 21:47:48.144101 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:47:48.144152 | mon1 | Thursday 05 March 2026 21:47:48 +0000 (0:00:00.407) 0:01:27.003 ******** 2026-03-05 21:47:49.014132 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:47:49.014225 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:47:49.014998 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:47:49.015044 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:47:49.015052 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:47:49.015059 | mon1 | 2026-03-05 21:47:49.015066 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:47:49.015072 | mon1 | Thursday 05 March 2026 21:47:49 +0000 (0:00:00.870) 0:01:27.873 ******** 2026-03-05 21:47:49.494497 | mon1 | ok: [osd1] 2026-03-05 21:47:49.494550 | mon1 | 2026-03-05 21:47:49.494636 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:47:49.495031 | mon1 | Thursday 05 March 2026 21:47:49 +0000 (0:00:00.473) 0:01:28.346 ******** 2026-03-05 21:47:49.495072 | mon1 | 2026-03-05 21:47:49.495077 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:47:49.495082 | mon1 | Thursday 05 March 2026 21:47:49 +0000 (0:00:00.007) 0:01:28.354 ******** 2026-03-05 21:47:49.845199 | mon1 | ok: [osd1] 2026-03-05 21:47:49.845269 | mon1 | 2026-03-05 21:47:49.845559 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:47:49.845606 | mon1 | Thursday 05 March 2026 21:47:49 +0000 (0:00:00.350) 0:01:28.704 ******** 2026-03-05 21:47:50.033178 | mon1 | ok: [osd1] 2026-03-05 21:47:50.033258 | mon1 | 2026-03-05 21:47:50.033270 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:47:50.033382 | mon1 | Thursday 05 March 2026 21:47:50 +0000 (0:00:00.188) 0:01:28.892 ******** 2026-03-05 21:47:50.103282 | mon1 | ok: [osd1] => { 2026-03-05 21:47:50.103708 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:47:50.103750 | mon1 | } 2026-03-05 21:47:50.103756 | mon1 | 2026-03-05 21:47:50.103993 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:47:50.104044 | mon1 | Thursday 05 March 2026 21:47:50 +0000 (0:00:00.069) 0:01:28.962 ******** 2026-03-05 21:47:50.448187 | mon1 | ok: [osd1] 2026-03-05 21:47:50.448291 | mon1 | 2026-03-05 21:47:50.448303 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:47:50.448317 | mon1 | Thursday 05 March 2026 21:47:50 +0000 (0:00:00.345) 0:01:29.307 ******** 2026-03-05 21:47:53.489393 | mon1 | ok: [osd1] 2026-03-05 21:47:53.489474 | mon1 | 2026-03-05 21:47:53.489535 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:47:53.489647 | mon1 | Thursday 05 March 2026 21:47:53 +0000 (0:00:03.041) 0:01:32.348 ******** 2026-03-05 21:47:54.468835 | mon1 | ok: [osd1] 2026-03-05 21:47:54.468902 | mon1 | 2026-03-05 21:47:54.469206 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:47:54.469229 | mon1 | Thursday 05 March 2026 21:47:54 +0000 (0:00:00.979) 0:01:33.328 ******** 2026-03-05 21:47:54.663058 | mon1 | ok: [osd1] 2026-03-05 21:47:54.663121 | mon1 | 2026-03-05 21:47:54.663206 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:47:54.663290 | mon1 | Thursday 05 March 2026 21:47:54 +0000 (0:00:00.194) 0:01:33.522 ******** 2026-03-05 21:47:55.074188 | mon1 | ok: [osd1] 2026-03-05 21:47:55.074233 | mon1 | 2026-03-05 21:47:55.074240 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:47:55.074247 | mon1 | Thursday 05 March 2026 21:47:55 +0000 (0:00:00.410) 0:01:33.933 ******** 2026-03-05 21:47:55.602759 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 21:47:55.602806 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:47:55.602814 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:47:55.602820 | mon1 | 2026-03-05 21:47:55.602827 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:47:55.602845 | mon1 | Thursday 05 March 2026 21:47:55 +0000 (0:00:00.528) 0:01:34.461 ******** 2026-03-05 21:47:56.010899 | mon1 | ok: [osd1] 2026-03-05 21:47:56.010940 | mon1 | 2026-03-05 21:47:56.010945 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:47:56.010950 | mon1 | Thursday 05 March 2026 21:47:56 +0000 (0:00:00.408) 0:01:34.870 ******** 2026-03-05 21:47:56.436269 | mon1 | ok: [osd1] 2026-03-05 21:47:56.436310 | mon1 | 2026-03-05 21:47:56.436316 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:47:56.436320 | mon1 | Thursday 05 March 2026 21:47:56 +0000 (0:00:00.417) 0:01:35.288 ******** 2026-03-05 21:47:56.436324 | mon1 | 2026-03-05 21:47:56.436328 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:47:56.436332 | mon1 | Thursday 05 March 2026 21:47:56 +0000 (0:00:00.007) 0:01:35.295 ******** 2026-03-05 21:47:56.787415 | mon1 | ok: [osd1] 2026-03-05 21:47:56.787457 | mon1 | 2026-03-05 21:47:56.787463 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:47:56.787469 | mon1 | Thursday 05 March 2026 21:47:56 +0000 (0:00:00.351) 0:01:35.646 ******** 2026-03-05 21:47:56.829826 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:47:56.830222 | mon1 | 2026-03-05 21:47:56.830273 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:47:56.830281 | mon1 | Thursday 05 March 2026 21:47:56 +0000 (0:00:00.042) 0:01:35.689 ******** 2026-03-05 21:47:57.778016 | mon1 | ok: [osd1] 2026-03-05 21:47:57.778083 | mon1 | 2026-03-05 21:47:57.778265 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:47:57.778280 | mon1 | Thursday 05 March 2026 21:47:57 +0000 (0:00:00.948) 0:01:36.637 ******** 2026-03-05 21:47:58.399365 | mon1 | ok: [osd1] => (item=chronyd) 2026-03-05 21:47:58.399441 | mon1 | ok: [osd1] => (item=sshd) 2026-03-05 21:47:58.399878 | mon1 | 2026-03-05 21:47:58.399929 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:47:58.399937 | mon1 | Thursday 05 March 2026 21:47:58 +0000 (0:00:00.621) 0:01:37.258 ******** 2026-03-05 21:47:58.675496 | mon1 | ok: [osd1] 2026-03-05 21:47:58.675569 | mon1 | 2026-03-05 21:47:58.675860 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:47:58.675905 | mon1 | Thursday 05 March 2026 21:47:58 +0000 (0:00:00.276) 0:01:37.534 ******** 2026-03-05 21:47:58.877886 | mon1 | ok: [osd1] 2026-03-05 21:47:58.877938 | mon1 | 2026-03-05 21:47:58.877945 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:47:58.877952 | mon1 | Thursday 05 March 2026 21:47:58 +0000 (0:00:00.201) 0:01:37.736 ******** 2026-03-05 21:47:59.118930 | mon1 | ok: [osd1] 2026-03-05 21:47:59.118977 | mon1 | 2026-03-05 21:47:59.118984 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:47:59.118991 | mon1 | Thursday 05 March 2026 21:47:59 +0000 (0:00:00.241) 0:01:37.977 ******** 2026-03-05 21:47:59.311223 | mon1 | ok: [osd1] 2026-03-05 21:47:59.311304 | mon1 | 2026-03-05 21:47:59.311367 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:47:59.311468 | mon1 | Thursday 05 March 2026 21:47:59 +0000 (0:00:00.192) 0:01:38.170 ******** 2026-03-05 21:47:59.523313 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 21:47:59.523387 | mon1 | 2026-03-05 21:47:59.523590 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:47:59.523635 | mon1 | Thursday 05 March 2026 21:47:59 +0000 (0:00:00.211) 0:01:38.382 ******** 2026-03-05 21:47:59.563998 | mon1 | ok: [osd1] 2026-03-05 21:47:59.564434 | mon1 | 2026-03-05 21:47:59.564486 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:47:59.564498 | mon1 | Thursday 05 March 2026 21:47:59 +0000 (0:00:00.040) 0:01:38.423 ******** 2026-03-05 21:47:59.615830 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 21:47:59.615888 | mon1 | 2026-03-05 21:47:59.615894 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:47:59.615898 | mon1 | Thursday 05 March 2026 21:47:59 +0000 (0:00:00.051) 0:01:38.475 ******** 2026-03-05 21:48:05.661535 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:48:05.661595 | mon1 | 2026-03-05 21:48:05.661692 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:48:05.661796 | mon1 | Thursday 05 March 2026 21:48:05 +0000 (0:00:06.045) 0:01:44.520 ******** 2026-03-05 21:48:05.700381 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 21:48:05.700437 | mon1 | 2026-03-05 21:48:05.700664 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:48:05.700715 | mon1 | Thursday 05 March 2026 21:48:05 +0000 (0:00:00.038) 0:01:44.559 ******** 2026-03-05 21:48:05.935635 | mon1 | ok: [osd1] 2026-03-05 21:48:05.935703 | mon1 | 2026-03-05 21:48:05.935780 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:48:05.935909 | mon1 | Thursday 05 March 2026 21:48:05 +0000 (0:00:00.235) 0:01:44.795 ******** 2026-03-05 21:48:12.351707 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:48:12.351783 | mon1 | 2026-03-05 21:48:12.351848 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:48:12.351940 | mon1 | Thursday 05 March 2026 21:48:12 +0000 (0:00:06.416) 0:01:51.211 ******** 2026-03-05 21:48:17.667277 | mon1 | ok: [osd1] 2026-03-05 21:48:17.667398 | mon1 | 2026-03-05 21:48:17.667460 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:48:17.667617 | mon1 | Thursday 05 March 2026 21:48:17 +0000 (0:00:05.315) 0:01:56.526 ******** 2026-03-05 21:48:40.097131 | mon1 | ok: [osd1] 2026-03-05 21:48:40.097222 | mon1 | 2026-03-05 21:48:40.097234 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:48:40.097358 | mon1 | Thursday 05 March 2026 21:48:40 +0000 (0:00:22.429) 0:02:18.956 ******** 2026-03-05 21:48:40.164032 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 21:48:40.164098 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 21:48:40.164529 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 21:48:40.164585 | mon1 | skipping: [osd1] 2026-03-05 21:48:40.164602 | mon1 | 2026-03-05 21:48:40.164822 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:48:40.164846 | mon1 | Thursday 05 March 2026 21:48:40 +0000 (0:00:00.066) 0:02:19.023 ******** 2026-03-05 21:48:46.346588 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:48:46.346628 | mon1 | 2026-03-05 21:48:46.346634 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:48:46.346639 | mon1 | Thursday 05 March 2026 21:48:46 +0000 (0:00:06.182) 0:02:25.205 ******** 2026-03-05 21:48:52.422548 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:48:52.422863 | mon1 | 2026-03-05 21:48:52.422891 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:48:52.422902 | mon1 | Thursday 05 March 2026 21:48:52 +0000 (0:00:06.076) 0:02:31.282 ******** 2026-03-05 21:48:52.468345 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 21:48:52.468453 | mon1 | 2026-03-05 21:48:52.468694 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:48:52.468742 | mon1 | Thursday 05 March 2026 21:48:52 +0000 (0:00:00.045) 0:02:31.327 ******** 2026-03-05 21:48:52.507061 | mon1 | ok: [osd1] 2026-03-05 21:48:52.507177 | mon1 | 2026-03-05 21:48:52.507403 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:48:52.507431 | mon1 | Thursday 05 March 2026 21:48:52 +0000 (0:00:00.038) 0:02:31.366 ******** 2026-03-05 21:48:58.574203 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:48:58.574277 | mon1 | 2026-03-05 21:48:58.574353 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:48:58.574479 | mon1 | Thursday 05 March 2026 21:48:58 +0000 (0:00:06.067) 0:02:37.433 ******** 2026-03-05 21:48:58.611941 | mon1 | ok: [osd1] 2026-03-05 21:48:58.612004 | mon1 | 2026-03-05 21:48:58.612084 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:48:58.612183 | mon1 | Thursday 05 March 2026 21:48:58 +0000 (0:00:00.037) 0:02:37.471 ******** 2026-03-05 21:48:58.649991 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:48:58.650088 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:48:58.650171 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:48:58.650532 | mon1 | skipping: [osd1] 2026-03-05 21:48:58.650546 | mon1 | 2026-03-05 21:48:58.650551 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:48:58.650556 | mon1 | Thursday 05 March 2026 21:48:58 +0000 (0:00:00.038) 0:02:37.509 ******** 2026-03-05 21:48:58.676871 | mon1 | skipping: [osd1] 2026-03-05 21:48:58.676931 | mon1 | 2026-03-05 21:48:58.677026 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:48:58.679581 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 21:48:58.679598 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 21:48:58.679603 | mon1 | 2026-03-05 21:48:58.679607 | mon1 | 2026-03-05 21:48:58.679611 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:48:58.679615 | mon1 | Thursday 05 March 2026 21:48:58 +0000 (0:00:00.026) 0:02:37.536 ******** 2026-03-05 21:48:58.679625 | mon1 | =============================================================================== 2026-03-05 21:48:58.679629 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.43s 2026-03-05 21:48:58.679633 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.18s 2026-03-05 21:48:58.679637 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.58s 2026-03-05 21:48:58.679641 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.51s 2026-03-05 21:48:58.679645 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.45s 2026-03-05 21:48:58.679649 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.42s 2026-03-05 21:48:58.679653 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.21s 2026-03-05 21:48:58.679657 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.20s 2026-03-05 21:48:58.679660 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.18s 2026-03-05 21:48:58.679664 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.11s 2026-03-05 21:48:58.679668 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.10s 2026-03-05 21:48:58.679672 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.08s 2026-03-05 21:48:58.679676 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.07s 2026-03-05 21:48:58.679680 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.05s 2026-03-05 21:48:58.679684 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.32s 2026-03-05 21:48:58.679687 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.05s 2026-03-05 21:48:58.679691 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.04s 2026-03-05 21:48:58.679695 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.17s 2026-03-05 21:48:58.679699 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.93s 2026-03-05 21:48:58.679703 | mon1 | Gathering Facts --------------------------------------------------------- 1.16s 2026-03-05 21:48:58.753829 | mon1 | INFO [default > idempotence] Executed: Successful 2026-03-05 21:48:58.764572 | mon1 | INFO [default > side_effect] Executing 2026-03-05 21:48:58.764900 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:48:58.770099 | mon1 | INFO [default > verify] Executing 2026-03-05 21:48:59.363534 | mon1 | 2026-03-05 21:48:59.364041 | mon1 | PLAY [Verify] ****************************************************************** 2026-03-05 21:48:59.364302 | mon1 | 2026-03-05 21:48:59.364644 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:48:59.364917 | mon1 | Thursday 05 March 2026 21:48:59 +0000 (0:00:00.006) 0:00:00.006 ******** 2026-03-05 21:49:00.460438 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:49:00.460645 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:49:00.460903 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:49:00.461115 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:49:00.461326 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:49:00.471129 | mon1 | ok: [mon1] 2026-03-05 21:49:00.471288 | mon1 | 2026-03-05 21:49:00.471487 | mon1 | TASK [Get cluster health status] *********************************************** 2026-03-05 21:49:00.471690 | mon1 | Thursday 05 March 2026 21:49:00 +0000 (0:00:01.107) 0:00:01.114 ******** 2026-03-05 21:49:10.627494 | mon1 | ok: [mon1] 2026-03-05 21:49:10.627684 | mon1 | 2026-03-05 21:49:10.627912 | mon1 | TASK [Print cluster health status] ********************************************* 2026-03-05 21:49:10.628221 | mon1 | Thursday 05 March 2026 21:49:10 +0000 (0:00:10.155) 0:00:11.269 ******** 2026-03-05 21:49:10.655849 | mon1 | ok: [mon1] => { 2026-03-05 21:49:10.656062 | mon1 | "_ceph_health": { 2026-03-05 21:49:10.656270 | mon1 | "changed": false, 2026-03-05 21:49:10.656505 | mon1 | "cmd": [ 2026-03-05 21:49:10.656724 | mon1 | "cephadm", 2026-03-05 21:49:10.656927 | mon1 | "shell", 2026-03-05 21:49:10.657114 | mon1 | "--", 2026-03-05 21:49:10.657310 | mon1 | "ceph", 2026-03-05 21:49:10.657505 | mon1 | "health" 2026-03-05 21:49:10.657741 | mon1 | ], 2026-03-05 21:49:10.658007 | mon1 | "delta": "0:00:09.893714", 2026-03-05 21:49:10.658212 | mon1 | "end": "2026-03-05 21:49:10.591721", 2026-03-05 21:49:10.658410 | mon1 | "failed": false, 2026-03-05 21:49:10.658609 | mon1 | "msg": "", 2026-03-05 21:49:10.658873 | mon1 | "rc": 0, 2026-03-05 21:49:10.659091 | mon1 | "start": "2026-03-05 21:49:00.698007", 2026-03-05 21:49:10.659316 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-03-05 21:49:10.659510 | mon1 | "stderr_lines": [ 2026-03-05 21:49:10.659788 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-05 21:49:10.660025 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-03-05 21:49:10.660221 | mon1 | ], 2026-03-05 21:49:10.660449 | mon1 | "stdout": "HEALTH_OK", 2026-03-05 21:49:10.660652 | mon1 | "stdout_lines": [ 2026-03-05 21:49:10.660880 | mon1 | "HEALTH_OK" 2026-03-05 21:49:10.661051 | mon1 | ] 2026-03-05 21:49:10.661234 | mon1 | } 2026-03-05 21:49:10.661436 | mon1 | } 2026-03-05 21:49:10.661615 | mon1 | 2026-03-05 21:49:10.661837 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-05 21:49:10.662278 | mon1 | Thursday 05 March 2026 21:49:10 +0000 (0:00:00.029) 0:00:11.299 ******** 2026-03-05 21:49:10.681208 | mon1 | ok: [mon1] => { 2026-03-05 21:49:10.681402 | mon1 | "changed": false, 2026-03-05 21:49:10.681592 | mon1 | "msg": "All assertions passed" 2026-03-05 21:49:10.681776 | mon1 | } 2026-03-05 21:49:10.681980 | mon1 | 2026-03-05 21:49:10.682174 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-03-05 21:49:10.682368 | mon1 | Thursday 05 March 2026 21:49:10 +0000 (0:00:00.024) 0:00:11.324 ******** 2026-03-05 21:49:17.208343 | mon1 | changed: [mon1] 2026-03-05 21:49:17.208420 | mon1 | 2026-03-05 21:49:17.208551 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-03-05 21:49:17.208663 | mon1 | Thursday 05 March 2026 21:49:17 +0000 (0:00:06.527) 0:00:17.851 ******** 2026-03-05 21:49:19.470455 | mon1 | changed: [mon1] 2026-03-05 21:49:19.470506 | mon1 | 2026-03-05 21:49:19.470518 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-05 21:49:19.470723 | mon1 | Thursday 05 March 2026 21:49:19 +0000 (0:00:02.261) 0:00:20.112 ******** 2026-03-05 21:49:20.604946 | mon1 | ok: [mon1] 2026-03-05 21:49:20.605600 | mon1 | 2026-03-05 21:49:20.605660 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-03-05 21:49:20.605671 | mon1 | Thursday 05 March 2026 21:49:20 +0000 (0:00:01.134) 0:00:21.247 ******** 2026-03-05 21:49:20.637041 | mon1 | ok: [mon1] => { 2026-03-05 21:49:20.637156 | mon1 | "changed": false, 2026-03-05 21:49:20.639325 | mon1 | "msg": "All assertions passed" 2026-03-05 21:49:20.639372 | mon1 | } 2026-03-05 21:49:20.639380 | mon1 | 2026-03-05 21:49:20.639386 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:49:20.639399 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 21:49:20.639405 | mon1 | 2026-03-05 21:49:20.639411 | mon1 | 2026-03-05 21:49:20.639416 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:49:20.639422 | mon1 | Thursday 05 March 2026 21:49:20 +0000 (0:00:00.032) 0:00:21.280 ******** 2026-03-05 21:49:20.639428 | mon1 | =============================================================================== 2026-03-05 21:49:20.639447 | mon1 | Get cluster health status ---------------------------------------------- 10.16s 2026-03-05 21:49:20.639453 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.53s 2026-03-05 21:49:20.639458 | mon1 | Create a test Ceph key -------------------------------------------------- 2.26s 2026-03-05 21:49:20.639464 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.13s 2026-03-05 21:49:20.639470 | mon1 | Gathering Facts --------------------------------------------------------- 1.11s 2026-03-05 21:49:20.639475 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.03s 2026-03-05 21:49:20.639480 | mon1 | Print cluster health status --------------------------------------------- 0.03s 2026-03-05 21:49:20.639486 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.02s 2026-03-05 21:49:20.706451 | mon1 | INFO [default > verify] Executed: Successful 2026-03-05 21:49:20.715719 | mon1 | INFO [default > cleanup] Executing 2026-03-05 21:49:20.716031 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:49:20.720959 | mon1 | INFO [default > destroy] Executing 2026-03-05 21:49:20.721052 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 21:49:20.721135 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 21:49:20.721410 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-05 21:49:20.883954 | mon1 | ok: Runtime: 0:11:27.625570 2026-03-05 21:49:20.897732 | 2026-03-05 21:49:20.897781 | PLAY RECAP 2026-03-05 21:49:20.897823 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:49:20.897844 | 2026-03-05 21:49:21.012122 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 21:49:21.017319 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:49:21.618965 | 2026-03-05 21:49:21.619087 | PLAY [all] 2026-03-05 21:49:21.630488 | 2026-03-05 21:49:21.630561 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-05 21:49:21.683023 | mon1 | ok 2026-03-05 21:49:21.688427 | osd1 | ok 2026-03-05 21:49:21.692590 | 2026-03-05 21:49:21.692661 | TASK [fetch-output : Set log path for single node] 2026-03-05 21:49:21.717489 | mon1 | skipping: Conditional result was False 2026-03-05 21:49:21.728792 | osd1 | skipping: Conditional result was False 2026-03-05 21:49:21.739006 | 2026-03-05 21:49:21.739191 | LOOP [fetch-output : Ensure local output dirs] 2026-03-05 21:49:22.124438 | mon1 -> localhost | changed: "/var/lib/zuul/builds/270af7299b8a41c0a02d9c032c5ec777/work/logs/mon1" 2026-03-05 21:49:22.128677 | osd1 -> localhost | changed: "/var/lib/zuul/builds/270af7299b8a41c0a02d9c032c5ec777/work/logs/osd1" 2026-03-05 21:49:22.334315 | mon1 -> localhost | changed: "/var/lib/zuul/builds/270af7299b8a41c0a02d9c032c5ec777/work/artifacts" 2026-03-05 21:49:22.335575 | osd1 -> localhost | ok: "/var/lib/zuul/builds/270af7299b8a41c0a02d9c032c5ec777/work/artifacts" 2026-03-05 21:49:22.527660 | mon1 -> localhost | changed: "/var/lib/zuul/builds/270af7299b8a41c0a02d9c032c5ec777/work/docs" 2026-03-05 21:49:22.537857 | osd1 -> localhost | ok: "/var/lib/zuul/builds/270af7299b8a41c0a02d9c032c5ec777/work/docs" 2026-03-05 21:49:22.537938 | osd1 -> localhost | changed: All items complete 2026-03-05 21:49:22.537977 | 2026-03-05 21:49:22.559425 | 2026-03-05 21:49:22.559548 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-05 21:49:23.184713 | osd1 | changed: .d..t...... ./ 2026-03-05 21:49:23.190478 | mon1 | changed: .d..t...... ./ 2026-03-05 21:49:23.615336 | osd1 | changed: .d..t...... ./ 2026-03-05 21:49:23.626775 | mon1 | changed: .d..t...... ./ 2026-03-05 21:49:24.052656 | osd1 | changed: .d..t...... ./ 2026-03-05 21:49:24.080663 | mon1 | ok 2026-03-05 21:49:24.080737 | mon1 | changed: All items complete 2026-03-05 21:49:24.080771 | 2026-03-05 21:49:24.108103 | 2026-03-05 21:49:24.108220 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-05 21:49:24.540757 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008787 2026-03-05 21:49:24.760564 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007920 2026-03-05 21:49:24.785612 | 2026-03-05 21:49:24.785704 | PLAY [all] 2026-03-05 21:49:24.791586 | 2026-03-05 21:49:24.791647 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-05 21:49:25.202644 | mon1 | changed 2026-03-05 21:49:25.374614 | osd1 | changed 2026-03-05 21:49:25.385862 | 2026-03-05 21:49:25.385911 | PLAY RECAP 2026-03-05 21:49:25.385973 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 21:49:25.386007 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 21:49:25.386027 | 2026-03-05 21:49:25.570364 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:49:25.576091 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-05 21:49:26.136797 | 2026-03-05 21:49:26.136943 | PLAY [localhost] 2026-03-05 21:49:26.147063 | 2026-03-05 21:49:26.147131 | TASK [Generate Zuul manifest] 2026-03-05 21:49:26.169782 | localhost | ok 2026-03-05 21:49:26.186469 | 2026-03-05 21:49:26.186546 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-05 21:49:26.484519 | localhost | changed 2026-03-05 21:49:26.496741 | 2026-03-05 21:49:26.496821 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-05 21:49:26.528607 | localhost | ok 2026-03-05 21:49:26.536668 | 2026-03-05 21:49:26.536736 | TASK [Upload logs] 2026-03-05 21:49:26.569231 | localhost | ok 2026-03-05 21:49:26.628864 | 2026-03-05 21:49:26.629003 | TASK [Set zuul-log-path fact] 2026-03-05 21:49:26.650611 | localhost | ok 2026-03-05 21:49:26.664086 | 2026-03-05 21:49:26.664155 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 21:49:26.695782 | localhost | ok 2026-03-05 21:49:26.704141 | 2026-03-05 21:49:26.704207 | TASK [upload-logs : Create log directories] 2026-03-05 21:49:27.121575 | localhost | changed 2026-03-05 21:49:27.127596 | 2026-03-05 21:49:27.127667 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-05 21:49:27.526006 | localhost -> localhost | ok: Runtime: 0:00:00.005488 2026-03-05 21:49:27.533041 | 2026-03-05 21:49:27.533112 | TASK [upload-logs : Upload logs to log server] 2026-03-05 21:49:27.992868 | localhost | Output suppressed because no_log was given 2026-03-05 21:49:27.997960 | 2026-03-05 21:49:27.998032 | LOOP [upload-logs : Compress console log and json output] 2026-03-05 21:49:28.045621 | localhost | skipping: Conditional result was False 2026-03-05 21:49:28.053257 | localhost | skipping: Conditional result was False 2026-03-05 21:49:28.063709 | 2026-03-05 21:49:28.063927 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-05 21:49:28.104779 | localhost | skipping: Conditional result was False 2026-03-05 21:49:28.105219 | 2026-03-05 21:49:28.108903 | localhost | skipping: Conditional result was False 2026-03-05 21:49:28.116331 | 2026-03-05 21:49:28.116486 | LOOP [upload-logs : Upload console log and json output]