2026-03-06 01:19:15.282176 | Job console starting 2026-03-06 01:19:15.296666 | Updating git repos 2026-03-06 01:19:15.315644 | Cloning repos into workspace 2026-03-06 01:19:15.352669 | Restoring repo states 2026-03-06 01:19:15.362167 | Merging changes 2026-03-06 01:19:15.619355 | Checking out repos 2026-03-06 01:19:15.652635 | Preparing playbooks 2026-03-06 01:19:16.732790 | Running Ansible setup 2026-03-06 01:19:20.859495 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-06 01:19:21.494551 | 2026-03-06 01:19:21.494739 | PLAY [localhost] 2026-03-06 01:19:21.506307 | 2026-03-06 01:19:21.506464 | TASK [Gathering Facts] 2026-03-06 01:19:22.350119 | localhost | ok 2026-03-06 01:19:22.360456 | 2026-03-06 01:19:22.360622 | TASK [Setup log path fact] 2026-03-06 01:19:22.379068 | localhost | ok 2026-03-06 01:19:22.394231 | 2026-03-06 01:19:22.394300 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-06 01:19:22.425613 | localhost | ok 2026-03-06 01:19:22.433933 | 2026-03-06 01:19:22.434027 | TASK [emit-job-header : Print job information] 2026-03-06 01:19:22.476908 | # Job Information 2026-03-06 01:19:22.477160 | Ansible Version: 2.16.16 2026-03-06 01:19:22.477233 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-03-06 01:19:22.477285 | Pipeline: check 2026-03-06 01:19:22.477331 | Executor: 0a8996d2b663 2026-03-06 01:19:22.477376 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/96 2026-03-06 01:19:22.477427 | Event ID: 61bdb7f0-18fa-11f1-8961-149ac14c4b20 2026-03-06 01:19:22.481861 | 2026-03-06 01:19:22.481928 | LOOP [emit-job-header : Print node information] 2026-03-06 01:19:22.575207 | localhost | ok: 2026-03-06 01:19:22.576042 | localhost | # Node Information 2026-03-06 01:19:22.576136 | localhost | Inventory Hostname: mon1 2026-03-06 01:19:22.576172 | localhost | Hostname: np0000158006 2026-03-06 01:19:22.576202 | localhost | Username: zuul 2026-03-06 01:19:22.576235 | localhost | Distro: Ubuntu 22.04 2026-03-06 01:19:22.576265 | localhost | Provider: yul1 2026-03-06 01:19:22.576293 | localhost | Region: ca-ymq-1 2026-03-06 01:19:22.576321 | localhost | Label: ubuntu-jammy 2026-03-06 01:19:22.576348 | localhost | Product Name: OpenStack Nova 2026-03-06 01:19:22.576375 | localhost | Interface IP: 162.253.55.70 2026-03-06 01:19:22.619830 | localhost | ok: 2026-03-06 01:19:22.619932 | localhost | # Node Information 2026-03-06 01:19:22.619959 | localhost | Inventory Hostname: osd1 2026-03-06 01:19:22.619981 | localhost | Hostname: np0000158007 2026-03-06 01:19:22.620001 | localhost | Username: zuul 2026-03-06 01:19:22.620039 | localhost | Distro: Ubuntu 22.04 2026-03-06 01:19:22.620059 | localhost | Provider: yul1 2026-03-06 01:19:22.620077 | localhost | Region: ca-ymq-1 2026-03-06 01:19:22.620095 | localhost | Label: ubuntu-jammy 2026-03-06 01:19:22.620113 | localhost | Product Name: OpenStack Nova 2026-03-06 01:19:22.620132 | localhost | Interface IP: 199.204.45.223 2026-03-06 01:19:22.640156 | 2026-03-06 01:19:22.640328 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-06 01:19:23.023869 | localhost -> localhost | changed 2026-03-06 01:19:23.030765 | 2026-03-06 01:19:23.030830 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-06 01:19:23.845388 | localhost -> localhost | changed 2026-03-06 01:19:23.855370 | 2026-03-06 01:19:23.855447 | PLAY [all] 2026-03-06 01:19:23.865106 | 2026-03-06 01:19:23.865175 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-06 01:19:24.081861 | mon1 -> localhost | ok 2026-03-06 01:19:24.087280 | 2026-03-06 01:19:24.087339 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-06 01:19:24.118648 | mon1 | ok 2026-03-06 01:19:24.122389 | osd1 | ok 2026-03-06 01:19:24.138897 | mon1 | included: /var/lib/zuul/builds/3226b5909f3f46a99c4d154042a7df4e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-06 01:19:24.138943 | osd1 | included: /var/lib/zuul/builds/3226b5909f3f46a99c4d154042a7df4e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-06 01:19:24.144486 | 2026-03-06 01:19:24.144546 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-06 01:19:26.348842 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-06 01:19:26.349013 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/3226b5909f3f46a99c4d154042a7df4e/work/3226b5909f3f46a99c4d154042a7df4e_id_rsa 2026-03-06 01:19:26.349046 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/3226b5909f3f46a99c4d154042a7df4e/work/3226b5909f3f46a99c4d154042a7df4e_id_rsa.pub 2026-03-06 01:19:26.349071 | mon1 -> localhost | The key fingerprint is: 2026-03-06 01:19:26.349101 | mon1 -> localhost | SHA256:q+Ngu0xLca5PhQ43S9mb3HFB2Q8APWUsSyRXSohMpH4 zuul-build-sshkey 2026-03-06 01:19:26.349123 | mon1 -> localhost | The key's randomart image is: 2026-03-06 01:19:26.349145 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-06 01:19:26.349166 | mon1 -> localhost | | +o.o=*B+ | 2026-03-06 01:19:26.349189 | mon1 -> localhost | | .o .=*o+ | 2026-03-06 01:19:26.349209 | mon1 -> localhost | | . .o+ o | 2026-03-06 01:19:26.349230 | mon1 -> localhost | | . + .. .| 2026-03-06 01:19:26.349251 | mon1 -> localhost | | o O E . . | 2026-03-06 01:19:26.349272 | mon1 -> localhost | | O * = o | 2026-03-06 01:19:26.349293 | mon1 -> localhost | | = = = . | 2026-03-06 01:19:26.349313 | mon1 -> localhost | | = *.. | 2026-03-06 01:19:26.349333 | mon1 -> localhost | | *++. | 2026-03-06 01:19:26.349353 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-06 01:19:26.349398 | mon1 -> localhost | ok: Runtime: 0:00:01.817120 2026-03-06 01:19:26.354435 | 2026-03-06 01:19:26.354497 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-06 01:19:26.383299 | mon1 | ok 2026-03-06 01:19:26.388612 | osd1 | ok 2026-03-06 01:19:26.401961 | mon1 | included: /var/lib/zuul/builds/3226b5909f3f46a99c4d154042a7df4e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-06 01:19:26.402014 | osd1 | included: /var/lib/zuul/builds/3226b5909f3f46a99c4d154042a7df4e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-06 01:19:26.412929 | 2026-03-06 01:19:26.413008 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-06 01:19:26.436521 | mon1 | skipping: Conditional result was False 2026-03-06 01:19:26.447989 | osd1 | skipping: Conditional result was False 2026-03-06 01:19:26.458252 | 2026-03-06 01:19:26.458355 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-06 01:19:26.896132 | mon1 | changed 2026-03-06 01:19:26.902118 | osd1 | changed 2026-03-06 01:19:26.906740 | 2026-03-06 01:19:26.906804 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-06 01:19:27.109393 | mon1 | ok 2026-03-06 01:19:27.115802 | osd1 | ok 2026-03-06 01:19:27.122621 | 2026-03-06 01:19:27.122705 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-06 01:19:27.599163 | osd1 | changed 2026-03-06 01:19:27.629180 | mon1 | changed 2026-03-06 01:19:27.634899 | 2026-03-06 01:19:27.634975 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-06 01:19:28.096904 | mon1 | changed 2026-03-06 01:19:28.108209 | osd1 | changed 2026-03-06 01:19:28.115176 | 2026-03-06 01:19:28.115261 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-06 01:19:28.137676 | mon1 | skipping: Conditional result was False 2026-03-06 01:19:28.148637 | osd1 | skipping: Conditional result was False 2026-03-06 01:19:28.184945 | 2026-03-06 01:19:28.185132 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-06 01:19:28.514946 | mon1 -> localhost | changed 2026-03-06 01:19:28.534437 | 2026-03-06 01:19:28.534512 | TASK [add-build-sshkey : Add back temp key] 2026-03-06 01:19:28.801482 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/3226b5909f3f46a99c4d154042a7df4e/work/3226b5909f3f46a99c4d154042a7df4e_id_rsa (zuul-build-sshkey) 2026-03-06 01:19:28.801697 | mon1 -> localhost | ok: Runtime: 0:00:00.014461 2026-03-06 01:19:28.807991 | 2026-03-06 01:19:28.808051 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-06 01:19:29.066125 | osd1 | ok 2026-03-06 01:19:29.072725 | mon1 | ok 2026-03-06 01:19:29.078820 | 2026-03-06 01:19:29.078906 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-06 01:19:29.103001 | mon1 | skipping: Conditional result was False 2026-03-06 01:19:29.114319 | osd1 | skipping: Conditional result was False 2026-03-06 01:19:29.133676 | 2026-03-06 01:19:29.133742 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-06 01:19:29.406385 | mon1 | ok 2026-03-06 01:19:29.410555 | osd1 | ok 2026-03-06 01:19:29.415928 | 2026-03-06 01:19:29.415988 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-06 01:19:30.054601 | mon1 | Output suppressed because no_log was given 2026-03-06 01:19:30.071306 | osd1 | Output suppressed because no_log was given 2026-03-06 01:19:30.086064 | 2026-03-06 01:19:30.086235 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-06 01:19:30.283635 | mon1 | ok: "logs" 2026-03-06 01:19:30.284326 | mon1 | ok: All items complete 2026-03-06 01:19:30.284378 | 2026-03-06 01:19:30.290651 | osd1 | ok: "logs" 2026-03-06 01:19:30.450156 | mon1 | ok: "artifacts" 2026-03-06 01:19:30.456899 | osd1 | ok: "artifacts" 2026-03-06 01:19:30.607678 | osd1 | ok: "docs" 2026-03-06 01:19:30.613595 | mon1 | ok: "docs" 2026-03-06 01:19:30.624775 | 2026-03-06 01:19:30.624849 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-06 01:19:30.807345 | mon1 | changed: "logs" 2026-03-06 01:19:30.807557 | mon1 | ok: All items complete 2026-03-06 01:19:30.807585 | 2026-03-06 01:19:30.830949 | osd1 | changed: "logs" 2026-03-06 01:19:30.965950 | mon1 | changed: "artifacts" 2026-03-06 01:19:30.986584 | osd1 | changed: "artifacts" 2026-03-06 01:19:31.114142 | mon1 | changed: "docs" 2026-03-06 01:19:31.161595 | osd1 | changed: "docs" 2026-03-06 01:19:31.180733 | 2026-03-06 01:19:31.180859 | PLAY RECAP 2026-03-06 01:19:31.180912 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-06 01:19:31.180950 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-06 01:19:31.180982 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-06 01:19:31.181011 | 2026-03-06 01:19:31.296761 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-06 01:19:31.301865 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-06 01:19:31.852723 | 2026-03-06 01:19:31.854808 | PLAY [all] 2026-03-06 01:19:31.872654 | 2026-03-06 01:19:31.872751 | TASK [setup-uv : Extract archive] 2026-03-06 01:19:34.117273 | osd1 | changed 2026-03-06 01:19:34.409353 | mon1 | changed 2026-03-06 01:19:34.447907 | 2026-03-06 01:19:34.448012 | TASK [setup-uv : Print version] 2026-03-06 01:19:34.778244 | mon1 | uv 0.8.13 2026-03-06 01:19:35.205463 | osd1 | uv 0.8.13 2026-03-06 01:19:35.002335 | osd1 | ok: Runtime: 0:00:00.010958 2026-03-06 01:19:35.010431 | mon1 | ok: Runtime: 0:00:00.013501 2026-03-06 01:19:35.019810 | 2026-03-06 01:19:35.019856 | PLAY RECAP 2026-03-06 01:19:35.019902 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-06 01:19:35.019930 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-06 01:19:35.019951 | 2026-03-06 01:19:35.126738 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-06 01:19:35.131020 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-06 01:19:35.707328 | 2026-03-06 01:19:35.707512 | PLAY [all] 2026-03-06 01:19:35.719669 | 2026-03-06 01:19:35.719766 | TASK [Copy inventory file for Zuul] 2026-03-06 01:19:36.593983 | mon1 | changed 2026-03-06 01:19:36.598986 | 2026-03-06 01:19:36.599058 | TASK [Switch "ansible_host" to private IP] 2026-03-06 01:19:36.887897 | mon1 | changed: 2 replacements made 2026-03-06 01:19:36.893101 | 2026-03-06 01:19:36.920032 | TASK [Run Molecule scenario] 2026-03-06 01:19:37.588476 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-03-06 01:19:38.885756 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-03-06 01:19:39.146847 | mon1 | Using CPython 3.13.7 2026-03-06 01:19:39.146934 | mon1 | Creating virtual environment at: .venv 2026-03-06 01:19:39.612339 | mon1 | Downloading pygments (1.2MiB) 2026-03-06 01:19:39.630611 | mon1 | Downloading netaddr (2.2MiB) 2026-03-06 01:19:39.632514 | mon1 | Downloading cryptography (4.3MiB) 2026-03-06 01:19:39.634749 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-06 01:19:39.831689 | mon1 | Downloading netaddr 2026-03-06 01:19:39.845242 | mon1 | Downloading cryptography 2026-03-06 01:19:39.880841 | mon1 | Downloading pygments 2026-03-06 01:19:40.010910 | mon1 | Downloading ansible-core 2026-03-06 01:19:40.041776 | mon1 | Installed 36 packages in 30ms 2026-03-06 01:19:41.146497 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-06 01:19:41.146577 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-06 01:19:41.792936 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-06 01:19:41.793019 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-06 01:19:54.898357 | mon1 | INFO [default > dependency] Executing 2026-03-06 01:19:54.898577 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-06 01:19:54.898832 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-06 01:19:54.899013 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-06 01:19:54.906850 | mon1 | INFO [default > cleanup] Executing 2026-03-06 01:19:54.907263 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-06 01:19:54.914082 | mon1 | INFO [default > destroy] Executing 2026-03-06 01:19:54.914195 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-06 01:19:54.914291 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-06 01:19:54.921300 | mon1 | INFO [default > syntax] Executing 2026-03-06 01:19:55.872506 | mon1 | 2026-03-06 01:19:55.872815 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-06 01:19:55.945530 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-06 01:19:55.953292 | mon1 | INFO [default > create] Executing 2026-03-06 01:19:55.955195 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-06 01:19:55.961832 | mon1 | INFO [default > prepare] Executing 2026-03-06 01:19:56.642065 | mon1 | 2026-03-06 01:19:56.642245 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-06 01:19:56.642448 | mon1 | 2026-03-06 01:19:56.642669 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-06 01:19:56.642890 | mon1 | Friday 06 March 2026 01:19:56 +0000 (0:00:00.031) 0:00:00.031 ********** 2026-03-06 01:19:57.844214 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-06 01:19:57.844518 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-06 01:19:57.844686 | mon1 | interpreter could change the meaning of that path. See 2026-03-06 01:19:57.844967 | mon1 | https://docs.ansible.com/ansible- 2026-03-06 01:19:57.845202 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-06 01:19:57.872584 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-06 01:19:57.872723 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-06 01:19:57.872862 | mon1 | interpreter could change the meaning of that path. See 2026-03-06 01:19:57.873002 | mon1 | https://docs.ansible.com/ansible- 2026-03-06 01:19:57.873146 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-06 01:19:57.880966 | mon1 | ok: [osd1] 2026-03-06 01:19:57.881171 | mon1 | ok: [mon1] 2026-03-06 01:19:57.881428 | mon1 | 2026-03-06 01:19:57.881641 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-06 01:19:57.881850 | mon1 | Friday 06 March 2026 01:19:57 +0000 (0:00:01.239) 0:00:01.271 ********** 2026-03-06 01:19:59.659176 | mon1 | changed: [mon1] 2026-03-06 01:19:59.659274 | mon1 | changed: [osd1] 2026-03-06 01:19:59.659387 | mon1 | 2026-03-06 01:19:59.659546 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-06 01:19:59.659686 | mon1 | Friday 06 March 2026 01:19:59 +0000 (0:00:01.777) 0:00:03.048 ********** 2026-03-06 01:19:59.993832 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-06 01:19:59.994035 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-06 01:19:59.994254 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-06 01:20:00.012787 | mon1 | changed: [mon1] 2026-03-06 01:20:00.013000 | mon1 | changed: [osd1] 2026-03-06 01:20:00.013193 | mon1 | 2026-03-06 01:20:00.013400 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-06 01:20:00.013604 | mon1 | Friday 06 March 2026 01:20:00 +0000 (0:00:00.354) 0:00:03.402 ********** 2026-03-06 01:20:08.385335 | mon1 | changed: [mon1] 2026-03-06 01:20:08.385418 | mon1 | changed: [osd1] 2026-03-06 01:20:08.385476 | mon1 | 2026-03-06 01:20:08.385572 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-06 01:20:08.385659 | mon1 | 2026-03-06 01:20:08.385750 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-06 01:20:08.385842 | mon1 | Friday 06 March 2026 01:20:08 +0000 (0:00:08.372) 0:00:11.775 ********** 2026-03-06 01:20:09.180004 | mon1 | ok: [osd1] 2026-03-06 01:20:09.180159 | mon1 | 2026-03-06 01:20:09.180383 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-06 01:20:09.180632 | mon1 | Friday 06 March 2026 01:20:09 +0000 (0:00:00.794) 0:00:12.569 ********** 2026-03-06 01:20:47.157673 | mon1 | changed: [osd1] 2026-03-06 01:20:47.157817 | mon1 | 2026-03-06 01:20:47.158147 | mon1 | TASK [Start up service] ******************************************************** 2026-03-06 01:20:47.158580 | mon1 | Friday 06 March 2026 01:20:47 +0000 (0:00:37.977) 0:00:50.547 ********** 2026-03-06 01:20:47.729699 | mon1 | ok: [osd1] 2026-03-06 01:20:47.729781 | mon1 | 2026-03-06 01:20:47.730048 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-06 01:20:47.730265 | mon1 | Friday 06 March 2026 01:20:47 +0000 (0:00:00.572) 0:00:51.119 ********** 2026-03-06 01:20:48.050653 | mon1 | ok: [osd1] 2026-03-06 01:20:48.050847 | mon1 | 2026-03-06 01:20:48.051081 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-06 01:20:48.051313 | mon1 | Friday 06 March 2026 01:20:48 +0000 (0:00:00.320) 0:00:51.440 ********** 2026-03-06 01:20:48.798736 | mon1 | changed: [osd1] 2026-03-06 01:20:48.798818 | mon1 | 2026-03-06 01:20:48.798829 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-06 01:20:48.798839 | mon1 | Friday 06 March 2026 01:20:48 +0000 (0:00:00.746) 0:00:52.187 ********** 2026-03-06 01:20:48.981016 | mon1 | ok: [osd1] 2026-03-06 01:20:48.981098 | mon1 | 2026-03-06 01:20:48.981363 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-06 01:20:48.981579 | mon1 | Friday 06 March 2026 01:20:48 +0000 (0:00:00.183) 0:00:52.370 ********** 2026-03-06 01:20:49.003050 | mon1 | skipping: [osd1] 2026-03-06 01:20:49.003273 | mon1 | 2026-03-06 01:20:49.003520 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-06 01:20:49.003764 | mon1 | Friday 06 March 2026 01:20:48 +0000 (0:00:00.022) 0:00:52.393 ********** 2026-03-06 01:20:49.538508 | mon1 | changed: [osd1] => (item=osd0) 2026-03-06 01:20:49.538619 | mon1 | changed: [osd1] => (item=osd1) 2026-03-06 01:20:49.538844 | mon1 | changed: [osd1] => (item=osd2) 2026-03-06 01:20:49.539040 | mon1 | 2026-03-06 01:20:49.539295 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-06 01:20:49.539563 | mon1 | Friday 06 March 2026 01:20:49 +0000 (0:00:00.526) 0:00:52.919 ********** 2026-03-06 01:20:50.166691 | mon1 | changed: [osd1] => (item=osd0) 2026-03-06 01:20:50.166849 | mon1 | changed: [osd1] => (item=osd1) 2026-03-06 01:20:50.167066 | mon1 | changed: [osd1] => (item=osd2) 2026-03-06 01:20:50.167264 | mon1 | 2026-03-06 01:20:50.167492 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-06 01:20:50.167706 | mon1 | Friday 06 March 2026 01:20:50 +0000 (0:00:00.636) 0:00:53.556 ********** 2026-03-06 01:20:50.881655 | mon1 | changed: [osd1] => (item=osd0) 2026-03-06 01:20:50.881888 | mon1 | changed: [osd1] => (item=osd1) 2026-03-06 01:20:50.882129 | mon1 | changed: [osd1] => (item=osd2) 2026-03-06 01:20:50.882332 | mon1 | 2026-03-06 01:20:50.882558 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-06 01:20:50.882771 | mon1 | Friday 06 March 2026 01:20:50 +0000 (0:00:00.714) 0:00:54.270 ********** 2026-03-06 01:20:53.918094 | mon1 | changed: [osd1] => (item=osd0) 2026-03-06 01:20:53.918265 | mon1 | changed: [osd1] => (item=osd1) 2026-03-06 01:20:53.918464 | mon1 | changed: [osd1] => (item=osd2) 2026-03-06 01:20:53.918644 | mon1 | 2026-03-06 01:20:53.918851 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-06 01:20:53.919060 | mon1 | Friday 06 March 2026 01:20:53 +0000 (0:00:03.036) 0:00:57.307 ********** 2026-03-06 01:20:55.764399 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-06 01:20:55.764558 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-06 01:20:55.764832 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-06 01:20:55.764986 | mon1 | 2026-03-06 01:20:55.765190 | mon1 | PLAY RECAP ********************************************************************* 2026-03-06 01:20:55.765426 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-06 01:20:55.765650 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-06 01:20:55.765825 | mon1 | 2026-03-06 01:20:55.766000 | mon1 | 2026-03-06 01:20:55.766193 | mon1 | TASKS RECAP ******************************************************************** 2026-03-06 01:20:55.766395 | mon1 | Friday 06 March 2026 01:20:55 +0000 (0:00:01.847) 0:00:59.154 ********** 2026-03-06 01:20:55.766578 | mon1 | =============================================================================== 2026-03-06 01:20:55.766778 | mon1 | Install depedencies ---------------------------------------------------- 37.98s 2026-03-06 01:20:55.767033 | mon1 | Update apt cache -------------------------------------------------------- 8.37s 2026-03-06 01:20:55.767225 | mon1 | Create a volume group for each loop device ------------------------------ 3.04s 2026-03-06 01:20:55.767418 | mon1 | Create a logical volume for each loop device ---------------------------- 1.85s 2026-03-06 01:20:55.767611 | mon1 | Configure short hostname ------------------------------------------------ 1.78s 2026-03-06 01:20:55.767802 | mon1 | Gathering Facts --------------------------------------------------------- 1.24s 2026-03-06 01:20:55.767996 | mon1 | Gathering Facts --------------------------------------------------------- 0.79s 2026-03-06 01:20:55.768190 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.75s 2026-03-06 01:20:55.768385 | mon1 | Start loop devices ------------------------------------------------------ 0.71s 2026-03-06 01:20:55.768584 | mon1 | Set permissions on loopback devices ------------------------------------- 0.64s 2026-03-06 01:20:55.768808 | mon1 | Start up service -------------------------------------------------------- 0.57s 2026-03-06 01:20:55.769005 | mon1 | Create devices for Ceph ------------------------------------------------- 0.53s 2026-03-06 01:20:55.769207 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.35s 2026-03-06 01:20:55.769436 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.32s 2026-03-06 01:20:55.769680 | mon1 | Get list of all loopback devices ---------------------------------------- 0.18s 2026-03-06 01:20:55.769891 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-03-06 01:20:55.862463 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-06 01:20:55.868989 | mon1 | INFO [default > converge] Executing 2026-03-06 01:20:56.749715 | mon1 | 2026-03-06 01:20:56.749797 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-06 01:20:56.749836 | mon1 | 2026-03-06 01:20:56.749938 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-06 01:20:56.750040 | mon1 | Friday 06 March 2026 01:20:56 +0000 (0:00:00.049) 0:00:00.049 ********** 2026-03-06 01:20:57.745979 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-06 01:20:57.746254 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-06 01:20:57.746463 | mon1 | interpreter could change the meaning of that path. See 2026-03-06 01:20:57.746693 | mon1 | https://docs.ansible.com/ansible- 2026-03-06 01:20:57.746921 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-06 01:20:57.757820 | mon1 | ok: [mon1] 2026-03-06 01:20:57.757979 | mon1 | 2026-03-06 01:20:57.758198 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:20:57.758526 | mon1 | Friday 06 March 2026 01:20:57 +0000 (0:00:01.008) 0:00:01.058 ********** 2026-03-06 01:20:58.058596 | mon1 | ok: [mon1] 2026-03-06 01:20:58.058711 | mon1 | 2026-03-06 01:20:58.058914 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:20:58.059012 | mon1 | Friday 06 March 2026 01:20:58 +0000 (0:00:00.300) 0:00:01.358 ********** 2026-03-06 01:20:58.093534 | mon1 | skipping: [mon1] 2026-03-06 01:20:58.093676 | mon1 | 2026-03-06 01:20:58.094262 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-06 01:20:58.094428 | mon1 | Friday 06 March 2026 01:20:58 +0000 (0:00:00.034) 0:00:01.393 ********** 2026-03-06 01:20:58.421866 | mon1 | changed: [mon1] 2026-03-06 01:20:58.421982 | mon1 | 2026-03-06 01:20:58.422231 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:20:58.422452 | mon1 | Friday 06 March 2026 01:20:58 +0000 (0:00:00.328) 0:00:01.721 ********** 2026-03-06 01:20:58.523743 | mon1 | ok: [mon1] => { 2026-03-06 01:20:58.523921 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-06 01:20:58.524155 | mon1 | } 2026-03-06 01:20:58.524367 | mon1 | 2026-03-06 01:20:58.524609 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:20:58.524852 | mon1 | Friday 06 March 2026 01:20:58 +0000 (0:00:00.101) 0:00:01.823 ********** 2026-03-06 01:20:59.140478 | mon1 | changed: [mon1] 2026-03-06 01:20:59.140672 | mon1 | 2026-03-06 01:20:59.140947 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:20:59.141141 | mon1 | Friday 06 March 2026 01:20:59 +0000 (0:00:00.617) 0:00:02.440 ********** 2026-03-06 01:20:59.178164 | mon1 | skipping: [mon1] 2026-03-06 01:20:59.178308 | mon1 | 2026-03-06 01:20:59.178525 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:20:59.178734 | mon1 | Friday 06 March 2026 01:20:59 +0000 (0:00:00.037) 0:00:02.478 ********** 2026-03-06 01:20:59.217719 | mon1 | skipping: [mon1] 2026-03-06 01:20:59.217795 | mon1 | 2026-03-06 01:20:59.218069 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:20:59.218274 | mon1 | Friday 06 March 2026 01:20:59 +0000 (0:00:00.039) 0:00:02.518 ********** 2026-03-06 01:20:59.418182 | mon1 | ok: [mon1] 2026-03-06 01:20:59.418421 | mon1 | 2026-03-06 01:20:59.418686 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:20:59.418924 | mon1 | Friday 06 March 2026 01:20:59 +0000 (0:00:00.199) 0:00:02.718 ********** 2026-03-06 01:21:00.559927 | mon1 | ok: [mon1] 2026-03-06 01:21:00.560111 | mon1 | 2026-03-06 01:21:00.560248 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:21:00.560374 | mon1 | Friday 06 March 2026 01:21:00 +0000 (0:00:01.142) 0:00:03.860 ********** 2026-03-06 01:21:00.653513 | mon1 | ok: [mon1] => { 2026-03-06 01:21:00.653587 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-06 01:21:00.653607 | mon1 | } 2026-03-06 01:21:00.653773 | mon1 | 2026-03-06 01:21:00.654124 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:21:00.654256 | mon1 | Friday 06 March 2026 01:21:00 +0000 (0:00:00.090) 0:00:03.951 ********** 2026-03-06 01:21:01.445309 | mon1 | changed: [mon1] 2026-03-06 01:21:01.445390 | mon1 | 2026-03-06 01:21:01.445565 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:21:01.445778 | mon1 | Friday 06 March 2026 01:21:01 +0000 (0:00:00.793) 0:00:04.744 ********** 2026-03-06 01:21:04.384682 | mon1 | changed: [mon1] 2026-03-06 01:21:04.384760 | mon1 | 2026-03-06 01:21:04.384978 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-06 01:21:04.385032 | mon1 | Friday 06 March 2026 01:21:04 +0000 (0:00:02.940) 0:00:07.685 ********** 2026-03-06 01:21:04.416099 | mon1 | skipping: [mon1] 2026-03-06 01:21:04.416439 | mon1 | 2026-03-06 01:21:04.416489 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-06 01:21:04.416495 | mon1 | Friday 06 March 2026 01:21:04 +0000 (0:00:00.031) 0:00:07.716 ********** 2026-03-06 01:21:04.443479 | mon1 | skipping: [mon1] 2026-03-06 01:21:04.443559 | mon1 | 2026-03-06 01:21:04.443595 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-06 01:21:04.443716 | mon1 | Friday 06 March 2026 01:21:04 +0000 (0:00:00.027) 0:00:07.744 ********** 2026-03-06 01:21:04.471784 | mon1 | skipping: [mon1] 2026-03-06 01:21:04.472144 | mon1 | 2026-03-06 01:21:04.472202 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-06 01:21:04.472209 | mon1 | Friday 06 March 2026 01:21:04 +0000 (0:00:00.028) 0:00:07.772 ********** 2026-03-06 01:21:10.876840 | mon1 | changed: [mon1] 2026-03-06 01:21:10.876934 | mon1 | 2026-03-06 01:21:10.876950 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-06 01:21:10.877098 | mon1 | Friday 06 March 2026 01:21:10 +0000 (0:00:06.405) 0:00:14.177 ********** 2026-03-06 01:21:11.435206 | mon1 | changed: [mon1] 2026-03-06 01:21:11.435279 | mon1 | 2026-03-06 01:21:11.435453 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-06 01:21:11.435471 | mon1 | Friday 06 March 2026 01:21:11 +0000 (0:00:00.558) 0:00:14.735 ********** 2026-03-06 01:21:12.328143 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-06 01:21:12.328211 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-06 01:21:12.328879 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-06 01:21:12.328953 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-06 01:21:12.328961 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-06 01:21:12.328968 | mon1 | 2026-03-06 01:21:12.328974 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-06 01:21:12.328980 | mon1 | Friday 06 March 2026 01:21:12 +0000 (0:00:00.892) 0:00:15.628 ********** 2026-03-06 01:21:12.871909 | mon1 | changed: [mon1] 2026-03-06 01:21:12.871978 | mon1 | 2026-03-06 01:21:12.872573 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-06 01:21:12.872629 | mon1 | Friday 06 March 2026 01:21:12 +0000 (0:00:00.536) 0:00:16.165 ********** 2026-03-06 01:21:12.872635 | mon1 | 2026-03-06 01:21:12.872640 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-06 01:21:12.872645 | mon1 | Friday 06 March 2026 01:21:12 +0000 (0:00:00.006) 0:00:16.172 ********** 2026-03-06 01:21:13.741568 | mon1 | ok: [mon1] 2026-03-06 01:21:13.741812 | mon1 | 2026-03-06 01:21:13.741824 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-06 01:21:13.741964 | mon1 | Friday 06 March 2026 01:21:13 +0000 (0:00:00.869) 0:00:17.041 ********** 2026-03-06 01:21:14.217981 | mon1 | changed: [mon1] 2026-03-06 01:21:14.218087 | mon1 | 2026-03-06 01:21:14.218101 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-06 01:21:14.218246 | mon1 | Friday 06 March 2026 01:21:14 +0000 (0:00:00.476) 0:00:17.518 ********** 2026-03-06 01:21:14.745102 | mon1 | changed: [mon1] 2026-03-06 01:21:14.745165 | mon1 | 2026-03-06 01:21:14.745396 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:21:14.745449 | mon1 | Friday 06 March 2026 01:21:14 +0000 (0:00:00.527) 0:00:18.045 ********** 2026-03-06 01:21:14.950563 | mon1 | ok: [mon1] 2026-03-06 01:21:14.950659 | mon1 | 2026-03-06 01:21:14.950875 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:21:14.950986 | mon1 | Friday 06 March 2026 01:21:14 +0000 (0:00:00.205) 0:00:18.250 ********** 2026-03-06 01:21:15.016338 | mon1 | ok: [mon1] => { 2026-03-06 01:21:15.016422 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-06 01:21:15.016438 | mon1 | } 2026-03-06 01:21:15.016825 | mon1 | 2026-03-06 01:21:15.016884 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:21:15.016890 | mon1 | Friday 06 March 2026 01:21:15 +0000 (0:00:00.065) 0:00:18.316 ********** 2026-03-06 01:21:16.101910 | mon1 | changed: [mon1] 2026-03-06 01:21:16.102000 | mon1 | 2026-03-06 01:21:16.102389 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:21:16.102444 | mon1 | Friday 06 March 2026 01:21:16 +0000 (0:00:01.085) 0:00:19.402 ********** 2026-03-06 01:21:20.551576 | mon1 | changed: [mon1] 2026-03-06 01:21:20.551735 | mon1 | 2026-03-06 01:21:20.551749 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-06 01:21:20.551905 | mon1 | Friday 06 March 2026 01:21:20 +0000 (0:00:04.449) 0:00:23.851 ********** 2026-03-06 01:21:21.610314 | mon1 | ok: [mon1] 2026-03-06 01:21:21.610381 | mon1 | 2026-03-06 01:21:21.610462 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-06 01:21:21.610603 | mon1 | Friday 06 March 2026 01:21:21 +0000 (0:00:01.058) 0:00:24.910 ********** 2026-03-06 01:21:21.935523 | mon1 | changed: [mon1] 2026-03-06 01:21:21.935595 | mon1 | 2026-03-06 01:21:21.935648 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-06 01:21:21.935786 | mon1 | Friday 06 March 2026 01:21:21 +0000 (0:00:00.325) 0:00:25.236 ********** 2026-03-06 01:21:22.387967 | mon1 | changed: [mon1] 2026-03-06 01:21:22.388032 | mon1 | 2026-03-06 01:21:22.388099 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-06 01:21:22.388237 | mon1 | Friday 06 March 2026 01:21:22 +0000 (0:00:00.452) 0:00:25.688 ********** 2026-03-06 01:21:22.954636 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-06 01:21:22.954712 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-06 01:21:22.955103 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-06 01:21:22.955152 | mon1 | 2026-03-06 01:21:22.955157 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-06 01:21:22.955162 | mon1 | Friday 06 March 2026 01:21:22 +0000 (0:00:00.566) 0:00:26.255 ********** 2026-03-06 01:21:23.407597 | mon1 | changed: [mon1] 2026-03-06 01:21:23.407784 | mon1 | 2026-03-06 01:21:23.407797 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-06 01:21:23.407952 | mon1 | Friday 06 March 2026 01:21:23 +0000 (0:00:00.452) 0:00:26.708 ********** 2026-03-06 01:21:23.880137 | mon1 | changed: [mon1] 2026-03-06 01:21:23.880214 | mon1 | 2026-03-06 01:21:23.880822 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-06 01:21:23.880894 | mon1 | Friday 06 March 2026 01:21:23 +0000 (0:00:00.466) 0:00:27.174 ********** 2026-03-06 01:21:23.880906 | mon1 | 2026-03-06 01:21:23.880916 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-06 01:21:23.880944 | mon1 | Friday 06 March 2026 01:21:23 +0000 (0:00:00.006) 0:00:27.180 ********** 2026-03-06 01:21:24.546514 | mon1 | ok: [mon1] 2026-03-06 01:21:24.546625 | mon1 | 2026-03-06 01:21:24.546637 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-06 01:21:24.546774 | mon1 | Friday 06 March 2026 01:21:24 +0000 (0:00:00.666) 0:00:27.847 ********** 2026-03-06 01:21:26.048144 | mon1 | changed: [mon1] 2026-03-06 01:21:26.048220 | mon1 | 2026-03-06 01:21:26.048415 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-06 01:21:26.048618 | mon1 | Friday 06 March 2026 01:21:26 +0000 (0:00:01.501) 0:00:29.348 ********** 2026-03-06 01:21:26.574683 | mon1 | changed: [mon1] 2026-03-06 01:21:26.574795 | mon1 | 2026-03-06 01:21:26.574807 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-06 01:21:26.574963 | mon1 | Friday 06 March 2026 01:21:26 +0000 (0:00:00.526) 0:00:29.875 ********** 2026-03-06 01:21:26.624116 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-06 01:21:26.624144 | mon1 | 2026-03-06 01:21:26.624150 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-06 01:21:26.624155 | mon1 | Friday 06 March 2026 01:21:26 +0000 (0:00:00.049) 0:00:29.924 ********** 2026-03-06 01:21:58.663100 | mon1 | changed: [mon1] 2026-03-06 01:21:58.663188 | mon1 | 2026-03-06 01:21:58.663495 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-06 01:21:58.663547 | mon1 | Friday 06 March 2026 01:21:58 +0000 (0:00:32.038) 0:01:01.963 ********** 2026-03-06 01:21:59.322958 | mon1 | ok: [mon1] => (item=chronyd) 2026-03-06 01:21:59.323018 | mon1 | ok: [mon1] => (item=sshd) 2026-03-06 01:21:59.323104 | mon1 | 2026-03-06 01:21:59.323338 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-06 01:21:59.323382 | mon1 | Friday 06 March 2026 01:21:59 +0000 (0:00:00.660) 0:01:02.623 ********** 2026-03-06 01:21:59.599401 | mon1 | changed: [mon1] 2026-03-06 01:21:59.599507 | mon1 | 2026-03-06 01:21:59.599812 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-06 01:21:59.599861 | mon1 | Friday 06 March 2026 01:21:59 +0000 (0:00:00.276) 0:01:02.899 ********** 2026-03-06 01:21:59.785701 | mon1 | ok: [mon1] 2026-03-06 01:21:59.785753 | mon1 | 2026-03-06 01:21:59.785858 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-06 01:21:59.785993 | mon1 | Friday 06 March 2026 01:21:59 +0000 (0:00:00.186) 0:01:03.086 ********** 2026-03-06 01:22:01.138604 | mon1 | changed: [mon1] 2026-03-06 01:22:01.138698 | mon1 | 2026-03-06 01:22:01.138851 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-06 01:22:01.138868 | mon1 | Friday 06 March 2026 01:22:01 +0000 (0:00:01.352) 0:01:04.438 ********** 2026-03-06 01:22:01.531476 | mon1 | changed: [mon1] 2026-03-06 01:22:01.531585 | mon1 | 2026-03-06 01:22:01.531595 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-06 01:22:01.531734 | mon1 | Friday 06 March 2026 01:22:01 +0000 (0:00:00.393) 0:01:04.832 ********** 2026-03-06 01:22:01.649775 | mon1 | ok: [mon1] 2026-03-06 01:22:01.649846 | mon1 | 2026-03-06 01:22:01.650081 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-06 01:22:01.650177 | mon1 | Friday 06 March 2026 01:22:01 +0000 (0:00:00.117) 0:01:04.949 ********** 2026-03-06 01:22:01.855926 | mon1 | ok: [mon1] => (item=mon1) 2026-03-06 01:22:01.856033 | mon1 | 2026-03-06 01:22:01.856041 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-06 01:22:01.856194 | mon1 | Friday 06 March 2026 01:22:01 +0000 (0:00:00.206) 0:01:05.156 ********** 2026-03-06 01:22:01.901446 | mon1 | ok: [mon1] 2026-03-06 01:22:01.901521 | mon1 | 2026-03-06 01:22:01.901528 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-06 01:22:01.901533 | mon1 | Friday 06 March 2026 01:22:01 +0000 (0:00:00.044) 0:01:05.201 ********** 2026-03-06 01:22:02.019496 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-03-06 01:22:02.019578 | mon1 | 2026-03-06 01:22:02.019812 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-06 01:22:02.019876 | mon1 | Friday 06 March 2026 01:22:02 +0000 (0:00:00.118) 0:01:05.319 ********** 2026-03-06 01:22:02.318913 | mon1 | changed: [mon1] 2026-03-06 01:22:02.318957 | mon1 | 2026-03-06 01:22:02.318963 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-06 01:22:02.318968 | mon1 | Friday 06 March 2026 01:22:02 +0000 (0:00:00.299) 0:01:05.619 ********** 2026-03-06 01:22:02.989865 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-06 01:22:02.989939 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-06 01:22:02.990373 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-06 01:22:02.990458 | mon1 | 2026-03-06 01:22:02.990464 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-06 01:22:02.990470 | mon1 | Friday 06 March 2026 01:22:02 +0000 (0:00:00.671) 0:01:06.290 ********** 2026-03-06 01:25:44.659771 | mon1 | ok: [mon1] 2026-03-06 01:25:44.659873 | mon1 | 2026-03-06 01:25:44.659881 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-06 01:25:44.659890 | mon1 | Friday 06 March 2026 01:25:44 +0000 (0:03:41.669) 0:04:47.959 ********** 2026-03-06 01:25:44.886599 | mon1 | changed: [mon1] 2026-03-06 01:25:44.886723 | mon1 | 2026-03-06 01:25:44.886732 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-06 01:25:44.886814 | mon1 | Friday 06 March 2026 01:25:44 +0000 (0:00:00.227) 0:04:48.186 ********** 2026-03-06 01:25:44.926175 | mon1 | ok: [mon1] 2026-03-06 01:25:44.926266 | mon1 | 2026-03-06 01:25:44.926372 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-06 01:25:44.926512 | mon1 | Friday 06 March 2026 01:25:44 +0000 (0:00:00.039) 0:04:48.226 ********** 2026-03-06 01:25:45.002112 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-06 01:25:45.002220 | mon1 | 2026-03-06 01:25:45.002235 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-06 01:25:45.002258 | mon1 | Friday 06 March 2026 01:25:44 +0000 (0:00:00.075) 0:04:48.301 ********** 2026-03-06 01:25:50.428606 | mon1 | ok: [mon1] 2026-03-06 01:25:50.428757 | mon1 | 2026-03-06 01:25:50.428825 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-06 01:25:50.428911 | mon1 | Friday 06 March 2026 01:25:50 +0000 (0:00:05.427) 0:04:53.729 ********** 2026-03-06 01:25:50.479754 | mon1 | ok: [mon1] => (item=mon1) 2026-03-06 01:25:50.479841 | mon1 | 2026-03-06 01:25:50.479856 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-06 01:25:50.479967 | mon1 | Friday 06 March 2026 01:25:50 +0000 (0:00:00.051) 0:04:53.780 ********** 2026-03-06 01:25:50.840490 | mon1 | ok: [mon1] 2026-03-06 01:25:50.840673 | mon1 | 2026-03-06 01:25:50.840983 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-06 01:25:50.841209 | mon1 | Friday 06 March 2026 01:25:50 +0000 (0:00:00.360) 0:04:54.140 ********** 2026-03-06 01:25:57.478522 | mon1 | ok: [mon1] 2026-03-06 01:25:57.478683 | mon1 | 2026-03-06 01:25:57.478921 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-06 01:25:57.479139 | mon1 | Friday 06 March 2026 01:25:57 +0000 (0:00:06.638) 0:05:00.778 ********** 2026-03-06 01:26:09.397540 | mon1 | changed: [mon1] 2026-03-06 01:26:09.397615 | mon1 | 2026-03-06 01:26:09.397989 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-06 01:26:09.398079 | mon1 | Friday 06 March 2026 01:26:09 +0000 (0:00:11.918) 0:05:12.697 ********** 2026-03-06 01:26:26.545940 | mon1 | ok: [mon1] 2026-03-06 01:26:26.546027 | mon1 | 2026-03-06 01:26:26.546102 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-06 01:26:26.546272 | mon1 | Friday 06 March 2026 01:26:26 +0000 (0:00:17.148) 0:05:29.846 ********** 2026-03-06 01:26:26.617819 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-06 01:26:26.617899 | mon1 | 2026-03-06 01:26:26.617953 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-06 01:26:26.618081 | mon1 | Friday 06 March 2026 01:26:26 +0000 (0:00:00.071) 0:05:29.918 ********** 2026-03-06 01:26:26.662055 | mon1 | skipping: [mon1] 2026-03-06 01:26:26.662118 | mon1 | 2026-03-06 01:26:26.662371 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-06 01:26:26.662413 | mon1 | Friday 06 March 2026 01:26:26 +0000 (0:00:00.043) 0:05:29.961 ********** 2026-03-06 01:26:26.708115 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-06 01:26:26.708579 | mon1 | skipping: [mon1] 2026-03-06 01:26:26.708629 | mon1 | 2026-03-06 01:26:26.708635 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-06 01:26:26.708640 | mon1 | Friday 06 March 2026 01:26:26 +0000 (0:00:00.046) 0:05:30.008 ********** 2026-03-06 01:26:26.960652 | mon1 | ok: [mon1] 2026-03-06 01:26:26.960719 | mon1 | 2026-03-06 01:26:26.960937 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-06 01:26:26.960994 | mon1 | Friday 06 March 2026 01:26:26 +0000 (0:00:00.252) 0:05:30.261 ********** 2026-03-06 01:26:33.696836 | mon1 | ok: [mon1] 2026-03-06 01:26:33.696922 | mon1 | 2026-03-06 01:26:33.696935 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-06 01:26:33.696945 | mon1 | Friday 06 March 2026 01:26:33 +0000 (0:00:06.735) 0:05:36.996 ********** 2026-03-06 01:26:46.393195 | mon1 | changed: [mon1] 2026-03-06 01:26:46.393282 | mon1 | 2026-03-06 01:26:46.393335 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-06 01:26:46.393459 | mon1 | Friday 06 March 2026 01:26:46 +0000 (0:00:12.696) 0:05:49.693 ********** 2026-03-06 01:26:52.748552 | mon1 | ok: [mon1] 2026-03-06 01:26:52.748665 | mon1 | 2026-03-06 01:26:52.748831 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-06 01:26:52.748968 | mon1 | Friday 06 March 2026 01:26:52 +0000 (0:00:06.355) 0:05:56.048 ********** 2026-03-06 01:27:01.115741 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-06 01:27:01.115816 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-06 01:27:01.115828 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-03-06 01:27:01.115839 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-06 01:27:01.115850 | mon1 | 2026-03-06 01:27:01.115861 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-06 01:27:01.115871 | mon1 | 2026-03-06 01:27:01.115881 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-06 01:27:01.115891 | mon1 | Friday 06 March 2026 01:27:01 +0000 (0:00:08.365) 0:06:04.414 ********** 2026-03-06 01:27:02.161242 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-06 01:27:02.161447 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-06 01:27:02.161664 | mon1 | interpreter could change the meaning of that path. See 2026-03-06 01:27:02.161925 | mon1 | https://docs.ansible.com/ansible- 2026-03-06 01:27:02.162179 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-06 01:27:02.177403 | mon1 | ok: [osd1] 2026-03-06 01:27:02.177493 | mon1 | 2026-03-06 01:27:02.177615 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:27:02.177738 | mon1 | Friday 06 March 2026 01:27:02 +0000 (0:00:01.063) 0:06:05.478 ********** 2026-03-06 01:27:02.374202 | mon1 | ok: [osd1] 2026-03-06 01:27:02.374267 | mon1 | 2026-03-06 01:27:02.374386 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:27:02.374504 | mon1 | Friday 06 March 2026 01:27:02 +0000 (0:00:00.196) 0:06:05.674 ********** 2026-03-06 01:27:02.410208 | mon1 | skipping: [osd1] 2026-03-06 01:27:02.410283 | mon1 | 2026-03-06 01:27:02.410447 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-06 01:27:02.410572 | mon1 | Friday 06 March 2026 01:27:02 +0000 (0:00:00.036) 0:06:05.710 ********** 2026-03-06 01:27:02.623304 | mon1 | changed: [osd1] 2026-03-06 01:27:02.623368 | mon1 | 2026-03-06 01:27:02.623441 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:27:02.623538 | mon1 | Friday 06 March 2026 01:27:02 +0000 (0:00:00.213) 0:06:05.923 ********** 2026-03-06 01:27:02.688991 | mon1 | ok: [osd1] => { 2026-03-06 01:27:02.689108 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-06 01:27:02.689240 | mon1 | } 2026-03-06 01:27:02.689334 | mon1 | 2026-03-06 01:27:02.689426 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:27:02.689520 | mon1 | Friday 06 March 2026 01:27:02 +0000 (0:00:00.065) 0:06:05.989 ********** 2026-03-06 01:27:03.320397 | mon1 | changed: [osd1] 2026-03-06 01:27:03.320462 | mon1 | 2026-03-06 01:27:03.320542 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:27:03.320650 | mon1 | Friday 06 March 2026 01:27:03 +0000 (0:00:00.631) 0:06:06.620 ********** 2026-03-06 01:27:03.357111 | mon1 | skipping: [osd1] 2026-03-06 01:27:03.357171 | mon1 | 2026-03-06 01:27:03.357246 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:27:03.357374 | mon1 | Friday 06 March 2026 01:27:03 +0000 (0:00:00.036) 0:06:06.657 ********** 2026-03-06 01:27:03.396762 | mon1 | skipping: [osd1] 2026-03-06 01:27:03.396828 | mon1 | 2026-03-06 01:27:03.396897 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:27:03.396989 | mon1 | Friday 06 March 2026 01:27:03 +0000 (0:00:00.039) 0:06:06.697 ********** 2026-03-06 01:27:03.594770 | mon1 | ok: [osd1] 2026-03-06 01:27:03.594835 | mon1 | 2026-03-06 01:27:03.594923 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:27:03.595021 | mon1 | Friday 06 March 2026 01:27:03 +0000 (0:00:00.198) 0:06:06.895 ********** 2026-03-06 01:27:04.680250 | mon1 | ok: [osd1] 2026-03-06 01:27:04.680322 | mon1 | 2026-03-06 01:27:04.680396 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:27:04.680497 | mon1 | Friday 06 March 2026 01:27:04 +0000 (0:00:01.085) 0:06:07.980 ********** 2026-03-06 01:27:04.746532 | mon1 | ok: [osd1] => { 2026-03-06 01:27:04.746603 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-06 01:27:04.746730 | mon1 | } 2026-03-06 01:27:04.746853 | mon1 | 2026-03-06 01:27:04.747054 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:27:04.747224 | mon1 | Friday 06 March 2026 01:27:04 +0000 (0:00:00.066) 0:06:08.046 ********** 2026-03-06 01:27:05.946824 | mon1 | changed: [osd1] 2026-03-06 01:27:05.946915 | mon1 | 2026-03-06 01:27:05.946934 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:27:05.947083 | mon1 | Friday 06 March 2026 01:27:05 +0000 (0:00:01.199) 0:06:09.246 ********** 2026-03-06 01:27:08.598705 | mon1 | changed: [osd1] 2026-03-06 01:27:08.598804 | mon1 | 2026-03-06 01:27:08.598816 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-06 01:27:08.598827 | mon1 | Friday 06 March 2026 01:27:08 +0000 (0:00:02.651) 0:06:11.897 ********** 2026-03-06 01:27:08.624645 | mon1 | skipping: [osd1] 2026-03-06 01:27:08.624737 | mon1 | 2026-03-06 01:27:08.624746 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-06 01:27:08.624753 | mon1 | Friday 06 March 2026 01:27:08 +0000 (0:00:00.026) 0:06:11.924 ********** 2026-03-06 01:27:08.654722 | mon1 | skipping: [osd1] 2026-03-06 01:27:08.654814 | mon1 | 2026-03-06 01:27:08.655142 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-06 01:27:08.655163 | mon1 | Friday 06 March 2026 01:27:08 +0000 (0:00:00.030) 0:06:11.955 ********** 2026-03-06 01:27:08.682206 | mon1 | skipping: [osd1] 2026-03-06 01:27:08.682264 | mon1 | 2026-03-06 01:27:08.682373 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-06 01:27:08.682507 | mon1 | Friday 06 March 2026 01:27:08 +0000 (0:00:00.027) 0:06:11.982 ********** 2026-03-06 01:27:14.571734 | mon1 | changed: [osd1] 2026-03-06 01:27:14.571866 | mon1 | 2026-03-06 01:27:14.571888 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-06 01:27:14.572102 | mon1 | Friday 06 March 2026 01:27:14 +0000 (0:00:05.889) 0:06:17.872 ********** 2026-03-06 01:27:15.031035 | mon1 | changed: [osd1] 2026-03-06 01:27:15.031209 | mon1 | 2026-03-06 01:27:15.031233 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-06 01:27:15.031253 | mon1 | Friday 06 March 2026 01:27:15 +0000 (0:00:00.459) 0:06:18.331 ********** 2026-03-06 01:27:15.964852 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-06 01:27:15.964984 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-06 01:27:15.965003 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-06 01:27:15.965181 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-06 01:27:15.965328 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-06 01:27:15.965484 | mon1 | 2026-03-06 01:27:15.965664 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-06 01:27:15.965807 | mon1 | Friday 06 March 2026 01:27:15 +0000 (0:00:00.933) 0:06:19.265 ********** 2026-03-06 01:27:16.483014 | mon1 | changed: [osd1] 2026-03-06 01:27:16.483116 | mon1 | 2026-03-06 01:27:16.483129 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-06 01:27:16.483216 | mon1 | Friday 06 March 2026 01:27:16 +0000 (0:00:00.511) 0:06:19.776 ********** 2026-03-06 01:27:16.483295 | mon1 | 2026-03-06 01:27:16.483393 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-06 01:27:16.483489 | mon1 | Friday 06 March 2026 01:27:16 +0000 (0:00:00.006) 0:06:19.783 ********** 2026-03-06 01:27:17.138217 | mon1 | ok: [osd1] 2026-03-06 01:27:17.138338 | mon1 | 2026-03-06 01:27:17.138377 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-06 01:27:17.138582 | mon1 | Friday 06 March 2026 01:27:17 +0000 (0:00:00.655) 0:06:20.438 ********** 2026-03-06 01:27:17.569289 | mon1 | changed: [osd1] 2026-03-06 01:27:17.569393 | mon1 | 2026-03-06 01:27:17.569405 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-06 01:27:17.569491 | mon1 | Friday 06 March 2026 01:27:17 +0000 (0:00:00.431) 0:06:20.869 ********** 2026-03-06 01:27:18.100584 | mon1 | changed: [osd1] 2026-03-06 01:27:18.100726 | mon1 | 2026-03-06 01:27:18.100740 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:27:18.100789 | mon1 | Friday 06 March 2026 01:27:18 +0000 (0:00:00.531) 0:06:21.401 ********** 2026-03-06 01:27:18.311518 | mon1 | ok: [osd1] 2026-03-06 01:27:18.311623 | mon1 | 2026-03-06 01:27:18.311718 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:27:18.311861 | mon1 | Friday 06 March 2026 01:27:18 +0000 (0:00:00.210) 0:06:21.611 ********** 2026-03-06 01:27:18.371731 | mon1 | ok: [osd1] => { 2026-03-06 01:27:18.371831 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-06 01:27:18.371846 | mon1 | } 2026-03-06 01:27:18.371964 | mon1 | 2026-03-06 01:27:18.372059 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:27:18.372170 | mon1 | Friday 06 March 2026 01:27:18 +0000 (0:00:00.060) 0:06:21.672 ********** 2026-03-06 01:27:19.206640 | mon1 | changed: [osd1] 2026-03-06 01:27:19.206714 | mon1 | 2026-03-06 01:27:19.206771 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:27:19.206879 | mon1 | Friday 06 March 2026 01:27:19 +0000 (0:00:00.835) 0:06:22.507 ********** 2026-03-06 01:27:23.563086 | mon1 | changed: [osd1] 2026-03-06 01:27:23.563159 | mon1 | 2026-03-06 01:27:23.563172 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-06 01:27:23.563182 | mon1 | Friday 06 March 2026 01:27:23 +0000 (0:00:04.355) 0:06:26.862 ********** 2026-03-06 01:27:24.544608 | mon1 | ok: [osd1] 2026-03-06 01:27:24.544682 | mon1 | 2026-03-06 01:27:24.545046 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-06 01:27:24.545102 | mon1 | Friday 06 March 2026 01:27:24 +0000 (0:00:00.981) 0:06:27.844 ********** 2026-03-06 01:27:24.775306 | mon1 | changed: [osd1] 2026-03-06 01:27:24.775390 | mon1 | 2026-03-06 01:27:24.775636 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-06 01:27:24.775686 | mon1 | Friday 06 March 2026 01:27:24 +0000 (0:00:00.230) 0:06:28.075 ********** 2026-03-06 01:27:25.232779 | mon1 | changed: [osd1] 2026-03-06 01:27:25.232855 | mon1 | 2026-03-06 01:27:25.233173 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-06 01:27:25.233223 | mon1 | Friday 06 March 2026 01:27:25 +0000 (0:00:00.457) 0:06:28.532 ********** 2026-03-06 01:27:25.762214 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-03-06 01:27:25.762322 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-06 01:27:25.762822 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-06 01:27:25.762844 | mon1 | 2026-03-06 01:27:25.762851 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-06 01:27:25.762858 | mon1 | Friday 06 March 2026 01:27:25 +0000 (0:00:00.529) 0:06:29.062 ********** 2026-03-06 01:27:26.201855 | mon1 | changed: [osd1] 2026-03-06 01:27:26.201937 | mon1 | 2026-03-06 01:27:26.202062 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-06 01:27:26.202215 | mon1 | Friday 06 March 2026 01:27:26 +0000 (0:00:00.439) 0:06:29.502 ********** 2026-03-06 01:27:26.655369 | mon1 | changed: [osd1] 2026-03-06 01:27:26.655445 | mon1 | 2026-03-06 01:27:26.655514 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-06 01:27:26.655908 | mon1 | Friday 06 March 2026 01:27:26 +0000 (0:00:00.447) 0:06:29.949 ********** 2026-03-06 01:27:26.655950 | mon1 | 2026-03-06 01:27:26.655956 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-06 01:27:26.655961 | mon1 | Friday 06 March 2026 01:27:26 +0000 (0:00:00.005) 0:06:29.955 ********** 2026-03-06 01:27:27.316303 | mon1 | ok: [osd1] 2026-03-06 01:27:27.316413 | mon1 | 2026-03-06 01:27:27.316789 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-06 01:27:27.316850 | mon1 | Friday 06 March 2026 01:27:27 +0000 (0:00:00.660) 0:06:30.616 ********** 2026-03-06 01:27:29.036993 | mon1 | changed: [osd1] 2026-03-06 01:27:29.037054 | mon1 | 2026-03-06 01:27:29.037399 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-06 01:27:29.037446 | mon1 | Friday 06 March 2026 01:27:29 +0000 (0:00:01.720) 0:06:32.337 ********** 2026-03-06 01:27:29.581222 | mon1 | changed: [osd1] 2026-03-06 01:27:29.581264 | mon1 | 2026-03-06 01:27:29.581270 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-06 01:27:29.581274 | mon1 | Friday 06 March 2026 01:27:29 +0000 (0:00:00.544) 0:06:32.881 ********** 2026-03-06 01:27:29.614783 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-06 01:27:29.614827 | mon1 | 2026-03-06 01:27:29.614833 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-06 01:27:29.614837 | mon1 | Friday 06 March 2026 01:27:29 +0000 (0:00:00.033) 0:06:32.915 ********** 2026-03-06 01:27:34.904886 | mon1 | changed: [osd1] 2026-03-06 01:27:34.904963 | mon1 | 2026-03-06 01:27:34.905330 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-06 01:27:34.905391 | mon1 | Friday 06 March 2026 01:27:34 +0000 (0:00:05.290) 0:06:38.205 ********** 2026-03-06 01:27:35.550225 | mon1 | ok: [osd1] => (item=chronyd) 2026-03-06 01:27:35.550307 | mon1 | ok: [osd1] => (item=sshd) 2026-03-06 01:27:35.550713 | mon1 | 2026-03-06 01:27:35.550766 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-06 01:27:35.550774 | mon1 | Friday 06 March 2026 01:27:35 +0000 (0:00:00.645) 0:06:38.850 ********** 2026-03-06 01:27:36.413794 | mon1 | changed: [osd1] 2026-03-06 01:27:36.413858 | mon1 | 2026-03-06 01:27:36.414027 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-06 01:27:36.414042 | mon1 | Friday 06 March 2026 01:27:36 +0000 (0:00:00.863) 0:06:39.714 ********** 2026-03-06 01:27:36.606570 | mon1 | ok: [osd1] 2026-03-06 01:27:36.609979 | mon1 | 2026-03-06 01:27:36.609997 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-06 01:27:36.610005 | mon1 | Friday 06 March 2026 01:27:36 +0000 (0:00:00.192) 0:06:39.907 ********** 2026-03-06 01:27:36.900258 | mon1 | changed: [osd1] 2026-03-06 01:27:36.900795 | mon1 | 2026-03-06 01:27:36.900860 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-06 01:27:36.900961 | mon1 | Friday 06 March 2026 01:27:36 +0000 (0:00:00.293) 0:06:40.200 ********** 2026-03-06 01:27:37.110725 | mon1 | changed: [osd1] 2026-03-06 01:27:37.110951 | mon1 | 2026-03-06 01:27:37.111179 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-06 01:27:37.111227 | mon1 | Friday 06 March 2026 01:27:37 +0000 (0:00:00.210) 0:06:40.411 ********** 2026-03-06 01:27:37.316363 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-06 01:27:37.316434 | mon1 | 2026-03-06 01:27:37.316656 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-06 01:27:37.316735 | mon1 | Friday 06 March 2026 01:27:37 +0000 (0:00:00.205) 0:06:40.616 ********** 2026-03-06 01:27:37.360842 | mon1 | ok: [osd1] 2026-03-06 01:27:37.360904 | mon1 | 2026-03-06 01:27:37.361159 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-06 01:27:37.361207 | mon1 | Friday 06 March 2026 01:27:37 +0000 (0:00:00.044) 0:06:40.661 ********** 2026-03-06 01:27:37.416027 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-06 01:27:37.416434 | mon1 | 2026-03-06 01:27:37.416483 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-06 01:27:37.416491 | mon1 | Friday 06 March 2026 01:27:37 +0000 (0:00:00.055) 0:06:40.716 ********** 2026-03-06 01:27:43.640191 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:27:43.640267 | mon1 | 2026-03-06 01:27:43.640633 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-06 01:27:43.640724 | mon1 | Friday 06 March 2026 01:27:43 +0000 (0:00:06.223) 0:06:46.940 ********** 2026-03-06 01:27:43.682577 | mon1 | ok: [osd1] => (item=osd1) 2026-03-06 01:27:43.683100 | mon1 | 2026-03-06 01:27:43.683129 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-06 01:27:43.683140 | mon1 | Friday 06 March 2026 01:27:43 +0000 (0:00:00.042) 0:06:46.983 ********** 2026-03-06 01:27:43.929747 | mon1 | changed: [osd1] 2026-03-06 01:27:43.929806 | mon1 | 2026-03-06 01:27:43.929893 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-06 01:27:43.929991 | mon1 | Friday 06 March 2026 01:27:43 +0000 (0:00:00.247) 0:06:47.230 ********** 2026-03-06 01:27:54.188600 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:27:54.188663 | mon1 | 2026-03-06 01:27:54.188672 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-06 01:27:54.188679 | mon1 | Friday 06 March 2026 01:27:54 +0000 (0:00:10.258) 0:06:57.488 ********** 2026-03-06 01:27:55.718142 | mon1 | ok: [osd1] 2026-03-06 01:27:55.718217 | mon1 | 2026-03-06 01:27:55.718443 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-06 01:27:55.718489 | mon1 | Friday 06 March 2026 01:27:55 +0000 (0:00:01.530) 0:06:59.018 ********** 2026-03-06 01:28:48.966509 | mon1 | ok: [osd1] 2026-03-06 01:28:48.966584 | mon1 | 2026-03-06 01:28:48.966928 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-06 01:28:48.966998 | mon1 | Friday 06 March 2026 01:28:48 +0000 (0:00:53.248) 0:07:52.266 ********** 2026-03-06 01:30:47.257251 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-03-06 01:30:47.257379 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-03-06 01:30:47.257391 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-03-06 01:30:47.257403 | mon1 | 2026-03-06 01:30:47.257662 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-06 01:30:47.257718 | mon1 | Friday 06 March 2026 01:30:47 +0000 (0:01:58.290) 0:09:50.557 ********** 2026-03-06 01:30:53.545968 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:30:53.546082 | mon1 | 2026-03-06 01:30:53.546095 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-06 01:30:53.546235 | mon1 | Friday 06 March 2026 01:30:53 +0000 (0:00:06.288) 0:09:56.846 ********** 2026-03-06 01:30:59.803037 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:30:59.803145 | mon1 | 2026-03-06 01:30:59.803154 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-06 01:30:59.803295 | mon1 | Friday 06 March 2026 01:30:59 +0000 (0:00:06.257) 0:10:03.103 ********** 2026-03-06 01:30:59.857210 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-06 01:30:59.857284 | mon1 | 2026-03-06 01:30:59.857516 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-06 01:30:59.857587 | mon1 | Friday 06 March 2026 01:30:59 +0000 (0:00:00.053) 0:10:03.157 ********** 2026-03-06 01:30:59.896247 | mon1 | ok: [osd1] 2026-03-06 01:30:59.896306 | mon1 | 2026-03-06 01:30:59.896568 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-06 01:30:59.896625 | mon1 | Friday 06 March 2026 01:30:59 +0000 (0:00:00.039) 0:10:03.196 ********** 2026-03-06 01:31:06.098714 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:31:06.098785 | mon1 | 2026-03-06 01:31:06.098866 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-06 01:31:06.099004 | mon1 | Friday 06 March 2026 01:31:06 +0000 (0:00:06.202) 0:10:09.399 ********** 2026-03-06 01:31:06.136191 | mon1 | ok: [osd1] 2026-03-06 01:31:06.136640 | mon1 | 2026-03-06 01:31:06.136664 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-06 01:31:06.136670 | mon1 | Friday 06 March 2026 01:31:06 +0000 (0:00:00.037) 0:10:09.436 ********** 2026-03-06 01:31:06.180065 | mon1 | skipping: [osd1] => (item=1) 2026-03-06 01:31:06.180191 | mon1 | skipping: [osd1] => (item=1) 2026-03-06 01:31:06.180716 | mon1 | skipping: [osd1] => (item=1) 2026-03-06 01:31:06.180763 | mon1 | skipping: [osd1] 2026-03-06 01:31:06.180768 | mon1 | 2026-03-06 01:31:06.180773 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-06 01:31:06.180778 | mon1 | Friday 06 March 2026 01:31:06 +0000 (0:00:00.044) 0:10:09.480 ********** 2026-03-06 01:31:06.210414 | mon1 | skipping: [osd1] 2026-03-06 01:31:06.210482 | mon1 | 2026-03-06 01:31:06.210597 | mon1 | PLAY RECAP ********************************************************************* 2026-03-06 01:31:06.212846 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-06 01:31:06.212887 | mon1 | osd1 : ok=53 changed=24 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-06 01:31:06.212899 | mon1 | 2026-03-06 01:31:06.212908 | mon1 | 2026-03-06 01:31:06.212918 | mon1 | TASKS RECAP ******************************************************************** 2026-03-06 01:31:06.212927 | mon1 | Friday 06 March 2026 01:31:06 +0000 (0:00:00.030) 0:10:09.511 ********** 2026-03-06 01:31:06.212936 | mon1 | =============================================================================== 2026-03-06 01:31:06.212965 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 221.67s 2026-03-06 01:31:06.212974 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 118.29s 2026-03-06 01:31:06.212984 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 53.25s 2026-03-06 01:31:06.212993 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 32.04s 2026-03-06 01:31:06.213002 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 17.15s 2026-03-06 01:31:06.213011 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.70s 2026-03-06 01:31:06.213020 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 11.92s 2026-03-06 01:31:06.213032 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 10.26s 2026-03-06 01:31:06.213045 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.37s 2026-03-06 01:31:06.213058 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.74s 2026-03-06 01:31:06.213071 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.64s 2026-03-06 01:31:06.213081 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.41s 2026-03-06 01:31:06.213091 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.36s 2026-03-06 01:31:06.213099 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.29s 2026-03-06 01:31:06.213108 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.26s 2026-03-06 01:31:06.213117 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.22s 2026-03-06 01:31:06.213126 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.20s 2026-03-06 01:31:06.213140 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.89s 2026-03-06 01:31:06.213150 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.43s 2026-03-06 01:31:06.213159 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.29s 2026-03-06 01:31:06.322715 | mon1 | INFO [default > converge] Executed: Successful 2026-03-06 01:31:06.329391 | mon1 | INFO [default > idempotence] Executing 2026-03-06 01:31:07.134119 | mon1 | 2026-03-06 01:31:07.134454 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-06 01:31:07.134703 | mon1 | 2026-03-06 01:31:07.134964 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-06 01:31:07.135225 | mon1 | Friday 06 March 2026 01:31:07 +0000 (0:00:00.046) 0:00:00.046 ********** 2026-03-06 01:31:08.287279 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-06 01:31:08.287337 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-06 01:31:08.287349 | mon1 | interpreter could change the meaning of that path. See 2026-03-06 01:31:08.287359 | mon1 | https://docs.ansible.com/ansible- 2026-03-06 01:31:08.287368 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-06 01:31:08.299925 | mon1 | ok: [mon1] 2026-03-06 01:31:08.299957 | mon1 | 2026-03-06 01:31:08.299967 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:31:08.299977 | mon1 | Friday 06 March 2026 01:31:08 +0000 (0:00:01.165) 0:00:01.211 ********** 2026-03-06 01:31:08.576757 | mon1 | ok: [mon1] 2026-03-06 01:31:08.576930 | mon1 | 2026-03-06 01:31:08.576936 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:31:08.576946 | mon1 | Friday 06 March 2026 01:31:08 +0000 (0:00:00.276) 0:00:01.488 ********** 2026-03-06 01:31:08.600747 | mon1 | skipping: [mon1] 2026-03-06 01:31:08.600798 | mon1 | 2026-03-06 01:31:08.600810 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-06 01:31:08.600820 | mon1 | Friday 06 March 2026 01:31:08 +0000 (0:00:00.024) 0:00:01.512 ********** 2026-03-06 01:31:08.913028 | mon1 | ok: [mon1] 2026-03-06 01:31:08.913091 | mon1 | 2026-03-06 01:31:08.913102 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:31:08.913124 | mon1 | Friday 06 March 2026 01:31:08 +0000 (0:00:00.311) 0:00:01.824 ********** 2026-03-06 01:31:08.976850 | mon1 | ok: [mon1] => { 2026-03-06 01:31:08.976911 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-06 01:31:08.976923 | mon1 | } 2026-03-06 01:31:08.976933 | mon1 | 2026-03-06 01:31:08.976948 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:31:08.977091 | mon1 | Friday 06 March 2026 01:31:08 +0000 (0:00:00.063) 0:00:01.888 ********** 2026-03-06 01:31:09.381642 | mon1 | ok: [mon1] 2026-03-06 01:31:09.381689 | mon1 | 2026-03-06 01:31:09.381696 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:31:09.381703 | mon1 | Friday 06 March 2026 01:31:09 +0000 (0:00:00.405) 0:00:02.293 ********** 2026-03-06 01:31:09.424597 | mon1 | skipping: [mon1] 2026-03-06 01:31:09.424641 | mon1 | 2026-03-06 01:31:09.424647 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:31:09.424652 | mon1 | Friday 06 March 2026 01:31:09 +0000 (0:00:00.043) 0:00:02.337 ********** 2026-03-06 01:31:09.465222 | mon1 | skipping: [mon1] 2026-03-06 01:31:09.465269 | mon1 | 2026-03-06 01:31:09.465274 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:31:09.465279 | mon1 | Friday 06 March 2026 01:31:09 +0000 (0:00:00.040) 0:00:02.377 ********** 2026-03-06 01:31:09.666075 | mon1 | ok: [mon1] 2026-03-06 01:31:09.666135 | mon1 | 2026-03-06 01:31:09.666270 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:31:09.666420 | mon1 | Friday 06 March 2026 01:31:09 +0000 (0:00:00.201) 0:00:02.578 ********** 2026-03-06 01:31:10.771347 | mon1 | ok: [mon1] 2026-03-06 01:31:10.771423 | mon1 | 2026-03-06 01:31:10.771497 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:31:10.771630 | mon1 | Friday 06 March 2026 01:31:10 +0000 (0:00:01.105) 0:00:03.683 ********** 2026-03-06 01:31:10.840190 | mon1 | ok: [mon1] => { 2026-03-06 01:31:10.840710 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-06 01:31:10.840761 | mon1 | } 2026-03-06 01:31:10.840767 | mon1 | 2026-03-06 01:31:10.840772 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:31:10.840777 | mon1 | Friday 06 March 2026 01:31:10 +0000 (0:00:00.068) 0:00:03.752 ********** 2026-03-06 01:31:11.164797 | mon1 | ok: [mon1] 2026-03-06 01:31:11.164870 | mon1 | 2026-03-06 01:31:11.165073 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:31:11.165277 | mon1 | Friday 06 March 2026 01:31:11 +0000 (0:00:00.324) 0:00:04.077 ********** 2026-03-06 01:31:13.342803 | mon1 | ok: [mon1] 2026-03-06 01:31:13.342877 | mon1 | 2026-03-06 01:31:13.343060 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-06 01:31:13.343105 | mon1 | Friday 06 March 2026 01:31:13 +0000 (0:00:02.178) 0:00:06.255 ********** 2026-03-06 01:31:13.374479 | mon1 | skipping: [mon1] 2026-03-06 01:31:13.374542 | mon1 | 2026-03-06 01:31:13.374630 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-06 01:31:13.374743 | mon1 | Friday 06 March 2026 01:31:13 +0000 (0:00:00.031) 0:00:06.287 ********** 2026-03-06 01:31:13.405012 | mon1 | skipping: [mon1] 2026-03-06 01:31:13.405450 | mon1 | 2026-03-06 01:31:13.405501 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-06 01:31:13.405509 | mon1 | Friday 06 March 2026 01:31:13 +0000 (0:00:00.030) 0:00:06.317 ********** 2026-03-06 01:31:13.434834 | mon1 | skipping: [mon1] 2026-03-06 01:31:13.434913 | mon1 | 2026-03-06 01:31:13.435182 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-06 01:31:13.435211 | mon1 | Friday 06 March 2026 01:31:13 +0000 (0:00:00.030) 0:00:06.347 ********** 2026-03-06 01:31:14.501278 | mon1 | ok: [mon1] 2026-03-06 01:31:14.501358 | mon1 | 2026-03-06 01:31:14.501678 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-06 01:31:14.501726 | mon1 | Friday 06 March 2026 01:31:14 +0000 (0:00:01.066) 0:00:07.413 ********** 2026-03-06 01:31:14.920243 | mon1 | ok: [mon1] 2026-03-06 01:31:14.920681 | mon1 | 2026-03-06 01:31:14.920756 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-06 01:31:14.920766 | mon1 | Friday 06 March 2026 01:31:14 +0000 (0:00:00.418) 0:00:07.832 ********** 2026-03-06 01:31:15.871382 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-06 01:31:15.871464 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-06 01:31:15.872443 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-06 01:31:15.872536 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-06 01:31:15.872546 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-06 01:31:15.872554 | mon1 | 2026-03-06 01:31:15.872561 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-06 01:31:15.872568 | mon1 | Friday 06 March 2026 01:31:15 +0000 (0:00:00.950) 0:00:08.783 ********** 2026-03-06 01:31:16.386640 | mon1 | ok: [mon1] 2026-03-06 01:31:16.386700 | mon1 | 2026-03-06 01:31:16.386712 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-06 01:31:16.386722 | mon1 | Friday 06 March 2026 01:31:16 +0000 (0:00:00.507) 0:00:09.290 ********** 2026-03-06 01:31:16.386732 | mon1 | 2026-03-06 01:31:16.386741 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-06 01:31:16.386750 | mon1 | Friday 06 March 2026 01:31:16 +0000 (0:00:00.006) 0:00:09.297 ********** 2026-03-06 01:31:16.983532 | mon1 | ok: [mon1] 2026-03-06 01:31:16.983603 | mon1 | 2026-03-06 01:31:16.983850 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:31:16.983933 | mon1 | Friday 06 March 2026 01:31:16 +0000 (0:00:00.598) 0:00:09.895 ********** 2026-03-06 01:31:17.187616 | mon1 | ok: [mon1] 2026-03-06 01:31:17.187730 | mon1 | 2026-03-06 01:31:17.187744 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:31:17.187877 | mon1 | Friday 06 March 2026 01:31:17 +0000 (0:00:00.204) 0:00:10.099 ********** 2026-03-06 01:31:17.259419 | mon1 | ok: [mon1] => { 2026-03-06 01:31:17.260194 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-06 01:31:17.260280 | mon1 | } 2026-03-06 01:31:17.260288 | mon1 | 2026-03-06 01:31:17.260295 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:31:17.260302 | mon1 | Friday 06 March 2026 01:31:17 +0000 (0:00:00.071) 0:00:10.171 ********** 2026-03-06 01:31:17.611918 | mon1 | ok: [mon1] 2026-03-06 01:31:17.612000 | mon1 | 2026-03-06 01:31:17.612330 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:31:17.612373 | mon1 | Friday 06 March 2026 01:31:17 +0000 (0:00:00.352) 0:00:10.524 ********** 2026-03-06 01:31:20.657777 | mon1 | ok: [mon1] 2026-03-06 01:31:20.657850 | mon1 | 2026-03-06 01:31:20.657914 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-06 01:31:20.658042 | mon1 | Friday 06 March 2026 01:31:20 +0000 (0:00:03.045) 0:00:13.570 ********** 2026-03-06 01:31:21.695320 | mon1 | ok: [mon1] 2026-03-06 01:31:21.695432 | mon1 | 2026-03-06 01:31:21.695695 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-06 01:31:21.695754 | mon1 | Friday 06 March 2026 01:31:21 +0000 (0:00:01.037) 0:00:14.607 ********** 2026-03-06 01:31:21.984347 | mon1 | ok: [mon1] 2026-03-06 01:31:21.984437 | mon1 | 2026-03-06 01:31:21.984634 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-06 01:31:21.984678 | mon1 | Friday 06 March 2026 01:31:21 +0000 (0:00:00.289) 0:00:14.896 ********** 2026-03-06 01:31:22.413097 | mon1 | ok: [mon1] 2026-03-06 01:31:22.413525 | mon1 | 2026-03-06 01:31:22.413581 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-06 01:31:22.413589 | mon1 | Friday 06 March 2026 01:31:22 +0000 (0:00:00.428) 0:00:15.325 ********** 2026-03-06 01:31:22.931796 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-03-06 01:31:22.931856 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-06 01:31:22.932445 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-06 01:31:22.932495 | mon1 | 2026-03-06 01:31:22.932503 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-06 01:31:22.932510 | mon1 | Friday 06 March 2026 01:31:22 +0000 (0:00:00.518) 0:00:15.844 ********** 2026-03-06 01:31:23.355589 | mon1 | ok: [mon1] 2026-03-06 01:31:23.355703 | mon1 | 2026-03-06 01:31:23.356046 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-06 01:31:23.356102 | mon1 | Friday 06 March 2026 01:31:23 +0000 (0:00:00.423) 0:00:16.267 ********** 2026-03-06 01:31:23.768133 | mon1 | ok: [mon1] 2026-03-06 01:31:23.768223 | mon1 | 2026-03-06 01:31:23.768327 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-06 01:31:23.768745 | mon1 | Friday 06 March 2026 01:31:23 +0000 (0:00:00.404) 0:00:16.672 ********** 2026-03-06 01:31:23.768789 | mon1 | 2026-03-06 01:31:23.768794 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-06 01:31:23.768799 | mon1 | Friday 06 March 2026 01:31:23 +0000 (0:00:00.008) 0:00:16.680 ********** 2026-03-06 01:31:24.120351 | mon1 | ok: [mon1] 2026-03-06 01:31:24.120410 | mon1 | 2026-03-06 01:31:24.120421 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-06 01:31:24.120431 | mon1 | Friday 06 March 2026 01:31:24 +0000 (0:00:00.351) 0:00:17.032 ********** 2026-03-06 01:31:24.159134 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-06 01:31:24.159206 | mon1 | 2026-03-06 01:31:24.159218 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-06 01:31:24.159227 | mon1 | Friday 06 March 2026 01:31:24 +0000 (0:00:00.038) 0:00:17.070 ********** 2026-03-06 01:31:25.292834 | mon1 | ok: [mon1] 2026-03-06 01:31:25.292921 | mon1 | 2026-03-06 01:31:25.293559 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-06 01:31:25.293768 | mon1 | Friday 06 March 2026 01:31:25 +0000 (0:00:01.133) 0:00:18.204 ********** 2026-03-06 01:31:26.022849 | mon1 | ok: [mon1] => (item=chronyd) 2026-03-06 01:31:26.022915 | mon1 | ok: [mon1] => (item=sshd) 2026-03-06 01:31:26.022927 | mon1 | 2026-03-06 01:31:26.022938 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-06 01:31:26.022949 | mon1 | Friday 06 March 2026 01:31:26 +0000 (0:00:00.729) 0:00:18.934 ********** 2026-03-06 01:31:26.309548 | mon1 | ok: [mon1] 2026-03-06 01:31:26.309604 | mon1 | 2026-03-06 01:31:26.309616 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-06 01:31:26.309627 | mon1 | Friday 06 March 2026 01:31:26 +0000 (0:00:00.286) 0:00:19.220 ********** 2026-03-06 01:31:26.507644 | mon1 | ok: [mon1] 2026-03-06 01:31:26.507697 | mon1 | 2026-03-06 01:31:26.507705 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-06 01:31:26.507711 | mon1 | Friday 06 March 2026 01:31:26 +0000 (0:00:00.198) 0:00:19.419 ********** 2026-03-06 01:31:26.928853 | mon1 | ok: [mon1] 2026-03-06 01:31:26.928916 | mon1 | 2026-03-06 01:31:26.928928 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-06 01:31:26.928945 | mon1 | Friday 06 March 2026 01:31:26 +0000 (0:00:00.420) 0:00:19.840 ********** 2026-03-06 01:31:27.241683 | mon1 | ok: [mon1] 2026-03-06 01:31:27.241735 | mon1 | 2026-03-06 01:31:27.241743 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-06 01:31:27.241749 | mon1 | Friday 06 March 2026 01:31:27 +0000 (0:00:00.313) 0:00:20.153 ********** 2026-03-06 01:31:27.310481 | mon1 | ok: [mon1] 2026-03-06 01:31:27.310530 | mon1 | 2026-03-06 01:31:27.310538 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-06 01:31:27.310543 | mon1 | Friday 06 March 2026 01:31:27 +0000 (0:00:00.068) 0:00:20.222 ********** 2026-03-06 01:31:27.518173 | mon1 | ok: [mon1] => (item=mon1) 2026-03-06 01:31:27.518221 | mon1 | 2026-03-06 01:31:27.518228 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-06 01:31:27.518235 | mon1 | Friday 06 March 2026 01:31:27 +0000 (0:00:00.207) 0:00:20.430 ********** 2026-03-06 01:31:27.558367 | mon1 | ok: [mon1] 2026-03-06 01:31:27.558804 | mon1 | 2026-03-06 01:31:27.558859 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-06 01:31:27.558867 | mon1 | Friday 06 March 2026 01:31:27 +0000 (0:00:00.040) 0:00:20.470 ********** 2026-03-06 01:31:27.596740 | mon1 | skipping: [mon1] 2026-03-06 01:31:27.596781 | mon1 | 2026-03-06 01:31:27.597023 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-06 01:31:27.597056 | mon1 | Friday 06 March 2026 01:31:27 +0000 (0:00:00.038) 0:00:20.509 ********** 2026-03-06 01:31:27.662277 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-06 01:31:27.662340 | mon1 | 2026-03-06 01:31:27.662530 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-06 01:31:27.662571 | mon1 | Friday 06 March 2026 01:31:27 +0000 (0:00:00.065) 0:00:20.574 ********** 2026-03-06 01:31:33.992838 | mon1 | ok: [mon1] 2026-03-06 01:31:33.992919 | mon1 | 2026-03-06 01:31:33.993192 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-06 01:31:33.993244 | mon1 | Friday 06 March 2026 01:31:33 +0000 (0:00:06.330) 0:00:26.905 ********** 2026-03-06 01:31:34.036591 | mon1 | ok: [mon1] => (item=mon1) 2026-03-06 01:31:34.036652 | mon1 | 2026-03-06 01:31:34.036875 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-06 01:31:34.036939 | mon1 | Friday 06 March 2026 01:31:34 +0000 (0:00:00.043) 0:00:26.949 ********** 2026-03-06 01:31:34.422747 | mon1 | ok: [mon1] 2026-03-06 01:31:34.422818 | mon1 | 2026-03-06 01:31:34.423144 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-06 01:31:34.423197 | mon1 | Friday 06 March 2026 01:31:34 +0000 (0:00:00.385) 0:00:27.335 ********** 2026-03-06 01:31:41.027733 | mon1 | ok: [mon1] 2026-03-06 01:31:41.027809 | mon1 | 2026-03-06 01:31:41.027887 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-06 01:31:41.027988 | mon1 | Friday 06 March 2026 01:31:41 +0000 (0:00:06.604) 0:00:33.940 ********** 2026-03-06 01:31:47.332201 | mon1 | ok: [mon1] 2026-03-06 01:31:47.332280 | mon1 | 2026-03-06 01:31:47.332342 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-06 01:31:47.332466 | mon1 | Friday 06 March 2026 01:31:47 +0000 (0:00:06.304) 0:00:40.244 ********** 2026-03-06 01:32:01.568808 | mon1 | ok: [mon1] 2026-03-06 01:32:01.568881 | mon1 | 2026-03-06 01:32:01.569117 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-06 01:32:01.569169 | mon1 | Friday 06 March 2026 01:32:01 +0000 (0:00:14.236) 0:00:54.481 ********** 2026-03-06 01:32:01.654219 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-06 01:32:01.654290 | mon1 | 2026-03-06 01:32:01.654480 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-06 01:32:01.654528 | mon1 | Friday 06 March 2026 01:32:01 +0000 (0:00:00.085) 0:00:54.566 ********** 2026-03-06 01:32:01.702673 | mon1 | skipping: [mon1] 2026-03-06 01:32:01.702716 | mon1 | 2026-03-06 01:32:01.702978 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-06 01:32:01.703026 | mon1 | Friday 06 March 2026 01:32:01 +0000 (0:00:00.048) 0:00:54.615 ********** 2026-03-06 01:32:01.750306 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-06 01:32:01.750867 | mon1 | skipping: [mon1] 2026-03-06 01:32:01.750899 | mon1 | 2026-03-06 01:32:01.750919 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-06 01:32:01.750926 | mon1 | Friday 06 March 2026 01:32:01 +0000 (0:00:00.047) 0:00:54.662 ********** 2026-03-06 01:32:02.016985 | mon1 | ok: [mon1] 2026-03-06 01:32:02.017048 | mon1 | 2026-03-06 01:32:02.017273 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-06 01:32:02.017324 | mon1 | Friday 06 March 2026 01:32:02 +0000 (0:00:00.266) 0:00:54.929 ********** 2026-03-06 01:32:08.593330 | mon1 | ok: [mon1] 2026-03-06 01:32:08.593417 | mon1 | 2026-03-06 01:32:08.593639 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-06 01:32:08.593684 | mon1 | Friday 06 March 2026 01:32:08 +0000 (0:00:06.576) 0:01:01.505 ********** 2026-03-06 01:32:14.769103 | mon1 | ok: [mon1] 2026-03-06 01:32:14.769406 | mon1 | 2026-03-06 01:32:14.769420 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-06 01:32:14.769444 | mon1 | Friday 06 March 2026 01:32:14 +0000 (0:00:06.175) 0:01:07.681 ********** 2026-03-06 01:32:20.920863 | mon1 | ok: [mon1] 2026-03-06 01:32:20.920934 | mon1 | 2026-03-06 01:32:20.921174 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-06 01:32:20.921221 | mon1 | Friday 06 March 2026 01:32:20 +0000 (0:00:06.151) 0:01:13.833 ********** 2026-03-06 01:32:28.816096 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-06 01:32:28.816151 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-06 01:32:28.816156 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-03-06 01:32:28.816161 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-06 01:32:28.816166 | mon1 | 2026-03-06 01:32:28.816172 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-06 01:32:28.816177 | mon1 | 2026-03-06 01:32:28.816181 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-06 01:32:28.816185 | mon1 | Friday 06 March 2026 01:32:28 +0000 (0:00:07.894) 0:01:21.728 ********** 2026-03-06 01:32:29.905810 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-06 01:32:29.906528 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-06 01:32:29.906785 | mon1 | interpreter could change the meaning of that path. See 2026-03-06 01:32:29.906793 | mon1 | https://docs.ansible.com/ansible- 2026-03-06 01:32:29.906800 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-06 01:32:29.920751 | mon1 | ok: [osd1] 2026-03-06 01:32:29.920839 | mon1 | 2026-03-06 01:32:29.921065 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:32:29.921098 | mon1 | Friday 06 March 2026 01:32:29 +0000 (0:00:01.105) 0:01:22.833 ********** 2026-03-06 01:32:30.114313 | mon1 | ok: [osd1] 2026-03-06 01:32:30.114407 | mon1 | 2026-03-06 01:32:30.114423 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:32:30.114557 | mon1 | Friday 06 March 2026 01:32:30 +0000 (0:00:00.193) 0:01:23.026 ********** 2026-03-06 01:32:30.151927 | mon1 | skipping: [osd1] 2026-03-06 01:32:30.151996 | mon1 | 2026-03-06 01:32:30.152056 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-06 01:32:30.152193 | mon1 | Friday 06 March 2026 01:32:30 +0000 (0:00:00.037) 0:01:23.064 ********** 2026-03-06 01:32:30.355744 | mon1 | ok: [osd1] 2026-03-06 01:32:30.355830 | mon1 | 2026-03-06 01:32:30.355906 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:32:30.356089 | mon1 | Friday 06 March 2026 01:32:30 +0000 (0:00:00.203) 0:01:23.268 ********** 2026-03-06 01:32:30.427717 | mon1 | ok: [osd1] => { 2026-03-06 01:32:30.428610 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-06 01:32:30.428662 | mon1 | } 2026-03-06 01:32:30.428670 | mon1 | 2026-03-06 01:32:30.428720 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:32:30.428731 | mon1 | Friday 06 March 2026 01:32:30 +0000 (0:00:00.071) 0:01:23.339 ********** 2026-03-06 01:32:30.727355 | mon1 | ok: [osd1] 2026-03-06 01:32:30.727442 | mon1 | 2026-03-06 01:32:30.727604 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:32:30.727823 | mon1 | Friday 06 March 2026 01:32:30 +0000 (0:00:00.299) 0:01:23.639 ********** 2026-03-06 01:32:30.769383 | mon1 | skipping: [osd1] 2026-03-06 01:32:30.769447 | mon1 | 2026-03-06 01:32:30.769517 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:32:30.769671 | mon1 | Friday 06 March 2026 01:32:30 +0000 (0:00:00.042) 0:01:23.681 ********** 2026-03-06 01:32:30.801877 | mon1 | skipping: [osd1] 2026-03-06 01:32:30.801942 | mon1 | 2026-03-06 01:32:30.802033 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:32:30.802152 | mon1 | Friday 06 March 2026 01:32:30 +0000 (0:00:00.032) 0:01:23.714 ********** 2026-03-06 01:32:31.000873 | mon1 | ok: [osd1] 2026-03-06 01:32:31.000942 | mon1 | 2026-03-06 01:32:31.000996 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:32:31.001103 | mon1 | Friday 06 March 2026 01:32:30 +0000 (0:00:00.198) 0:01:23.913 ********** 2026-03-06 01:32:32.243111 | mon1 | ok: [osd1] 2026-03-06 01:32:32.243159 | mon1 | 2026-03-06 01:32:32.243164 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:32:32.243169 | mon1 | Friday 06 March 2026 01:32:32 +0000 (0:00:01.241) 0:01:25.155 ********** 2026-03-06 01:32:32.318007 | mon1 | ok: [osd1] => { 2026-03-06 01:32:32.318056 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-06 01:32:32.318063 | mon1 | } 2026-03-06 01:32:32.318069 | mon1 | 2026-03-06 01:32:32.318075 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:32:32.318081 | mon1 | Friday 06 March 2026 01:32:32 +0000 (0:00:00.074) 0:01:25.229 ********** 2026-03-06 01:32:32.676878 | mon1 | ok: [osd1] 2026-03-06 01:32:32.676967 | mon1 | 2026-03-06 01:32:32.677263 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:32:32.677314 | mon1 | Friday 06 March 2026 01:32:32 +0000 (0:00:00.359) 0:01:25.589 ********** 2026-03-06 01:32:34.607068 | mon1 | ok: [osd1] 2026-03-06 01:32:34.607143 | mon1 | 2026-03-06 01:32:34.607149 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-06 01:32:34.607155 | mon1 | Friday 06 March 2026 01:32:34 +0000 (0:00:01.929) 0:01:27.518 ********** 2026-03-06 01:32:34.638130 | mon1 | skipping: [osd1] 2026-03-06 01:32:34.638159 | mon1 | 2026-03-06 01:32:34.638166 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-06 01:32:34.638173 | mon1 | Friday 06 March 2026 01:32:34 +0000 (0:00:00.031) 0:01:27.550 ********** 2026-03-06 01:32:34.672657 | mon1 | skipping: [osd1] 2026-03-06 01:32:34.672776 | mon1 | 2026-03-06 01:32:34.672782 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-06 01:32:34.672788 | mon1 | Friday 06 March 2026 01:32:34 +0000 (0:00:00.034) 0:01:27.584 ********** 2026-03-06 01:32:34.704749 | mon1 | skipping: [osd1] 2026-03-06 01:32:34.704839 | mon1 | 2026-03-06 01:32:34.705125 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-06 01:32:34.705187 | mon1 | Friday 06 March 2026 01:32:34 +0000 (0:00:00.032) 0:01:27.616 ********** 2026-03-06 01:32:35.859555 | mon1 | ok: [osd1] 2026-03-06 01:32:35.859606 | mon1 | 2026-03-06 01:32:35.859611 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-06 01:32:35.859616 | mon1 | Friday 06 March 2026 01:32:35 +0000 (0:00:01.154) 0:01:28.771 ********** 2026-03-06 01:32:36.286646 | mon1 | ok: [osd1] 2026-03-06 01:32:36.286692 | mon1 | 2026-03-06 01:32:36.286697 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-06 01:32:36.286702 | mon1 | Friday 06 March 2026 01:32:36 +0000 (0:00:00.427) 0:01:29.199 ********** 2026-03-06 01:32:37.217157 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-06 01:32:37.217278 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-06 01:32:37.217290 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-06 01:32:37.217848 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-06 01:32:37.217908 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-06 01:32:37.217915 | mon1 | 2026-03-06 01:32:37.217920 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-06 01:32:37.217925 | mon1 | Friday 06 March 2026 01:32:37 +0000 (0:00:00.930) 0:01:30.129 ********** 2026-03-06 01:32:37.711631 | mon1 | ok: [osd1] 2026-03-06 01:32:37.711705 | mon1 | 2026-03-06 01:32:37.712203 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-06 01:32:37.712245 | mon1 | Friday 06 March 2026 01:32:37 +0000 (0:00:00.487) 0:01:30.617 ********** 2026-03-06 01:32:37.712252 | mon1 | 2026-03-06 01:32:37.712256 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-06 01:32:37.712260 | mon1 | Friday 06 March 2026 01:32:37 +0000 (0:00:00.007) 0:01:30.624 ********** 2026-03-06 01:32:38.056130 | mon1 | ok: [osd1] 2026-03-06 01:32:38.056215 | mon1 | 2026-03-06 01:32:38.056499 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:32:38.056552 | mon1 | Friday 06 March 2026 01:32:38 +0000 (0:00:00.344) 0:01:30.968 ********** 2026-03-06 01:32:38.265315 | mon1 | ok: [osd1] 2026-03-06 01:32:38.265385 | mon1 | 2026-03-06 01:32:38.265728 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:32:38.265788 | mon1 | Friday 06 March 2026 01:32:38 +0000 (0:00:00.208) 0:01:31.177 ********** 2026-03-06 01:32:38.336248 | mon1 | ok: [osd1] => { 2026-03-06 01:32:38.336329 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-06 01:32:38.336817 | mon1 | } 2026-03-06 01:32:38.336884 | mon1 | 2026-03-06 01:32:38.336896 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:32:38.336914 | mon1 | Friday 06 March 2026 01:32:38 +0000 (0:00:00.071) 0:01:31.248 ********** 2026-03-06 01:32:38.696434 | mon1 | ok: [osd1] 2026-03-06 01:32:38.696581 | mon1 | 2026-03-06 01:32:38.696895 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:32:38.697103 | mon1 | Friday 06 March 2026 01:32:38 +0000 (0:00:00.359) 0:01:31.608 ********** 2026-03-06 01:32:41.772080 | mon1 | ok: [osd1] 2026-03-06 01:32:41.772252 | mon1 | 2026-03-06 01:32:41.772471 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-06 01:32:41.772681 | mon1 | Friday 06 March 2026 01:32:41 +0000 (0:00:03.075) 0:01:34.684 ********** 2026-03-06 01:32:42.952878 | mon1 | ok: [osd1] 2026-03-06 01:32:42.953283 | mon1 | 2026-03-06 01:32:42.953620 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-06 01:32:42.953905 | mon1 | Friday 06 March 2026 01:32:42 +0000 (0:00:01.180) 0:01:35.864 ********** 2026-03-06 01:32:43.137445 | mon1 | ok: [osd1] 2026-03-06 01:32:43.137799 | mon1 | 2026-03-06 01:32:43.138114 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-06 01:32:43.138404 | mon1 | Friday 06 March 2026 01:32:43 +0000 (0:00:00.183) 0:01:36.048 ********** 2026-03-06 01:32:43.555925 | mon1 | ok: [osd1] 2026-03-06 01:32:43.555995 | mon1 | 2026-03-06 01:32:43.556203 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-06 01:32:43.556249 | mon1 | Friday 06 March 2026 01:32:43 +0000 (0:00:00.420) 0:01:36.468 ********** 2026-03-06 01:32:44.101817 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-03-06 01:32:44.102103 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-06 01:32:44.102464 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-06 01:32:44.102604 | mon1 | 2026-03-06 01:32:44.102748 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-06 01:32:44.102883 | mon1 | Friday 06 March 2026 01:32:44 +0000 (0:00:00.545) 0:01:37.014 ********** 2026-03-06 01:32:44.501368 | mon1 | ok: [osd1] 2026-03-06 01:32:44.501493 | mon1 | 2026-03-06 01:32:44.501760 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-06 01:32:44.501914 | mon1 | Friday 06 March 2026 01:32:44 +0000 (0:00:00.399) 0:01:37.413 ********** 2026-03-06 01:32:44.922369 | mon1 | ok: [osd1] 2026-03-06 01:32:44.922427 | mon1 | 2026-03-06 01:32:44.922515 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-06 01:32:44.922618 | mon1 | Friday 06 March 2026 01:32:44 +0000 (0:00:00.415) 0:01:37.829 ********** 2026-03-06 01:32:44.922705 | mon1 | 2026-03-06 01:32:44.922869 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-06 01:32:44.922987 | mon1 | Friday 06 March 2026 01:32:44 +0000 (0:00:00.005) 0:01:37.834 ********** 2026-03-06 01:32:45.263218 | mon1 | ok: [osd1] 2026-03-06 01:32:45.263555 | mon1 | 2026-03-06 01:32:45.263836 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-06 01:32:45.264051 | mon1 | Friday 06 March 2026 01:32:45 +0000 (0:00:00.340) 0:01:38.175 ********** 2026-03-06 01:32:45.304220 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-06 01:32:45.304406 | mon1 | 2026-03-06 01:32:45.304644 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-06 01:32:45.304914 | mon1 | Friday 06 March 2026 01:32:45 +0000 (0:00:00.040) 0:01:38.216 ********** 2026-03-06 01:32:46.417760 | mon1 | ok: [osd1] 2026-03-06 01:32:46.418139 | mon1 | 2026-03-06 01:32:46.418480 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-06 01:32:46.418940 | mon1 | Friday 06 March 2026 01:32:46 +0000 (0:00:01.113) 0:01:39.329 ********** 2026-03-06 01:32:47.044719 | mon1 | ok: [osd1] => (item=chronyd) 2026-03-06 01:32:47.044864 | mon1 | ok: [osd1] => (item=sshd) 2026-03-06 01:32:47.044875 | mon1 | 2026-03-06 01:32:47.044995 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-06 01:32:47.045194 | mon1 | Friday 06 March 2026 01:32:47 +0000 (0:00:00.627) 0:01:39.957 ********** 2026-03-06 01:32:47.324996 | mon1 | ok: [osd1] 2026-03-06 01:32:47.325113 | mon1 | 2026-03-06 01:32:47.325126 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-06 01:32:47.325193 | mon1 | Friday 06 March 2026 01:32:47 +0000 (0:00:00.280) 0:01:40.237 ********** 2026-03-06 01:32:47.518712 | mon1 | ok: [osd1] 2026-03-06 01:32:47.518770 | mon1 | 2026-03-06 01:32:47.518891 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-06 01:32:47.519066 | mon1 | Friday 06 March 2026 01:32:47 +0000 (0:00:00.193) 0:01:40.431 ********** 2026-03-06 01:32:47.755839 | mon1 | ok: [osd1] 2026-03-06 01:32:47.756060 | mon1 | 2026-03-06 01:32:47.756251 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-06 01:32:47.756428 | mon1 | Friday 06 March 2026 01:32:47 +0000 (0:00:00.235) 0:01:40.666 ********** 2026-03-06 01:32:47.942033 | mon1 | ok: [osd1] 2026-03-06 01:32:47.942346 | mon1 | 2026-03-06 01:32:47.942672 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-06 01:32:47.942942 | mon1 | Friday 06 March 2026 01:32:47 +0000 (0:00:00.187) 0:01:40.854 ********** 2026-03-06 01:32:48.172105 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-06 01:32:48.172175 | mon1 | 2026-03-06 01:32:48.172187 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-06 01:32:48.172197 | mon1 | Friday 06 March 2026 01:32:48 +0000 (0:00:00.229) 0:01:41.083 ********** 2026-03-06 01:32:48.220889 | mon1 | ok: [osd1] 2026-03-06 01:32:48.220926 | mon1 | 2026-03-06 01:32:48.220938 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-06 01:32:48.220947 | mon1 | Friday 06 March 2026 01:32:48 +0000 (0:00:00.048) 0:01:41.132 ********** 2026-03-06 01:32:48.272483 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-06 01:32:48.272672 | mon1 | 2026-03-06 01:32:48.272954 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-06 01:32:48.273181 | mon1 | Friday 06 March 2026 01:32:48 +0000 (0:00:00.052) 0:01:41.184 ********** 2026-03-06 01:32:54.380244 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:32:54.380319 | mon1 | 2026-03-06 01:32:54.380385 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-06 01:32:54.380522 | mon1 | Friday 06 March 2026 01:32:54 +0000 (0:00:06.107) 0:01:47.292 ********** 2026-03-06 01:32:54.427123 | mon1 | ok: [osd1] => (item=osd1) 2026-03-06 01:32:54.427318 | mon1 | 2026-03-06 01:32:54.427529 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-06 01:32:54.427733 | mon1 | Friday 06 March 2026 01:32:54 +0000 (0:00:00.046) 0:01:47.339 ********** 2026-03-06 01:32:54.664869 | mon1 | ok: [osd1] 2026-03-06 01:32:54.665029 | mon1 | 2026-03-06 01:32:54.665242 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-06 01:32:54.665446 | mon1 | Friday 06 March 2026 01:32:54 +0000 (0:00:00.237) 0:01:47.577 ********** 2026-03-06 01:33:01.118090 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:33:01.118146 | mon1 | 2026-03-06 01:33:01.118151 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-06 01:33:01.118156 | mon1 | Friday 06 March 2026 01:33:01 +0000 (0:00:06.453) 0:01:54.030 ********** 2026-03-06 01:33:06.433632 | mon1 | ok: [osd1] 2026-03-06 01:33:06.433719 | mon1 | 2026-03-06 01:33:06.433731 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-06 01:33:06.433869 | mon1 | Friday 06 March 2026 01:33:06 +0000 (0:00:05.315) 0:01:59.346 ********** 2026-03-06 01:33:28.930651 | mon1 | ok: [osd1] 2026-03-06 01:33:28.930744 | mon1 | 2026-03-06 01:33:28.931061 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-06 01:33:28.931116 | mon1 | Friday 06 March 2026 01:33:28 +0000 (0:00:22.496) 0:02:21.843 ********** 2026-03-06 01:33:29.002813 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-03-06 01:33:29.002876 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-03-06 01:33:29.003377 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-03-06 01:33:29.003453 | mon1 | skipping: [osd1] 2026-03-06 01:33:29.003460 | mon1 | 2026-03-06 01:33:29.003465 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-06 01:33:29.003470 | mon1 | Friday 06 March 2026 01:33:28 +0000 (0:00:00.071) 0:02:21.915 ********** 2026-03-06 01:33:35.251901 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:33:35.252019 | mon1 | 2026-03-06 01:33:35.252031 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-06 01:33:35.252108 | mon1 | Friday 06 March 2026 01:33:35 +0000 (0:00:06.249) 0:02:28.164 ********** 2026-03-06 01:33:41.481732 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:33:41.481779 | mon1 | 2026-03-06 01:33:41.481785 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-06 01:33:41.481789 | mon1 | Friday 06 March 2026 01:33:41 +0000 (0:00:06.229) 0:02:34.394 ********** 2026-03-06 01:33:41.532921 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-06 01:33:41.532994 | mon1 | 2026-03-06 01:33:41.533014 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-06 01:33:41.533113 | mon1 | Friday 06 March 2026 01:33:41 +0000 (0:00:00.051) 0:02:34.445 ********** 2026-03-06 01:33:41.579580 | mon1 | ok: [osd1] 2026-03-06 01:33:41.579684 | mon1 | 2026-03-06 01:33:41.580003 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-06 01:33:41.580053 | mon1 | Friday 06 March 2026 01:33:41 +0000 (0:00:00.046) 0:02:34.491 ********** 2026-03-06 01:33:47.773676 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:33:47.773796 | mon1 | 2026-03-06 01:33:47.773884 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-06 01:33:47.774085 | mon1 | Friday 06 March 2026 01:33:47 +0000 (0:00:06.194) 0:02:40.686 ********** 2026-03-06 01:33:47.820750 | mon1 | ok: [osd1] 2026-03-06 01:33:47.820872 | mon1 | 2026-03-06 01:33:47.821029 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-06 01:33:47.821152 | mon1 | Friday 06 March 2026 01:33:47 +0000 (0:00:00.046) 0:02:40.732 ********** 2026-03-06 01:33:47.861120 | mon1 | skipping: [osd1] => (item=1) 2026-03-06 01:33:47.861214 | mon1 | skipping: [osd1] => (item=1) 2026-03-06 01:33:47.861367 | mon1 | skipping: [osd1] => (item=1) 2026-03-06 01:33:47.861502 | mon1 | skipping: [osd1] 2026-03-06 01:33:47.861629 | mon1 | 2026-03-06 01:33:47.861794 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-06 01:33:47.861910 | mon1 | Friday 06 March 2026 01:33:47 +0000 (0:00:00.040) 0:02:40.773 ********** 2026-03-06 01:33:47.887382 | mon1 | skipping: [osd1] 2026-03-06 01:33:47.887552 | mon1 | 2026-03-06 01:33:47.887863 | mon1 | PLAY RECAP ********************************************************************* 2026-03-06 01:33:47.888167 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-06 01:33:47.888421 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-06 01:33:47.888594 | mon1 | 2026-03-06 01:33:47.888817 | mon1 | 2026-03-06 01:33:47.889024 | mon1 | TASKS RECAP ******************************************************************** 2026-03-06 01:33:47.889249 | mon1 | Friday 06 March 2026 01:33:47 +0000 (0:00:00.026) 0:02:40.799 ********** 2026-03-06 01:33:47.889457 | mon1 | =============================================================================== 2026-03-06 01:33:47.889638 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.50s 2026-03-06 01:33:47.889833 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.24s 2026-03-06 01:33:47.890047 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.89s 2026-03-06 01:33:47.890323 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.60s 2026-03-06 01:33:47.890550 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.58s 2026-03-06 01:33:47.890766 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.45s 2026-03-06 01:33:47.890963 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.33s 2026-03-06 01:33:47.891163 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.30s 2026-03-06 01:33:47.891360 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.25s 2026-03-06 01:33:47.891550 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.23s 2026-03-06 01:33:47.891803 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.19s 2026-03-06 01:33:47.891989 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.18s 2026-03-06 01:33:47.892203 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.15s 2026-03-06 01:33:47.892406 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.11s 2026-03-06 01:33:47.892617 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.32s 2026-03-06 01:33:47.892870 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.08s 2026-03-06 01:33:47.893060 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.05s 2026-03-06 01:33:47.893256 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.18s 2026-03-06 01:33:47.893450 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.93s 2026-03-06 01:33:47.893650 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 1.24s 2026-03-06 01:33:48.001183 | mon1 | INFO [default > idempotence] Executed: Successful 2026-03-06 01:33:48.010512 | mon1 | INFO [default > side_effect] Executing 2026-03-06 01:33:48.011138 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-06 01:33:48.016732 | mon1 | INFO [default > verify] Executing 2026-03-06 01:33:48.610828 | mon1 | 2026-03-06 01:33:48.611077 | mon1 | PLAY [Verify] ****************************************************************** 2026-03-06 01:33:48.611283 | mon1 | 2026-03-06 01:33:48.611543 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-06 01:33:48.611914 | mon1 | Friday 06 March 2026 01:33:48 +0000 (0:00:00.007) 0:00:00.007 ********** 2026-03-06 01:33:49.725805 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-06 01:33:49.725976 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-06 01:33:49.726215 | mon1 | interpreter could change the meaning of that path. See 2026-03-06 01:33:49.726496 | mon1 | https://docs.ansible.com/ansible- 2026-03-06 01:33:49.726770 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-06 01:33:49.736391 | mon1 | ok: [mon1] 2026-03-06 01:33:49.736576 | mon1 | 2026-03-06 01:33:49.736879 | mon1 | TASK [Get cluster health status] *********************************************** 2026-03-06 01:33:49.737061 | mon1 | Friday 06 March 2026 01:33:49 +0000 (0:00:01.125) 0:00:01.133 ********** 2026-03-06 01:33:59.940620 | mon1 | ok: [mon1] 2026-03-06 01:33:59.940692 | mon1 | 2026-03-06 01:33:59.940894 | mon1 | TASK [Print cluster health status] ********************************************* 2026-03-06 01:33:59.941017 | mon1 | Friday 06 March 2026 01:33:59 +0000 (0:00:10.203) 0:00:11.337 ********** 2026-03-06 01:33:59.972055 | mon1 | ok: [mon1] => { 2026-03-06 01:33:59.972269 | mon1 | "_ceph_health": { 2026-03-06 01:33:59.972469 | mon1 | "changed": false, 2026-03-06 01:33:59.972662 | mon1 | "cmd": [ 2026-03-06 01:33:59.972887 | mon1 | "cephadm", 2026-03-06 01:33:59.973081 | mon1 | "shell", 2026-03-06 01:33:59.973270 | mon1 | "--", 2026-03-06 01:33:59.973457 | mon1 | "ceph", 2026-03-06 01:33:59.973643 | mon1 | "health" 2026-03-06 01:33:59.973836 | mon1 | ], 2026-03-06 01:33:59.974068 | mon1 | "delta": "0:00:09.943490", 2026-03-06 01:33:59.974277 | mon1 | "end": "2026-03-06 01:33:59.905928", 2026-03-06 01:33:59.974470 | mon1 | "failed": false, 2026-03-06 01:33:59.974660 | mon1 | "msg": "", 2026-03-06 01:33:59.974849 | mon1 | "rc": 0, 2026-03-06 01:33:59.975044 | mon1 | "start": "2026-03-06 01:33:49.962438", 2026-03-06 01:33:59.975262 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-03-06 01:33:59.975456 | mon1 | "stderr_lines": [ 2026-03-06 01:33:59.975648 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-06 01:33:59.975860 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-03-06 01:33:59.976051 | mon1 | ], 2026-03-06 01:33:59.976252 | mon1 | "stdout": "HEALTH_OK", 2026-03-06 01:33:59.976443 | mon1 | "stdout_lines": [ 2026-03-06 01:33:59.976630 | mon1 | "HEALTH_OK" 2026-03-06 01:33:59.976857 | mon1 | ] 2026-03-06 01:33:59.977047 | mon1 | } 2026-03-06 01:33:59.977235 | mon1 | } 2026-03-06 01:33:59.977416 | mon1 | 2026-03-06 01:33:59.977613 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-06 01:33:59.977812 | mon1 | Friday 06 March 2026 01:33:59 +0000 (0:00:00.031) 0:00:11.368 ********** 2026-03-06 01:33:59.997066 | mon1 | ok: [mon1] => { 2026-03-06 01:33:59.997263 | mon1 | "changed": false, 2026-03-06 01:33:59.997458 | mon1 | "msg": "All assertions passed" 2026-03-06 01:33:59.997646 | mon1 | } 2026-03-06 01:33:59.997823 | mon1 | 2026-03-06 01:33:59.998022 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-03-06 01:33:59.998253 | mon1 | Friday 06 March 2026 01:33:59 +0000 (0:00:00.024) 0:00:11.393 ********** 2026-03-06 01:34:06.035175 | mon1 | changed: [mon1] 2026-03-06 01:34:06.035247 | mon1 | 2026-03-06 01:34:06.035338 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-03-06 01:34:06.035440 | mon1 | Friday 06 March 2026 01:34:06 +0000 (0:00:06.038) 0:00:17.431 ********** 2026-03-06 01:34:08.430930 | mon1 | changed: [mon1] 2026-03-06 01:34:08.430988 | mon1 | 2026-03-06 01:34:08.430999 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-06 01:34:08.431009 | mon1 | Friday 06 March 2026 01:34:08 +0000 (0:00:02.393) 0:00:19.825 ********** 2026-03-06 01:34:09.645167 | mon1 | ok: [mon1] 2026-03-06 01:34:09.645285 | mon1 | 2026-03-06 01:34:09.645602 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-03-06 01:34:09.645801 | mon1 | Friday 06 March 2026 01:34:09 +0000 (0:00:01.215) 0:00:21.041 ********** 2026-03-06 01:34:09.676415 | mon1 | ok: [mon1] => { 2026-03-06 01:34:09.676795 | mon1 | "changed": false, 2026-03-06 01:34:09.679707 | mon1 | "msg": "All assertions passed" 2026-03-06 01:34:09.679759 | mon1 | } 2026-03-06 01:34:09.679769 | mon1 | 2026-03-06 01:34:09.679777 | mon1 | PLAY RECAP ********************************************************************* 2026-03-06 01:34:09.679786 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-06 01:34:09.679794 | mon1 | 2026-03-06 01:34:09.679801 | mon1 | 2026-03-06 01:34:09.679808 | mon1 | TASKS RECAP ******************************************************************** 2026-03-06 01:34:09.679816 | mon1 | Friday 06 March 2026 01:34:09 +0000 (0:00:00.031) 0:00:21.073 ********** 2026-03-06 01:34:09.679824 | mon1 | =============================================================================== 2026-03-06 01:34:09.679832 | mon1 | Get cluster health status ---------------------------------------------- 10.20s 2026-03-06 01:34:09.679839 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.04s 2026-03-06 01:34:09.679847 | mon1 | Create a test Ceph key -------------------------------------------------- 2.39s 2026-03-06 01:34:09.679854 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.22s 2026-03-06 01:34:09.679861 | mon1 | Gathering Facts --------------------------------------------------------- 1.13s 2026-03-06 01:34:09.679869 | mon1 | Print cluster health status --------------------------------------------- 0.03s 2026-03-06 01:34:09.679876 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.03s 2026-03-06 01:34:09.679884 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.02s 2026-03-06 01:34:09.742727 | mon1 | INFO [default > verify] Executed: Successful 2026-03-06 01:34:09.752623 | mon1 | INFO [default > cleanup] Executing 2026-03-06 01:34:09.752967 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-06 01:34:09.758021 | mon1 | INFO [default > destroy] Executing 2026-03-06 01:34:09.758134 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-06 01:34:09.758219 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-06 01:34:09.758483 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-06 01:34:10.022803 | mon1 | ok: Runtime: 0:14:32.545962 2026-03-06 01:34:10.035771 | 2026-03-06 01:34:10.035829 | PLAY RECAP 2026-03-06 01:34:10.035882 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-06 01:34:10.035904 | 2026-03-06 01:34:10.197862 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-06 01:34:10.200387 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-06 01:34:10.744541 | 2026-03-06 01:34:10.744672 | PLAY [all] 2026-03-06 01:34:10.756413 | 2026-03-06 01:34:10.756505 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-06 01:34:10.809627 | mon1 | ok 2026-03-06 01:34:10.815025 | osd1 | ok 2026-03-06 01:34:10.819360 | 2026-03-06 01:34:10.819436 | TASK [fetch-output : Set log path for single node] 2026-03-06 01:34:10.844496 | mon1 | skipping: Conditional result was False 2026-03-06 01:34:10.855610 | osd1 | skipping: Conditional result was False 2026-03-06 01:34:10.864893 | 2026-03-06 01:34:10.865006 | LOOP [fetch-output : Ensure local output dirs] 2026-03-06 01:34:11.225760 | mon1 -> localhost | changed: "/var/lib/zuul/builds/3226b5909f3f46a99c4d154042a7df4e/work/logs/mon1" 2026-03-06 01:34:11.243684 | osd1 -> localhost | changed: "/var/lib/zuul/builds/3226b5909f3f46a99c4d154042a7df4e/work/logs/osd1" 2026-03-06 01:34:11.423164 | mon1 -> localhost | changed: "/var/lib/zuul/builds/3226b5909f3f46a99c4d154042a7df4e/work/artifacts" 2026-03-06 01:34:11.451759 | osd1 -> localhost | ok: "/var/lib/zuul/builds/3226b5909f3f46a99c4d154042a7df4e/work/artifacts" 2026-03-06 01:34:11.637416 | mon1 -> localhost | changed: "/var/lib/zuul/builds/3226b5909f3f46a99c4d154042a7df4e/work/docs" 2026-03-06 01:34:11.664850 | osd1 -> localhost | ok: "/var/lib/zuul/builds/3226b5909f3f46a99c4d154042a7df4e/work/docs" 2026-03-06 01:34:11.665065 | osd1 -> localhost | changed: All items complete 2026-03-06 01:34:11.665134 | 2026-03-06 01:34:11.682964 | 2026-03-06 01:34:11.683186 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-06 01:34:12.291821 | osd1 | changed: .d..t...... ./ 2026-03-06 01:34:12.300596 | mon1 | changed: .d..t...... ./ 2026-03-06 01:34:12.735210 | mon1 | changed: .d..t...... ./ 2026-03-06 01:34:12.759119 | osd1 | changed: .d..t...... ./ 2026-03-06 01:34:13.167756 | mon1 | changed: .d..t...... ./ 2026-03-06 01:34:13.186162 | osd1 | ok 2026-03-06 01:34:13.186315 | osd1 | changed: All items complete 2026-03-06 01:34:13.186347 | 2026-03-06 01:34:13.220083 | 2026-03-06 01:34:13.220227 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-06 01:34:13.603377 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006501 2026-03-06 01:34:13.812639 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.005174 2026-03-06 01:34:13.834895 | 2026-03-06 01:34:13.835033 | PLAY [all] 2026-03-06 01:34:13.842066 | 2026-03-06 01:34:13.842140 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-06 01:34:14.240599 | mon1 | changed 2026-03-06 01:34:14.418442 | osd1 | changed 2026-03-06 01:34:14.429003 | 2026-03-06 01:34:14.429120 | PLAY RECAP 2026-03-06 01:34:14.429183 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-06 01:34:14.429215 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-06 01:34:14.429235 | 2026-03-06 01:34:14.549772 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-06 01:34:14.552898 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-06 01:34:15.090591 | 2026-03-06 01:34:15.090708 | PLAY [localhost] 2026-03-06 01:34:15.100208 | 2026-03-06 01:34:15.100284 | TASK [Generate Zuul manifest] 2026-03-06 01:34:15.132015 | localhost | ok 2026-03-06 01:34:15.145927 | 2026-03-06 01:34:15.146007 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-06 01:34:15.455543 | localhost | changed 2026-03-06 01:34:15.467929 | 2026-03-06 01:34:15.468021 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-06 01:34:15.500738 | localhost | ok 2026-03-06 01:34:15.509596 | 2026-03-06 01:34:15.509656 | TASK [Upload logs] 2026-03-06 01:34:15.538253 | localhost | ok 2026-03-06 01:34:15.592967 | 2026-03-06 01:34:15.593097 | TASK [Set zuul-log-path fact] 2026-03-06 01:34:15.609715 | localhost | ok 2026-03-06 01:34:15.619704 | 2026-03-06 01:34:15.619765 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-06 01:34:15.646782 | localhost | ok 2026-03-06 01:34:15.653289 | 2026-03-06 01:34:15.653352 | TASK [upload-logs : Create log directories] 2026-03-06 01:34:16.040389 | localhost | changed 2026-03-06 01:34:16.047007 | 2026-03-06 01:34:16.047100 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-06 01:34:16.408572 | localhost -> localhost | ok: Runtime: 0:00:00.004945 2026-03-06 01:34:16.413398 | 2026-03-06 01:34:16.413459 | TASK [upload-logs : Upload logs to log server] 2026-03-06 01:34:16.830866 | localhost | Output suppressed because no_log was given 2026-03-06 01:34:16.834264 | 2026-03-06 01:34:16.834326 | LOOP [upload-logs : Compress console log and json output] 2026-03-06 01:34:16.869351 | localhost | skipping: Conditional result was False 2026-03-06 01:34:16.876367 | localhost | skipping: Conditional result was False 2026-03-06 01:34:16.886034 | 2026-03-06 01:34:16.886199 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-06 01:34:16.918666 | localhost | skipping: Conditional result was False 2026-03-06 01:34:16.919026 | 2026-03-06 01:34:16.922636 | localhost | skipping: Conditional result was False 2026-03-06 01:34:16.939410 | 2026-03-06 01:34:16.939577 | LOOP [upload-logs : Upload console log and json output]