2026-08-18 15:19:51.639234 | Job console starting 2026-08-18 15:19:51.659885 | Updating git repos 2026-08-18 15:19:51.683494 | Cloning repos into workspace 2026-08-18 15:19:51.721643 | Restoring repo states 2026-08-18 15:19:51.728208 | Merging changes 2026-08-18 15:19:52.105110 | Checking out repos 2026-08-18 15:19:52.152405 | Preparing playbooks 2026-08-18 15:19:53.084697 | Running Ansible setup 2026-08-18 15:19:58.290097 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-18 15:19:58.951483 | 2026-08-18 15:19:58.951925 | PLAY [localhost] 2026-08-18 15:19:58.959531 | 2026-08-18 15:19:58.959607 | TASK [Gathering Facts] 2026-08-18 15:20:00.841730 | localhost | ok 2026-08-18 15:20:00.852393 | 2026-08-18 15:20:00.852462 | TASK [Setup log path fact] 2026-08-18 15:20:00.873638 | localhost | ok 2026-08-18 15:20:00.888233 | 2026-08-18 15:20:00.888297 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-18 15:20:00.919271 | localhost | ok 2026-08-18 15:20:00.931643 | 2026-08-18 15:20:00.931834 | TASK [emit-job-header : Print job information] 2026-08-18 15:20:00.972975 | # Job Information 2026-08-18 15:20:00.973183 | Ansible Version: 2.16.18 2026-08-18 15:20:00.973250 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-08-18 15:20:00.973297 | Pipeline: check 2026-08-18 15:20:00.973341 | Executor: 2d72f0692154 2026-08-18 15:20:00.973383 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/123 2026-08-18 15:20:00.973431 | Event ID: ca719330-9b17-11f1-98d0-5d703f0ffff7 2026-08-18 15:20:00.977649 | 2026-08-18 15:20:00.977709 | LOOP [emit-job-header : Print node information] 2026-08-18 15:20:01.114130 | localhost | ok: 2026-08-18 15:20:01.114532 | localhost | # Node Information 2026-08-18 15:20:01.114609 | localhost | Inventory Hostname: node1 2026-08-18 15:20:01.114659 | localhost | Hostname: np0000190033 2026-08-18 15:20:01.114703 | localhost | Username: zuul 2026-08-18 15:20:01.114752 | localhost | Distro: Ubuntu 22.04 2026-08-18 15:20:01.114797 | localhost | Provider: yul1 2026-08-18 15:20:01.114840 | localhost | Region: ca-ymq-1 2026-08-18 15:20:01.114882 | localhost | Label: ubuntu-jammy 2026-08-18 15:20:01.114980 | localhost | Product Name: OpenStack Nova 2026-08-18 15:20:01.115027 | localhost | Interface IP: 199.204.45.169 2026-08-18 15:20:01.155418 | localhost | ok: 2026-08-18 15:20:01.155528 | localhost | # Node Information 2026-08-18 15:20:01.155570 | localhost | Inventory Hostname: node2 2026-08-18 15:20:01.155603 | localhost | Hostname: np0000190034 2026-08-18 15:20:01.155637 | localhost | Username: zuul 2026-08-18 15:20:01.155668 | localhost | Distro: Ubuntu 22.04 2026-08-18 15:20:01.155699 | localhost | Provider: yul1 2026-08-18 15:20:01.155729 | localhost | Region: ca-ymq-1 2026-08-18 15:20:01.155759 | localhost | Label: ubuntu-jammy 2026-08-18 15:20:01.155789 | localhost | Product Name: OpenStack Nova 2026-08-18 15:20:01.155820 | localhost | Interface IP: 199.204.45.162 2026-08-18 15:20:01.198302 | localhost | ok: 2026-08-18 15:20:01.198456 | localhost | # Node Information 2026-08-18 15:20:01.198520 | localhost | Inventory Hostname: node3 2026-08-18 15:20:01.198599 | localhost | Hostname: np0000190035 2026-08-18 15:20:01.198654 | localhost | Username: zuul 2026-08-18 15:20:01.198705 | localhost | Distro: Ubuntu 22.04 2026-08-18 15:20:01.198755 | localhost | Provider: yul1 2026-08-18 15:20:01.198803 | localhost | Region: ca-ymq-1 2026-08-18 15:20:01.198851 | localhost | Label: ubuntu-jammy 2026-08-18 15:20:01.198897 | localhost | Product Name: OpenStack Nova 2026-08-18 15:20:01.198945 | localhost | Interface IP: 199.204.45.77 2026-08-18 15:20:01.208482 | 2026-08-18 15:20:01.208595 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-08-18 15:20:01.743709 | localhost -> localhost | changed 2026-08-18 15:20:01.750295 | 2026-08-18 15:20:01.750396 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-08-18 15:20:02.698829 | localhost -> localhost | changed 2026-08-18 15:20:02.709151 | 2026-08-18 15:20:02.709207 | PLAY [all] 2026-08-18 15:20:02.717801 | 2026-08-18 15:20:02.717864 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-08-18 15:20:02.934794 | node1 -> localhost | ok 2026-08-18 15:20:02.947174 | 2026-08-18 15:20:02.947311 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-08-18 15:20:02.979657 | node1 | ok 2026-08-18 15:20:02.983698 | node2 | ok 2026-08-18 15:20:03.003082 | node3 | ok 2026-08-18 15:20:03.056898 | node1 | included: /var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 15:20:03.057028 | node2 | included: /var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 15:20:03.057054 | node3 | included: /var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 15:20:03.062788 | 2026-08-18 15:20:03.062847 | TASK [add-build-sshkey : Create Temp SSH key] 2026-08-18 15:20:03.894091 | node1 -> localhost | Generating public/private rsa key pair. 2026-08-18 15:20:03.894405 | node1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/work/baccb7c3338d47c5af70a1aad390f60c_id_rsa 2026-08-18 15:20:03.894456 | node1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/work/baccb7c3338d47c5af70a1aad390f60c_id_rsa.pub 2026-08-18 15:20:03.894518 | node1 -> localhost | The key fingerprint is: 2026-08-18 15:20:03.894582 | node1 -> localhost | SHA256:9UjnPmAbJes7PbRiCGqTHkTJOZtJzdwUJd0jBMHI0QA zuul-build-sshkey 2026-08-18 15:20:03.894654 | node1 -> localhost | The key's randomart image is: 2026-08-18 15:20:03.894708 | node1 -> localhost | +---[RSA 3072]----+ 2026-08-18 15:20:03.894750 | node1 -> localhost | | Eoo**Bo. | 2026-08-18 15:20:03.894811 | node1 -> localhost | | . *ooo.o o | 2026-08-18 15:20:03.894881 | node1 -> localhost | | B + . +.o. | 2026-08-18 15:20:03.894940 | node1 -> localhost | | o = o O | 2026-08-18 15:20:03.895000 | node1 -> localhost | | = S * o | 2026-08-18 15:20:03.895070 | node1 -> localhost | | . . o =. | 2026-08-18 15:20:03.895128 | node1 -> localhost | | .o . .ooo. | 2026-08-18 15:20:03.895187 | node1 -> localhost | | =. . +.+. | 2026-08-18 15:20:03.895260 | node1 -> localhost | | o.. ..o . | 2026-08-18 15:20:03.895299 | node1 -> localhost | +----[SHA256]-----+ 2026-08-18 15:20:03.895393 | node1 -> localhost | ok: Runtime: 0:00:00.489843 2026-08-18 15:20:03.907281 | 2026-08-18 15:20:03.907442 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-08-18 15:20:03.943096 | node1 | ok 2026-08-18 15:20:03.968416 | node2 | ok 2026-08-18 15:20:03.984020 | node3 | ok 2026-08-18 15:20:04.006006 | node1 | included: /var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 15:20:04.006208 | node2 | included: /var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 15:20:04.006375 | node3 | included: /var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 15:20:04.030342 | 2026-08-18 15:20:04.030454 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-08-18 15:20:04.060480 | node1 | skipping: Conditional result was False 2026-08-18 15:20:04.062802 | node2 | skipping: Conditional result was False 2026-08-18 15:20:04.083379 | node3 | skipping: Conditional result was False 2026-08-18 15:20:04.092714 | 2026-08-18 15:20:04.092807 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-08-18 15:20:04.545995 | node1 | changed 2026-08-18 15:20:04.554451 | node2 | changed 2026-08-18 15:20:04.561926 | node3 | changed 2026-08-18 15:20:04.568940 | 2026-08-18 15:20:04.569030 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-08-18 15:20:04.747726 | node1 | ok 2026-08-18 15:20:04.774264 | node2 | ok 2026-08-18 15:20:04.779956 | node3 | ok 2026-08-18 15:20:04.787973 | 2026-08-18 15:20:04.788064 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-08-18 15:20:05.226272 | node1 | changed 2026-08-18 15:20:05.255203 | node3 | changed 2026-08-18 15:20:05.269906 | node2 | changed 2026-08-18 15:20:05.277637 | 2026-08-18 15:20:05.277722 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-08-18 15:20:05.707083 | node1 | changed 2026-08-18 15:20:05.736221 | node2 | changed 2026-08-18 15:20:05.784891 | node3 | changed 2026-08-18 15:20:05.794132 | 2026-08-18 15:20:05.794251 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-08-18 15:20:05.824550 | node1 | skipping: Conditional result was False 2026-08-18 15:20:05.826689 | node2 | skipping: Conditional result was False 2026-08-18 15:20:05.837025 | node3 | skipping: Conditional result was False 2026-08-18 15:20:05.843770 | 2026-08-18 15:20:05.843860 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-08-18 15:20:06.283428 | node1 -> localhost | changed 2026-08-18 15:20:06.308435 | 2026-08-18 15:20:06.308507 | TASK [add-build-sshkey : Add back temp key] 2026-08-18 15:20:06.626283 | node1 -> localhost | Identity added: /var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/work/baccb7c3338d47c5af70a1aad390f60c_id_rsa (zuul-build-sshkey) 2026-08-18 15:20:06.626499 | node1 -> localhost | ok: Runtime: 0:00:00.014686 2026-08-18 15:20:06.633169 | 2026-08-18 15:20:06.633250 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-08-18 15:20:06.946582 | node1 | ok 2026-08-18 15:20:06.953225 | node3 | ok 2026-08-18 15:20:06.958431 | node2 | ok 2026-08-18 15:20:06.963605 | 2026-08-18 15:20:06.963754 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-08-18 15:20:06.997587 | node1 | skipping: Conditional result was False 2026-08-18 15:20:07.009355 | node2 | skipping: Conditional result was False 2026-08-18 15:20:07.020472 | node3 | skipping: Conditional result was False 2026-08-18 15:20:07.045561 | 2026-08-18 15:20:07.045645 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-08-18 15:20:07.459894 | node1 | ok 2026-08-18 15:20:07.464563 | node3 | ok 2026-08-18 15:20:07.468461 | node2 | ok 2026-08-18 15:20:07.474170 | 2026-08-18 15:20:07.474236 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-08-18 15:20:08.152939 | node1 | Output suppressed because no_log was given 2026-08-18 15:20:08.158199 | node3 | Output suppressed because no_log was given 2026-08-18 15:20:08.197280 | node2 | Output suppressed because no_log was given 2026-08-18 15:20:08.217508 | 2026-08-18 15:20:08.217621 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-08-18 15:20:08.408700 | node1 | ok: "logs" 2026-08-18 15:20:08.409088 | node1 | ok: All items complete 2026-08-18 15:20:08.409150 | 2026-08-18 15:20:08.416810 | node2 | ok: "logs" 2026-08-18 15:20:08.427472 | node3 | ok: "logs" 2026-08-18 15:20:08.565092 | node2 | ok: "artifacts" 2026-08-18 15:20:08.571340 | node1 | ok: "artifacts" 2026-08-18 15:20:08.593639 | node3 | ok: "artifacts" 2026-08-18 15:20:08.713237 | node2 | ok: "docs" 2026-08-18 15:20:08.725468 | node1 | ok: "docs" 2026-08-18 15:20:08.757198 | node3 | ok: "docs" 2026-08-18 15:20:08.757336 | node3 | ok: All items complete 2026-08-18 15:20:08.757373 | 2026-08-18 15:20:08.776090 | 2026-08-18 15:20:08.776270 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-08-18 15:20:08.962821 | node1 | changed: "logs" 2026-08-18 15:20:08.982735 | node2 | changed: "logs" 2026-08-18 15:20:08.994302 | node3 | changed: "logs" 2026-08-18 15:20:09.113869 | node1 | changed: "artifacts" 2026-08-18 15:20:09.159324 | node3 | changed: "artifacts" 2026-08-18 15:20:09.166525 | node2 | changed: "artifacts" 2026-08-18 15:20:09.264203 | node1 | changed: "docs" 2026-08-18 15:20:09.321823 | node2 | changed: "docs" 2026-08-18 15:20:09.321921 | node2 | changed: All items complete 2026-08-18 15:20:09.321947 | 2026-08-18 15:20:09.326663 | node3 | changed: "docs" 2026-08-18 15:20:09.353828 | 2026-08-18 15:20:09.353942 | PLAY RECAP 2026-08-18 15:20:09.353993 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 15:20:09.354024 | node1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 15:20:09.354050 | node2 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 15:20:09.354073 | node3 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 15:20:09.354092 | 2026-08-18 15:20:09.527792 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-18 15:20:09.542591 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-18 15:20:10.143348 | 2026-08-18 15:20:10.143462 | PLAY [all] 2026-08-18 15:20:10.155300 | 2026-08-18 15:20:10.155387 | TASK [setup-uv : Extract archive] 2026-08-18 15:20:12.311985 | node3 | changed 2026-08-18 15:20:12.391630 | node1 | changed 2026-08-18 15:20:12.531945 | node2 | changed 2026-08-18 15:20:12.540724 | 2026-08-18 15:20:12.540823 | TASK [setup-uv : Print version] 2026-08-18 15:20:12.915809 | node2 | uv 0.8.13 2026-08-18 15:20:12.906534 | node1 | uv 0.8.13 2026-08-18 15:20:12.916838 | node3 | uv 0.8.13 2026-08-18 15:20:13.122241 | node1 | ok: Runtime: 0:00:00.012345 2026-08-18 15:20:13.133581 | node2 | ok: Runtime: 0:00:00.012945 2026-08-18 15:20:13.142334 | node3 | ok: Runtime: 0:00:00.013118 2026-08-18 15:20:13.158384 | 2026-08-18 15:20:13.158447 | TASK [Install Ansible collection siblings] 2026-08-18 15:20:13.495562 | node1 | ok: 2026-08-18 15:20:13.495757 | node1 | Skipping community.crypto: no checked-out sibling 2026-08-18 15:20:13.495800 | node1 | Skipping community.docker: no checked-out sibling 2026-08-18 15:20:13.495832 | node1 | Skipping community.general: no checked-out sibling 2026-08-18 15:20:13.495860 | node1 | Skipping ansible.utils: no checked-out sibling 2026-08-18 15:20:13.495888 | node1 | Skipping vexxhost.containers: no checked-out sibling 2026-08-18 15:20:13.498314 | 2026-08-18 15:20:13.498386 | PLAY RECAP 2026-08-18 15:20:13.498450 | node1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 15:20:13.498488 | node2 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 15:20:13.498523 | node3 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 15:20:13.498548 | 2026-08-18 15:20:13.622999 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-18 15:20:13.636699 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-18 15:20:14.289411 | 2026-08-18 15:20:14.289570 | PLAY [all] 2026-08-18 15:20:14.301960 | 2026-08-18 15:20:14.302037 | LOOP [Check inventory directories] 2026-08-18 15:20:14.608645 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-18 15:20:14.780189 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-08-18 15:20:14.922134 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-08-18 15:20:14.942588 | 2026-08-18 15:20:14.942841 | LOOP [Copy inventory file for Zuul] 2026-08-18 15:20:15.678500 | node1 | changed: 2026-08-18 15:20:15.678785 | node1 | { 2026-08-18 15:20:15.678830 | node1 | "ansible_loop_var": "item", 2026-08-18 15:20:15.678863 | node1 | "changed": false, 2026-08-18 15:20:15.678901 | node1 | "failed": false, 2026-08-18 15:20:15.678942 | node1 | "invocation": { 2026-08-18 15:20:15.678981 | node1 | "module_args": { 2026-08-18 15:20:15.679034 | node1 | "checksum_algorithm": "sha1", 2026-08-18 15:20:15.679062 | node1 | "follow": true, 2026-08-18 15:20:15.679089 | node1 | "get_attributes": true, 2026-08-18 15:20:15.679125 | node1 | "get_checksum": true, 2026-08-18 15:20:15.679161 | node1 | "get_mime": true, 2026-08-18 15:20:15.679193 | node1 | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-18 15:20:15.679219 | node1 | } 2026-08-18 15:20:15.679244 | node1 | }, 2026-08-18 15:20:15.679268 | node1 | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-18 15:20:15.679292 | node1 | "stat": { 2026-08-18 15:20:15.679319 | node1 | "atime": 1787066408.049089, 2026-08-18 15:20:15.679353 | node1 | "attr_flags": "e", 2026-08-18 15:20:15.679389 | node1 | "attributes": [ 2026-08-18 15:20:15.679424 | node1 | "extents" 2026-08-18 15:20:15.679455 | node1 | ], 2026-08-18 15:20:15.679482 | node1 | "block_size": 4096, 2026-08-18 15:20:15.679506 | node1 | "blocks": 8, 2026-08-18 15:20:15.679531 | node1 | "charset": "unknown", 2026-08-18 15:20:15.679561 | node1 | "ctime": 1787066408.053089, 2026-08-18 15:20:15.679596 | node1 | "dev": 64513, 2026-08-18 15:20:15.679633 | node1 | "device_type": 0, 2026-08-18 15:20:15.679668 | node1 | "executable": true, 2026-08-18 15:20:15.679704 | node1 | "exists": true, 2026-08-18 15:20:15.679738 | node1 | "gid": 1000, 2026-08-18 15:20:15.679771 | node1 | "gr_name": "zuul", 2026-08-18 15:20:15.679805 | node1 | "inode": 1042461, 2026-08-18 15:20:15.679839 | node1 | "isblk": false, 2026-08-18 15:20:15.679869 | node1 | "ischr": false, 2026-08-18 15:20:15.679903 | node1 | "isdir": true, 2026-08-18 15:20:15.679936 | node1 | "isfifo": false, 2026-08-18 15:20:15.679965 | node1 | "isgid": false, 2026-08-18 15:20:15.679991 | node1 | "islnk": false, 2026-08-18 15:20:15.680017 | node1 | "isreg": false, 2026-08-18 15:20:15.680047 | node1 | "issock": false, 2026-08-18 15:20:15.680081 | node1 | "isuid": false, 2026-08-18 15:20:15.680115 | node1 | "mimetype": "unknown", 2026-08-18 15:20:15.680146 | node1 | "mode": "0755", 2026-08-18 15:20:15.680177 | node1 | "mtime": 1787066392.0545144, 2026-08-18 15:20:15.680210 | node1 | "nlink": 10, 2026-08-18 15:20:15.680240 | node1 | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-18 15:20:15.680271 | node1 | "pw_name": "zuul", 2026-08-18 15:20:15.680306 | node1 | "readable": true, 2026-08-18 15:20:15.680336 | node1 | "rgrp": true, 2026-08-18 15:20:15.680362 | node1 | "roth": true, 2026-08-18 15:20:15.680392 | node1 | "rusr": true, 2026-08-18 15:20:15.680427 | node1 | "size": 4096, 2026-08-18 15:20:15.680458 | node1 | "uid": 1000, 2026-08-18 15:20:15.680483 | node1 | "version": "2562685600", 2026-08-18 15:20:15.680513 | node1 | "wgrp": false, 2026-08-18 15:20:15.680550 | node1 | "woth": false, 2026-08-18 15:20:15.680581 | node1 | "writeable": true, 2026-08-18 15:20:15.680610 | node1 | "wusr": true, 2026-08-18 15:20:15.680644 | node1 | "xgrp": true, 2026-08-18 15:20:15.680677 | node1 | "xoth": true, 2026-08-18 15:20:15.680703 | node1 | "xusr": true 2026-08-18 15:20:15.680728 | node1 | } 2026-08-18 15:20:15.680769 | node1 | } 2026-08-18 15:20:15.680831 | node1 | ok: All items complete 2026-08-18 15:20:15.680920 | 2026-08-18 15:20:15.682577 | node1 | skipping: Conditional result was False 2026-08-18 15:20:15.683198 | node1 | skipping: Conditional result was False 2026-08-18 15:20:15.697643 | 2026-08-18 15:20:15.697809 | LOOP [Switch "ansible_host" to private IP] 2026-08-18 15:20:16.012312 | node1 | changed: 3 replacements made 2026-08-18 15:20:16.013858 | node1 | skipping: Conditional result was False 2026-08-18 15:20:16.016166 | node1 | skipping: Conditional result was False 2026-08-18 15:20:16.033884 | 2026-08-18 15:20:16.034036 | TASK [Run Molecule scenario] 2026-08-18 15:20:17.012928 | node1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-08-18 15:20:17.663984 | node1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-08-18 15:20:17.829356 | node1 | Using CPython 3.13.7 2026-08-18 15:20:17.829415 | node1 | Creating virtual environment at: .venv 2026-08-18 15:20:17.875649 | node1 | Downloading pygments (1.2MiB) 2026-08-18 15:20:17.875837 | node1 | Downloading ansible-core (2.1MiB) 2026-08-18 15:20:17.876678 | node1 | Downloading cryptography (4.3MiB) 2026-08-18 15:20:17.876863 | node1 | Downloading netaddr (2.2MiB) 2026-08-18 15:20:18.058463 | node1 | Downloading netaddr 2026-08-18 15:20:18.069399 | node1 | Downloading cryptography 2026-08-18 15:20:18.112975 | node1 | Downloading pygments 2026-08-18 15:20:18.228472 | node1 | Downloading ansible-core 2026-08-18 15:20:18.256110 | node1 | Installed 42 packages in 27ms 2026-08-18 15:20:19.329092 | node1 | INFO Collection 'vexxhost.ceph' detected. 2026-08-18 15:20:19.329173 | node1 | INFO Scenarios will be used from 'extensions/molecule' 2026-08-18 15:20:19.941768 | node1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-08-18 15:20:19.941846 | node1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-08-18 15:21:00.898565 | node1 | INFO [default > dependency] Executing 2026-08-18 15:21:00.898769 | node1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-08-18 15:21:00.899056 | node1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-08-18 15:21:00.899152 | node1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-08-18 15:21:00.904950 | node1 | INFO [default > cleanup] Executing 2026-08-18 15:21:00.905217 | node1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 15:21:00.910092 | node1 | INFO [default > destroy] Executing 2026-08-18 15:21:00.910121 | node1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-18 15:21:00.910198 | node1 | INFO [default > destroy] Executed: Successful 2026-08-18 15:21:00.915020 | node1 | INFO [default > syntax] Executing 2026-08-18 15:21:02.027097 | node1 | 2026-08-18 15:21:02.027376 | node1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-08-18 15:21:02.090533 | node1 | INFO [default > syntax] Executed: Successful 2026-08-18 15:21:02.099908 | node1 | INFO [default > create] Executing 2026-08-18 15:21:02.101269 | node1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 15:21:02.106179 | node1 | INFO [default > prepare] Executing 2026-08-18 15:21:02.763634 | node1 | 2026-08-18 15:21:02.763716 | node1 | PLAY [Prepare] ***************************************************************** 2026-08-18 15:21:02.763806 | node1 | 2026-08-18 15:21:02.763901 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:21:02.763997 | node1 | Tuesday 18 August 2026 15:21:02 +0000 (0:00:00.029) 0:00:00.029 ******** 2026-08-18 15:21:03.865088 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python 2026-08-18 15:21:03.865155 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 15:21:03.865196 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:21:03.865292 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:21:03.865388 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:21:03.910780 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python 2026-08-18 15:21:03.911030 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 15:21:03.911204 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:21:03.911415 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:21:03.911647 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:21:03.927370 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python 2026-08-18 15:21:03.927552 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 15:21:03.927762 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:21:03.927969 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:21:03.928187 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:21:03.936434 | node1 | ok: [node1] 2026-08-18 15:21:03.936610 | node1 | ok: [node3] 2026-08-18 15:21:03.936830 | node1 | ok: [node2] 2026-08-18 15:21:03.937016 | node1 | 2026-08-18 15:21:03.937225 | node1 | TASK [Configure short hostname] ************************************************ 2026-08-18 15:21:03.937426 | node1 | Tuesday 18 August 2026 15:21:03 +0000 (0:00:01.173) 0:00:01.202 ******** 2026-08-18 15:21:04.647917 | node1 | changed: [node1] 2026-08-18 15:21:04.648099 | node1 | changed: [node2] 2026-08-18 15:21:04.648313 | node1 | changed: [node3] 2026-08-18 15:21:04.648573 | node1 | 2026-08-18 15:21:04.648798 | node1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-08-18 15:21:04.649022 | node1 | Tuesday 18 August 2026 15:21:04 +0000 (0:00:00.711) 0:00:01.913 ******** 2026-08-18 15:21:04.898632 | node1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-08-18 15:21:04.898901 | node1 | with a mode of 0700, this may cause issues when running as another user. To 2026-08-18 15:21:04.899092 | node1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-08-18 15:21:04.919947 | node1 | changed: [node1] 2026-08-18 15:21:04.920125 | node1 | changed: [node2] 2026-08-18 15:21:04.920318 | node1 | changed: [node3] 2026-08-18 15:21:04.920534 | node1 | 2026-08-18 15:21:04.920737 | node1 | TASK [Update apt cache] ******************************************************** 2026-08-18 15:21:04.920936 | node1 | Tuesday 18 August 2026 15:21:04 +0000 (0:00:00.272) 0:00:02.185 ******** 2026-08-18 15:21:11.952263 | node1 | changed: [node3] 2026-08-18 15:21:11.952408 | node1 | changed: [node1] 2026-08-18 15:21:11.952627 | node1 | changed: [node2] 2026-08-18 15:21:11.952807 | node1 | 2026-08-18 15:21:11.953010 | node1 | PLAY [Create devices for Ceph] ************************************************* 2026-08-18 15:21:11.953187 | node1 | 2026-08-18 15:21:11.953382 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:21:11.953584 | node1 | Tuesday 18 August 2026 15:21:11 +0000 (0:00:07.032) 0:00:09.218 ******** 2026-08-18 15:21:12.675349 | node1 | ok: [node1] 2026-08-18 15:21:12.675555 | node1 | ok: [node2] 2026-08-18 15:21:12.675752 | node1 | ok: [node3] 2026-08-18 15:21:12.675936 | node1 | 2026-08-18 15:21:12.676145 | node1 | TASK [Install depedencies] ***************************************************** 2026-08-18 15:21:12.676354 | node1 | Tuesday 18 August 2026 15:21:12 +0000 (0:00:00.722) 0:00:09.941 ******** 2026-08-18 15:21:33.354361 | node1 | changed: [node2] 2026-08-18 15:21:33.354528 | node1 | changed: [node1] 2026-08-18 15:21:33.354713 | node1 | changed: [node3] 2026-08-18 15:21:33.354898 | node1 | 2026-08-18 15:21:33.355104 | node1 | TASK [Start up service] ******************************************************** 2026-08-18 15:21:33.355306 | node1 | Tuesday 18 August 2026 15:21:33 +0000 (0:00:20.678) 0:00:30.619 ******** 2026-08-18 15:21:33.950747 | node1 | ok: [node2] 2026-08-18 15:21:33.950908 | node1 | ok: [node1] 2026-08-18 15:21:33.951100 | node1 | ok: [node3] 2026-08-18 15:21:33.951286 | node1 | 2026-08-18 15:21:33.951585 | node1 | TASK [Generate lvm.conf] ******************************************************* 2026-08-18 15:21:33.951849 | node1 | Tuesday 18 August 2026 15:21:33 +0000 (0:00:00.596) 0:00:31.216 ******** 2026-08-18 15:21:34.250884 | node1 | ok: [node1] 2026-08-18 15:21:34.251073 | node1 | ok: [node2] 2026-08-18 15:21:34.251261 | node1 | ok: [node3] 2026-08-18 15:21:34.251452 | node1 | 2026-08-18 15:21:34.251655 | node1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-08-18 15:21:34.251857 | node1 | Tuesday 18 August 2026 15:21:34 +0000 (0:00:00.300) 0:00:31.516 ******** 2026-08-18 15:21:34.903768 | node1 | changed: [node1] 2026-08-18 15:21:34.903976 | node1 | changed: [node2] 2026-08-18 15:21:34.904192 | node1 | changed: [node3] 2026-08-18 15:21:34.904425 | node1 | 2026-08-18 15:21:34.904731 | node1 | TASK [Get list of all loopback devices] **************************************** 2026-08-18 15:21:34.904945 | node1 | Tuesday 18 August 2026 15:21:34 +0000 (0:00:00.652) 0:00:32.169 ******** 2026-08-18 15:21:35.112029 | node1 | ok: [node1] 2026-08-18 15:21:35.112104 | node1 | ok: [node2] 2026-08-18 15:21:35.112255 | node1 | ok: [node3] 2026-08-18 15:21:35.112389 | node1 | 2026-08-18 15:21:35.112552 | node1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-08-18 15:21:35.112715 | node1 | Tuesday 18 August 2026 15:21:35 +0000 (0:00:00.208) 0:00:32.377 ******** 2026-08-18 15:21:35.145365 | node1 | skipping: [node1] 2026-08-18 15:21:35.145552 | node1 | skipping: [node2] 2026-08-18 15:21:35.145753 | node1 | skipping: [node3] 2026-08-18 15:21:35.145942 | node1 | 2026-08-18 15:21:35.146168 | node1 | TASK [Create devices for Ceph] ************************************************* 2026-08-18 15:21:35.146374 | node1 | Tuesday 18 August 2026 15:21:35 +0000 (0:00:00.033) 0:00:32.411 ******** 2026-08-18 15:21:35.720290 | node1 | changed: [node1] => (item=osd0) 2026-08-18 15:21:35.720405 | node1 | changed: [node2] => (item=osd0) 2026-08-18 15:21:35.720655 | node1 | changed: [node3] => (item=osd0) 2026-08-18 15:21:35.720939 | node1 | changed: [node1] => (item=osd1) 2026-08-18 15:21:35.721137 | node1 | changed: [node2] => (item=osd1) 2026-08-18 15:21:35.721336 | node1 | changed: [node3] => (item=osd1) 2026-08-18 15:21:35.721534 | node1 | changed: [node2] => (item=osd2) 2026-08-18 15:21:35.721690 | node1 | changed: [node1] => (item=osd2) 2026-08-18 15:21:35.721883 | node1 | changed: [node3] => (item=osd2) 2026-08-18 15:21:35.722065 | node1 | 2026-08-18 15:21:35.722283 | node1 | TASK [Set permissions on loopback devices] ************************************* 2026-08-18 15:21:35.722480 | node1 | Tuesday 18 August 2026 15:21:35 +0000 (0:00:00.574) 0:00:32.985 ******** 2026-08-18 15:21:36.358874 | node1 | changed: [node1] => (item=osd0) 2026-08-18 15:21:36.358999 | node1 | changed: [node2] => (item=osd0) 2026-08-18 15:21:36.359230 | node1 | changed: [node3] => (item=osd0) 2026-08-18 15:21:36.359439 | node1 | changed: [node1] => (item=osd1) 2026-08-18 15:21:36.359676 | node1 | changed: [node2] => (item=osd1) 2026-08-18 15:21:36.359895 | node1 | changed: [node3] => (item=osd1) 2026-08-18 15:21:36.360099 | node1 | changed: [node1] => (item=osd2) 2026-08-18 15:21:36.360313 | node1 | changed: [node2] => (item=osd2) 2026-08-18 15:21:36.360573 | node1 | changed: [node3] => (item=osd2) 2026-08-18 15:21:36.360784 | node1 | 2026-08-18 15:21:36.361009 | node1 | TASK [Start loop devices] ****************************************************** 2026-08-18 15:21:36.361219 | node1 | Tuesday 18 August 2026 15:21:36 +0000 (0:00:00.638) 0:00:33.624 ******** 2026-08-18 15:21:37.064043 | node1 | changed: [node1] => (item=osd0) 2026-08-18 15:21:37.064266 | node1 | changed: [node2] => (item=osd0) 2026-08-18 15:21:37.064580 | node1 | changed: [node3] => (item=osd0) 2026-08-18 15:21:37.064816 | node1 | changed: [node1] => (item=osd1) 2026-08-18 15:21:37.065058 | node1 | changed: [node2] => (item=osd1) 2026-08-18 15:21:37.065284 | node1 | changed: [node3] => (item=osd1) 2026-08-18 15:21:37.065505 | node1 | changed: [node1] => (item=osd2) 2026-08-18 15:21:37.065723 | node1 | changed: [node2] => (item=osd2) 2026-08-18 15:21:37.065938 | node1 | changed: [node3] => (item=osd2) 2026-08-18 15:21:37.066166 | node1 | 2026-08-18 15:21:37.066394 | node1 | TASK [Create a volume group for each loop device] ****************************** 2026-08-18 15:21:37.066619 | node1 | Tuesday 18 August 2026 15:21:37 +0000 (0:00:00.705) 0:00:34.329 ******** 2026-08-18 15:21:40.259960 | node1 | changed: [node1] => (item=osd0) 2026-08-18 15:21:40.260033 | node1 | changed: [node3] => (item=osd0) 2026-08-18 15:21:40.260247 | node1 | changed: [node2] => (item=osd0) 2026-08-18 15:21:40.260415 | node1 | changed: [node1] => (item=osd1) 2026-08-18 15:21:40.260562 | node1 | changed: [node2] => (item=osd1) 2026-08-18 15:21:40.260700 | node1 | changed: [node3] => (item=osd1) 2026-08-18 15:21:40.260828 | node1 | changed: [node1] => (item=osd2) 2026-08-18 15:21:40.260953 | node1 | changed: [node2] => (item=osd2) 2026-08-18 15:21:40.261077 | node1 | changed: [node3] => (item=osd2) 2026-08-18 15:21:40.261194 | node1 | 2026-08-18 15:21:40.261326 | node1 | TASK [Create a logical volume for each loop device] **************************** 2026-08-18 15:21:40.261453 | node1 | Tuesday 18 August 2026 15:21:40 +0000 (0:00:03.195) 0:00:37.525 ******** 2026-08-18 15:21:42.195216 | node1 | changed: [node2] => (item=ceph-node2-osd0) 2026-08-18 15:21:42.195412 | node1 | changed: [node1] => (item=ceph-node1-osd0) 2026-08-18 15:21:42.195635 | node1 | changed: [node3] => (item=ceph-node3-osd0) 2026-08-18 15:21:42.195883 | node1 | changed: [node2] => (item=ceph-node2-osd1) 2026-08-18 15:21:42.196091 | node1 | changed: [node1] => (item=ceph-node1-osd1) 2026-08-18 15:21:42.196330 | node1 | changed: [node3] => (item=ceph-node3-osd1) 2026-08-18 15:21:42.196587 | node1 | changed: [node2] => (item=ceph-node2-osd2) 2026-08-18 15:21:42.196809 | node1 | changed: [node1] => (item=ceph-node1-osd2) 2026-08-18 15:21:42.197033 | node1 | changed: [node3] => (item=ceph-node3-osd2) 2026-08-18 15:21:42.197221 | node1 | 2026-08-18 15:21:42.197433 | node1 | PLAY RECAP ********************************************************************* 2026-08-18 15:21:42.197672 | node1 | node1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 15:21:42.197909 | node1 | node2 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 15:21:42.198154 | node1 | node3 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 15:21:42.198346 | node1 | 2026-08-18 15:21:42.198535 | node1 | 2026-08-18 15:21:42.198750 | node1 | TASKS RECAP ******************************************************************** 2026-08-18 15:21:42.198965 | node1 | Tuesday 18 August 2026 15:21:42 +0000 (0:00:01.935) 0:00:39.461 ******** 2026-08-18 15:21:42.199168 | node1 | =============================================================================== 2026-08-18 15:21:42.199378 | node1 | Install depedencies ---------------------------------------------------- 20.68s 2026-08-18 15:21:42.199587 | node1 | Update apt cache -------------------------------------------------------- 7.03s 2026-08-18 15:21:42.199799 | node1 | Create a volume group for each loop device ------------------------------ 3.20s 2026-08-18 15:21:42.200010 | node1 | Create a logical volume for each loop device ---------------------------- 1.94s 2026-08-18 15:21:42.200222 | node1 | Gathering Facts --------------------------------------------------------- 1.17s 2026-08-18 15:21:42.200517 | node1 | Gathering Facts --------------------------------------------------------- 0.72s 2026-08-18 15:21:42.200728 | node1 | Configure short hostname ------------------------------------------------ 0.71s 2026-08-18 15:21:42.200941 | node1 | Start loop devices ------------------------------------------------------ 0.71s 2026-08-18 15:21:42.201157 | node1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.65s 2026-08-18 15:21:42.201380 | node1 | Set permissions on loopback devices ------------------------------------- 0.64s 2026-08-18 15:21:42.201530 | node1 | Start up service -------------------------------------------------------- 0.60s 2026-08-18 15:21:42.201629 | node1 | Create devices for Ceph ------------------------------------------------- 0.57s 2026-08-18 15:21:42.201711 | node1 | Generate lvm.conf ------------------------------------------------------- 0.30s 2026-08-18 15:21:42.201801 | node1 | Ensure hostname inside hosts file --------------------------------------- 0.27s 2026-08-18 15:21:42.201899 | node1 | Get list of all loopback devices ---------------------------------------- 0.21s 2026-08-18 15:21:42.201981 | node1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-08-18 15:21:42.267552 | node1 | INFO [default > prepare] Executed: Successful 2026-08-18 15:21:42.276516 | node1 | INFO [default > converge] Executing 2026-08-18 15:21:43.305016 | node1 | 2026-08-18 15:21:43.305232 | node1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-18 15:21:43.305425 | node1 | 2026-08-18 15:21:43.305641 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:21:43.305852 | node1 | Tuesday 18 August 2026 15:21:43 +0000 (0:00:00.077) 0:00:00.077 ******** 2026-08-18 15:21:44.373833 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python 2026-08-18 15:21:44.374021 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 15:21:44.374238 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:21:44.374452 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:21:44.374666 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:21:44.406279 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python 2026-08-18 15:21:44.406520 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 15:21:44.406726 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:21:44.407002 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:21:44.407227 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:21:44.425350 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python 2026-08-18 15:21:44.425559 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 15:21:44.425758 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:21:44.425960 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:21:44.426160 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:21:44.476214 | node1 | ok: [node1] 2026-08-18 15:21:44.476439 | node1 | ok: [node2] 2026-08-18 15:21:44.476639 | node1 | ok: [node3] 2026-08-18 15:21:44.476824 | node1 | 2026-08-18 15:21:44.477033 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:21:44.477239 | node1 | Tuesday 18 August 2026 15:21:44 +0000 (0:00:01.171) 0:00:01.248 ******** 2026-08-18 15:21:44.786471 | node1 | ok: [node1] 2026-08-18 15:21:44.786642 | node1 | ok: [node2] 2026-08-18 15:21:44.786839 | node1 | ok: [node3] 2026-08-18 15:21:44.787049 | node1 | 2026-08-18 15:21:44.787260 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:21:44.787438 | node1 | Tuesday 18 August 2026 15:21:44 +0000 (0:00:00.309) 0:00:01.558 ******** 2026-08-18 15:21:44.860521 | node1 | skipping: [node1] 2026-08-18 15:21:44.860741 | node1 | skipping: [node2] 2026-08-18 15:21:44.860971 | node1 | skipping: [node3] 2026-08-18 15:21:44.861131 | node1 | 2026-08-18 15:21:44.861332 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:21:44.861531 | node1 | Tuesday 18 August 2026 15:21:44 +0000 (0:00:00.074) 0:00:01.632 ******** 2026-08-18 15:21:45.165479 | node1 | changed: [node2] 2026-08-18 15:21:45.165665 | node1 | changed: [node1] 2026-08-18 15:21:45.165962 | node1 | changed: [node3] 2026-08-18 15:21:45.166134 | node1 | 2026-08-18 15:21:45.166351 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:21:45.166564 | node1 | Tuesday 18 August 2026 15:21:45 +0000 (0:00:00.304) 0:00:01.937 ******** 2026-08-18 15:21:45.266990 | node1 | ok: [node3] => { 2026-08-18 15:21:45.267188 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:21:45.267387 | node1 | } 2026-08-18 15:21:45.267593 | node1 | ok: [node2] => { 2026-08-18 15:21:45.267809 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:21:45.268006 | node1 | } 2026-08-18 15:21:45.268201 | node1 | ok: [node1] => { 2026-08-18 15:21:45.268449 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:21:45.268637 | node1 | } 2026-08-18 15:21:45.268823 | node1 | 2026-08-18 15:21:45.269031 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:21:45.269233 | node1 | Tuesday 18 August 2026 15:21:45 +0000 (0:00:00.101) 0:00:02.039 ******** 2026-08-18 15:21:46.052706 | node1 | changed: [node1] 2026-08-18 15:21:46.052913 | node1 | changed: [node2] 2026-08-18 15:21:46.053202 | node1 | changed: [node3] 2026-08-18 15:21:46.053456 | node1 | 2026-08-18 15:21:46.053716 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:21:46.053938 | node1 | Tuesday 18 August 2026 15:21:46 +0000 (0:00:00.784) 0:00:02.824 ******** 2026-08-18 15:21:46.141541 | node1 | skipping: [node1] 2026-08-18 15:21:46.141673 | node1 | skipping: [node2] 2026-08-18 15:21:46.141875 | node1 | skipping: [node3] 2026-08-18 15:21:46.142063 | node1 | 2026-08-18 15:21:46.142292 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:21:46.142508 | node1 | Tuesday 18 August 2026 15:21:46 +0000 (0:00:00.089) 0:00:02.913 ******** 2026-08-18 15:21:46.235207 | node1 | skipping: [node1] 2026-08-18 15:21:46.235334 | node1 | skipping: [node2] 2026-08-18 15:21:46.235529 | node1 | skipping: [node3] 2026-08-18 15:21:46.235720 | node1 | 2026-08-18 15:21:46.235932 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:21:46.236137 | node1 | Tuesday 18 August 2026 15:21:46 +0000 (0:00:00.093) 0:00:03.007 ******** 2026-08-18 15:21:46.468890 | node1 | ok: [node1] 2026-08-18 15:21:46.469054 | node1 | ok: [node2] 2026-08-18 15:21:46.469245 | node1 | ok: [node3] 2026-08-18 15:21:46.469432 | node1 | 2026-08-18 15:21:46.469645 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:21:46.469863 | node1 | Tuesday 18 August 2026 15:21:46 +0000 (0:00:00.233) 0:00:03.241 ******** 2026-08-18 15:21:47.781876 | node1 | ok: [node1] 2026-08-18 15:21:47.781940 | node1 | ok: [node2] 2026-08-18 15:21:47.781952 | node1 | ok: [node3] 2026-08-18 15:21:47.781962 | node1 | 2026-08-18 15:21:47.781972 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:21:47.781981 | node1 | Tuesday 18 August 2026 15:21:47 +0000 (0:00:01.312) 0:00:04.553 ******** 2026-08-18 15:21:47.876221 | node1 | ok: [node1] => { 2026-08-18 15:21:47.876276 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:21:47.876477 | node1 | } 2026-08-18 15:21:47.876542 | node1 | ok: [node2] => { 2026-08-18 15:21:47.877242 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:21:47.877260 | node1 | } 2026-08-18 15:21:47.877265 | node1 | ok: [node3] => { 2026-08-18 15:21:47.877270 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:21:47.877274 | node1 | } 2026-08-18 15:21:47.877278 | node1 | 2026-08-18 15:21:47.877282 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:21:47.877287 | node1 | Tuesday 18 August 2026 15:21:47 +0000 (0:00:00.095) 0:00:04.648 ******** 2026-08-18 15:21:48.989012 | node1 | changed: [node2] 2026-08-18 15:21:48.989070 | node1 | changed: [node1] 2026-08-18 15:21:48.989162 | node1 | changed: [node3] 2026-08-18 15:21:48.989481 | node1 | 2026-08-18 15:21:48.989497 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:21:48.989502 | node1 | Tuesday 18 August 2026 15:21:48 +0000 (0:00:01.112) 0:00:05.761 ******** 2026-08-18 15:21:51.866882 | node1 | changed: [node1] 2026-08-18 15:21:51.866949 | node1 | changed: [node3] 2026-08-18 15:21:51.867026 | node1 | changed: [node2] 2026-08-18 15:21:51.867375 | node1 | 2026-08-18 15:21:51.867423 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:21:51.867429 | node1 | Tuesday 18 August 2026 15:21:51 +0000 (0:00:02.877) 0:00:08.639 ******** 2026-08-18 15:21:51.897827 | node1 | skipping: [node1] 2026-08-18 15:21:51.920299 | node1 | skipping: [node2] 2026-08-18 15:21:51.920406 | node1 | skipping: [node3] 2026-08-18 15:21:51.920498 | node1 | 2026-08-18 15:21:51.920595 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:21:51.920722 | node1 | Tuesday 18 August 2026 15:21:51 +0000 (0:00:00.053) 0:00:08.692 ******** 2026-08-18 15:21:51.980340 | node1 | skipping: [node1] 2026-08-18 15:21:51.980458 | node1 | skipping: [node2] 2026-08-18 15:21:51.980532 | node1 | skipping: [node3] 2026-08-18 15:21:51.980618 | node1 | 2026-08-18 15:21:51.980713 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:21:51.980819 | node1 | Tuesday 18 August 2026 15:21:51 +0000 (0:00:00.059) 0:00:08.752 ******** 2026-08-18 15:21:52.012578 | node1 | skipping: [node1] 2026-08-18 15:21:52.037436 | node1 | skipping: [node2] 2026-08-18 15:21:52.037632 | node1 | skipping: [node3] 2026-08-18 15:21:52.037816 | node1 | 2026-08-18 15:21:52.038024 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:21:52.038222 | node1 | Tuesday 18 August 2026 15:21:52 +0000 (0:00:00.057) 0:00:08.809 ******** 2026-08-18 15:21:57.618665 | node1 | changed: [node1] 2026-08-18 15:21:57.618806 | node1 | changed: [node3] 2026-08-18 15:21:57.619078 | node1 | changed: [node2] 2026-08-18 15:21:57.619267 | node1 | 2026-08-18 15:21:57.619511 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:21:57.619735 | node1 | Tuesday 18 August 2026 15:21:57 +0000 (0:00:05.580) 0:00:14.390 ******** 2026-08-18 15:21:58.177744 | node1 | changed: [node1] 2026-08-18 15:21:58.177858 | node1 | changed: [node2] 2026-08-18 15:21:58.177994 | node1 | changed: [node3] 2026-08-18 15:21:58.178123 | node1 | 2026-08-18 15:21:58.178271 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:21:58.178414 | node1 | Tuesday 18 August 2026 15:21:58 +0000 (0:00:00.559) 0:00:14.950 ******** 2026-08-18 15:21:59.136556 | node1 | changed: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:21:59.136620 | node1 | changed: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:21:59.136631 | node1 | changed: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:21:59.136641 | node1 | changed: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:21:59.139719 | node1 | changed: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:21:59.139821 | node1 | changed: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:21:59.139833 | node1 | changed: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:21:59.139843 | node1 | changed: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:21:59.139852 | node1 | changed: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:21:59.139862 | node1 | changed: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:21:59.139872 | node1 | changed: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:21:59.139881 | node1 | changed: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:21:59.139901 | node1 | changed: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:21:59.139912 | node1 | changed: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:21:59.139934 | node1 | changed: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:21:59.139944 | node1 | 2026-08-18 15:21:59.139954 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:21:59.139964 | node1 | Tuesday 18 August 2026 15:21:59 +0000 (0:00:00.957) 0:00:15.907 ******** 2026-08-18 15:21:59.753471 | node1 | changed: [node1] 2026-08-18 15:21:59.753560 | node1 | changed: [node2] 2026-08-18 15:21:59.753695 | node1 | changed: [node3] 2026-08-18 15:21:59.755143 | node1 | 2026-08-18 15:21:59.755162 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:21:59.755170 | node1 | Tuesday 18 August 2026 15:21:59 +0000 (0:00:00.597) 0:00:16.505 ******** 2026-08-18 15:21:59.755176 | node1 | 2026-08-18 15:21:59.755182 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:21:59.755187 | node1 | Tuesday 18 August 2026 15:21:59 +0000 (0:00:00.007) 0:00:16.512 ******** 2026-08-18 15:21:59.755193 | node1 | 2026-08-18 15:21:59.755199 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:21:59.755204 | node1 | Tuesday 18 August 2026 15:21:59 +0000 (0:00:00.006) 0:00:16.519 ******** 2026-08-18 15:21:59.755210 | node1 | 2026-08-18 15:21:59.755215 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 15:21:59.755221 | node1 | Tuesday 18 August 2026 15:21:59 +0000 (0:00:00.006) 0:00:16.526 ******** 2026-08-18 15:22:00.652266 | node1 | ok: [node1] 2026-08-18 15:22:00.652315 | node1 | ok: [node2] 2026-08-18 15:22:00.652544 | node1 | ok: [node3] 2026-08-18 15:22:00.652641 | node1 | 2026-08-18 15:22:00.652654 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-18 15:22:00.652761 | node1 | Tuesday 18 August 2026 15:22:00 +0000 (0:00:00.898) 0:00:17.424 ******** 2026-08-18 15:22:01.106483 | node1 | changed: [node2] 2026-08-18 15:22:01.106564 | node1 | changed: [node1] 2026-08-18 15:22:01.106934 | node1 | changed: [node3] 2026-08-18 15:22:01.107029 | node1 | 2026-08-18 15:22:01.107545 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:22:01.107725 | node1 | Tuesday 18 August 2026 15:22:01 +0000 (0:00:00.453) 0:00:17.878 ******** 2026-08-18 15:22:01.675219 | node1 | changed: [node2] 2026-08-18 15:22:01.675262 | node1 | changed: [node3] 2026-08-18 15:22:01.675267 | node1 | changed: [node1] 2026-08-18 15:22:01.675272 | node1 | 2026-08-18 15:22:01.675277 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:22:01.675281 | node1 | Tuesday 18 August 2026 15:22:01 +0000 (0:00:00.568) 0:00:18.447 ******** 2026-08-18 15:22:01.912463 | node1 | ok: [node1] 2026-08-18 15:22:01.912751 | node1 | ok: [node2] 2026-08-18 15:22:01.912764 | node1 | ok: [node3] 2026-08-18 15:22:01.912875 | node1 | 2026-08-18 15:22:01.913095 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:22:01.913310 | node1 | Tuesday 18 August 2026 15:22:01 +0000 (0:00:00.237) 0:00:18.684 ******** 2026-08-18 15:22:02.009680 | node1 | ok: [node1] => { 2026-08-18 15:22:02.009872 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:22:02.010110 | node1 | } 2026-08-18 15:22:02.010368 | node1 | ok: [node2] => { 2026-08-18 15:22:02.010585 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:22:02.010773 | node1 | } 2026-08-18 15:22:02.010969 | node1 | ok: [node3] => { 2026-08-18 15:22:02.011183 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:22:02.011367 | node1 | } 2026-08-18 15:22:02.011545 | node1 | 2026-08-18 15:22:02.011745 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:22:02.011941 | node1 | Tuesday 18 August 2026 15:22:02 +0000 (0:00:00.097) 0:00:18.782 ******** 2026-08-18 15:22:03.000486 | node1 | changed: [node1] 2026-08-18 15:22:03.000548 | node1 | changed: [node3] 2026-08-18 15:22:03.000559 | node1 | changed: [node2] 2026-08-18 15:22:03.000575 | node1 | 2026-08-18 15:22:03.000921 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:22:03.000981 | node1 | Tuesday 18 August 2026 15:22:02 +0000 (0:00:00.990) 0:00:19.772 ******** 2026-08-18 15:22:07.458438 | node1 | changed: [node1] 2026-08-18 15:22:07.458506 | node1 | changed: [node2] 2026-08-18 15:22:07.458560 | node1 | changed: [node3] 2026-08-18 15:22:07.458855 | node1 | 2026-08-18 15:22:07.458894 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:22:07.458900 | node1 | Tuesday 18 August 2026 15:22:07 +0000 (0:00:04.458) 0:00:24.230 ******** 2026-08-18 15:22:08.736261 | node1 | ok: [node1] 2026-08-18 15:22:08.736548 | node1 | ok: [node2] 2026-08-18 15:22:08.736614 | node1 | ok: [node3] 2026-08-18 15:22:08.736631 | node1 | 2026-08-18 15:22:08.736928 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:22:08.736977 | node1 | Tuesday 18 August 2026 15:22:08 +0000 (0:00:01.277) 0:00:25.508 ******** 2026-08-18 15:22:09.052793 | node1 | changed: [node1] 2026-08-18 15:22:09.052852 | node1 | changed: [node3] 2026-08-18 15:22:09.053194 | node1 | changed: [node2] 2026-08-18 15:22:09.053209 | node1 | 2026-08-18 15:22:09.053214 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:22:09.053219 | node1 | Tuesday 18 August 2026 15:22:09 +0000 (0:00:00.316) 0:00:25.824 ******** 2026-08-18 15:22:09.557622 | node1 | changed: [node1] 2026-08-18 15:22:09.557689 | node1 | changed: [node3] 2026-08-18 15:22:09.557757 | node1 | changed: [node2] 2026-08-18 15:22:09.558053 | node1 | 2026-08-18 15:22:09.558210 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:22:09.558217 | node1 | Tuesday 18 August 2026 15:22:09 +0000 (0:00:00.505) 0:00:26.330 ******** 2026-08-18 15:22:10.142241 | node1 | changed: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:22:10.144103 | node1 | changed: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:22:10.144131 | node1 | changed: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:22:10.144141 | node1 | changed: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:22:10.144151 | node1 | changed: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:22:10.144159 | node1 | changed: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:22:10.144167 | node1 | changed: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:22:10.144175 | node1 | changed: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:22:10.144183 | node1 | changed: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:22:10.144191 | node1 | 2026-08-18 15:22:10.144200 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:22:10.144208 | node1 | Tuesday 18 August 2026 15:22:10 +0000 (0:00:00.584) 0:00:26.914 ******** 2026-08-18 15:22:10.635030 | node1 | changed: [node1] 2026-08-18 15:22:10.635101 | node1 | changed: [node2] 2026-08-18 15:22:10.635173 | node1 | changed: [node3] 2026-08-18 15:22:10.635485 | node1 | 2026-08-18 15:22:10.635528 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:22:10.635534 | node1 | Tuesday 18 August 2026 15:22:10 +0000 (0:00:00.493) 0:00:27.407 ******** 2026-08-18 15:22:11.164718 | node1 | changed: [node1] 2026-08-18 15:22:11.164787 | node1 | changed: [node2] 2026-08-18 15:22:11.165990 | node1 | changed: [node3] 2026-08-18 15:22:11.166032 | node1 | 2026-08-18 15:22:11.166039 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:22:11.166045 | node1 | Tuesday 18 August 2026 15:22:11 +0000 (0:00:00.508) 0:00:27.916 ******** 2026-08-18 15:22:11.166050 | node1 | 2026-08-18 15:22:11.166054 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:22:11.166064 | node1 | Tuesday 18 August 2026 15:22:11 +0000 (0:00:00.007) 0:00:27.923 ******** 2026-08-18 15:22:11.166068 | node1 | 2026-08-18 15:22:11.166072 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:22:11.166077 | node1 | Tuesday 18 August 2026 15:22:11 +0000 (0:00:00.007) 0:00:27.930 ******** 2026-08-18 15:22:11.166081 | node1 | 2026-08-18 15:22:11.166084 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 15:22:11.166088 | node1 | Tuesday 18 August 2026 15:22:11 +0000 (0:00:00.006) 0:00:27.937 ******** 2026-08-18 15:22:11.856103 | node1 | ok: [node3] 2026-08-18 15:22:11.856146 | node1 | ok: [node1] 2026-08-18 15:22:11.856151 | node1 | ok: [node2] 2026-08-18 15:22:11.856155 | node1 | 2026-08-18 15:22:11.856160 | node1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-18 15:22:11.856164 | node1 | Tuesday 18 August 2026 15:22:11 +0000 (0:00:00.691) 0:00:28.628 ******** 2026-08-18 15:22:13.313546 | node1 | changed: [node1] 2026-08-18 15:22:13.313658 | node1 | changed: [node3] 2026-08-18 15:22:13.313682 | node1 | changed: [node2] 2026-08-18 15:22:13.314112 | node1 | 2026-08-18 15:22:13.314201 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:22:13.314208 | node1 | Tuesday 18 August 2026 15:22:13 +0000 (0:00:01.456) 0:00:30.085 ******** 2026-08-18 15:22:13.921193 | node1 | changed: [node1] 2026-08-18 15:22:13.921283 | node1 | changed: [node2] 2026-08-18 15:22:13.921290 | node1 | changed: [node3] 2026-08-18 15:22:13.921295 | node1 | 2026-08-18 15:22:13.921300 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:22:13.921306 | node1 | Tuesday 18 August 2026 15:22:13 +0000 (0:00:00.607) 0:00:30.692 ******** 2026-08-18 15:22:13.987430 | node1 | ok: [node1] => { 2026-08-18 15:22:13.987519 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:22:13.987558 | node1 | } 2026-08-18 15:22:13.988403 | node1 | ok: [node2] => { 2026-08-18 15:22:13.988456 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:22:13.988474 | node1 | } 2026-08-18 15:22:13.988479 | node1 | ok: [node3] => { 2026-08-18 15:22:13.988483 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:22:13.988487 | node1 | } 2026-08-18 15:22:13.988492 | node1 | 2026-08-18 15:22:13.988496 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:22:13.988501 | node1 | Tuesday 18 August 2026 15:22:13 +0000 (0:00:00.067) 0:00:30.759 ******** 2026-08-18 15:22:15.459801 | node1 | changed: [node2] 2026-08-18 15:22:15.459842 | node1 | changed: [node3] 2026-08-18 15:22:15.459847 | node1 | changed: [node1] 2026-08-18 15:22:15.459851 | node1 | 2026-08-18 15:22:15.459856 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:22:15.459860 | node1 | Tuesday 18 August 2026 15:22:15 +0000 (0:00:01.472) 0:00:32.231 ******** 2026-08-18 15:22:15.534933 | node1 | skipping: [node1] 2026-08-18 15:22:15.534999 | node1 | skipping: [node2] 2026-08-18 15:22:15.535011 | node1 | skipping: [node3] 2026-08-18 15:22:15.535314 | node1 | 2026-08-18 15:22:15.535351 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:22:15.535357 | node1 | Tuesday 18 August 2026 15:22:15 +0000 (0:00:00.075) 0:00:32.307 ******** 2026-08-18 15:22:15.612397 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:22:15.612555 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:22:15.612692 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:22:15.612807 | node1 | 2026-08-18 15:22:15.612978 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:22:15.613106 | node1 | Tuesday 18 August 2026 15:22:15 +0000 (0:00:00.077) 0:00:32.384 ******** 2026-08-18 15:22:20.847833 | node1 | changed: [node2] 2026-08-18 15:22:20.848068 | node1 | changed: [node3] 2026-08-18 15:22:20.848348 | node1 | changed: [node1] 2026-08-18 15:22:20.848695 | node1 | 2026-08-18 15:22:20.848989 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:22:20.849208 | node1 | Tuesday 18 August 2026 15:22:20 +0000 (0:00:05.235) 0:00:37.619 ******** 2026-08-18 15:22:21.537440 | node1 | ok: [node2] => (item=chronyd) 2026-08-18 15:22:21.537510 | node1 | ok: [node1] => (item=chronyd) 2026-08-18 15:22:21.537603 | node1 | ok: [node3] => (item=chronyd) 2026-08-18 15:22:21.537707 | node1 | ok: [node2] => (item=sshd) 2026-08-18 15:22:21.537793 | node1 | ok: [node1] => (item=sshd) 2026-08-18 15:22:21.537885 | node1 | ok: [node3] => (item=sshd) 2026-08-18 15:22:21.537966 | node1 | 2026-08-18 15:22:21.538065 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:22:21.538175 | node1 | Tuesday 18 August 2026 15:22:21 +0000 (0:00:00.690) 0:00:38.309 ******** 2026-08-18 15:22:21.758031 | node1 | ok: [node1] 2026-08-18 15:22:21.758250 | node1 | ok: [node2] 2026-08-18 15:22:21.758451 | node1 | ok: [node3] 2026-08-18 15:22:21.758637 | node1 | 2026-08-18 15:22:21.758846 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:22:21.759046 | node1 | Tuesday 18 August 2026 15:22:21 +0000 (0:00:00.220) 0:00:38.530 ******** 2026-08-18 15:22:22.194931 | node1 | changed: [node1] 2026-08-18 15:22:22.194995 | node1 | changed: [node2] 2026-08-18 15:22:22.195007 | node1 | changed: [node3] 2026-08-18 15:22:22.195018 | node1 | 2026-08-18 15:22:22.195029 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:22:22.195039 | node1 | Tuesday 18 August 2026 15:22:22 +0000 (0:00:00.435) 0:00:38.965 ******** 2026-08-18 15:22:22.683728 | node1 | changed: [node1] 2026-08-18 15:22:22.683798 | node1 | changed: [node2] 2026-08-18 15:22:22.684163 | node1 | changed: [node3] 2026-08-18 15:22:22.684364 | node1 | 2026-08-18 15:22:22.684370 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:22:22.684394 | node1 | Tuesday 18 August 2026 15:22:22 +0000 (0:00:00.490) 0:00:39.456 ******** 2026-08-18 15:22:22.747532 | node1 | skipping: [node1] 2026-08-18 15:22:22.747597 | node1 | skipping: [node2] 2026-08-18 15:22:22.748014 | node1 | skipping: [node3] 2026-08-18 15:22:22.748059 | node1 | 2026-08-18 15:22:22.748065 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:22:22.748070 | node1 | Tuesday 18 August 2026 15:22:22 +0000 (0:00:00.063) 0:00:39.520 ******** 2026-08-18 15:23:02.344426 | node1 | changed: [node2] 2026-08-18 15:23:02.344515 | node1 | changed: [node1] 2026-08-18 15:23:02.345037 | node1 | changed: [node3] 2026-08-18 15:23:02.345090 | node1 | 2026-08-18 15:23:02.345098 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:23:02.345106 | node1 | Tuesday 18 August 2026 15:23:02 +0000 (0:00:39.596) 0:01:19.116 ******** 2026-08-18 15:23:02.879014 | node1 | changed: [node1] 2026-08-18 15:23:02.879089 | node1 | changed: [node2] 2026-08-18 15:23:02.879100 | node1 | changed: [node3] 2026-08-18 15:23:02.879410 | node1 | 2026-08-18 15:23:02.879444 | node1 | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] *** 2026-08-18 15:23:02.879450 | node1 | Tuesday 18 August 2026 15:23:02 +0000 (0:00:00.534) 0:01:19.651 ******** 2026-08-18 15:23:02.993941 | node1 | ok: [node2] 2026-08-18 15:23:02.994010 | node1 | ok: [node3] 2026-08-18 15:23:02.994069 | node1 | ok: [node1] 2026-08-18 15:23:02.994385 | node1 | 2026-08-18 15:23:02.994422 | node1 | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] *** 2026-08-18 15:23:02.994428 | node1 | Tuesday 18 August 2026 15:23:02 +0000 (0:00:00.115) 0:01:19.766 ******** 2026-08-18 15:23:03.068184 | node1 | ok: [node1] => { 2026-08-18 15:23:03.068249 | node1 | "changed": false, 2026-08-18 15:23:03.068468 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:03.068540 | node1 | } 2026-08-18 15:23:03.068558 | node1 | ok: [node2] => { 2026-08-18 15:23:03.068617 | node1 | "changed": false, 2026-08-18 15:23:03.068707 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:03.068795 | node1 | } 2026-08-18 15:23:03.068890 | node1 | ok: [node3] => { 2026-08-18 15:23:03.068982 | node1 | "changed": false, 2026-08-18 15:23:03.069078 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:03.069164 | node1 | } 2026-08-18 15:23:03.069249 | node1 | 2026-08-18 15:23:03.069347 | node1 | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] ******************* 2026-08-18 15:23:03.069441 | node1 | Tuesday 18 August 2026 15:23:03 +0000 (0:00:00.074) 0:01:19.840 ******** 2026-08-18 15:23:03.144133 | node1 | ok: [node1] 2026-08-18 15:23:03.144338 | node1 | ok: [node2] 2026-08-18 15:23:03.144575 | node1 | ok: [node3] 2026-08-18 15:23:03.144766 | node1 | 2026-08-18 15:23:03.144981 | node1 | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] *** 2026-08-18 15:23:03.145213 | node1 | Tuesday 18 August 2026 15:23:03 +0000 (0:00:00.075) 0:01:19.916 ******** 2026-08-18 15:23:03.703843 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:23:03.704050 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:23:03.704266 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:23:03.704488 | node1 | 2026-08-18 15:23:03.704713 | node1 | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] *** 2026-08-18 15:23:03.704923 | node1 | Tuesday 18 August 2026 15:23:03 +0000 (0:00:00.559) 0:01:20.476 ******** 2026-08-18 15:23:03.777964 | node1 | ok: [node1] 2026-08-18 15:23:03.778145 | node1 | ok: [node2] 2026-08-18 15:23:03.778337 | node1 | ok: [node3] 2026-08-18 15:23:03.778515 | node1 | 2026-08-18 15:23:03.778717 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 15:23:03.778916 | node1 | Tuesday 18 August 2026 15:23:03 +0000 (0:00:00.073) 0:01:20.550 ******** 2026-08-18 15:23:03.896554 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap.yml for node1, node2, node3 2026-08-18 15:23:03.896734 | node1 | 2026-08-18 15:23:03.896954 | node1 | TASK [vexxhost.ceph.mon : Ensure /etc/ceph exists] ***************************** 2026-08-18 15:23:03.897149 | node1 | Tuesday 18 August 2026 15:23:03 +0000 (0:00:00.118) 0:01:20.668 ******** 2026-08-18 15:23:04.088369 | node1 | skipping: [node2] 2026-08-18 15:23:04.088630 | node1 | skipping: [node3] 2026-08-18 15:23:04.088830 | node1 | changed: [node1] 2026-08-18 15:23:04.089014 | node1 | 2026-08-18 15:23:04.089239 | node1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH private key] *********** 2026-08-18 15:23:04.089438 | node1 | Tuesday 18 August 2026 15:23:04 +0000 (0:00:00.191) 0:01:20.860 ******** 2026-08-18 15:23:04.119412 | node1 | skipping: [node1] 2026-08-18 15:23:04.148873 | node1 | skipping: [node2] 2026-08-18 15:23:04.149072 | node1 | skipping: [node3] 2026-08-18 15:23:04.149256 | node1 | 2026-08-18 15:23:04.149464 | node1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH public key] ************ 2026-08-18 15:23:04.149661 | node1 | Tuesday 18 August 2026 15:23:04 +0000 (0:00:00.060) 0:01:20.921 ******** 2026-08-18 15:23:04.187572 | node1 | skipping: [node1] 2026-08-18 15:23:04.216816 | node1 | skipping: [node2] 2026-08-18 15:23:04.217004 | node1 | skipping: [node3] 2026-08-18 15:23:04.217198 | node1 | 2026-08-18 15:23:04.217398 | node1 | TASK [vexxhost.ceph.mon : Generate a cephadm SSH keypair when none was provided] *** 2026-08-18 15:23:04.217596 | node1 | Tuesday 18 August 2026 15:23:04 +0000 (0:00:00.067) 0:01:20.989 ******** 2026-08-18 15:23:05.179166 | node1 | skipping: [node2] 2026-08-18 15:23:05.179218 | node1 | skipping: [node3] 2026-08-18 15:23:05.179229 | node1 | changed: [node1] 2026-08-18 15:23:05.179239 | node1 | 2026-08-18 15:23:05.179249 | node1 | TASK [vexxhost.ceph.mon : Create a temporary ceph.conf for bootstrap overrides] *** 2026-08-18 15:23:05.179259 | node1 | Tuesday 18 August 2026 15:23:05 +0000 (0:00:00.960) 0:01:21.950 ******** 2026-08-18 15:23:05.457069 | node1 | skipping: [node2] 2026-08-18 15:23:05.457151 | node1 | skipping: [node3] 2026-08-18 15:23:05.457546 | node1 | changed: [node1] 2026-08-18 15:23:05.457592 | node1 | 2026-08-18 15:23:05.457597 | node1 | TASK [vexxhost.ceph.mon : Populate bootstrap ceph.conf overrides] ************** 2026-08-18 15:23:05.457602 | node1 | Tuesday 18 August 2026 15:23:05 +0000 (0:00:00.278) 0:01:22.229 ******** 2026-08-18 15:23:05.494099 | node1 | skipping: [node1] 2026-08-18 15:23:05.522830 | node1 | skipping: [node2] 2026-08-18 15:23:05.522885 | node1 | skipping: [node3] 2026-08-18 15:23:05.522972 | node1 | 2026-08-18 15:23:05.523076 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 15:23:05.523213 | node1 | Tuesday 18 August 2026 15:23:05 +0000 (0:00:00.066) 0:01:22.295 ******** 2026-08-18 15:23:43.713305 | node1 | skipping: [node2] 2026-08-18 15:23:43.713418 | node1 | skipping: [node3] 2026-08-18 15:23:43.713944 | node1 | changed: [node1] 2026-08-18 15:23:43.713987 | node1 | 2026-08-18 15:23:43.713995 | node1 | TASK [vexxhost.ceph.mon : Remove the temporary ceph.conf] ********************** 2026-08-18 15:23:43.714002 | node1 | Tuesday 18 August 2026 15:23:43 +0000 (0:00:38.190) 0:02:00.485 ******** 2026-08-18 15:23:43.916006 | node1 | skipping: [node2] 2026-08-18 15:23:43.916063 | node1 | skipping: [node3] 2026-08-18 15:23:43.916493 | node1 | changed: [node1] 2026-08-18 15:23:43.916560 | node1 | 2026-08-18 15:23:43.916572 | node1 | TASK [Register this monitor host] ********************************************** 2026-08-18 15:23:43.916589 | node1 | Tuesday 18 August 2026 15:23:43 +0000 (0:00:00.202) 0:02:00.688 ******** 2026-08-18 15:23:44.041663 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:23:44.041732 | node1 | 2026-08-18 15:23:44.041848 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:23:44.041980 | node1 | Tuesday 18 August 2026 15:23:44 +0000 (0:00:00.126) 0:02:00.814 ******** 2026-08-18 15:23:45.504279 | node1 | ok: [node1] 2026-08-18 15:23:45.504349 | node1 | 2026-08-18 15:23:45.504469 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:23:45.504575 | node1 | Tuesday 18 August 2026 15:23:45 +0000 (0:00:01.462) 0:02:02.276 ******** 2026-08-18 15:23:45.568650 | node1 | ok: [node1] 2026-08-18 15:23:45.568736 | node1 | ok: [node2] 2026-08-18 15:23:45.568844 | node1 | ok: [node3] 2026-08-18 15:23:45.568999 | node1 | 2026-08-18 15:23:45.569106 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:23:45.569194 | node1 | Tuesday 18 August 2026 15:23:45 +0000 (0:00:00.064) 0:02:02.341 ******** 2026-08-18 15:23:45.630135 | node1 | ok: [node1] => { 2026-08-18 15:23:45.630227 | node1 | "changed": false, 2026-08-18 15:23:45.630313 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:45.630439 | node1 | } 2026-08-18 15:23:45.630565 | node1 | ok: [node2] => { 2026-08-18 15:23:45.630686 | node1 | "changed": false, 2026-08-18 15:23:45.630847 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:45.630969 | node1 | } 2026-08-18 15:23:45.631094 | node1 | ok: [node3] => { 2026-08-18 15:23:45.631217 | node1 | "changed": false, 2026-08-18 15:23:45.631339 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:45.631462 | node1 | } 2026-08-18 15:23:45.631574 | node1 | 2026-08-18 15:23:45.631714 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:23:45.631843 | node1 | Tuesday 18 August 2026 15:23:45 +0000 (0:00:00.061) 0:02:02.402 ******** 2026-08-18 15:23:45.990602 | node1 | ok: [node1] 2026-08-18 15:23:45.990688 | node1 | changed: [node3] 2026-08-18 15:23:45.990864 | node1 | changed: [node2] 2026-08-18 15:23:45.990984 | node1 | 2026-08-18 15:23:45.991126 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:23:45.991275 | node1 | Tuesday 18 August 2026 15:23:45 +0000 (0:00:00.360) 0:02:02.763 ******** 2026-08-18 15:23:46.056119 | node1 | ok: [node1] 2026-08-18 15:23:46.056236 | node1 | ok: [node2] 2026-08-18 15:23:46.056363 | node1 | ok: [node3] 2026-08-18 15:23:46.056524 | node1 | 2026-08-18 15:23:46.056667 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:23:46.056803 | node1 | Tuesday 18 August 2026 15:23:46 +0000 (0:00:00.065) 0:02:02.828 ******** 2026-08-18 15:23:46.148952 | node1 | ok: [node1] 2026-08-18 15:23:46.148993 | node1 | ok: [node2] 2026-08-18 15:23:46.149005 | node1 | ok: [node3] 2026-08-18 15:23:46.149017 | node1 | 2026-08-18 15:23:46.149038 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:23:46.149050 | node1 | Tuesday 18 August 2026 15:23:46 +0000 (0:00:00.092) 0:02:02.920 ******** 2026-08-18 15:23:46.210068 | node1 | ok: [node1] => { 2026-08-18 15:23:46.210121 | node1 | "changed": false, 2026-08-18 15:23:46.210269 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:46.210393 | node1 | } 2026-08-18 15:23:46.210520 | node1 | ok: [node2] => { 2026-08-18 15:23:46.210649 | node1 | "changed": false, 2026-08-18 15:23:46.210778 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:46.210930 | node1 | } 2026-08-18 15:23:46.211059 | node1 | ok: [node3] => { 2026-08-18 15:23:46.211185 | node1 | "changed": false, 2026-08-18 15:23:46.211312 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:46.211415 | node1 | } 2026-08-18 15:23:46.211497 | node1 | 2026-08-18 15:23:46.211591 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:23:46.211683 | node1 | Tuesday 18 August 2026 15:23:46 +0000 (0:00:00.061) 0:02:02.982 ******** 2026-08-18 15:24:12.396069 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:24:12.396271 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:24:12.396506 | node1 | changed: [node1] 2026-08-18 15:24:12.396697 | node1 | 2026-08-18 15:24:12.396909 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:24:12.397120 | node1 | Tuesday 18 August 2026 15:24:12 +0000 (0:00:26.185) 0:02:29.168 ******** 2026-08-18 15:24:12.480632 | node1 | skipping: [node1] 2026-08-18 15:24:12.480805 | node1 | skipping: [node2] 2026-08-18 15:24:12.481003 | node1 | skipping: [node3] 2026-08-18 15:24:12.481186 | node1 | 2026-08-18 15:24:12.481390 | node1 | TASK [vexxhost.ceph.mon : Apply the monitor service spec] ********************** 2026-08-18 15:24:12.481663 | node1 | Tuesday 18 August 2026 15:24:12 +0000 (0:00:00.084) 0:02:29.252 ******** 2026-08-18 15:24:15.254278 | node1 | changed: [node1] 2026-08-18 15:24:15.254485 | node1 | 2026-08-18 15:24:15.254738 | node1 | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ******** 2026-08-18 15:24:15.254966 | node1 | Tuesday 18 August 2026 15:24:15 +0000 (0:00:02.773) 0:02:32.026 ******** 2026-08-18 15:24:16.873329 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:24:16.873529 | node1 | ok: [node1] 2026-08-18 15:24:16.873749 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:24:16.873945 | node1 | 2026-08-18 15:24:16.874163 | node1 | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] *********************** 2026-08-18 15:24:16.874392 | node1 | Tuesday 18 August 2026 15:24:16 +0000 (0:00:01.619) 0:02:33.645 ******** 2026-08-18 15:24:18.627706 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:24:18.627775 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:24:18.627787 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:24:18.627797 | node1 | 2026-08-18 15:24:18.627807 | node1 | TASK [vexxhost.ceph.mgr : Select the admin host] ******************************* 2026-08-18 15:24:18.627817 | node1 | Tuesday 18 August 2026 15:24:18 +0000 (0:00:01.752) 0:02:35.398 ******** 2026-08-18 15:24:18.695779 | node1 | ok: [node1] 2026-08-18 15:24:18.695880 | node1 | ok: [node2] 2026-08-18 15:24:18.696262 | node1 | ok: [node3] 2026-08-18 15:24:18.696312 | node1 | 2026-08-18 15:24:18.696318 | node1 | TASK [Register this manager host] ********************************************** 2026-08-18 15:24:18.696323 | node1 | Tuesday 18 August 2026 15:24:18 +0000 (0:00:00.069) 0:02:35.468 ******** 2026-08-18 15:24:18.807094 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:24:18.807152 | node1 | 2026-08-18 15:24:18.807359 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:24:18.807395 | node1 | Tuesday 18 August 2026 15:24:18 +0000 (0:00:00.111) 0:02:35.579 ******** 2026-08-18 15:24:26.242043 | node1 | ok: [node1] 2026-08-18 15:24:26.242157 | node1 | 2026-08-18 15:24:26.242170 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:24:26.242280 | node1 | Tuesday 18 August 2026 15:24:26 +0000 (0:00:07.433) 0:02:43.013 ******** 2026-08-18 15:24:26.323960 | node1 | ok: [node1] 2026-08-18 15:24:26.324071 | node1 | ok: [node2] 2026-08-18 15:24:26.324556 | node1 | ok: [node3] 2026-08-18 15:24:26.324625 | node1 | 2026-08-18 15:24:26.324633 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:24:26.324647 | node1 | Tuesday 18 August 2026 15:24:26 +0000 (0:00:00.082) 0:02:43.095 ******** 2026-08-18 15:24:26.414089 | node1 | ok: [node1] => { 2026-08-18 15:24:26.414159 | node1 | "changed": false, 2026-08-18 15:24:26.415339 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:26.415390 | node1 | } 2026-08-18 15:24:26.415396 | node1 | ok: [node2] => { 2026-08-18 15:24:26.415401 | node1 | "changed": false, 2026-08-18 15:24:26.415406 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:26.415410 | node1 | } 2026-08-18 15:24:26.415414 | node1 | ok: [node3] => { 2026-08-18 15:24:26.415418 | node1 | "changed": false, 2026-08-18 15:24:26.415422 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:26.415426 | node1 | } 2026-08-18 15:24:26.415431 | node1 | 2026-08-18 15:24:26.415436 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:24:26.415442 | node1 | Tuesday 18 August 2026 15:24:26 +0000 (0:00:00.090) 0:02:43.186 ******** 2026-08-18 15:24:26.698345 | node1 | ok: [node2] 2026-08-18 15:24:26.698948 | node1 | ok: [node1] 2026-08-18 15:24:26.698969 | node1 | ok: [node3] 2026-08-18 15:24:26.698977 | node1 | 2026-08-18 15:24:26.698983 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:24:26.698991 | node1 | Tuesday 18 August 2026 15:24:26 +0000 (0:00:00.284) 0:02:43.470 ******** 2026-08-18 15:24:26.770305 | node1 | ok: [node1] 2026-08-18 15:24:26.770369 | node1 | ok: [node2] 2026-08-18 15:24:26.770720 | node1 | ok: [node3] 2026-08-18 15:24:26.770736 | node1 | 2026-08-18 15:24:26.770742 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:24:26.770747 | node1 | Tuesday 18 August 2026 15:24:26 +0000 (0:00:00.071) 0:02:43.542 ******** 2026-08-18 15:24:26.874568 | node1 | ok: [node1] 2026-08-18 15:24:26.874628 | node1 | ok: [node2] 2026-08-18 15:24:26.874702 | node1 | ok: [node3] 2026-08-18 15:24:26.874986 | node1 | 2026-08-18 15:24:26.875001 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:24:26.875008 | node1 | Tuesday 18 August 2026 15:24:26 +0000 (0:00:00.104) 0:02:43.647 ******** 2026-08-18 15:24:26.949170 | node1 | ok: [node1] => { 2026-08-18 15:24:26.949235 | node1 | "changed": false, 2026-08-18 15:24:26.950527 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:26.950543 | node1 | } 2026-08-18 15:24:26.950548 | node1 | ok: [node2] => { 2026-08-18 15:24:26.950552 | node1 | "changed": false, 2026-08-18 15:24:26.950556 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:26.950561 | node1 | } 2026-08-18 15:24:26.950565 | node1 | ok: [node3] => { 2026-08-18 15:24:26.950569 | node1 | "changed": false, 2026-08-18 15:24:26.950578 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:26.950582 | node1 | } 2026-08-18 15:24:26.950586 | node1 | 2026-08-18 15:24:26.950591 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:24:26.950596 | node1 | Tuesday 18 August 2026 15:24:26 +0000 (0:00:00.074) 0:02:43.721 ******** 2026-08-18 15:24:28.522661 | node1 | ok: [node1] 2026-08-18 15:24:28.522789 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:24:28.523374 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:24:28.523462 | node1 | 2026-08-18 15:24:28.523471 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:24:28.523478 | node1 | Tuesday 18 August 2026 15:24:28 +0000 (0:00:01.573) 0:02:45.294 ******** 2026-08-18 15:24:28.614788 | node1 | skipping: [node1] 2026-08-18 15:24:28.614879 | node1 | skipping: [node2] 2026-08-18 15:24:28.615283 | node1 | skipping: [node3] 2026-08-18 15:24:28.615339 | node1 | 2026-08-18 15:24:28.615345 | node1 | TASK [vexxhost.ceph.mgr : Apply the manager service spec] ********************** 2026-08-18 15:24:28.615351 | node1 | Tuesday 18 August 2026 15:24:28 +0000 (0:00:00.092) 0:02:45.386 ******** 2026-08-18 15:24:31.396885 | node1 | changed: [node1] 2026-08-18 15:24:31.396955 | node1 | 2026-08-18 15:24:31.397047 | node1 | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ******** 2026-08-18 15:24:31.397146 | node1 | Tuesday 18 August 2026 15:24:31 +0000 (0:00:02.782) 0:02:48.169 ******** 2026-08-18 15:24:33.005225 | node1 | ok: [node1] 2026-08-18 15:24:33.005291 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:24:33.005380 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:24:33.005684 | node1 | 2026-08-18 15:24:33.005726 | node1 | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] ************************** 2026-08-18 15:24:33.005732 | node1 | Tuesday 18 August 2026 15:24:33 +0000 (0:00:01.608) 0:02:49.777 ******** 2026-08-18 15:24:43.036020 | node1 | changed: [node1] => (item={'name': 'diskprediction_local'}) 2026-08-18 15:24:43.036070 | node1 | changed: [node1] => (item={'name': 'dashboard'}) 2026-08-18 15:24:43.036076 | node1 | ok: [node1] => (item={'name': 'iostat'}) 2026-08-18 15:24:43.036081 | node1 | changed: [node1] => (item={'name': 'prometheus'}) 2026-08-18 15:24:43.036085 | node1 | changed: [node1] => (item={'name': 'rgw'}) 2026-08-18 15:24:43.036090 | node1 | 2026-08-18 15:24:43.036094 | node1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-18 15:24:43.036098 | node1 | 2026-08-18 15:24:43.036103 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:24:43.036107 | node1 | Tuesday 18 August 2026 15:24:43 +0000 (0:00:10.030) 0:02:59.807 ******** 2026-08-18 15:24:43.965574 | node1 | ok: [node1] 2026-08-18 15:24:43.965616 | node1 | ok: [node2] 2026-08-18 15:24:43.965622 | node1 | ok: [node3] 2026-08-18 15:24:43.965626 | node1 | 2026-08-18 15:24:43.965631 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:24:43.965636 | node1 | Tuesday 18 August 2026 15:24:43 +0000 (0:00:00.929) 0:03:00.737 ******** 2026-08-18 15:24:44.189368 | node1 | ok: [node1] 2026-08-18 15:24:44.189408 | node1 | ok: [node2] 2026-08-18 15:24:44.189413 | node1 | ok: [node3] 2026-08-18 15:24:44.189417 | node1 | 2026-08-18 15:24:44.189422 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:24:44.189427 | node1 | Tuesday 18 August 2026 15:24:44 +0000 (0:00:00.223) 0:03:00.961 ******** 2026-08-18 15:24:44.249795 | node1 | skipping: [node1] 2026-08-18 15:24:44.249835 | node1 | skipping: [node2] 2026-08-18 15:24:44.249840 | node1 | skipping: [node3] 2026-08-18 15:24:44.249855 | node1 | 2026-08-18 15:24:44.249860 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:24:44.249865 | node1 | Tuesday 18 August 2026 15:24:44 +0000 (0:00:00.060) 0:03:01.022 ******** 2026-08-18 15:24:44.472605 | node1 | ok: [node1] 2026-08-18 15:24:44.472649 | node1 | ok: [node2] 2026-08-18 15:24:44.472654 | node1 | ok: [node3] 2026-08-18 15:24:44.472658 | node1 | 2026-08-18 15:24:44.472663 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:24:44.472668 | node1 | Tuesday 18 August 2026 15:24:44 +0000 (0:00:00.222) 0:03:01.244 ******** 2026-08-18 15:24:44.552594 | node1 | ok: [node1] => { 2026-08-18 15:24:44.552646 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:24:44.552739 | node1 | } 2026-08-18 15:24:44.552856 | node1 | ok: [node2] => { 2026-08-18 15:24:44.553458 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:24:44.553509 | node1 | } 2026-08-18 15:24:44.553516 | node1 | ok: [node3] => { 2026-08-18 15:24:44.553523 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:24:44.553534 | node1 | } 2026-08-18 15:24:44.553582 | node1 | 2026-08-18 15:24:44.553747 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:24:44.553878 | node1 | Tuesday 18 August 2026 15:24:44 +0000 (0:00:00.080) 0:03:01.324 ******** 2026-08-18 15:24:44.909266 | node1 | ok: [node1] 2026-08-18 15:24:44.909423 | node1 | ok: [node2] 2026-08-18 15:24:44.909659 | node1 | ok: [node3] 2026-08-18 15:24:44.909837 | node1 | 2026-08-18 15:24:44.910041 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:24:44.910238 | node1 | Tuesday 18 August 2026 15:24:44 +0000 (0:00:00.356) 0:03:01.681 ******** 2026-08-18 15:24:44.999166 | node1 | skipping: [node1] 2026-08-18 15:24:44.999231 | node1 | skipping: [node2] 2026-08-18 15:24:44.999356 | node1 | skipping: [node3] 2026-08-18 15:24:44.999436 | node1 | 2026-08-18 15:24:44.999530 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:24:44.999622 | node1 | Tuesday 18 August 2026 15:24:44 +0000 (0:00:00.090) 0:03:01.771 ******** 2026-08-18 15:24:45.075134 | node1 | skipping: [node1] 2026-08-18 15:24:45.075199 | node1 | skipping: [node2] 2026-08-18 15:24:45.075265 | node1 | skipping: [node3] 2026-08-18 15:24:45.075347 | node1 | 2026-08-18 15:24:45.075439 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:24:45.075530 | node1 | Tuesday 18 August 2026 15:24:45 +0000 (0:00:00.076) 0:03:01.847 ******** 2026-08-18 15:24:45.299015 | node1 | ok: [node1] 2026-08-18 15:24:45.299178 | node1 | ok: [node2] 2026-08-18 15:24:45.299372 | node1 | ok: [node3] 2026-08-18 15:24:45.299546 | node1 | 2026-08-18 15:24:45.299747 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:24:45.299944 | node1 | Tuesday 18 August 2026 15:24:45 +0000 (0:00:00.223) 0:03:02.071 ******** 2026-08-18 15:24:46.365752 | node1 | ok: [node2] 2026-08-18 15:24:46.365812 | node1 | ok: [node1] 2026-08-18 15:24:46.366203 | node1 | ok: [node3] 2026-08-18 15:24:46.366367 | node1 | 2026-08-18 15:24:46.366374 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:24:46.366379 | node1 | Tuesday 18 August 2026 15:24:46 +0000 (0:00:01.066) 0:03:03.138 ******** 2026-08-18 15:24:46.457327 | node1 | ok: [node1] => { 2026-08-18 15:24:46.457369 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:24:46.458301 | node1 | } 2026-08-18 15:24:46.458347 | node1 | ok: [node2] => { 2026-08-18 15:24:46.458353 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:24:46.458358 | node1 | } 2026-08-18 15:24:46.458362 | node1 | ok: [node3] => { 2026-08-18 15:24:46.458372 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:24:46.458376 | node1 | } 2026-08-18 15:24:46.458380 | node1 | 2026-08-18 15:24:46.458385 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:24:46.458398 | node1 | Tuesday 18 August 2026 15:24:46 +0000 (0:00:00.091) 0:03:03.229 ******** 2026-08-18 15:24:46.844108 | node1 | ok: [node1] 2026-08-18 15:24:46.844173 | node1 | ok: [node2] 2026-08-18 15:24:46.844247 | node1 | ok: [node3] 2026-08-18 15:24:46.844332 | node1 | 2026-08-18 15:24:46.844468 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:24:46.844544 | node1 | Tuesday 18 August 2026 15:24:46 +0000 (0:00:00.386) 0:03:03.616 ******** 2026-08-18 15:24:49.771936 | node1 | ok: [node2] 2026-08-18 15:24:49.772010 | node1 | ok: [node3] 2026-08-18 15:24:49.772417 | node1 | ok: [node1] 2026-08-18 15:24:49.772512 | node1 | 2026-08-18 15:24:49.772519 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:24:49.772525 | node1 | Tuesday 18 August 2026 15:24:49 +0000 (0:00:02.927) 0:03:06.543 ******** 2026-08-18 15:24:49.802636 | node1 | skipping: [node1] 2026-08-18 15:24:49.830747 | node1 | skipping: [node2] 2026-08-18 15:24:49.830891 | node1 | skipping: [node3] 2026-08-18 15:24:49.831525 | node1 | 2026-08-18 15:24:49.831594 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:24:49.831608 | node1 | Tuesday 18 August 2026 15:24:49 +0000 (0:00:00.059) 0:03:06.603 ******** 2026-08-18 15:24:49.866446 | node1 | skipping: [node1] 2026-08-18 15:24:49.893122 | node1 | skipping: [node2] 2026-08-18 15:24:49.893510 | node1 | skipping: [node3] 2026-08-18 15:24:49.893561 | node1 | 2026-08-18 15:24:49.893567 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:24:49.893573 | node1 | Tuesday 18 August 2026 15:24:49 +0000 (0:00:00.062) 0:03:06.665 ******** 2026-08-18 15:24:49.922742 | node1 | skipping: [node1] 2026-08-18 15:24:49.952816 | node1 | skipping: [node2] 2026-08-18 15:24:49.952941 | node1 | skipping: [node3] 2026-08-18 15:24:49.953052 | node1 | 2026-08-18 15:24:49.953353 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:24:49.953398 | node1 | Tuesday 18 August 2026 15:24:49 +0000 (0:00:00.059) 0:03:06.725 ******** 2026-08-18 15:24:51.003722 | node1 | ok: [node1] 2026-08-18 15:24:51.003760 | node1 | ok: [node2] 2026-08-18 15:24:51.003765 | node1 | ok: [node3] 2026-08-18 15:24:51.003769 | node1 | 2026-08-18 15:24:51.003774 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:24:51.003779 | node1 | Tuesday 18 August 2026 15:24:51 +0000 (0:00:01.050) 0:03:07.775 ******** 2026-08-18 15:24:51.456553 | node1 | ok: [node2] 2026-08-18 15:24:51.457178 | node1 | ok: [node1] 2026-08-18 15:24:51.457226 | node1 | ok: [node3] 2026-08-18 15:24:51.457234 | node1 | 2026-08-18 15:24:51.457241 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:24:51.457247 | node1 | Tuesday 18 August 2026 15:24:51 +0000 (0:00:00.453) 0:03:08.228 ******** 2026-08-18 15:24:52.362996 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:24:52.363060 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:24:52.363155 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:24:52.364532 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:24:52.364577 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:24:52.364582 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:24:52.364587 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:24:52.364591 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:24:52.364595 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:24:52.364599 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:24:52.364604 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:24:52.364608 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:24:52.364612 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:24:52.364628 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:24:52.364632 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:24:52.364637 | node1 | 2026-08-18 15:24:52.364641 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:24:52.364651 | node1 | Tuesday 18 August 2026 15:24:52 +0000 (0:00:00.906) 0:03:09.135 ******** 2026-08-18 15:24:52.894228 | node1 | ok: [node1] 2026-08-18 15:24:52.894295 | node1 | ok: [node2] 2026-08-18 15:24:52.894368 | node1 | ok: [node3] 2026-08-18 15:24:52.895441 | node1 | 2026-08-18 15:24:52.895481 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:24:52.895487 | node1 | Tuesday 18 August 2026 15:24:52 +0000 (0:00:00.515) 0:03:09.651 ******** 2026-08-18 15:24:52.895492 | node1 | 2026-08-18 15:24:52.895496 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:24:52.895500 | node1 | Tuesday 18 August 2026 15:24:52 +0000 (0:00:00.005) 0:03:09.656 ******** 2026-08-18 15:24:52.895504 | node1 | 2026-08-18 15:24:52.895508 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:24:52.895512 | node1 | Tuesday 18 August 2026 15:24:52 +0000 (0:00:00.004) 0:03:09.661 ******** 2026-08-18 15:24:52.895516 | node1 | 2026-08-18 15:24:52.895520 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:24:52.895524 | node1 | Tuesday 18 August 2026 15:24:52 +0000 (0:00:00.005) 0:03:09.666 ******** 2026-08-18 15:24:53.268930 | node1 | ok: [node2] 2026-08-18 15:24:53.269001 | node1 | ok: [node1] 2026-08-18 15:24:53.269401 | node1 | ok: [node3] 2026-08-18 15:24:53.269449 | node1 | 2026-08-18 15:24:53.269455 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:24:53.269460 | node1 | Tuesday 18 August 2026 15:24:53 +0000 (0:00:00.374) 0:03:10.041 ******** 2026-08-18 15:24:53.517185 | node1 | ok: [node1] 2026-08-18 15:24:53.517258 | node1 | ok: [node2] 2026-08-18 15:24:53.517272 | node1 | ok: [node3] 2026-08-18 15:24:53.517579 | node1 | 2026-08-18 15:24:53.517650 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:24:53.517656 | node1 | Tuesday 18 August 2026 15:24:53 +0000 (0:00:00.248) 0:03:10.289 ******** 2026-08-18 15:24:53.590614 | node1 | ok: [node1] => { 2026-08-18 15:24:53.591816 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:24:53.591920 | node1 | } 2026-08-18 15:24:53.591932 | node1 | ok: [node2] => { 2026-08-18 15:24:53.591942 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:24:53.591951 | node1 | } 2026-08-18 15:24:53.591960 | node1 | ok: [node3] => { 2026-08-18 15:24:53.591969 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:24:53.591977 | node1 | } 2026-08-18 15:24:53.591987 | node1 | 2026-08-18 15:24:53.591997 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:24:53.592018 | node1 | Tuesday 18 August 2026 15:24:53 +0000 (0:00:00.073) 0:03:10.362 ******** 2026-08-18 15:24:53.952517 | node1 | ok: [node1] 2026-08-18 15:24:53.952591 | node1 | ok: [node2] 2026-08-18 15:24:53.952595 | node1 | ok: [node3] 2026-08-18 15:24:53.952600 | node1 | 2026-08-18 15:24:53.952631 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:24:53.952637 | node1 | Tuesday 18 August 2026 15:24:53 +0000 (0:00:00.360) 0:03:10.723 ******** 2026-08-18 15:24:57.023392 | node1 | ok: [node1] 2026-08-18 15:24:57.023468 | node1 | ok: [node2] 2026-08-18 15:24:57.023541 | node1 | ok: [node3] 2026-08-18 15:24:57.023842 | node1 | 2026-08-18 15:24:57.023892 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:24:57.023898 | node1 | Tuesday 18 August 2026 15:24:57 +0000 (0:00:03.072) 0:03:13.795 ******** 2026-08-18 15:24:58.042998 | node1 | ok: [node1] 2026-08-18 15:24:58.043067 | node1 | ok: [node2] 2026-08-18 15:24:58.043605 | node1 | ok: [node3] 2026-08-18 15:24:58.043652 | node1 | 2026-08-18 15:24:58.043660 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:24:58.043667 | node1 | Tuesday 18 August 2026 15:24:58 +0000 (0:00:01.019) 0:03:14.815 ******** 2026-08-18 15:24:58.252622 | node1 | ok: [node1] 2026-08-18 15:24:58.252691 | node1 | ok: [node2] 2026-08-18 15:24:58.252749 | node1 | ok: [node3] 2026-08-18 15:24:58.253035 | node1 | 2026-08-18 15:24:58.253075 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:24:58.253081 | node1 | Tuesday 18 August 2026 15:24:58 +0000 (0:00:00.209) 0:03:15.024 ******** 2026-08-18 15:24:58.687277 | node1 | ok: [node1] 2026-08-18 15:24:58.687343 | node1 | ok: [node2] 2026-08-18 15:24:58.687401 | node1 | ok: [node3] 2026-08-18 15:24:58.687758 | node1 | 2026-08-18 15:24:58.687803 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:24:58.687810 | node1 | Tuesday 18 August 2026 15:24:58 +0000 (0:00:00.434) 0:03:15.459 ******** 2026-08-18 15:24:59.227785 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:24:59.227837 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:24:59.227936 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:24:59.228458 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:24:59.228689 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:24:59.228695 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:24:59.228699 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:24:59.228703 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:24:59.229096 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:24:59.229107 | node1 | 2026-08-18 15:24:59.229113 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:24:59.229117 | node1 | Tuesday 18 August 2026 15:24:59 +0000 (0:00:00.540) 0:03:16.000 ******** 2026-08-18 15:24:59.666647 | node1 | ok: [node1] 2026-08-18 15:24:59.666730 | node1 | ok: [node2] 2026-08-18 15:24:59.666784 | node1 | ok: [node3] 2026-08-18 15:24:59.667089 | node1 | 2026-08-18 15:24:59.667132 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:24:59.667137 | node1 | Tuesday 18 August 2026 15:24:59 +0000 (0:00:00.438) 0:03:16.439 ******** 2026-08-18 15:25:00.176011 | node1 | ok: [node1] 2026-08-18 15:25:00.176054 | node1 | ok: [node2] 2026-08-18 15:25:00.176059 | node1 | ok: [node3] 2026-08-18 15:25:00.176063 | node1 | 2026-08-18 15:25:00.176068 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:25:00.176072 | node1 | Tuesday 18 August 2026 15:25:00 +0000 (0:00:00.457) 0:03:16.896 ******** 2026-08-18 15:25:00.176077 | node1 | 2026-08-18 15:25:00.176080 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:25:00.176084 | node1 | Tuesday 18 August 2026 15:25:00 +0000 (0:00:00.005) 0:03:16.902 ******** 2026-08-18 15:25:00.176088 | node1 | 2026-08-18 15:25:00.176092 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:25:00.176096 | node1 | Tuesday 18 August 2026 15:25:00 +0000 (0:00:00.005) 0:03:16.907 ******** 2026-08-18 15:25:00.176100 | node1 | 2026-08-18 15:25:00.176104 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:25:00.176108 | node1 | Tuesday 18 August 2026 15:25:00 +0000 (0:00:00.039) 0:03:16.947 ******** 2026-08-18 15:25:00.560643 | node1 | ok: [node1] 2026-08-18 15:25:00.560706 | node1 | ok: [node2] 2026-08-18 15:25:00.560782 | node1 | ok: [node3] 2026-08-18 15:25:00.561056 | node1 | 2026-08-18 15:25:00.561071 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:25:00.561077 | node1 | Tuesday 18 August 2026 15:25:00 +0000 (0:00:00.385) 0:03:17.333 ******** 2026-08-18 15:25:00.614796 | node1 | ok: [node1] => { 2026-08-18 15:25:00.614857 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:25:00.616073 | node1 | } 2026-08-18 15:25:00.616092 | node1 | ok: [node2] => { 2026-08-18 15:25:00.616099 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:25:00.616105 | node1 | } 2026-08-18 15:25:00.616111 | node1 | ok: [node3] => { 2026-08-18 15:25:00.616116 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:25:00.616122 | node1 | } 2026-08-18 15:25:00.616127 | node1 | 2026-08-18 15:25:00.616133 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:25:00.616138 | node1 | Tuesday 18 August 2026 15:25:00 +0000 (0:00:00.054) 0:03:17.387 ******** 2026-08-18 15:25:00.897472 | node1 | ok: [node1] 2026-08-18 15:25:00.897577 | node1 | ok: [node2] 2026-08-18 15:25:00.898071 | node1 | ok: [node3] 2026-08-18 15:25:00.898093 | node1 | 2026-08-18 15:25:00.898101 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:25:00.898107 | node1 | Tuesday 18 August 2026 15:25:00 +0000 (0:00:00.282) 0:03:17.669 ******** 2026-08-18 15:25:00.923832 | node1 | skipping: [node1] 2026-08-18 15:25:00.967663 | node1 | skipping: [node2] 2026-08-18 15:25:00.967728 | node1 | skipping: [node3] 2026-08-18 15:25:00.968029 | node1 | 2026-08-18 15:25:00.968071 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:25:00.968076 | node1 | Tuesday 18 August 2026 15:25:00 +0000 (0:00:00.070) 0:03:17.740 ******** 2026-08-18 15:25:01.036725 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:25:01.037366 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:25:01.037407 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:25:01.037415 | node1 | 2026-08-18 15:25:01.037421 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:25:01.037428 | node1 | Tuesday 18 August 2026 15:25:01 +0000 (0:00:00.069) 0:03:17.809 ******** 2026-08-18 15:25:02.094571 | node1 | ok: [node1] 2026-08-18 15:25:02.094620 | node1 | ok: [node2] 2026-08-18 15:25:02.094717 | node1 | ok: [node3] 2026-08-18 15:25:02.095021 | node1 | 2026-08-18 15:25:02.095063 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:25:02.095070 | node1 | Tuesday 18 August 2026 15:25:02 +0000 (0:00:01.057) 0:03:18.866 ******** 2026-08-18 15:25:02.714891 | node1 | ok: [node1] => (item=chronyd) 2026-08-18 15:25:02.714960 | node1 | ok: [node2] => (item=chronyd) 2026-08-18 15:25:02.715064 | node1 | ok: [node3] => (item=chronyd) 2026-08-18 15:25:02.715666 | node1 | ok: [node1] => (item=sshd) 2026-08-18 15:25:02.715708 | node1 | ok: [node2] => (item=sshd) 2026-08-18 15:25:02.715713 | node1 | ok: [node3] => (item=sshd) 2026-08-18 15:25:02.715718 | node1 | 2026-08-18 15:25:02.715722 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:25:02.715728 | node1 | Tuesday 18 August 2026 15:25:02 +0000 (0:00:00.620) 0:03:19.487 ******** 2026-08-18 15:25:02.939704 | node1 | ok: [node1] 2026-08-18 15:25:02.939786 | node1 | ok: [node2] 2026-08-18 15:25:02.940316 | node1 | ok: [node3] 2026-08-18 15:25:02.940338 | node1 | 2026-08-18 15:25:02.940345 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:25:02.940352 | node1 | Tuesday 18 August 2026 15:25:02 +0000 (0:00:00.224) 0:03:19.711 ******** 2026-08-18 15:25:03.191843 | node1 | ok: [node1] 2026-08-18 15:25:03.191917 | node1 | ok: [node2] 2026-08-18 15:25:03.191976 | node1 | ok: [node3] 2026-08-18 15:25:03.192285 | node1 | 2026-08-18 15:25:03.192328 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:25:03.192334 | node1 | Tuesday 18 August 2026 15:25:03 +0000 (0:00:00.252) 0:03:19.964 ******** 2026-08-18 15:25:03.634836 | node1 | ok: [node1] 2026-08-18 15:25:03.635071 | node1 | ok: [node2] 2026-08-18 15:25:03.635084 | node1 | ok: [node3] 2026-08-18 15:25:03.635093 | node1 | 2026-08-18 15:25:03.635295 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:25:03.635341 | node1 | Tuesday 18 August 2026 15:25:03 +0000 (0:00:00.442) 0:03:20.407 ******** 2026-08-18 15:25:03.662633 | node1 | skipping: [node1] 2026-08-18 15:25:03.686774 | node1 | skipping: [node2] 2026-08-18 15:25:03.686836 | node1 | skipping: [node3] 2026-08-18 15:25:03.686922 | node1 | 2026-08-18 15:25:03.687023 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:25:03.687156 | node1 | Tuesday 18 August 2026 15:25:03 +0000 (0:00:00.052) 0:03:20.459 ******** 2026-08-18 15:25:04.057669 | node1 | ok: [node1] 2026-08-18 15:25:04.058458 | node1 | ok: [node2] 2026-08-18 15:25:04.058502 | node1 | ok: [node3] 2026-08-18 15:25:04.058507 | node1 | 2026-08-18 15:25:04.058512 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:25:04.058517 | node1 | Tuesday 18 August 2026 15:25:04 +0000 (0:00:00.370) 0:03:20.829 ******** 2026-08-18 15:25:04.513464 | node1 | ok: [node1] 2026-08-18 15:25:04.513527 | node1 | ok: [node2] 2026-08-18 15:25:04.513608 | node1 | ok: [node3] 2026-08-18 15:25:04.513969 | node1 | 2026-08-18 15:25:04.514017 | node1 | TASK [vexxhost.ceph.osd : Locate the cluster admin host] *********************** 2026-08-18 15:25:04.514023 | node1 | Tuesday 18 August 2026 15:25:04 +0000 (0:00:00.455) 0:03:21.285 ******** 2026-08-18 15:25:05.081681 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:25:05.081753 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:25:05.082135 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:25:05.082179 | node1 | 2026-08-18 15:25:05.082185 | node1 | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] ******* 2026-08-18 15:25:05.082190 | node1 | Tuesday 18 August 2026 15:25:05 +0000 (0:00:00.568) 0:03:21.854 ******** 2026-08-18 15:25:05.154300 | node1 | ok: [node1] 2026-08-18 15:25:05.154342 | node1 | ok: [node2] 2026-08-18 15:25:05.154732 | node1 | ok: [node3] 2026-08-18 15:25:05.154776 | node1 | 2026-08-18 15:25:05.154782 | node1 | TASK [vexxhost.ceph.osd : Set the admin mon config path] *********************** 2026-08-18 15:25:05.154787 | node1 | Tuesday 18 August 2026 15:25:05 +0000 (0:00:00.072) 0:03:21.926 ******** 2026-08-18 15:25:05.219711 | node1 | ok: [node1] 2026-08-18 15:25:05.219790 | node1 | ok: [node2] 2026-08-18 15:25:05.220159 | node1 | ok: [node3] 2026-08-18 15:25:05.220200 | node1 | 2026-08-18 15:25:05.220206 | node1 | TASK [Register this OSD host] ************************************************** 2026-08-18 15:25:05.220211 | node1 | Tuesday 18 August 2026 15:25:05 +0000 (0:00:00.065) 0:03:21.992 ******** 2026-08-18 15:25:05.313547 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:25:05.313624 | node1 | 2026-08-18 15:25:05.313638 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:25:05.313784 | node1 | Tuesday 18 August 2026 15:25:05 +0000 (0:00:00.093) 0:03:22.086 ******** 2026-08-18 15:25:06.721274 | node1 | ok: [node1] 2026-08-18 15:25:06.721329 | node1 | 2026-08-18 15:25:06.721339 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:25:06.721347 | node1 | Tuesday 18 August 2026 15:25:06 +0000 (0:00:01.406) 0:03:23.492 ******** 2026-08-18 15:25:06.777011 | node1 | ok: [node1] 2026-08-18 15:25:06.777102 | node1 | ok: [node2] 2026-08-18 15:25:06.777612 | node1 | ok: [node3] 2026-08-18 15:25:06.777662 | node1 | 2026-08-18 15:25:06.777670 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:25:06.777676 | node1 | Tuesday 18 August 2026 15:25:06 +0000 (0:00:00.056) 0:03:23.549 ******** 2026-08-18 15:25:06.839038 | node1 | ok: [node1] => { 2026-08-18 15:25:06.839099 | node1 | "changed": false, 2026-08-18 15:25:06.840362 | node1 | "msg": "All assertions passed" 2026-08-18 15:25:06.840460 | node1 | } 2026-08-18 15:25:06.840467 | node1 | ok: [node2] => { 2026-08-18 15:25:06.840473 | node1 | "changed": false, 2026-08-18 15:25:06.840478 | node1 | "msg": "All assertions passed" 2026-08-18 15:25:06.840482 | node1 | } 2026-08-18 15:25:06.840486 | node1 | ok: [node3] => { 2026-08-18 15:25:06.840490 | node1 | "changed": false, 2026-08-18 15:25:06.840501 | node1 | "msg": "All assertions passed" 2026-08-18 15:25:06.840505 | node1 | } 2026-08-18 15:25:06.840510 | node1 | 2026-08-18 15:25:06.840514 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:25:06.840535 | node1 | Tuesday 18 August 2026 15:25:06 +0000 (0:00:00.061) 0:03:23.611 ******** 2026-08-18 15:25:07.102822 | node1 | ok: [node1] 2026-08-18 15:25:07.103046 | node1 | ok: [node2] 2026-08-18 15:25:07.103061 | node1 | ok: [node3] 2026-08-18 15:25:07.103475 | node1 | 2026-08-18 15:25:07.103537 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:25:07.103544 | node1 | Tuesday 18 August 2026 15:25:07 +0000 (0:00:00.263) 0:03:23.874 ******** 2026-08-18 15:25:07.174993 | node1 | ok: [node1] 2026-08-18 15:25:07.175662 | node1 | ok: [node2] 2026-08-18 15:25:07.175734 | node1 | ok: [node3] 2026-08-18 15:25:07.175740 | node1 | 2026-08-18 15:25:07.175747 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:25:07.175753 | node1 | Tuesday 18 August 2026 15:25:07 +0000 (0:00:00.071) 0:03:23.946 ******** 2026-08-18 15:25:07.272072 | node1 | ok: [node1] 2026-08-18 15:25:07.272195 | node1 | ok: [node2] 2026-08-18 15:25:07.272207 | node1 | ok: [node3] 2026-08-18 15:25:07.272293 | node1 | 2026-08-18 15:25:07.272570 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:25:07.272637 | node1 | Tuesday 18 August 2026 15:25:07 +0000 (0:00:00.097) 0:03:24.044 ******** 2026-08-18 15:25:07.354347 | node1 | ok: [node1] => { 2026-08-18 15:25:07.354428 | node1 | "changed": false, 2026-08-18 15:25:07.354436 | node1 | "msg": "All assertions passed" 2026-08-18 15:25:07.354445 | node1 | } 2026-08-18 15:25:07.354451 | node1 | ok: [node2] => { 2026-08-18 15:25:07.354456 | node1 | "changed": false, 2026-08-18 15:25:07.354462 | node1 | "msg": "All assertions passed" 2026-08-18 15:25:07.354496 | node1 | } 2026-08-18 15:25:07.354502 | node1 | ok: [node3] => { 2026-08-18 15:25:07.354507 | node1 | "changed": false, 2026-08-18 15:25:07.354513 | node1 | "msg": "All assertions passed" 2026-08-18 15:25:07.354518 | node1 | } 2026-08-18 15:25:07.354524 | node1 | 2026-08-18 15:25:07.354531 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:25:07.354538 | node1 | Tuesday 18 August 2026 15:25:07 +0000 (0:00:00.080) 0:03:24.124 ******** 2026-08-18 15:25:08.912786 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:25:08.912873 | node1 | ok: [node1] 2026-08-18 15:25:08.913438 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:25:08.913504 | node1 | 2026-08-18 15:25:08.913511 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:25:08.913517 | node1 | Tuesday 18 August 2026 15:25:08 +0000 (0:00:01.560) 0:03:25.684 ******** 2026-08-18 15:25:08.997620 | node1 | skipping: [node1] 2026-08-18 15:25:08.997704 | node1 | skipping: [node2] 2026-08-18 15:25:08.998119 | node1 | skipping: [node3] 2026-08-18 15:25:08.998176 | node1 | 2026-08-18 15:25:08.998182 | node1 | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] ************** 2026-08-18 15:25:08.998189 | node1 | Tuesday 18 August 2026 15:25:08 +0000 (0:00:00.085) 0:03:25.769 ******** 2026-08-18 15:25:09.030126 | node1 | skipping: [node1] 2026-08-18 15:25:09.030199 | node1 | 2026-08-18 15:25:09.030307 | node1 | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] ********* 2026-08-18 15:25:09.030425 | node1 | Tuesday 18 August 2026 15:25:09 +0000 (0:00:00.032) 0:03:25.802 ******** 2026-08-18 15:25:10.322779 | node1 | ok: [node2] 2026-08-18 15:25:10.322860 | node1 | ok: [node3] 2026-08-18 15:25:10.323422 | node1 | ok: [node1] 2026-08-18 15:25:10.323468 | node1 | 2026-08-18 15:25:10.323475 | node1 | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ******** 2026-08-18 15:25:10.323482 | node1 | Tuesday 18 August 2026 15:25:10 +0000 (0:00:01.292) 0:03:27.095 ******** 2026-08-18 15:30:55.283707 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd0/data) 2026-08-18 15:30:55.283793 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd0/data) 2026-08-18 15:30:55.283876 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd0/data) 2026-08-18 15:30:55.284509 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd1/data) 2026-08-18 15:30:55.284621 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd1/data) 2026-08-18 15:30:55.284628 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd1/data) 2026-08-18 15:30:55.284633 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd2/data) 2026-08-18 15:30:55.284637 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd2/data) 2026-08-18 15:30:55.284651 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd2/data) 2026-08-18 15:30:55.284656 | node1 | 2026-08-18 15:30:55.284661 | node1 | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] *** 2026-08-18 15:30:55.284820 | node1 | Tuesday 18 August 2026 15:30:55 +0000 (0:05:44.960) 0:09:12.055 ******** 2026-08-18 15:31:03.362380 | node1 | ok: [node1] 2026-08-18 15:31:03.362476 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:31:03.362561 | node1 | FAILED - RETRYING: [node3 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (120 retries left). 2026-08-18 15:31:03.362655 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:31:03.362743 | node1 | 2026-08-18 15:31:03.362847 | node1 | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] *** 2026-08-18 15:31:03.362934 | node1 | Tuesday 18 August 2026 15:31:03 +0000 (0:00:08.078) 0:09:20.134 ******** 2026-08-18 15:31:03.439366 | node1 | skipping: [node1] 2026-08-18 15:31:03.439404 | node1 | 2026-08-18 15:31:03.439522 | node1 | PLAY [Apply Ceph configuration] ************************************************ 2026-08-18 15:31:03.439606 | node1 | 2026-08-18 15:31:03.439703 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:31:03.439798 | node1 | Tuesday 18 August 2026 15:31:03 +0000 (0:00:00.077) 0:09:20.211 ******** 2026-08-18 15:31:04.506145 | node1 | ok: [node1] 2026-08-18 15:31:04.506216 | node1 | ok: [node2] 2026-08-18 15:31:04.506324 | node1 | ok: [node3] 2026-08-18 15:31:04.506413 | node1 | 2026-08-18 15:31:04.506513 | node1 | TASK [vexxhost.ceph.configure : Locate the cluster admin host] ***************** 2026-08-18 15:31:04.506606 | node1 | Tuesday 18 August 2026 15:31:04 +0000 (0:00:01.066) 0:09:21.278 ******** 2026-08-18 15:31:05.075383 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:31:05.075913 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:31:05.075952 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:31:05.075958 | node1 | 2026-08-18 15:31:05.075963 | node1 | TASK [vexxhost.ceph.configure : Select the admin host] ************************* 2026-08-18 15:31:05.075968 | node1 | Tuesday 18 August 2026 15:31:05 +0000 (0:00:00.569) 0:09:21.847 ******** 2026-08-18 15:31:05.140060 | node1 | ok: [node1] 2026-08-18 15:31:05.140749 | node1 | ok: [node2] 2026-08-18 15:31:05.140794 | node1 | ok: [node3] 2026-08-18 15:31:05.140801 | node1 | 2026-08-18 15:31:05.140808 | node1 | TASK [vexxhost.ceph.configure : Set the admin mon config path] ***************** 2026-08-18 15:31:05.140815 | node1 | Tuesday 18 August 2026 15:31:05 +0000 (0:00:00.064) 0:09:21.912 ******** 2026-08-18 15:31:05.191905 | node1 | ok: [node1] 2026-08-18 15:31:05.191964 | node1 | ok: [node2] 2026-08-18 15:31:05.192047 | node1 | ok: [node3] 2026-08-18 15:31:05.192359 | node1 | 2026-08-18 15:31:05.192406 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 15:31:05.192412 | node1 | Tuesday 18 August 2026 15:31:05 +0000 (0:00:00.052) 0:09:21.964 ******** 2026-08-18 15:31:05.261857 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/config.yml for node1, node2, node3 2026-08-18 15:31:05.261920 | node1 | 2026-08-18 15:31:05.262009 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 15:31:05.262104 | node1 | Tuesday 18 August 2026 15:31:05 +0000 (0:00:00.069) 0:09:22.034 ******** 2026-08-18 15:31:22.018845 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/standby_behaviour) 2026-08-18 15:31:22.018927 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/RGW_API_SSL_VERIFY) 2026-08-18 15:31:22.019016 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_CEPHFS) 2026-08-18 15:31:22.019566 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_ISCSI) 2026-08-18 15:31:22.019611 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_MIRRORING) 2026-08-18 15:31:22.019617 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_NFS) 2026-08-18 15:31:22.019622 | node1 | 2026-08-18 15:31:22.019627 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 15:31:22.019632 | node1 | Tuesday 18 August 2026 15:31:22 +0000 (0:00:16.757) 0:09:38.791 ******** 2026-08-18 15:31:22.089637 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/ec_profiles.yml for node1, node2, node3 2026-08-18 15:31:22.089713 | node1 | 2026-08-18 15:31:22.089923 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 15:31:22.089965 | node1 | Tuesday 18 August 2026 15:31:22 +0000 (0:00:00.070) 0:09:38.862 ******** 2026-08-18 15:31:25.091327 | node1 | changed: [node1] => (item=ec_hdd_s3) 2026-08-18 15:31:25.091403 | node1 | 2026-08-18 15:31:25.091544 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 15:31:25.091676 | node1 | Tuesday 18 August 2026 15:31:25 +0000 (0:00:03.001) 0:09:41.863 ******** 2026-08-18 15:31:25.150667 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/crush_rules.yml for node1, node2, node3 2026-08-18 15:31:25.150758 | node1 | 2026-08-18 15:31:25.150794 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 15:31:25.150930 | node1 | Tuesday 18 August 2026 15:31:25 +0000 (0:00:00.059) 0:09:41.923 ******** 2026-08-18 15:31:34.288193 | node1 | changed: [node1] => (item=rep_hdd) 2026-08-18 15:31:34.288256 | node1 | changed: [node1] => (item=rep_lab) 2026-08-18 15:31:34.288443 | node1 | changed: [node1] => (item=ec_hdd_s3) 2026-08-18 15:31:34.288498 | node1 | 2026-08-18 15:31:34.288658 | node1 | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 15:31:34.288703 | node1 | Tuesday 18 August 2026 15:31:34 +0000 (0:00:09.137) 0:09:51.060 ******** 2026-08-18 15:31:34.356687 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/pools.yml for node1, node2, node3 2026-08-18 15:31:34.356728 | node1 | 2026-08-18 15:31:34.356954 | node1 | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 15:31:34.356991 | node1 | Tuesday 18 August 2026 15:31:34 +0000 (0:00:00.068) 0:09:51.129 ******** 2026-08-18 15:32:05.166276 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.data) 2026-08-18 15:32:05.166383 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.index) 2026-08-18 15:32:05.167283 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.non-ec) 2026-08-18 15:32:05.167337 | node1 | changed: [node1] => (item=molecule-1.rgw.control) 2026-08-18 15:32:05.167344 | node1 | changed: [node1] => (item=molecule-1.rgw.log) 2026-08-18 15:32:05.167351 | node1 | changed: [node1] => (item=molecule-1.rgw.meta) 2026-08-18 15:32:05.167357 | node1 | 2026-08-18 15:32:05.167364 | node1 | TASK [vexxhost.ceph.configure : Configure CephX keys] ************************** 2026-08-18 15:32:05.167370 | node1 | Tuesday 18 August 2026 15:32:05 +0000 (0:00:30.809) 0:10:21.938 ******** 2026-08-18 15:32:05.216303 | node1 | skipping: [node1] 2026-08-18 15:32:05.216403 | node1 | skipping: [node2] 2026-08-18 15:32:05.216841 | node1 | skipping: [node3] 2026-08-18 15:32:05.216888 | node1 | 2026-08-18 15:32:05.216894 | node1 | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] ********** 2026-08-18 15:32:05.216900 | node1 | Tuesday 18 August 2026 15:32:05 +0000 (0:00:00.049) 0:10:21.988 ******** 2026-08-18 15:32:05.288737 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for node1, node2, node3 2026-08-18 15:32:05.288821 | node1 | 2026-08-18 15:32:05.288887 | node1 | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] *** 2026-08-18 15:32:05.288960 | node1 | Tuesday 18 August 2026 15:32:05 +0000 (0:00:00.073) 0:10:22.061 ******** 2026-08-18 15:32:06.775756 | node1 | ok: [node1] 2026-08-18 15:32:06.775828 | node1 | 2026-08-18 15:32:06.775909 | node1 | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] ********* 2026-08-18 15:32:06.776003 | node1 | Tuesday 18 August 2026 15:32:06 +0000 (0:00:01.486) 0:10:23.548 ******** 2026-08-18 15:32:08.361935 | node1 | ok: [node1] 2026-08-18 15:32:08.362006 | node1 | 2026-08-18 15:32:08.362018 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate] ***************** 2026-08-18 15:32:08.362028 | node1 | Tuesday 18 August 2026 15:32:08 +0000 (0:00:01.585) 0:10:25.133 ******** 2026-08-18 15:32:08.397362 | node1 | skipping: [node1] 2026-08-18 15:32:08.397438 | node1 | 2026-08-18 15:32:08.397677 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] ************* 2026-08-18 15:32:08.397720 | node1 | Tuesday 18 August 2026 15:32:08 +0000 (0:00:00.036) 0:10:25.169 ******** 2026-08-18 15:32:08.430615 | node1 | skipping: [node1] 2026-08-18 15:32:08.430789 | node1 | 2026-08-18 15:32:08.431093 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 15:32:08.431118 | node1 | Tuesday 18 August 2026 15:32:08 +0000 (0:00:00.032) 0:10:25.202 ******** 2026-08-18 15:32:08.459037 | node1 | skipping: [node1] 2026-08-18 15:32:08.459109 | node1 | 2026-08-18 15:32:08.459213 | node1 | TASK [vexxhost.ceph.configure : Create a self-signed certificate] ************** 2026-08-18 15:32:08.459306 | node1 | Tuesday 18 August 2026 15:32:08 +0000 (0:00:00.028) 0:10:25.231 ******** 2026-08-18 15:32:10.178812 | node1 | changed: [node1] 2026-08-18 15:32:10.178858 | node1 | 2026-08-18 15:32:10.178864 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 15:32:10.178868 | node1 | Tuesday 18 August 2026 15:32:10 +0000 (0:00:01.719) 0:10:26.950 ******** 2026-08-18 15:32:10.225901 | node1 | ok: [node1] 2026-08-18 15:32:10.225945 | node1 | 2026-08-18 15:32:10.225950 | node1 | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] *** 2026-08-18 15:32:10.225956 | node1 | Tuesday 18 August 2026 15:32:10 +0000 (0:00:00.046) 0:10:26.997 ******** 2026-08-18 15:32:16.856078 | node1 | changed: [node1] => (item=ceph mgr module disable dashboard) 2026-08-18 15:32:16.856182 | node1 | changed: [node1] => (item=ceph mgr module enable dashboard) 2026-08-18 15:32:16.856313 | node1 | changed: [node1] => (item=ceph orch reconfig mgr) 2026-08-18 15:32:16.856462 | node1 | 2026-08-18 15:32:16.856600 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 15:32:16.856732 | node1 | Tuesday 18 August 2026 15:32:16 +0000 (0:00:06.631) 0:10:33.628 ******** 2026-08-18 15:32:16.928111 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard_users.yml for node1, node2, node3 2026-08-18 15:32:16.928177 | node1 | 2026-08-18 15:32:16.928276 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 15:32:16.928369 | node1 | Tuesday 18 August 2026 15:32:16 +0000 (0:00:00.072) 0:10:33.700 ******** 2026-08-18 15:32:25.790219 | node1 | changed: [node1] => (item=None) 2026-08-18 15:32:25.790277 | node1 | changed: [node1] => (item=None) 2026-08-18 15:32:25.790283 | node1 | changed: [node1 -> {{ ceph_configure_admin_host }}] 2026-08-18 15:32:25.790288 | node1 | 2026-08-18 15:32:25.790292 | node1 | PLAY [Deploy Ceph RADOS Gateways] ********************************************** 2026-08-18 15:32:25.790297 | node1 | 2026-08-18 15:32:25.790301 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:32:25.790305 | node1 | Tuesday 18 August 2026 15:32:25 +0000 (0:00:08.861) 0:10:42.562 ******** 2026-08-18 15:32:26.926072 | node1 | ok: [node1] 2026-08-18 15:32:26.926116 | node1 | ok: [node2] 2026-08-18 15:32:26.926121 | node1 | ok: [node3] 2026-08-18 15:32:26.926125 | node1 | 2026-08-18 15:32:26.926130 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:32:26.926135 | node1 | Tuesday 18 August 2026 15:32:26 +0000 (0:00:01.135) 0:10:43.697 ******** 2026-08-18 15:32:27.156113 | node1 | ok: [node1] 2026-08-18 15:32:27.156156 | node1 | ok: [node2] 2026-08-18 15:32:27.156171 | node1 | ok: [node3] 2026-08-18 15:32:27.156176 | node1 | 2026-08-18 15:32:27.156181 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:32:27.156186 | node1 | Tuesday 18 August 2026 15:32:27 +0000 (0:00:00.230) 0:10:43.928 ******** 2026-08-18 15:32:27.222049 | node1 | skipping: [node1] 2026-08-18 15:32:27.222089 | node1 | skipping: [node2] 2026-08-18 15:32:27.222093 | node1 | skipping: [node3] 2026-08-18 15:32:27.222098 | node1 | 2026-08-18 15:32:27.222102 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:32:27.222107 | node1 | Tuesday 18 August 2026 15:32:27 +0000 (0:00:00.066) 0:10:43.994 ******** 2026-08-18 15:32:27.452882 | node1 | ok: [node1] 2026-08-18 15:32:27.453587 | node1 | ok: [node2] 2026-08-18 15:32:27.454687 | node1 | ok: [node3] 2026-08-18 15:32:27.454750 | node1 | 2026-08-18 15:32:27.454762 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:32:27.454773 | node1 | Tuesday 18 August 2026 15:32:27 +0000 (0:00:00.230) 0:10:44.225 ******** 2026-08-18 15:32:27.536568 | node1 | ok: [node1] => { 2026-08-18 15:32:27.538173 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:32:27.538224 | node1 | } 2026-08-18 15:32:27.538232 | node1 | ok: [node2] => { 2026-08-18 15:32:27.538238 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:32:27.538244 | node1 | } 2026-08-18 15:32:27.538249 | node1 | ok: [node3] => { 2026-08-18 15:32:27.538255 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:32:27.538260 | node1 | } 2026-08-18 15:32:27.538266 | node1 | 2026-08-18 15:32:27.538272 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:32:27.538278 | node1 | Tuesday 18 August 2026 15:32:27 +0000 (0:00:00.083) 0:10:44.308 ******** 2026-08-18 15:32:27.882000 | node1 | ok: [node1] 2026-08-18 15:32:27.882082 | node1 | ok: [node3] 2026-08-18 15:32:27.882212 | node1 | ok: [node2] 2026-08-18 15:32:27.882350 | node1 | 2026-08-18 15:32:27.882478 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:32:27.882621 | node1 | Tuesday 18 August 2026 15:32:27 +0000 (0:00:00.345) 0:10:44.654 ******** 2026-08-18 15:32:27.905360 | node1 | skipping: [node1] 2026-08-18 15:32:27.967696 | node1 | skipping: [node2] 2026-08-18 15:32:27.967782 | node1 | skipping: [node3] 2026-08-18 15:32:27.967867 | node1 | 2026-08-18 15:32:27.967965 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:32:27.968051 | node1 | Tuesday 18 August 2026 15:32:27 +0000 (0:00:00.086) 0:10:44.740 ******** 2026-08-18 15:32:28.051216 | node1 | skipping: [node1] 2026-08-18 15:32:28.051299 | node1 | skipping: [node2] 2026-08-18 15:32:28.051389 | node1 | skipping: [node3] 2026-08-18 15:32:28.051473 | node1 | 2026-08-18 15:32:28.051567 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:32:28.051652 | node1 | Tuesday 18 August 2026 15:32:28 +0000 (0:00:00.083) 0:10:44.823 ******** 2026-08-18 15:32:28.280192 | node1 | ok: [node1] 2026-08-18 15:32:28.280263 | node1 | ok: [node2] 2026-08-18 15:32:28.280345 | node1 | ok: [node3] 2026-08-18 15:32:28.280533 | node1 | 2026-08-18 15:32:28.280623 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:32:28.280636 | node1 | Tuesday 18 August 2026 15:32:28 +0000 (0:00:00.228) 0:10:45.052 ******** 2026-08-18 15:32:29.313618 | node1 | ok: [node2] 2026-08-18 15:32:29.313702 | node1 | ok: [node1] 2026-08-18 15:32:29.313767 | node1 | ok: [node3] 2026-08-18 15:32:29.314051 | node1 | 2026-08-18 15:32:29.314096 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:32:29.314105 | node1 | Tuesday 18 August 2026 15:32:29 +0000 (0:00:01.033) 0:10:46.086 ******** 2026-08-18 15:32:29.413364 | node1 | ok: [node1] => { 2026-08-18 15:32:29.414825 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:32:29.414875 | node1 | } 2026-08-18 15:32:29.414883 | node1 | ok: [node2] => { 2026-08-18 15:32:29.414889 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:32:29.414908 | node1 | } 2026-08-18 15:32:29.414914 | node1 | ok: [node3] => { 2026-08-18 15:32:29.414920 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:32:29.414926 | node1 | } 2026-08-18 15:32:29.414932 | node1 | 2026-08-18 15:32:29.414939 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:32:29.414945 | node1 | Tuesday 18 August 2026 15:32:29 +0000 (0:00:00.099) 0:10:46.185 ******** 2026-08-18 15:32:29.775218 | node1 | ok: [node1] 2026-08-18 15:32:29.775296 | node1 | ok: [node2] 2026-08-18 15:32:29.775817 | node1 | ok: [node3] 2026-08-18 15:32:29.775868 | node1 | 2026-08-18 15:32:29.775876 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:32:29.775883 | node1 | Tuesday 18 August 2026 15:32:29 +0000 (0:00:00.361) 0:10:46.547 ******** 2026-08-18 15:32:31.715986 | node1 | ok: [node1] 2026-08-18 15:32:31.716466 | node1 | ok: [node2] 2026-08-18 15:32:31.716511 | node1 | ok: [node3] 2026-08-18 15:32:31.716517 | node1 | 2026-08-18 15:32:31.716522 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:32:31.716527 | node1 | Tuesday 18 August 2026 15:32:31 +0000 (0:00:01.940) 0:10:48.487 ******** 2026-08-18 15:32:31.749326 | node1 | skipping: [node1] 2026-08-18 15:32:31.776574 | node1 | skipping: [node2] 2026-08-18 15:32:31.776633 | node1 | skipping: [node3] 2026-08-18 15:32:31.776726 | node1 | 2026-08-18 15:32:31.776823 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:32:31.776917 | node1 | Tuesday 18 August 2026 15:32:31 +0000 (0:00:00.061) 0:10:48.549 ******** 2026-08-18 15:32:31.830673 | node1 | skipping: [node1] 2026-08-18 15:32:31.830764 | node1 | skipping: [node2] 2026-08-18 15:32:31.830899 | node1 | skipping: [node3] 2026-08-18 15:32:31.831021 | node1 | 2026-08-18 15:32:31.831209 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:32:31.831355 | node1 | Tuesday 18 August 2026 15:32:31 +0000 (0:00:00.053) 0:10:48.602 ******** 2026-08-18 15:32:31.888831 | node1 | skipping: [node1] 2026-08-18 15:32:31.888923 | node1 | skipping: [node2] 2026-08-18 15:32:31.889048 | node1 | skipping: [node3] 2026-08-18 15:32:31.889168 | node1 | 2026-08-18 15:32:31.889306 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:32:31.889437 | node1 | Tuesday 18 August 2026 15:32:31 +0000 (0:00:00.058) 0:10:48.661 ******** 2026-08-18 15:32:32.938713 | node1 | ok: [node2] 2026-08-18 15:32:32.938775 | node1 | ok: [node3] 2026-08-18 15:32:32.939080 | node1 | ok: [node1] 2026-08-18 15:32:32.939114 | node1 | 2026-08-18 15:32:32.939156 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:32:32.939330 | node1 | Tuesday 18 August 2026 15:32:32 +0000 (0:00:01.049) 0:10:49.710 ******** 2026-08-18 15:32:33.377620 | node1 | ok: [node1] 2026-08-18 15:32:33.377726 | node1 | ok: [node3] 2026-08-18 15:32:33.378299 | node1 | ok: [node2] 2026-08-18 15:32:33.378349 | node1 | 2026-08-18 15:32:33.378357 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:32:33.378364 | node1 | Tuesday 18 August 2026 15:32:33 +0000 (0:00:00.439) 0:10:50.149 ******** 2026-08-18 15:32:34.318443 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:32:34.318514 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:32:34.318641 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:32:34.318744 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:32:34.318841 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:32:34.318936 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:32:34.319030 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:32:34.319124 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:32:34.319216 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:32:34.319314 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:32:34.319411 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:32:34.319507 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:32:34.319605 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:32:34.319702 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:32:34.319798 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:32:34.319896 | node1 | 2026-08-18 15:32:34.319984 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:32:34.320074 | node1 | Tuesday 18 August 2026 15:32:34 +0000 (0:00:00.941) 0:10:51.090 ******** 2026-08-18 15:32:34.871529 | node1 | ok: [node2] 2026-08-18 15:32:34.871606 | node1 | ok: [node1] 2026-08-18 15:32:34.872508 | node1 | ok: [node3] 2026-08-18 15:32:34.872543 | node1 | 2026-08-18 15:32:34.872556 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:32:34.872566 | node1 | Tuesday 18 August 2026 15:32:34 +0000 (0:00:00.519) 0:10:51.610 ******** 2026-08-18 15:32:34.872575 | node1 | 2026-08-18 15:32:34.872583 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:32:34.872592 | node1 | Tuesday 18 August 2026 15:32:34 +0000 (0:00:00.011) 0:10:51.621 ******** 2026-08-18 15:32:34.872602 | node1 | 2026-08-18 15:32:34.872611 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:32:34.873355 | node1 | Tuesday 18 August 2026 15:32:34 +0000 (0:00:00.011) 0:10:51.632 ******** 2026-08-18 15:32:34.873402 | node1 | 2026-08-18 15:32:34.873407 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:32:34.873411 | node1 | Tuesday 18 August 2026 15:32:34 +0000 (0:00:00.011) 0:10:51.644 ******** 2026-08-18 15:32:35.264839 | node1 | ok: [node1] 2026-08-18 15:32:35.264912 | node1 | ok: [node2] 2026-08-18 15:32:35.264991 | node1 | ok: [node3] 2026-08-18 15:32:35.265264 | node1 | 2026-08-18 15:32:35.265280 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:32:35.265285 | node1 | Tuesday 18 August 2026 15:32:35 +0000 (0:00:00.393) 0:10:52.037 ******** 2026-08-18 15:32:35.499469 | node1 | ok: [node1] 2026-08-18 15:32:35.500490 | node1 | ok: [node2] 2026-08-18 15:32:35.500556 | node1 | ok: [node3] 2026-08-18 15:32:35.500568 | node1 | 2026-08-18 15:32:35.500578 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:32:35.500596 | node1 | Tuesday 18 August 2026 15:32:35 +0000 (0:00:00.233) 0:10:52.270 ******** 2026-08-18 15:32:35.583551 | node1 | ok: [node1] => { 2026-08-18 15:32:35.583626 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:32:35.584496 | node1 | } 2026-08-18 15:32:35.584556 | node1 | ok: [node2] => { 2026-08-18 15:32:35.584568 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:32:35.584579 | node1 | } 2026-08-18 15:32:35.584588 | node1 | ok: [node3] => { 2026-08-18 15:32:35.584598 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:32:35.584607 | node1 | } 2026-08-18 15:32:35.584617 | node1 | 2026-08-18 15:32:35.584626 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:32:35.584642 | node1 | Tuesday 18 August 2026 15:32:35 +0000 (0:00:00.085) 0:10:52.355 ******** 2026-08-18 15:32:35.948078 | node1 | ok: [node1] 2026-08-18 15:32:35.948186 | node1 | ok: [node2] 2026-08-18 15:32:35.948477 | node1 | ok: [node3] 2026-08-18 15:32:35.948879 | node1 | 2026-08-18 15:32:35.948897 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:32:35.948905 | node1 | Tuesday 18 August 2026 15:32:35 +0000 (0:00:00.364) 0:10:52.720 ******** 2026-08-18 15:32:39.055711 | node1 | ok: [node1] 2026-08-18 15:32:39.055799 | node1 | ok: [node3] 2026-08-18 15:32:39.056197 | node1 | ok: [node2] 2026-08-18 15:32:39.056244 | node1 | 2026-08-18 15:32:39.056250 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:32:39.056256 | node1 | Tuesday 18 August 2026 15:32:39 +0000 (0:00:03.108) 0:10:55.828 ******** 2026-08-18 15:32:40.215648 | node1 | ok: [node1] 2026-08-18 15:32:40.215726 | node1 | ok: [node2] 2026-08-18 15:32:40.216256 | node1 | ok: [node3] 2026-08-18 15:32:40.216301 | node1 | 2026-08-18 15:32:40.216307 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:32:40.216313 | node1 | Tuesday 18 August 2026 15:32:40 +0000 (0:00:01.159) 0:10:56.988 ******** 2026-08-18 15:32:40.433389 | node1 | ok: [node1] 2026-08-18 15:32:40.433450 | node1 | ok: [node2] 2026-08-18 15:32:40.433819 | node1 | ok: [node3] 2026-08-18 15:32:40.433861 | node1 | 2026-08-18 15:32:40.433867 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:32:40.433873 | node1 | Tuesday 18 August 2026 15:32:40 +0000 (0:00:00.217) 0:10:57.205 ******** 2026-08-18 15:32:40.899836 | node1 | ok: [node1] 2026-08-18 15:32:40.899904 | node1 | ok: [node3] 2026-08-18 15:32:40.900280 | node1 | ok: [node2] 2026-08-18 15:32:40.900328 | node1 | 2026-08-18 15:32:40.900334 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:32:40.900339 | node1 | Tuesday 18 August 2026 15:32:40 +0000 (0:00:00.466) 0:10:57.672 ******** 2026-08-18 15:32:41.458326 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:32:41.458374 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:32:41.458381 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:32:41.458387 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:32:41.458394 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:32:41.458400 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:32:41.458406 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:32:41.458412 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:32:41.458417 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:32:41.458423 | node1 | 2026-08-18 15:32:41.458429 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:32:41.458435 | node1 | Tuesday 18 August 2026 15:32:41 +0000 (0:00:00.557) 0:10:58.229 ******** 2026-08-18 15:32:41.894246 | node1 | ok: [node1] 2026-08-18 15:32:41.894352 | node1 | ok: [node2] 2026-08-18 15:32:41.894889 | node1 | ok: [node3] 2026-08-18 15:32:41.894943 | node1 | 2026-08-18 15:32:41.894952 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:32:41.894966 | node1 | Tuesday 18 August 2026 15:32:41 +0000 (0:00:00.437) 0:10:58.666 ******** 2026-08-18 15:32:42.364470 | node1 | ok: [node1] 2026-08-18 15:32:42.364531 | node1 | ok: [node2] 2026-08-18 15:32:42.364542 | node1 | ok: [node3] 2026-08-18 15:32:42.364551 | node1 | 2026-08-18 15:32:42.364561 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:32:42.364572 | node1 | Tuesday 18 August 2026 15:32:42 +0000 (0:00:00.433) 0:10:59.100 ******** 2026-08-18 15:32:42.364581 | node1 | 2026-08-18 15:32:42.364590 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:32:42.364605 | node1 | Tuesday 18 August 2026 15:32:42 +0000 (0:00:00.013) 0:10:59.113 ******** 2026-08-18 15:32:42.364615 | node1 | 2026-08-18 15:32:42.365104 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:32:42.365151 | node1 | Tuesday 18 August 2026 15:32:42 +0000 (0:00:00.011) 0:10:59.124 ******** 2026-08-18 15:32:42.365156 | node1 | 2026-08-18 15:32:42.365161 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:32:42.365165 | node1 | Tuesday 18 August 2026 15:32:42 +0000 (0:00:00.011) 0:10:59.136 ******** 2026-08-18 15:32:42.765541 | node1 | ok: [node1] 2026-08-18 15:32:42.765587 | node1 | ok: [node3] 2026-08-18 15:32:42.765600 | node1 | ok: [node2] 2026-08-18 15:32:42.765604 | node1 | 2026-08-18 15:32:42.765609 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:32:42.765614 | node1 | Tuesday 18 August 2026 15:32:42 +0000 (0:00:00.401) 0:10:59.537 ******** 2026-08-18 15:32:42.837425 | node1 | ok: [node1] => { 2026-08-18 15:32:42.837519 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:32:42.837883 | node1 | } 2026-08-18 15:32:42.837941 | node1 | ok: [node2] => { 2026-08-18 15:32:42.837950 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:32:42.837964 | node1 | } 2026-08-18 15:32:42.837972 | node1 | ok: [node3] => { 2026-08-18 15:32:42.838496 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:32:42.838562 | node1 | } 2026-08-18 15:32:42.838568 | node1 | 2026-08-18 15:32:42.838573 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:32:42.838579 | node1 | Tuesday 18 August 2026 15:32:42 +0000 (0:00:00.072) 0:10:59.609 ******** 2026-08-18 15:32:43.133856 | node1 | ok: [node1] 2026-08-18 15:32:43.133988 | node1 | ok: [node2] 2026-08-18 15:32:43.134558 | node1 | ok: [node3] 2026-08-18 15:32:43.134622 | node1 | 2026-08-18 15:32:43.134634 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:32:43.134642 | node1 | Tuesday 18 August 2026 15:32:43 +0000 (0:00:00.296) 0:10:59.905 ******** 2026-08-18 15:32:43.216686 | node1 | skipping: [node1] 2026-08-18 15:32:43.216782 | node1 | skipping: [node2] 2026-08-18 15:32:43.216798 | node1 | skipping: [node3] 2026-08-18 15:32:43.217148 | node1 | 2026-08-18 15:32:43.217223 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:32:43.217230 | node1 | Tuesday 18 August 2026 15:32:43 +0000 (0:00:00.082) 0:10:59.988 ******** 2026-08-18 15:32:43.289740 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:32:43.289889 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:32:43.289900 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:32:43.289913 | node1 | 2026-08-18 15:32:43.290160 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:32:43.290213 | node1 | Tuesday 18 August 2026 15:32:43 +0000 (0:00:00.073) 0:11:00.062 ******** 2026-08-18 15:32:44.313205 | node1 | ok: [node1] 2026-08-18 15:32:44.313320 | node1 | ok: [node2] 2026-08-18 15:32:44.313862 | node1 | ok: [node3] 2026-08-18 15:32:44.313915 | node1 | 2026-08-18 15:32:44.313923 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:32:44.313930 | node1 | Tuesday 18 August 2026 15:32:44 +0000 (0:00:01.023) 0:11:01.085 ******** 2026-08-18 15:32:44.980652 | node1 | ok: [node1] => (item=chronyd) 2026-08-18 15:32:44.980703 | node1 | ok: [node2] => (item=chronyd) 2026-08-18 15:32:44.980710 | node1 | ok: [node3] => (item=chronyd) 2026-08-18 15:32:44.980716 | node1 | ok: [node2] => (item=sshd) 2026-08-18 15:32:44.980722 | node1 | ok: [node1] => (item=sshd) 2026-08-18 15:32:44.980727 | node1 | ok: [node3] => (item=sshd) 2026-08-18 15:32:44.980733 | node1 | 2026-08-18 15:32:44.980739 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:32:44.980746 | node1 | Tuesday 18 August 2026 15:32:44 +0000 (0:00:00.666) 0:11:01.751 ******** 2026-08-18 15:32:45.199269 | node1 | ok: [node1] 2026-08-18 15:32:45.199378 | node1 | ok: [node2] 2026-08-18 15:32:45.199887 | node1 | ok: [node3] 2026-08-18 15:32:45.199942 | node1 | 2026-08-18 15:32:45.199952 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:32:45.199960 | node1 | Tuesday 18 August 2026 15:32:45 +0000 (0:00:00.219) 0:11:01.971 ******** 2026-08-18 15:32:45.467910 | node1 | ok: [node1] 2026-08-18 15:32:45.467975 | node1 | ok: [node2] 2026-08-18 15:32:45.468072 | node1 | ok: [node3] 2026-08-18 15:32:45.468402 | node1 | 2026-08-18 15:32:45.468445 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:32:45.468461 | node1 | Tuesday 18 August 2026 15:32:45 +0000 (0:00:00.268) 0:11:02.240 ******** 2026-08-18 15:32:45.913302 | node1 | ok: [node1] 2026-08-18 15:32:45.913371 | node1 | ok: [node2] 2026-08-18 15:32:45.913913 | node1 | ok: [node3] 2026-08-18 15:32:45.913963 | node1 | 2026-08-18 15:32:45.913972 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:32:45.913979 | node1 | Tuesday 18 August 2026 15:32:45 +0000 (0:00:00.445) 0:11:02.685 ******** 2026-08-18 15:32:45.974054 | node1 | skipping: [node1] 2026-08-18 15:32:45.974534 | node1 | skipping: [node2] 2026-08-18 15:32:45.974576 | node1 | skipping: [node3] 2026-08-18 15:32:45.974582 | node1 | 2026-08-18 15:32:45.974587 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:32:45.974592 | node1 | Tuesday 18 August 2026 15:32:45 +0000 (0:00:00.061) 0:11:02.746 ******** 2026-08-18 15:32:46.350225 | node1 | ok: [node1] 2026-08-18 15:32:46.350296 | node1 | ok: [node2] 2026-08-18 15:32:46.350673 | node1 | ok: [node3] 2026-08-18 15:32:46.350719 | node1 | 2026-08-18 15:32:46.350725 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:32:46.350731 | node1 | Tuesday 18 August 2026 15:32:46 +0000 (0:00:00.376) 0:11:03.122 ******** 2026-08-18 15:32:46.840596 | node1 | ok: [node1] 2026-08-18 15:32:46.840670 | node1 | ok: [node2] 2026-08-18 15:32:46.840723 | node1 | ok: [node3] 2026-08-18 15:32:46.841029 | node1 | 2026-08-18 15:32:46.841074 | node1 | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] *********************** 2026-08-18 15:32:46.841083 | node1 | Tuesday 18 August 2026 15:32:46 +0000 (0:00:00.490) 0:11:03.612 ******** 2026-08-18 15:32:47.428512 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:32:47.429298 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:32:47.429317 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:32:47.429324 | node1 | 2026-08-18 15:32:47.429330 | node1 | TASK [vexxhost.ceph.rgw : Select the admin host] ******************************* 2026-08-18 15:32:47.429336 | node1 | Tuesday 18 August 2026 15:32:47 +0000 (0:00:00.587) 0:11:04.200 ******** 2026-08-18 15:32:47.503406 | node1 | ok: [node1] 2026-08-18 15:32:47.503456 | node1 | ok: [node2] 2026-08-18 15:32:47.503462 | node1 | ok: [node3] 2026-08-18 15:32:47.503468 | node1 | 2026-08-18 15:32:47.503475 | node1 | TASK [vexxhost.ceph.rgw : Set the admin mon config path] *********************** 2026-08-18 15:32:47.503482 | node1 | Tuesday 18 August 2026 15:32:47 +0000 (0:00:00.074) 0:11:04.274 ******** 2026-08-18 15:32:47.566404 | node1 | ok: [node1] 2026-08-18 15:32:47.566476 | node1 | ok: [node2] 2026-08-18 15:32:47.566492 | node1 | ok: [node3] 2026-08-18 15:32:47.566523 | node1 | 2026-08-18 15:32:47.566534 | node1 | TASK [Register this RGW host] ************************************************** 2026-08-18 15:32:47.566544 | node1 | Tuesday 18 August 2026 15:32:47 +0000 (0:00:00.062) 0:11:04.337 ******** 2026-08-18 15:32:47.660439 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:32:47.661248 | node1 | 2026-08-18 15:32:47.661278 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:32:47.661289 | node1 | Tuesday 18 August 2026 15:32:47 +0000 (0:00:00.095) 0:11:04.432 ******** 2026-08-18 15:32:49.080982 | node1 | ok: [node1] 2026-08-18 15:32:49.081111 | node1 | 2026-08-18 15:32:49.081307 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:32:49.081519 | node1 | Tuesday 18 August 2026 15:32:49 +0000 (0:00:01.419) 0:11:05.852 ******** 2026-08-18 15:32:49.144095 | node1 | ok: [node1] 2026-08-18 15:32:49.144211 | node1 | ok: [node2] 2026-08-18 15:32:49.144562 | node1 | ok: [node3] 2026-08-18 15:32:49.144794 | node1 | 2026-08-18 15:32:49.145048 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:32:49.145447 | node1 | Tuesday 18 August 2026 15:32:49 +0000 (0:00:00.063) 0:11:05.916 ******** 2026-08-18 15:32:49.202206 | node1 | ok: [node1] => { 2026-08-18 15:32:49.202320 | node1 | "changed": false, 2026-08-18 15:32:49.202332 | node1 | "msg": "All assertions passed" 2026-08-18 15:32:49.202405 | node1 | } 2026-08-18 15:32:49.202541 | node1 | ok: [node2] => { 2026-08-18 15:32:49.202624 | node1 | "changed": false, 2026-08-18 15:32:49.202719 | node1 | "msg": "All assertions passed" 2026-08-18 15:32:49.202797 | node1 | } 2026-08-18 15:32:49.202887 | node1 | ok: [node3] => { 2026-08-18 15:32:49.202984 | node1 | "changed": false, 2026-08-18 15:32:49.203131 | node1 | "msg": "All assertions passed" 2026-08-18 15:32:49.203321 | node1 | } 2026-08-18 15:32:49.203505 | node1 | 2026-08-18 15:32:49.203726 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:32:49.203920 | node1 | Tuesday 18 August 2026 15:32:49 +0000 (0:00:00.058) 0:11:05.974 ******** 2026-08-18 15:32:49.476050 | node1 | ok: [node2] 2026-08-18 15:32:49.476283 | node1 | ok: [node1] 2026-08-18 15:32:49.476566 | node1 | ok: [node3] 2026-08-18 15:32:49.476858 | node1 | 2026-08-18 15:32:49.477183 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:32:49.477402 | node1 | Tuesday 18 August 2026 15:32:49 +0000 (0:00:00.273) 0:11:06.248 ******** 2026-08-18 15:32:49.542503 | node1 | ok: [node1] 2026-08-18 15:32:49.542676 | node1 | ok: [node2] 2026-08-18 15:32:49.542896 | node1 | ok: [node3] 2026-08-18 15:32:49.543049 | node1 | 2026-08-18 15:32:49.543262 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:32:49.543466 | node1 | Tuesday 18 August 2026 15:32:49 +0000 (0:00:00.066) 0:11:06.314 ******** 2026-08-18 15:32:49.636795 | node1 | ok: [node1] 2026-08-18 15:32:49.637015 | node1 | ok: [node2] 2026-08-18 15:32:49.637230 | node1 | ok: [node3] 2026-08-18 15:32:49.637417 | node1 | 2026-08-18 15:32:49.637639 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:32:49.637849 | node1 | Tuesday 18 August 2026 15:32:49 +0000 (0:00:00.094) 0:11:06.408 ******** 2026-08-18 15:32:49.692622 | node1 | ok: [node1] => { 2026-08-18 15:32:49.692865 | node1 | "changed": false, 2026-08-18 15:32:49.693142 | node1 | "msg": "All assertions passed" 2026-08-18 15:32:49.693381 | node1 | } 2026-08-18 15:32:49.693602 | node1 | ok: [node2] => { 2026-08-18 15:32:49.693799 | node1 | "changed": false, 2026-08-18 15:32:49.693998 | node1 | "msg": "All assertions passed" 2026-08-18 15:32:49.694367 | node1 | } 2026-08-18 15:32:49.694563 | node1 | ok: [node3] => { 2026-08-18 15:32:49.694792 | node1 | "changed": false, 2026-08-18 15:32:49.694991 | node1 | "msg": "All assertions passed" 2026-08-18 15:32:49.695178 | node1 | } 2026-08-18 15:32:49.695358 | node1 | 2026-08-18 15:32:49.695566 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:32:49.695765 | node1 | Tuesday 18 August 2026 15:32:49 +0000 (0:00:00.055) 0:11:06.464 ******** 2026-08-18 15:32:51.252257 | node1 | ok: [node1] 2026-08-18 15:32:51.252489 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:32:51.252717 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:32:51.252925 | node1 | 2026-08-18 15:32:51.253136 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:32:51.253335 | node1 | Tuesday 18 August 2026 15:32:51 +0000 (0:00:01.559) 0:11:08.024 ******** 2026-08-18 15:32:51.341972 | node1 | skipping: [node1] 2026-08-18 15:32:51.342012 | node1 | skipping: [node2] 2026-08-18 15:32:51.342082 | node1 | skipping: [node3] 2026-08-18 15:32:51.342160 | node1 | 2026-08-18 15:32:51.342283 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] **** 2026-08-18 15:32:51.342371 | node1 | Tuesday 18 August 2026 15:32:51 +0000 (0:00:00.089) 0:11:08.114 ******** 2026-08-18 15:32:51.395866 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/multisite.yml for node1 2026-08-18 15:32:51.395922 | node1 | 2026-08-18 15:32:51.395987 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW realms] ******************************** 2026-08-18 15:32:51.396087 | node1 | Tuesday 18 August 2026 15:32:51 +0000 (0:00:00.054) 0:11:08.168 ******** 2026-08-18 15:32:54.923090 | node1 | changed: [node1] => (item=molecule) 2026-08-18 15:32:54.923445 | node1 | 2026-08-18 15:32:54.923463 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zonegroups] **************************** 2026-08-18 15:32:54.923695 | node1 | Tuesday 18 August 2026 15:32:54 +0000 (0:00:03.526) 0:11:11.695 ******** 2026-08-18 15:32:56.884451 | node1 | changed: [node1] => (item=molecule) 2026-08-18 15:32:56.884515 | node1 | 2026-08-18 15:32:56.884528 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zones] ********************************* 2026-08-18 15:32:56.884544 | node1 | Tuesday 18 August 2026 15:32:56 +0000 (0:00:01.960) 0:11:13.655 ******** 2026-08-18 15:32:58.860496 | node1 | changed: [node1] => (item=None) 2026-08-18 15:32:58.860603 | node1 | changed: [node1 -> {{ ceph_rgw_admin_host }}] 2026-08-18 15:32:58.860715 | node1 | 2026-08-18 15:32:58.860848 | node1 | TASK [vexxhost.ceph.rgw : Commit the RGW period] ******************************* 2026-08-18 15:32:58.860993 | node1 | Tuesday 18 August 2026 15:32:58 +0000 (0:00:01.976) 0:11:15.632 ******** 2026-08-18 15:33:00.214664 | node1 | changed: [node1] 2026-08-18 15:33:00.214851 | node1 | 2026-08-18 15:33:00.215082 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 15:33:00.215304 | node1 | Tuesday 18 August 2026 15:33:00 +0000 (0:00:01.354) 0:11:16.986 ******** 2026-08-18 15:33:00.263559 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/services.yml for node1 2026-08-18 15:33:00.263726 | node1 | 2026-08-18 15:33:00.263933 | node1 | TASK [vexxhost.ceph.rgw : Snapshot current RGW service specs] ****************** 2026-08-18 15:33:00.264133 | node1 | Tuesday 18 August 2026 15:33:00 +0000 (0:00:00.049) 0:11:17.035 ******** 2026-08-18 15:33:01.672494 | node1 | ok: [node1] 2026-08-18 15:33:01.672572 | node1 | 2026-08-18 15:33:01.672597 | node1 | TASK [vexxhost.ceph.rgw : Index current RGW specs by service name] ************* 2026-08-18 15:33:01.672742 | node1 | Tuesday 18 August 2026 15:33:01 +0000 (0:00:01.407) 0:11:18.443 ******** 2026-08-18 15:33:01.714803 | node1 | ok: [node1] 2026-08-18 15:33:01.714881 | node1 | 2026-08-18 15:33:01.715153 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 15:33:01.715214 | node1 | Tuesday 18 August 2026 15:33:01 +0000 (0:00:00.043) 0:11:18.486 ******** 2026-08-18 15:33:04.402247 | node1 | changed: [node1] => (item=molecule) 2026-08-18 15:33:04.402336 | node1 | 2026-08-18 15:33:04.402436 | node1 | TASK [vexxhost.ceph.rgw : Redeploy RGW services whose redeploy-triggering keys changed] *** 2026-08-18 15:33:04.402533 | node1 | Tuesday 18 August 2026 15:33:04 +0000 (0:00:02.687) 0:11:21.173 ******** 2026-08-18 15:33:04.450423 | node1 | skipping: [node1] => (item=rgw.molecule) 2026-08-18 15:33:04.450532 | node1 | skipping: [node1] 2026-08-18 15:33:04.450647 | node1 | 2026-08-18 15:33:04.450783 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone / zonegroup / pools] ********* 2026-08-18 15:33:04.450964 | node1 | Tuesday 18 August 2026 15:33:04 +0000 (0:00:00.048) 0:11:21.222 ******** 2026-08-18 15:33:04.519329 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/cleanup.yml for node1 2026-08-18 15:33:04.519420 | node1 | 2026-08-18 15:33:04.519577 | node1 | TASK [vexxhost.ceph.rgw : List RGW zones] ************************************** 2026-08-18 15:33:04.519699 | node1 | Tuesday 18 August 2026 15:33:04 +0000 (0:00:00.068) 0:11:21.291 ******** 2026-08-18 15:33:05.577784 | node1 | ok: [node1] 2026-08-18 15:33:05.577860 | node1 | 2026-08-18 15:33:05.577953 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zonegroup] ************************ 2026-08-18 15:33:05.578047 | node1 | Tuesday 18 August 2026 15:33:05 +0000 (0:00:01.058) 0:11:22.349 ******** 2026-08-18 15:33:05.614432 | node1 | skipping: [node1] 2026-08-18 15:33:05.614618 | node1 | 2026-08-18 15:33:05.614837 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone] ***************************** 2026-08-18 15:33:05.615041 | node1 | Tuesday 18 August 2026 15:33:05 +0000 (0:00:00.036) 0:11:22.386 ******** 2026-08-18 15:33:05.653954 | node1 | skipping: [node1] 2026-08-18 15:33:05.654125 | node1 | 2026-08-18 15:33:05.654339 | node1 | TASK [vexxhost.ceph.rgw : Get the current pool deletion setting] *************** 2026-08-18 15:33:05.654548 | node1 | Tuesday 18 August 2026 15:33:05 +0000 (0:00:00.039) 0:11:22.426 ******** 2026-08-18 15:33:05.695398 | node1 | skipping: [node1] 2026-08-18 15:33:05.695443 | node1 | 2026-08-18 15:33:05.695451 | node1 | TASK [vexxhost.ceph.rgw : Allow pool deletion] ********************************* 2026-08-18 15:33:05.695581 | node1 | Tuesday 18 August 2026 15:33:05 +0000 (0:00:00.040) 0:11:22.466 ******** 2026-08-18 15:33:05.737607 | node1 | skipping: [node1] 2026-08-18 15:33:05.737771 | node1 | 2026-08-18 15:33:05.738003 | node1 | TASK [vexxhost.ceph.rgw : Remove the default RGW pools] ************************ 2026-08-18 15:33:05.738225 | node1 | Tuesday 18 August 2026 15:33:05 +0000 (0:00:00.042) 0:11:22.509 ******** 2026-08-18 15:33:05.804006 | node1 | skipping: [node1] => (item=default.rgw.control) 2026-08-18 15:33:05.804226 | node1 | skipping: [node1] => (item=default.rgw.log) 2026-08-18 15:33:05.804505 | node1 | skipping: [node1] => (item=default.rgw.meta) 2026-08-18 15:33:05.804722 | node1 | skipping: [node1] 2026-08-18 15:33:05.804923 | node1 | 2026-08-18 15:33:05.805153 | node1 | TASK [vexxhost.ceph.rgw : Restore the configured pool deletion setting] ******** 2026-08-18 15:33:05.805362 | node1 | Tuesday 18 August 2026 15:33:05 +0000 (0:00:00.066) 0:11:22.576 ******** 2026-08-18 15:33:05.842181 | node1 | skipping: [node1] 2026-08-18 15:33:05.842393 | node1 | 2026-08-18 15:33:05.842633 | node1 | TASK [vexxhost.ceph.rgw : Remove the temporary pool deletion setting] ********** 2026-08-18 15:33:05.842857 | node1 | Tuesday 18 August 2026 15:33:05 +0000 (0:00:00.038) 0:11:22.614 ******** 2026-08-18 15:33:05.931028 | node1 | skipping: [node1] 2026-08-18 15:33:05.931176 | node1 | 2026-08-18 15:33:05.931416 | node1 | PLAY [Deploy Ceph monitoring stack] ******************************************** 2026-08-18 15:33:05.931597 | node1 | 2026-08-18 15:33:05.931797 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:33:05.932008 | node1 | Tuesday 18 August 2026 15:33:05 +0000 (0:00:00.088) 0:11:22.703 ******** 2026-08-18 15:33:06.881613 | node1 | ok: [node1] 2026-08-18 15:33:06.881823 | node1 | ok: [node3] 2026-08-18 15:33:06.882023 | node1 | ok: [node2] 2026-08-18 15:33:06.882211 | node1 | 2026-08-18 15:33:06.882495 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:33:06.882672 | node1 | Tuesday 18 August 2026 15:33:06 +0000 (0:00:00.949) 0:11:23.653 ******** 2026-08-18 15:33:07.113336 | node1 | ok: [node1] 2026-08-18 15:33:07.113502 | node1 | ok: [node2] 2026-08-18 15:33:07.113697 | node1 | ok: [node3] 2026-08-18 15:33:07.113882 | node1 | 2026-08-18 15:33:07.114086 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:33:07.114284 | node1 | Tuesday 18 August 2026 15:33:07 +0000 (0:00:00.231) 0:11:23.885 ******** 2026-08-18 15:33:07.171915 | node1 | skipping: [node1] 2026-08-18 15:33:07.172130 | node1 | skipping: [node2] 2026-08-18 15:33:07.172453 | node1 | skipping: [node3] 2026-08-18 15:33:07.172680 | node1 | 2026-08-18 15:33:07.172931 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:33:07.173212 | node1 | Tuesday 18 August 2026 15:33:07 +0000 (0:00:00.058) 0:11:23.943 ******** 2026-08-18 15:33:07.425133 | node1 | ok: [node1] 2026-08-18 15:33:07.426240 | node1 | ok: [node3] 2026-08-18 15:33:07.426300 | node1 | ok: [node2] 2026-08-18 15:33:07.426312 | node1 | 2026-08-18 15:33:07.426323 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:33:07.426398 | node1 | Tuesday 18 August 2026 15:33:07 +0000 (0:00:00.252) 0:11:24.195 ******** 2026-08-18 15:33:07.507299 | node1 | ok: [node1] => { 2026-08-18 15:33:07.507422 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:33:07.507537 | node1 | } 2026-08-18 15:33:07.507669 | node1 | ok: [node2] => { 2026-08-18 15:33:07.507802 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:33:07.507920 | node1 | } 2026-08-18 15:33:07.508035 | node1 | ok: [node3] => { 2026-08-18 15:33:07.508164 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:33:07.508279 | node1 | } 2026-08-18 15:33:07.508442 | node1 | 2026-08-18 15:33:07.508565 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:33:07.508744 | node1 | Tuesday 18 August 2026 15:33:07 +0000 (0:00:00.083) 0:11:24.279 ******** 2026-08-18 15:33:07.851604 | node1 | ok: [node2] 2026-08-18 15:33:07.851789 | node1 | ok: [node1] 2026-08-18 15:33:07.852000 | node1 | ok: [node3] 2026-08-18 15:33:07.852220 | node1 | 2026-08-18 15:33:07.852484 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:33:07.852706 | node1 | Tuesday 18 August 2026 15:33:07 +0000 (0:00:00.344) 0:11:24.623 ******** 2026-08-18 15:33:07.974815 | node1 | skipping: [node1] 2026-08-18 15:33:07.974996 | node1 | skipping: [node2] 2026-08-18 15:33:07.975145 | node1 | skipping: [node3] 2026-08-18 15:33:07.975319 | node1 | 2026-08-18 15:33:07.975522 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:33:07.975722 | node1 | Tuesday 18 August 2026 15:33:07 +0000 (0:00:00.123) 0:11:24.747 ******** 2026-08-18 15:33:08.069289 | node1 | skipping: [node1] 2026-08-18 15:33:08.069455 | node1 | skipping: [node2] 2026-08-18 15:33:08.069650 | node1 | skipping: [node3] 2026-08-18 15:33:08.069834 | node1 | 2026-08-18 15:33:08.070035 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:33:08.070235 | node1 | Tuesday 18 August 2026 15:33:08 +0000 (0:00:00.094) 0:11:24.841 ******** 2026-08-18 15:33:08.306321 | node1 | ok: [node1] 2026-08-18 15:33:08.306487 | node1 | ok: [node2] 2026-08-18 15:33:08.306680 | node1 | ok: [node3] 2026-08-18 15:33:08.306863 | node1 | 2026-08-18 15:33:08.307071 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:33:08.307302 | node1 | Tuesday 18 August 2026 15:33:08 +0000 (0:00:00.236) 0:11:25.078 ******** 2026-08-18 15:33:09.417668 | node1 | ok: [node2] 2026-08-18 15:33:09.417870 | node1 | ok: [node3] 2026-08-18 15:33:09.418109 | node1 | ok: [node1] 2026-08-18 15:33:09.418298 | node1 | 2026-08-18 15:33:09.418509 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:33:09.418726 | node1 | Tuesday 18 August 2026 15:33:09 +0000 (0:00:01.111) 0:11:26.189 ******** 2026-08-18 15:33:09.498999 | node1 | ok: [node1] => { 2026-08-18 15:33:09.499222 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:33:09.499416 | node1 | } 2026-08-18 15:33:09.499617 | node1 | ok: [node2] => { 2026-08-18 15:33:09.499833 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:33:09.500026 | node1 | } 2026-08-18 15:33:09.500223 | node1 | ok: [node3] => { 2026-08-18 15:33:09.500467 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:33:09.500661 | node1 | } 2026-08-18 15:33:09.500845 | node1 | 2026-08-18 15:33:09.501052 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:33:09.501252 | node1 | Tuesday 18 August 2026 15:33:09 +0000 (0:00:00.081) 0:11:26.271 ******** 2026-08-18 15:33:09.877029 | node1 | ok: [node2] 2026-08-18 15:33:09.877150 | node1 | ok: [node1] 2026-08-18 15:33:09.877288 | node1 | ok: [node3] 2026-08-18 15:33:09.877461 | node1 | 2026-08-18 15:33:09.877624 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:33:09.877797 | node1 | Tuesday 18 August 2026 15:33:09 +0000 (0:00:00.377) 0:11:26.649 ******** 2026-08-18 15:33:11.904743 | node1 | ok: [node2] 2026-08-18 15:33:11.904833 | node1 | ok: [node1] 2026-08-18 15:33:11.904900 | node1 | ok: [node3] 2026-08-18 15:33:11.904981 | node1 | 2026-08-18 15:33:11.905093 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:33:11.905181 | node1 | Tuesday 18 August 2026 15:33:11 +0000 (0:00:02.027) 0:11:28.676 ******** 2026-08-18 15:33:11.942660 | node1 | skipping: [node1] 2026-08-18 15:33:11.976002 | node1 | skipping: [node2] 2026-08-18 15:33:11.976119 | node1 | skipping: [node3] 2026-08-18 15:33:11.976310 | node1 | 2026-08-18 15:33:11.976498 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:33:11.976667 | node1 | Tuesday 18 August 2026 15:33:11 +0000 (0:00:00.071) 0:11:28.748 ******** 2026-08-18 15:33:12.041647 | node1 | skipping: [node1] 2026-08-18 15:33:12.041821 | node1 | skipping: [node2] 2026-08-18 15:33:12.042052 | node1 | skipping: [node3] 2026-08-18 15:33:12.042238 | node1 | 2026-08-18 15:33:12.042483 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:33:12.042680 | node1 | Tuesday 18 August 2026 15:33:12 +0000 (0:00:00.065) 0:11:28.813 ******** 2026-08-18 15:33:12.100475 | node1 | skipping: [node1] 2026-08-18 15:33:12.100681 | node1 | skipping: [node2] 2026-08-18 15:33:12.100896 | node1 | skipping: [node3] 2026-08-18 15:33:12.101097 | node1 | 2026-08-18 15:33:12.101329 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:33:12.101574 | node1 | Tuesday 18 August 2026 15:33:12 +0000 (0:00:00.058) 0:11:28.872 ******** 2026-08-18 15:33:13.202984 | node1 | ok: [node3] 2026-08-18 15:33:13.203296 | node1 | ok: [node2] 2026-08-18 15:33:13.203573 | node1 | ok: [node1] 2026-08-18 15:33:13.203812 | node1 | 2026-08-18 15:33:13.204053 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:33:13.204281 | node1 | Tuesday 18 August 2026 15:33:13 +0000 (0:00:01.092) 0:11:29.964 ******** 2026-08-18 15:33:13.669281 | node1 | ok: [node1] 2026-08-18 15:33:13.669564 | node1 | ok: [node2] 2026-08-18 15:33:13.669768 | node1 | ok: [node3] 2026-08-18 15:33:13.670179 | node1 | 2026-08-18 15:33:13.670218 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:33:13.670514 | node1 | Tuesday 18 August 2026 15:33:13 +0000 (0:00:00.476) 0:11:30.441 ******** 2026-08-18 15:33:14.677531 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:33:14.677730 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:33:14.677946 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:33:14.678158 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:33:14.678365 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:33:14.678569 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:33:14.678773 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:33:14.678963 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:33:14.679168 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:33:14.679533 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:33:14.679849 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:33:14.680153 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:33:14.680475 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:33:14.680850 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:33:14.681170 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:33:14.681443 | node1 | 2026-08-18 15:33:14.681821 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:33:14.682012 | node1 | Tuesday 18 August 2026 15:33:14 +0000 (0:00:01.008) 0:11:31.449 ******** 2026-08-18 15:33:15.262336 | node1 | ok: [node1] 2026-08-18 15:33:15.262618 | node1 | ok: [node2] 2026-08-18 15:33:15.262844 | node1 | ok: [node3] 2026-08-18 15:33:15.263041 | node1 | 2026-08-18 15:33:15.263339 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:33:15.263569 | node1 | Tuesday 18 August 2026 15:33:15 +0000 (0:00:00.569) 0:11:32.018 ******** 2026-08-18 15:33:15.263763 | node1 | 2026-08-18 15:33:15.263975 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:33:15.264186 | node1 | Tuesday 18 August 2026 15:33:15 +0000 (0:00:00.005) 0:11:32.023 ******** 2026-08-18 15:33:15.264374 | node1 | 2026-08-18 15:33:15.264676 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:33:15.264993 | node1 | Tuesday 18 August 2026 15:33:15 +0000 (0:00:00.005) 0:11:32.028 ******** 2026-08-18 15:33:15.265205 | node1 | 2026-08-18 15:33:15.265439 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:33:15.265660 | node1 | Tuesday 18 August 2026 15:33:15 +0000 (0:00:00.005) 0:11:32.034 ******** 2026-08-18 15:33:15.668406 | node1 | ok: [node2] 2026-08-18 15:33:15.668642 | node1 | ok: [node1] 2026-08-18 15:33:15.668870 | node1 | ok: [node3] 2026-08-18 15:33:15.669070 | node1 | 2026-08-18 15:33:15.669298 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:33:15.669889 | node1 | Tuesday 18 August 2026 15:33:15 +0000 (0:00:00.405) 0:11:32.439 ******** 2026-08-18 15:33:15.904693 | node1 | ok: [node2] 2026-08-18 15:33:15.905133 | node1 | ok: [node1] 2026-08-18 15:33:15.905333 | node1 | ok: [node3] 2026-08-18 15:33:15.905698 | node1 | 2026-08-18 15:33:15.905736 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:33:15.905987 | node1 | Tuesday 18 August 2026 15:33:15 +0000 (0:00:00.236) 0:11:32.676 ******** 2026-08-18 15:33:16.007895 | node1 | ok: [node1] => { 2026-08-18 15:33:16.008055 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:33:16.008151 | node1 | } 2026-08-18 15:33:16.008284 | node1 | ok: [node2] => { 2026-08-18 15:33:16.008493 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:33:16.008571 | node1 | } 2026-08-18 15:33:16.008925 | node1 | ok: [node3] => { 2026-08-18 15:33:16.009084 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:33:16.009202 | node1 | } 2026-08-18 15:33:16.009319 | node1 | 2026-08-18 15:33:16.009459 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:33:16.009604 | node1 | Tuesday 18 August 2026 15:33:16 +0000 (0:00:00.103) 0:11:32.779 ******** 2026-08-18 15:33:16.437171 | node1 | ok: [node1] 2026-08-18 15:33:16.437419 | node1 | ok: [node2] 2026-08-18 15:33:16.437704 | node1 | ok: [node3] 2026-08-18 15:33:16.438006 | node1 | 2026-08-18 15:33:16.438346 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:33:16.438709 | node1 | Tuesday 18 August 2026 15:33:16 +0000 (0:00:00.429) 0:11:33.208 ******** 2026-08-18 15:33:19.606974 | node1 | ok: [node2] 2026-08-18 15:33:19.607179 | node1 | ok: [node3] 2026-08-18 15:33:19.607420 | node1 | ok: [node1] 2026-08-18 15:33:19.607609 | node1 | 2026-08-18 15:33:19.607838 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:33:19.608091 | node1 | Tuesday 18 August 2026 15:33:19 +0000 (0:00:03.170) 0:11:36.379 ******** 2026-08-18 15:33:20.623838 | node1 | ok: [node2] 2026-08-18 15:33:20.624025 | node1 | ok: [node3] 2026-08-18 15:33:20.624229 | node1 | ok: [node1] 2026-08-18 15:33:20.624430 | node1 | 2026-08-18 15:33:20.624678 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:33:20.624883 | node1 | Tuesday 18 August 2026 15:33:20 +0000 (0:00:01.016) 0:11:37.395 ******** 2026-08-18 15:33:20.847343 | node1 | ok: [node1] 2026-08-18 15:33:20.847502 | node1 | ok: [node2] 2026-08-18 15:33:20.847696 | node1 | ok: [node3] 2026-08-18 15:33:20.847882 | node1 | 2026-08-18 15:33:20.848103 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:33:20.848361 | node1 | Tuesday 18 August 2026 15:33:20 +0000 (0:00:00.223) 0:11:37.619 ******** 2026-08-18 15:33:21.303843 | node1 | ok: [node1] 2026-08-18 15:33:21.303921 | node1 | ok: [node2] 2026-08-18 15:33:21.304013 | node1 | ok: [node3] 2026-08-18 15:33:21.304096 | node1 | 2026-08-18 15:33:21.304196 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:33:21.304294 | node1 | Tuesday 18 August 2026 15:33:21 +0000 (0:00:00.457) 0:11:38.076 ******** 2026-08-18 15:33:21.915351 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:33:21.915419 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:33:21.915430 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:33:21.915440 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:33:21.915450 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:33:21.915473 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:33:21.915483 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:33:21.915492 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:33:21.915500 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:33:21.915509 | node1 | 2026-08-18 15:33:21.915527 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:33:21.915536 | node1 | Tuesday 18 August 2026 15:33:21 +0000 (0:00:00.609) 0:11:38.685 ******** 2026-08-18 15:33:22.357923 | node1 | ok: [node2] 2026-08-18 15:33:22.357976 | node1 | ok: [node1] 2026-08-18 15:33:22.358082 | node1 | ok: [node3] 2026-08-18 15:33:22.358169 | node1 | 2026-08-18 15:33:22.358269 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:33:22.358364 | node1 | Tuesday 18 August 2026 15:33:22 +0000 (0:00:00.444) 0:11:39.130 ******** 2026-08-18 15:33:22.815136 | node1 | ok: [node2] 2026-08-18 15:33:22.815204 | node1 | ok: [node3] 2026-08-18 15:33:22.816394 | node1 | ok: [node1] 2026-08-18 15:33:22.816437 | node1 | 2026-08-18 15:33:22.816468 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:33:22.816475 | node1 | Tuesday 18 August 2026 15:33:22 +0000 (0:00:00.438) 0:11:39.568 ******** 2026-08-18 15:33:22.816481 | node1 | 2026-08-18 15:33:22.816486 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:33:22.816492 | node1 | Tuesday 18 August 2026 15:33:22 +0000 (0:00:00.007) 0:11:39.576 ******** 2026-08-18 15:33:22.816497 | node1 | 2026-08-18 15:33:22.816502 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:33:22.816507 | node1 | Tuesday 18 August 2026 15:33:22 +0000 (0:00:00.005) 0:11:39.581 ******** 2026-08-18 15:33:22.816512 | node1 | 2026-08-18 15:33:22.816517 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:33:22.816522 | node1 | Tuesday 18 August 2026 15:33:22 +0000 (0:00:00.005) 0:11:39.587 ******** 2026-08-18 15:33:23.215487 | node1 | ok: [node1] 2026-08-18 15:33:23.215561 | node1 | ok: [node2] 2026-08-18 15:33:23.215861 | node1 | ok: [node3] 2026-08-18 15:33:23.215923 | node1 | 2026-08-18 15:33:23.215935 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:33:23.215953 | node1 | Tuesday 18 August 2026 15:33:23 +0000 (0:00:00.400) 0:11:39.987 ******** 2026-08-18 15:33:23.271075 | node1 | ok: [node1] => { 2026-08-18 15:33:23.271209 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:33:23.272059 | node1 | } 2026-08-18 15:33:23.272162 | node1 | ok: [node2] => { 2026-08-18 15:33:23.272175 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:33:23.272187 | node1 | } 2026-08-18 15:33:23.272204 | node1 | ok: [node3] => { 2026-08-18 15:33:23.272214 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:33:23.272430 | node1 | } 2026-08-18 15:33:23.272448 | node1 | 2026-08-18 15:33:23.272770 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:33:23.272828 | node1 | Tuesday 18 August 2026 15:33:23 +0000 (0:00:00.055) 0:11:40.043 ******** 2026-08-18 15:33:23.561853 | node1 | ok: [node1] 2026-08-18 15:33:23.561915 | node1 | ok: [node3] 2026-08-18 15:33:23.562019 | node1 | ok: [node2] 2026-08-18 15:33:23.562108 | node1 | 2026-08-18 15:33:23.562251 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:33:23.562369 | node1 | Tuesday 18 August 2026 15:33:23 +0000 (0:00:00.290) 0:11:40.334 ******** 2026-08-18 15:33:23.629453 | node1 | skipping: [node1] 2026-08-18 15:33:23.629511 | node1 | skipping: [node2] 2026-08-18 15:33:23.629605 | node1 | skipping: [node3] 2026-08-18 15:33:23.629698 | node1 | 2026-08-18 15:33:23.629791 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:33:23.629890 | node1 | Tuesday 18 August 2026 15:33:23 +0000 (0:00:00.067) 0:11:40.401 ******** 2026-08-18 15:33:23.701666 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:33:23.701760 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:33:23.701918 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:33:23.702035 | node1 | 2026-08-18 15:33:23.702149 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:33:23.702242 | node1 | Tuesday 18 August 2026 15:33:23 +0000 (0:00:00.072) 0:11:40.473 ******** 2026-08-18 15:33:24.768352 | node1 | ok: [node2] 2026-08-18 15:33:24.768455 | node1 | ok: [node3] 2026-08-18 15:33:24.768502 | node1 | ok: [node1] 2026-08-18 15:33:24.768595 | node1 | 2026-08-18 15:33:24.768696 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:33:24.768787 | node1 | Tuesday 18 August 2026 15:33:24 +0000 (0:00:01.066) 0:11:41.540 ******** 2026-08-18 15:33:25.449649 | node1 | ok: [node1] => (item=chronyd) 2026-08-18 15:33:25.450102 | node1 | ok: [node2] => (item=chronyd) 2026-08-18 15:33:25.450120 | node1 | ok: [node3] => (item=chronyd) 2026-08-18 15:33:25.450133 | node1 | ok: [node1] => (item=sshd) 2026-08-18 15:33:25.450623 | node1 | ok: [node2] => (item=sshd) 2026-08-18 15:33:25.450673 | node1 | ok: [node3] => (item=sshd) 2026-08-18 15:33:25.451100 | node1 | 2026-08-18 15:33:25.451119 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:33:25.451127 | node1 | Tuesday 18 August 2026 15:33:25 +0000 (0:00:00.680) 0:11:42.221 ******** 2026-08-18 15:33:25.682458 | node1 | ok: [node1] 2026-08-18 15:33:25.682513 | node1 | ok: [node2] 2026-08-18 15:33:25.682521 | node1 | ok: [node3] 2026-08-18 15:33:25.682527 | node1 | 2026-08-18 15:33:25.682534 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:33:25.682541 | node1 | Tuesday 18 August 2026 15:33:25 +0000 (0:00:00.232) 0:11:42.454 ******** 2026-08-18 15:33:25.936332 | node1 | ok: [node1] 2026-08-18 15:33:25.936407 | node1 | ok: [node2] 2026-08-18 15:33:25.936518 | node1 | ok: [node3] 2026-08-18 15:33:25.936537 | node1 | 2026-08-18 15:33:25.936548 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:33:25.936567 | node1 | Tuesday 18 August 2026 15:33:25 +0000 (0:00:00.253) 0:11:42.707 ******** 2026-08-18 15:33:26.368713 | node1 | ok: [node1] 2026-08-18 15:33:26.368901 | node1 | ok: [node2] 2026-08-18 15:33:26.369086 | node1 | ok: [node3] 2026-08-18 15:33:26.369267 | node1 | 2026-08-18 15:33:26.369467 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:33:26.369665 | node1 | Tuesday 18 August 2026 15:33:26 +0000 (0:00:00.433) 0:11:43.140 ******** 2026-08-18 15:33:26.416958 | node1 | skipping: [node1] 2026-08-18 15:33:26.417203 | node1 | skipping: [node2] 2026-08-18 15:33:26.417445 | node1 | skipping: [node3] 2026-08-18 15:33:26.417664 | node1 | 2026-08-18 15:33:26.417933 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:33:26.418178 | node1 | Tuesday 18 August 2026 15:33:26 +0000 (0:00:00.048) 0:11:43.189 ******** 2026-08-18 15:33:26.795361 | node1 | ok: [node3] 2026-08-18 15:33:26.795488 | node1 | ok: [node2] 2026-08-18 15:33:26.795693 | node1 | ok: [node1] 2026-08-18 15:33:26.795868 | node1 | 2026-08-18 15:33:26.796116 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:33:26.796329 | node1 | Tuesday 18 August 2026 15:33:26 +0000 (0:00:00.378) 0:11:43.567 ******** 2026-08-18 15:33:27.238598 | node1 | ok: [node2] 2026-08-18 15:33:27.238924 | node1 | ok: [node1] 2026-08-18 15:33:27.239260 | node1 | ok: [node3] 2026-08-18 15:33:27.239521 | node1 | 2026-08-18 15:33:27.239852 | node1 | TASK [vexxhost.ceph.monitoring : Locate the cluster admin host] **************** 2026-08-18 15:33:27.240113 | node1 | Tuesday 18 August 2026 15:33:27 +0000 (0:00:00.443) 0:11:44.010 ******** 2026-08-18 15:33:28.814464 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:33:28.814581 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:33:28.814724 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:33:28.814853 | node1 | 2026-08-18 15:33:28.814996 | node1 | TASK [vexxhost.ceph.monitoring : Select the admin host] ************************ 2026-08-18 15:33:28.815131 | node1 | Tuesday 18 August 2026 15:33:28 +0000 (0:00:01.576) 0:11:45.586 ******** 2026-08-18 15:33:28.879878 | node1 | ok: [node1] 2026-08-18 15:33:28.880085 | node1 | ok: [node2] 2026-08-18 15:33:28.880319 | node1 | ok: [node3] 2026-08-18 15:33:28.880519 | node1 | 2026-08-18 15:33:28.880742 | node1 | TASK [vexxhost.ceph.monitoring : Set the admin mon config path] **************** 2026-08-18 15:33:28.881000 | node1 | Tuesday 18 August 2026 15:33:28 +0000 (0:00:00.065) 0:11:45.652 ******** 2026-08-18 15:33:28.929712 | node1 | ok: [node1] 2026-08-18 15:33:28.929903 | node1 | ok: [node2] 2026-08-18 15:33:28.930092 | node1 | ok: [node3] 2026-08-18 15:33:28.930271 | node1 | 2026-08-18 15:33:28.930491 | node1 | TASK [vexxhost.ceph.monitoring : Pin monitoring container images] ************** 2026-08-18 15:33:28.930690 | node1 | Tuesday 18 August 2026 15:33:28 +0000 (0:00:00.050) 0:11:45.702 ******** 2026-08-18 15:33:28.946880 | node1 | skipping: [node1] 2026-08-18 15:33:28.947058 | node1 | 2026-08-18 15:33:28.947270 | node1 | TASK [vexxhost.ceph.monitoring : Apply the monitoring service specs] *********** 2026-08-18 15:33:28.947476 | node1 | Tuesday 18 August 2026 15:33:28 +0000 (0:00:00.017) 0:11:45.719 ******** 2026-08-18 15:33:31.715599 | node1 | changed: [node1] => (item=ceph-exporter) 2026-08-18 15:33:31.715657 | node1 | 2026-08-18 15:33:31.715665 | node1 | PLAY RECAP ********************************************************************* 2026-08-18 15:33:31.715672 | node1 | node1 : ok=246 changed=48 unreachable=0 failed=0 skipped=54 rescued=0 ignored=0 2026-08-18 15:33:31.715678 | node1 | node2 : ok=206 changed=28 unreachable=0 failed=0 skipped=45 rescued=0 ignored=0 2026-08-18 15:33:31.715683 | node1 | node3 : ok=206 changed=28 unreachable=0 failed=0 skipped=45 rescued=0 ignored=0 2026-08-18 15:33:31.715689 | node1 | 2026-08-18 15:33:31.715694 | node1 | 2026-08-18 15:33:31.715700 | node1 | TASKS RECAP ******************************************************************** 2026-08-18 15:33:31.715705 | node1 | Tuesday 18 August 2026 15:33:31 +0000 (0:00:02.764) 0:11:48.484 ******** 2026-08-18 15:33:31.715711 | node1 | =============================================================================== 2026-08-18 15:33:31.715716 | node1 | vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices ------ 344.96s 2026-08-18 15:33:31.715722 | node1 | vexxhost.ceph.cephadm : Pre-pull the Ceph image ------------------------ 39.60s 2026-08-18 15:33:31.715727 | node1 | vexxhost.ceph.mon : Bootstrap the cluster ------------------------------ 38.19s 2026-08-18 15:33:31.715732 | node1 | vexxhost.ceph.configure : Configure pools ------------------------------ 30.81s 2026-08-18 15:33:31.715738 | node1 | vexxhost.ceph.cephadm_host : Register the host (labels) ---------------- 26.19s 2026-08-18 15:33:31.715743 | node1 | vexxhost.ceph.configure : Apply central Ceph configuration ------------- 16.76s 2026-08-18 15:33:31.715748 | node1 | vexxhost.ceph.mgr : Configure ceph-mgr modules ------------------------- 10.03s 2026-08-18 15:33:31.715754 | node1 | vexxhost.ceph.configure : Configure CRUSH rules ------------------------- 9.14s 2026-08-18 15:33:31.715759 | node1 | vexxhost.ceph.configure : Configure dashboard users --------------------- 8.86s 2026-08-18 15:33:31.715765 | node1 | vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host --- 8.08s 2026-08-18 15:33:31.715771 | node1 | vexxhost.ceph.cephadm_host : Get the cephadm public key ----------------- 7.43s 2026-08-18 15:33:31.715776 | node1 | vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate --- 6.63s 2026-08-18 15:33:31.715782 | node1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.58s 2026-08-18 15:33:31.715787 | node1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.24s 2026-08-18 15:33:31.715793 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.46s 2026-08-18 15:33:31.715798 | node1 | vexxhost.ceph.rgw : Configure RGW realms -------------------------------- 3.53s 2026-08-18 15:33:31.715817 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.17s 2026-08-18 15:33:31.715823 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.11s 2026-08-18 15:33:31.715828 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.07s 2026-08-18 15:33:31.715833 | node1 | vexxhost.ceph.configure : Configure erasure-code profiles --------------- 3.00s 2026-08-18 15:33:31.811224 | node1 | INFO [default > converge] Executed: Successful 2026-08-18 15:33:31.819031 | node1 | INFO [default > idempotence] Executing 2026-08-18 15:33:32.875293 | node1 | 2026-08-18 15:33:32.875357 | node1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-18 15:33:32.875369 | node1 | 2026-08-18 15:33:32.875378 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:33:32.875387 | node1 | Tuesday 18 August 2026 15:33:32 +0000 (0:00:00.077) 0:00:00.077 ******** 2026-08-18 15:33:33.980125 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python 2026-08-18 15:33:33.980182 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 15:33:33.980194 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:33:33.980204 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:33:33.980213 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:33:33.996130 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python 2026-08-18 15:33:33.996152 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 15:33:33.996159 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:33:33.996165 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:33:33.996171 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:33:34.001363 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python 2026-08-18 15:33:34.001432 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 15:33:34.001620 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:33:34.001856 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:33:34.002064 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:33:34.056516 | node1 | ok: [node1] 2026-08-18 15:33:34.056726 | node1 | ok: [node2] 2026-08-18 15:33:34.056927 | node1 | ok: [node3] 2026-08-18 15:33:34.057108 | node1 | 2026-08-18 15:33:34.057309 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:33:34.057510 | node1 | Tuesday 18 August 2026 15:33:34 +0000 (0:00:01.182) 0:00:01.259 ******** 2026-08-18 15:33:34.370566 | node1 | ok: [node2] 2026-08-18 15:33:34.370721 | node1 | ok: [node3] 2026-08-18 15:33:34.370914 | node1 | ok: [node1] 2026-08-18 15:33:34.371094 | node1 | 2026-08-18 15:33:34.371381 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:33:34.371590 | node1 | Tuesday 18 August 2026 15:33:34 +0000 (0:00:00.313) 0:00:01.572 ******** 2026-08-18 15:33:34.436595 | node1 | skipping: [node1] 2026-08-18 15:33:34.436751 | node1 | skipping: [node2] 2026-08-18 15:33:34.436937 | node1 | skipping: [node3] 2026-08-18 15:33:34.437116 | node1 | 2026-08-18 15:33:34.437320 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:33:34.437532 | node1 | Tuesday 18 August 2026 15:33:34 +0000 (0:00:00.066) 0:00:01.639 ******** 2026-08-18 15:33:34.743834 | node1 | ok: [node1] 2026-08-18 15:33:34.744054 | node1 | ok: [node3] 2026-08-18 15:33:34.744404 | node1 | ok: [node2] 2026-08-18 15:33:34.744708 | node1 | 2026-08-18 15:33:34.744972 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:33:34.745210 | node1 | Tuesday 18 August 2026 15:33:34 +0000 (0:00:00.306) 0:00:01.946 ******** 2026-08-18 15:33:34.842334 | node1 | ok: [node1] => { 2026-08-18 15:33:34.842564 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:33:34.842762 | node1 | } 2026-08-18 15:33:34.842960 | node1 | ok: [node2] => { 2026-08-18 15:33:34.843172 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:33:34.843372 | node1 | } 2026-08-18 15:33:34.843597 | node1 | ok: [node3] => { 2026-08-18 15:33:34.843789 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:33:34.843983 | node1 | } 2026-08-18 15:33:34.844159 | node1 | 2026-08-18 15:33:34.844370 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:33:34.844620 | node1 | Tuesday 18 August 2026 15:33:34 +0000 (0:00:00.098) 0:00:02.044 ******** 2026-08-18 15:33:35.268919 | node1 | ok: [node1] 2026-08-18 15:33:35.269115 | node1 | ok: [node3] 2026-08-18 15:33:35.269317 | node1 | ok: [node2] 2026-08-18 15:33:35.269506 | node1 | 2026-08-18 15:33:35.269720 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:33:35.269933 | node1 | Tuesday 18 August 2026 15:33:35 +0000 (0:00:00.426) 0:00:02.471 ******** 2026-08-18 15:33:35.298194 | node1 | skipping: [node1] 2026-08-18 15:33:35.369595 | node1 | skipping: [node2] 2026-08-18 15:33:35.369784 | node1 | skipping: [node3] 2026-08-18 15:33:35.369968 | node1 | 2026-08-18 15:33:35.370176 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:33:35.370377 | node1 | Tuesday 18 August 2026 15:33:35 +0000 (0:00:00.101) 0:00:02.572 ******** 2026-08-18 15:33:35.467585 | node1 | skipping: [node1] 2026-08-18 15:33:35.467649 | node1 | skipping: [node2] 2026-08-18 15:33:35.467716 | node1 | skipping: [node3] 2026-08-18 15:33:35.467795 | node1 | 2026-08-18 15:33:35.467891 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:33:35.467983 | node1 | Tuesday 18 August 2026 15:33:35 +0000 (0:00:00.097) 0:00:02.670 ******** 2026-08-18 15:33:35.702703 | node1 | ok: [node2] 2026-08-18 15:33:35.702871 | node1 | ok: [node1] 2026-08-18 15:33:35.703072 | node1 | ok: [node3] 2026-08-18 15:33:35.703257 | node1 | 2026-08-18 15:33:35.703470 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:33:35.703676 | node1 | Tuesday 18 August 2026 15:33:35 +0000 (0:00:00.234) 0:00:02.905 ******** 2026-08-18 15:33:36.865778 | node1 | ok: [node2] 2026-08-18 15:33:36.865969 | node1 | ok: [node3] 2026-08-18 15:33:36.866170 | node1 | ok: [node1] 2026-08-18 15:33:36.866357 | node1 | 2026-08-18 15:33:36.866568 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:33:36.866773 | node1 | Tuesday 18 August 2026 15:33:36 +0000 (0:00:01.163) 0:00:04.068 ******** 2026-08-18 15:33:36.969520 | node1 | ok: [node1] => { 2026-08-18 15:33:36.969726 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:33:36.969929 | node1 | } 2026-08-18 15:33:36.970145 | node1 | ok: [node2] => { 2026-08-18 15:33:36.970371 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:33:36.970577 | node1 | } 2026-08-18 15:33:36.970782 | node1 | ok: [node3] => { 2026-08-18 15:33:36.971001 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:33:36.971198 | node1 | } 2026-08-18 15:33:36.971389 | node1 | 2026-08-18 15:33:36.971614 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:33:36.971825 | node1 | Tuesday 18 August 2026 15:33:36 +0000 (0:00:00.103) 0:00:04.172 ******** 2026-08-18 15:33:37.327634 | node1 | ok: [node2] 2026-08-18 15:33:37.327686 | node1 | ok: [node3] 2026-08-18 15:33:37.327691 | node1 | ok: [node1] 2026-08-18 15:33:37.327695 | node1 | 2026-08-18 15:33:37.327859 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:33:37.328096 | node1 | Tuesday 18 August 2026 15:33:37 +0000 (0:00:00.356) 0:00:04.528 ******** 2026-08-18 15:33:40.430228 | node1 | ok: [node1] 2026-08-18 15:33:40.430356 | node1 | ok: [node3] 2026-08-18 15:33:40.430598 | node1 | ok: [node2] 2026-08-18 15:33:40.430743 | node1 | 2026-08-18 15:33:40.430944 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:33:40.431144 | node1 | Tuesday 18 August 2026 15:33:40 +0000 (0:00:03.104) 0:00:07.632 ******** 2026-08-18 15:33:40.490605 | node1 | skipping: [node1] 2026-08-18 15:33:40.490679 | node1 | skipping: [node2] 2026-08-18 15:33:40.490768 | node1 | skipping: [node3] 2026-08-18 15:33:40.490850 | node1 | 2026-08-18 15:33:40.490942 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:33:40.491025 | node1 | Tuesday 18 August 2026 15:33:40 +0000 (0:00:00.060) 0:00:07.693 ******** 2026-08-18 15:33:40.556422 | node1 | skipping: [node1] 2026-08-18 15:33:40.556673 | node1 | skipping: [node2] 2026-08-18 15:33:40.556963 | node1 | skipping: [node3] 2026-08-18 15:33:40.557166 | node1 | 2026-08-18 15:33:40.557375 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:33:40.557588 | node1 | Tuesday 18 August 2026 15:33:40 +0000 (0:00:00.065) 0:00:07.758 ******** 2026-08-18 15:33:40.586376 | node1 | skipping: [node1] 2026-08-18 15:33:40.616931 | node1 | skipping: [node2] 2026-08-18 15:33:40.617186 | node1 | skipping: [node3] 2026-08-18 15:33:40.617369 | node1 | 2026-08-18 15:33:40.617586 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:33:40.617808 | node1 | Tuesday 18 August 2026 15:33:40 +0000 (0:00:00.060) 0:00:07.819 ******** 2026-08-18 15:33:41.854868 | node1 | ok: [node1] 2026-08-18 15:33:41.854934 | node1 | ok: [node3] 2026-08-18 15:33:41.855030 | node1 | ok: [node2] 2026-08-18 15:33:41.855121 | node1 | 2026-08-18 15:33:41.855291 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:33:41.855383 | node1 | Tuesday 18 August 2026 15:33:41 +0000 (0:00:01.238) 0:00:09.057 ******** 2026-08-18 15:33:42.301737 | node1 | ok: [node1] 2026-08-18 15:33:42.301803 | node1 | ok: [node2] 2026-08-18 15:33:42.302171 | node1 | ok: [node3] 2026-08-18 15:33:42.302433 | node1 | 2026-08-18 15:33:42.302440 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:33:42.302445 | node1 | Tuesday 18 August 2026 15:33:42 +0000 (0:00:00.446) 0:00:09.504 ******** 2026-08-18 15:33:43.204194 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:33:43.204360 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:33:43.204473 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:33:43.204570 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:33:43.204674 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:33:43.204765 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:33:43.204865 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:33:43.204955 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:33:43.205043 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:33:43.205138 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:33:43.205243 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:33:43.205337 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:33:43.205510 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:33:43.205597 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:33:43.205707 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:33:43.205794 | node1 | 2026-08-18 15:33:43.205897 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:33:43.205988 | node1 | Tuesday 18 August 2026 15:33:43 +0000 (0:00:00.902) 0:00:10.406 ******** 2026-08-18 15:33:43.769837 | node1 | ok: [node1] 2026-08-18 15:33:43.770026 | node1 | ok: [node2] 2026-08-18 15:33:43.770228 | node1 | ok: [node3] 2026-08-18 15:33:43.770446 | node1 | 2026-08-18 15:33:43.770657 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:33:43.770863 | node1 | Tuesday 18 August 2026 15:33:43 +0000 (0:00:00.544) 0:00:10.951 ******** 2026-08-18 15:33:43.771040 | node1 | 2026-08-18 15:33:43.771273 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:33:43.771550 | node1 | Tuesday 18 August 2026 15:33:43 +0000 (0:00:00.006) 0:00:10.958 ******** 2026-08-18 15:33:43.771802 | node1 | 2026-08-18 15:33:43.772087 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:33:43.772377 | node1 | Tuesday 18 August 2026 15:33:43 +0000 (0:00:00.006) 0:00:10.964 ******** 2026-08-18 15:33:43.772687 | node1 | 2026-08-18 15:33:43.772985 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:33:43.773281 | node1 | Tuesday 18 August 2026 15:33:43 +0000 (0:00:00.007) 0:00:10.972 ******** 2026-08-18 15:33:44.340209 | node1 | ok: [node2] 2026-08-18 15:33:44.340426 | node1 | ok: [node1] 2026-08-18 15:33:44.340671 | node1 | ok: [node3] 2026-08-18 15:33:44.340860 | node1 | 2026-08-18 15:33:44.341081 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:33:44.341287 | node1 | Tuesday 18 August 2026 15:33:44 +0000 (0:00:00.570) 0:00:11.542 ******** 2026-08-18 15:33:44.572628 | node1 | ok: [node1] 2026-08-18 15:33:44.572819 | node1 | ok: [node2] 2026-08-18 15:33:44.573028 | node1 | ok: [node3] 2026-08-18 15:33:44.573225 | node1 | 2026-08-18 15:33:44.573442 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:33:44.573677 | node1 | Tuesday 18 August 2026 15:33:44 +0000 (0:00:00.232) 0:00:11.774 ******** 2026-08-18 15:33:44.664846 | node1 | ok: [node1] => { 2026-08-18 15:33:44.665047 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:33:44.665257 | node1 | } 2026-08-18 15:33:44.665460 | node1 | ok: [node2] => { 2026-08-18 15:33:44.665786 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:33:44.665979 | node1 | } 2026-08-18 15:33:44.666175 | node1 | ok: [node3] => { 2026-08-18 15:33:44.666388 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:33:44.666575 | node1 | } 2026-08-18 15:33:44.666754 | node1 | 2026-08-18 15:33:44.666961 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:33:44.667158 | node1 | Tuesday 18 August 2026 15:33:44 +0000 (0:00:00.092) 0:00:11.867 ******** 2026-08-18 15:33:45.042929 | node1 | ok: [node1] 2026-08-18 15:33:45.043026 | node1 | ok: [node2] 2026-08-18 15:33:45.043156 | node1 | ok: [node3] 2026-08-18 15:33:45.043335 | node1 | 2026-08-18 15:33:45.043489 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:33:45.043626 | node1 | Tuesday 18 August 2026 15:33:45 +0000 (0:00:00.378) 0:00:12.245 ******** 2026-08-18 15:33:48.186568 | node1 | ok: [node2] 2026-08-18 15:33:48.186647 | node1 | ok: [node3] 2026-08-18 15:33:48.186725 | node1 | ok: [node1] 2026-08-18 15:33:48.186813 | node1 | 2026-08-18 15:33:48.186914 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:33:48.187007 | node1 | Tuesday 18 August 2026 15:33:48 +0000 (0:00:03.143) 0:00:15.389 ******** 2026-08-18 15:33:49.292574 | node1 | ok: [node3] 2026-08-18 15:33:49.292698 | node1 | ok: [node2] 2026-08-18 15:33:49.292836 | node1 | ok: [node1] 2026-08-18 15:33:49.292982 | node1 | 2026-08-18 15:33:49.293115 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:33:49.293243 | node1 | Tuesday 18 August 2026 15:33:49 +0000 (0:00:01.104) 0:00:16.494 ******** 2026-08-18 15:33:49.619663 | node1 | ok: [node2] 2026-08-18 15:33:49.619842 | node1 | ok: [node3] 2026-08-18 15:33:49.620038 | node1 | ok: [node1] 2026-08-18 15:33:49.620221 | node1 | 2026-08-18 15:33:49.620475 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:33:49.620694 | node1 | Tuesday 18 August 2026 15:33:49 +0000 (0:00:00.327) 0:00:16.822 ******** 2026-08-18 15:33:50.093660 | node1 | ok: [node1] 2026-08-18 15:33:50.093876 | node1 | ok: [node3] 2026-08-18 15:33:50.094094 | node1 | ok: [node2] 2026-08-18 15:33:50.094296 | node1 | 2026-08-18 15:33:50.094528 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:33:50.094750 | node1 | Tuesday 18 August 2026 15:33:50 +0000 (0:00:00.473) 0:00:17.295 ******** 2026-08-18 15:33:50.670729 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:33:50.670946 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:33:50.671168 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:33:50.671391 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:33:50.671602 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:33:50.671809 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:33:50.672018 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:33:50.672227 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:33:50.672478 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:33:50.672666 | node1 | 2026-08-18 15:33:50.672876 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:33:50.673090 | node1 | Tuesday 18 August 2026 15:33:50 +0000 (0:00:00.577) 0:00:17.873 ******** 2026-08-18 15:33:51.122093 | node1 | ok: [node1] 2026-08-18 15:33:51.122176 | node1 | ok: [node2] 2026-08-18 15:33:51.122243 | node1 | ok: [node3] 2026-08-18 15:33:51.122311 | node1 | 2026-08-18 15:33:51.122402 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:33:51.122493 | node1 | Tuesday 18 August 2026 15:33:51 +0000 (0:00:00.451) 0:00:18.324 ******** 2026-08-18 15:33:51.573971 | node1 | ok: [node1] 2026-08-18 15:33:51.574080 | node1 | ok: [node2] 2026-08-18 15:33:51.574246 | node1 | ok: [node3] 2026-08-18 15:33:51.574334 | node1 | 2026-08-18 15:33:51.574455 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:33:51.574609 | node1 | Tuesday 18 August 2026 15:33:51 +0000 (0:00:00.426) 0:00:18.750 ******** 2026-08-18 15:33:51.574690 | node1 | 2026-08-18 15:33:51.574819 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:33:51.575111 | node1 | Tuesday 18 August 2026 15:33:51 +0000 (0:00:00.006) 0:00:18.757 ******** 2026-08-18 15:33:51.575408 | node1 | 2026-08-18 15:33:51.575423 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:33:51.575468 | node1 | Tuesday 18 August 2026 15:33:51 +0000 (0:00:00.007) 0:00:18.764 ******** 2026-08-18 15:33:51.575579 | node1 | 2026-08-18 15:33:51.575713 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:33:51.575822 | node1 | Tuesday 18 August 2026 15:33:51 +0000 (0:00:00.010) 0:00:18.775 ******** 2026-08-18 15:33:51.992525 | node1 | ok: [node1] 2026-08-18 15:33:51.992721 | node1 | ok: [node2] 2026-08-18 15:33:51.992923 | node1 | ok: [node3] 2026-08-18 15:33:51.993119 | node1 | 2026-08-18 15:33:51.993341 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:33:51.993549 | node1 | Tuesday 18 August 2026 15:33:51 +0000 (0:00:00.418) 0:00:19.194 ******** 2026-08-18 15:33:52.047051 | node1 | ok: [node1] => { 2026-08-18 15:33:52.047253 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:33:52.047456 | node1 | } 2026-08-18 15:33:52.047668 | node1 | ok: [node2] => { 2026-08-18 15:33:52.047882 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:33:52.048079 | node1 | } 2026-08-18 15:33:52.048285 | node1 | ok: [node3] => { 2026-08-18 15:33:52.049253 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:33:52.049472 | node1 | } 2026-08-18 15:33:52.049670 | node1 | 2026-08-18 15:33:52.049893 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:33:52.050101 | node1 | Tuesday 18 August 2026 15:33:52 +0000 (0:00:00.054) 0:00:19.249 ******** 2026-08-18 15:33:52.349298 | node1 | ok: [node1] 2026-08-18 15:33:52.349496 | node1 | ok: [node2] 2026-08-18 15:33:52.349692 | node1 | ok: [node3] 2026-08-18 15:33:52.349868 | node1 | 2026-08-18 15:33:52.350076 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:33:52.350276 | node1 | Tuesday 18 August 2026 15:33:52 +0000 (0:00:00.302) 0:00:19.551 ******** 2026-08-18 15:33:52.410727 | node1 | skipping: [node1] 2026-08-18 15:33:52.410927 | node1 | skipping: [node2] 2026-08-18 15:33:52.411131 | node1 | skipping: [node3] 2026-08-18 15:33:52.411312 | node1 | 2026-08-18 15:33:52.411522 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:33:52.411725 | node1 | Tuesday 18 August 2026 15:33:52 +0000 (0:00:00.061) 0:00:19.613 ******** 2026-08-18 15:33:52.476145 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:33:52.476394 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:33:52.476614 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:33:52.476796 | node1 | 2026-08-18 15:33:52.477005 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:33:52.477234 | node1 | Tuesday 18 August 2026 15:33:52 +0000 (0:00:00.065) 0:00:19.678 ******** 2026-08-18 15:33:53.782057 | node1 | ok: [node1] 2026-08-18 15:33:53.782266 | node1 | ok: [node2] 2026-08-18 15:33:53.782470 | node1 | ok: [node3] 2026-08-18 15:33:53.782653 | node1 | 2026-08-18 15:33:53.782864 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:33:53.783068 | node1 | Tuesday 18 August 2026 15:33:53 +0000 (0:00:01.305) 0:00:20.984 ******** 2026-08-18 15:33:54.443803 | node1 | ok: [node1] => (item=chronyd) 2026-08-18 15:33:54.443925 | node1 | ok: [node2] => (item=chronyd) 2026-08-18 15:33:54.444059 | node1 | ok: [node3] => (item=chronyd) 2026-08-18 15:33:54.444190 | node1 | ok: [node1] => (item=sshd) 2026-08-18 15:33:54.444322 | node1 | ok: [node3] => (item=sshd) 2026-08-18 15:33:54.444514 | node1 | ok: [node2] => (item=sshd) 2026-08-18 15:33:54.444634 | node1 | 2026-08-18 15:33:54.444799 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:33:54.444913 | node1 | Tuesday 18 August 2026 15:33:54 +0000 (0:00:00.662) 0:00:21.646 ******** 2026-08-18 15:33:54.664387 | node1 | ok: [node1] 2026-08-18 15:33:54.664608 | node1 | ok: [node3] 2026-08-18 15:33:54.664813 | node1 | ok: [node2] 2026-08-18 15:33:54.664999 | node1 | 2026-08-18 15:33:54.666396 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:33:54.666460 | node1 | Tuesday 18 August 2026 15:33:54 +0000 (0:00:00.220) 0:00:21.866 ******** 2026-08-18 15:33:55.042821 | node1 | ok: [node3] 2026-08-18 15:33:55.042895 | node1 | ok: [node2] 2026-08-18 15:33:55.043029 | node1 | ok: [node1] 2026-08-18 15:33:55.043114 | node1 | 2026-08-18 15:33:55.043216 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:33:55.043320 | node1 | Tuesday 18 August 2026 15:33:55 +0000 (0:00:00.378) 0:00:22.245 ******** 2026-08-18 15:33:55.484483 | node1 | ok: [node1] 2026-08-18 15:33:55.484854 | node1 | ok: [node2] 2026-08-18 15:33:55.485234 | node1 | ok: [node3] 2026-08-18 15:33:55.485293 | node1 | 2026-08-18 15:33:55.485473 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:33:55.486565 | node1 | Tuesday 18 August 2026 15:33:55 +0000 (0:00:00.441) 0:00:22.686 ******** 2026-08-18 15:33:55.509704 | node1 | skipping: [node1] 2026-08-18 15:33:55.534844 | node1 | skipping: [node2] 2026-08-18 15:33:55.534919 | node1 | skipping: [node3] 2026-08-18 15:33:55.535001 | node1 | 2026-08-18 15:33:55.535099 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:33:55.535194 | node1 | Tuesday 18 August 2026 15:33:55 +0000 (0:00:00.051) 0:00:22.737 ******** 2026-08-18 15:33:56.135348 | node1 | ok: [node2] 2026-08-18 15:33:56.135506 | node1 | ok: [node3] 2026-08-18 15:33:56.135698 | node1 | ok: [node1] 2026-08-18 15:33:56.135881 | node1 | 2026-08-18 15:33:56.136106 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:33:56.136306 | node1 | Tuesday 18 August 2026 15:33:56 +0000 (0:00:00.600) 0:00:23.337 ******** 2026-08-18 15:33:56.604889 | node1 | ok: [node1] 2026-08-18 15:33:56.605085 | node1 | ok: [node2] 2026-08-18 15:33:56.605302 | node1 | ok: [node3] 2026-08-18 15:33:56.605486 | node1 | 2026-08-18 15:33:56.605726 | node1 | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] *** 2026-08-18 15:33:56.605935 | node1 | Tuesday 18 August 2026 15:33:56 +0000 (0:00:00.469) 0:00:23.807 ******** 2026-08-18 15:33:56.698935 | node1 | ok: [node1] 2026-08-18 15:33:56.699097 | node1 | ok: [node2] 2026-08-18 15:33:56.699298 | node1 | ok: [node3] 2026-08-18 15:33:56.699486 | node1 | 2026-08-18 15:33:56.699710 | node1 | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] *** 2026-08-18 15:33:56.699915 | node1 | Tuesday 18 August 2026 15:33:56 +0000 (0:00:00.094) 0:00:23.901 ******** 2026-08-18 15:33:56.760846 | node1 | ok: [node1] => { 2026-08-18 15:33:56.761035 | node1 | "changed": false, 2026-08-18 15:33:56.761237 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:56.761428 | node1 | } 2026-08-18 15:33:56.761627 | node1 | ok: [node2] => { 2026-08-18 15:33:56.761821 | node1 | "changed": false, 2026-08-18 15:33:56.762032 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:56.762201 | node1 | } 2026-08-18 15:33:56.762455 | node1 | ok: [node3] => { 2026-08-18 15:33:56.762647 | node1 | "changed": false, 2026-08-18 15:33:56.762846 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:56.763041 | node1 | } 2026-08-18 15:33:56.763255 | node1 | 2026-08-18 15:33:56.763468 | node1 | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] ******************* 2026-08-18 15:33:56.763672 | node1 | Tuesday 18 August 2026 15:33:56 +0000 (0:00:00.061) 0:00:23.963 ******** 2026-08-18 15:33:56.823103 | node1 | ok: [node1] 2026-08-18 15:33:56.823269 | node1 | ok: [node2] 2026-08-18 15:33:56.823461 | node1 | ok: [node3] 2026-08-18 15:33:56.823738 | node1 | 2026-08-18 15:33:56.823947 | node1 | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] *** 2026-08-18 15:33:56.824151 | node1 | Tuesday 18 August 2026 15:33:56 +0000 (0:00:00.062) 0:00:24.025 ******** 2026-08-18 15:33:57.395234 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:33:57.395406 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:33:57.395615 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:33:57.395789 | node1 | 2026-08-18 15:33:57.396020 | node1 | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] *** 2026-08-18 15:33:57.396251 | node1 | Tuesday 18 August 2026 15:33:57 +0000 (0:00:00.571) 0:00:24.597 ******** 2026-08-18 15:33:57.465947 | node1 | ok: [node1] 2026-08-18 15:33:57.466151 | node1 | ok: [node2] 2026-08-18 15:33:57.466345 | node1 | ok: [node3] 2026-08-18 15:33:57.466528 | node1 | 2026-08-18 15:33:57.466788 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 15:33:57.466943 | node1 | Tuesday 18 August 2026 15:33:57 +0000 (0:00:00.070) 0:00:24.668 ******** 2026-08-18 15:33:57.531799 | node1 | skipping: [node1] 2026-08-18 15:33:57.532012 | node1 | skipping: [node2] 2026-08-18 15:33:57.532215 | node1 | skipping: [node3] 2026-08-18 15:33:57.532432 | node1 | 2026-08-18 15:33:57.532645 | node1 | TASK [Register this monitor host] ********************************************** 2026-08-18 15:33:57.532848 | node1 | Tuesday 18 August 2026 15:33:57 +0000 (0:00:00.065) 0:00:24.734 ******** 2026-08-18 15:33:57.641269 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:33:57.641424 | node1 | 2026-08-18 15:33:57.641647 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:33:57.641976 | node1 | Tuesday 18 August 2026 15:33:57 +0000 (0:00:00.109) 0:00:24.843 ******** 2026-08-18 15:33:59.128212 | node1 | ok: [node1] 2026-08-18 15:33:59.128280 | node1 | 2026-08-18 15:33:59.128292 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:33:59.128302 | node1 | Tuesday 18 August 2026 15:33:59 +0000 (0:00:01.485) 0:00:26.329 ******** 2026-08-18 15:33:59.190845 | node1 | ok: [node1] 2026-08-18 15:33:59.191516 | node1 | ok: [node2] 2026-08-18 15:33:59.191568 | node1 | ok: [node3] 2026-08-18 15:33:59.191576 | node1 | 2026-08-18 15:33:59.191583 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:33:59.191602 | node1 | Tuesday 18 August 2026 15:33:59 +0000 (0:00:00.063) 0:00:26.393 ******** 2026-08-18 15:33:59.262148 | node1 | ok: [node1] => { 2026-08-18 15:33:59.262248 | node1 | "changed": false, 2026-08-18 15:33:59.263850 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:59.263872 | node1 | } 2026-08-18 15:33:59.263879 | node1 | ok: [node2] => { 2026-08-18 15:33:59.263885 | node1 | "changed": false, 2026-08-18 15:33:59.263890 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:59.263896 | node1 | } 2026-08-18 15:33:59.263901 | node1 | ok: [node3] => { 2026-08-18 15:33:59.263907 | node1 | "changed": false, 2026-08-18 15:33:59.263912 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:59.263917 | node1 | } 2026-08-18 15:33:59.263923 | node1 | 2026-08-18 15:33:59.263929 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:33:59.263935 | node1 | Tuesday 18 August 2026 15:33:59 +0000 (0:00:00.071) 0:00:26.464 ******** 2026-08-18 15:33:59.635466 | node1 | ok: [node1] 2026-08-18 15:33:59.635571 | node1 | ok: [node3] 2026-08-18 15:33:59.636091 | node1 | ok: [node2] 2026-08-18 15:33:59.636112 | node1 | 2026-08-18 15:33:59.636120 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:33:59.636126 | node1 | Tuesday 18 August 2026 15:33:59 +0000 (0:00:00.373) 0:00:26.838 ******** 2026-08-18 15:33:59.713787 | node1 | ok: [node1] 2026-08-18 15:33:59.713852 | node1 | ok: [node2] 2026-08-18 15:33:59.714384 | node1 | ok: [node3] 2026-08-18 15:33:59.714404 | node1 | 2026-08-18 15:33:59.714412 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:33:59.714419 | node1 | Tuesday 18 August 2026 15:33:59 +0000 (0:00:00.078) 0:00:26.916 ******** 2026-08-18 15:33:59.819378 | node1 | ok: [node1] 2026-08-18 15:33:59.819446 | node1 | ok: [node2] 2026-08-18 15:33:59.819979 | node1 | ok: [node3] 2026-08-18 15:33:59.820000 | node1 | 2026-08-18 15:33:59.820007 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:33:59.820014 | node1 | Tuesday 18 August 2026 15:33:59 +0000 (0:00:00.105) 0:00:27.021 ******** 2026-08-18 15:33:59.897646 | node1 | ok: [node1] => { 2026-08-18 15:33:59.897745 | node1 | "changed": false, 2026-08-18 15:33:59.899358 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:59.899383 | node1 | } 2026-08-18 15:33:59.899390 | node1 | ok: [node2] => { 2026-08-18 15:33:59.899396 | node1 | "changed": false, 2026-08-18 15:33:59.899402 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:59.899407 | node1 | } 2026-08-18 15:33:59.899413 | node1 | ok: [node3] => { 2026-08-18 15:33:59.899418 | node1 | "changed": false, 2026-08-18 15:33:59.899424 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:59.899429 | node1 | } 2026-08-18 15:33:59.899435 | node1 | 2026-08-18 15:33:59.899441 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:33:59.899447 | node1 | Tuesday 18 August 2026 15:33:59 +0000 (0:00:00.078) 0:00:27.100 ******** 2026-08-18 15:34:01.446953 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:34:01.447031 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:34:01.447443 | node1 | ok: [node1] 2026-08-18 15:34:01.447488 | node1 | 2026-08-18 15:34:01.447494 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:34:01.447499 | node1 | Tuesday 18 August 2026 15:34:01 +0000 (0:00:01.549) 0:00:28.649 ******** 2026-08-18 15:34:01.550687 | node1 | skipping: [node1] 2026-08-18 15:34:01.550767 | node1 | skipping: [node2] 2026-08-18 15:34:01.551142 | node1 | skipping: [node3] 2026-08-18 15:34:01.551189 | node1 | 2026-08-18 15:34:01.551194 | node1 | TASK [vexxhost.ceph.mon : Apply the monitor service spec] ********************** 2026-08-18 15:34:01.551199 | node1 | Tuesday 18 August 2026 15:34:01 +0000 (0:00:00.103) 0:00:28.753 ******** 2026-08-18 15:34:03.142096 | node1 | ok: [node1] 2026-08-18 15:34:03.142184 | node1 | 2026-08-18 15:34:03.142484 | node1 | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ******** 2026-08-18 15:34:03.142526 | node1 | Tuesday 18 August 2026 15:34:03 +0000 (0:00:01.591) 0:00:30.344 ******** 2026-08-18 15:34:04.718396 | node1 | ok: [node1] 2026-08-18 15:34:04.718494 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:34:04.718506 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:34:04.718523 | node1 | 2026-08-18 15:34:04.718540 | node1 | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] *********************** 2026-08-18 15:34:04.718634 | node1 | Tuesday 18 August 2026 15:34:04 +0000 (0:00:01.576) 0:00:31.920 ******** 2026-08-18 15:34:05.296829 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:34:05.296924 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:34:05.297068 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:34:05.297200 | node1 | 2026-08-18 15:34:05.297343 | node1 | TASK [vexxhost.ceph.mgr : Select the admin host] ******************************* 2026-08-18 15:34:05.297481 | node1 | Tuesday 18 August 2026 15:34:05 +0000 (0:00:00.578) 0:00:32.499 ******** 2026-08-18 15:34:05.376472 | node1 | ok: [node1] 2026-08-18 15:34:05.376671 | node1 | ok: [node2] 2026-08-18 15:34:05.376853 | node1 | ok: [node3] 2026-08-18 15:34:05.377036 | node1 | 2026-08-18 15:34:05.377239 | node1 | TASK [Register this manager host] ********************************************** 2026-08-18 15:34:05.377440 | node1 | Tuesday 18 August 2026 15:34:05 +0000 (0:00:00.079) 0:00:32.578 ******** 2026-08-18 15:34:05.500071 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:34:05.500266 | node1 | 2026-08-18 15:34:05.500532 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:34:05.500735 | node1 | Tuesday 18 August 2026 15:34:05 +0000 (0:00:00.123) 0:00:32.702 ******** 2026-08-18 15:34:06.933080 | node1 | ok: [node1] 2026-08-18 15:34:06.933292 | node1 | 2026-08-18 15:34:06.933535 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:34:06.933753 | node1 | Tuesday 18 August 2026 15:34:06 +0000 (0:00:01.432) 0:00:34.135 ******** 2026-08-18 15:34:07.004127 | node1 | ok: [node1] 2026-08-18 15:34:07.004300 | node1 | ok: [node2] 2026-08-18 15:34:07.004529 | node1 | ok: [node3] 2026-08-18 15:34:07.004710 | node1 | 2026-08-18 15:34:07.004920 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:34:07.005120 | node1 | Tuesday 18 August 2026 15:34:07 +0000 (0:00:00.071) 0:00:34.206 ******** 2026-08-18 15:34:07.073191 | node1 | ok: [node1] => { 2026-08-18 15:34:07.073363 | node1 | "changed": false, 2026-08-18 15:34:07.073563 | node1 | "msg": "All assertions passed" 2026-08-18 15:34:07.073754 | node1 | } 2026-08-18 15:34:07.073951 | node1 | ok: [node2] => { 2026-08-18 15:34:07.074143 | node1 | "changed": false, 2026-08-18 15:34:07.074341 | node1 | "msg": "All assertions passed" 2026-08-18 15:34:07.074528 | node1 | } 2026-08-18 15:34:07.074723 | node1 | ok: [node3] => { 2026-08-18 15:34:07.074940 | node1 | "changed": false, 2026-08-18 15:34:07.075142 | node1 | "msg": "All assertions passed" 2026-08-18 15:34:07.075327 | node1 | } 2026-08-18 15:34:07.075512 | node1 | 2026-08-18 15:34:07.075722 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:34:07.075922 | node1 | Tuesday 18 August 2026 15:34:07 +0000 (0:00:00.069) 0:00:34.276 ******** 2026-08-18 15:34:07.386504 | node1 | ok: [node1] 2026-08-18 15:34:07.386627 | node1 | ok: [node2] 2026-08-18 15:34:07.386763 | node1 | ok: [node3] 2026-08-18 15:34:07.386881 | node1 | 2026-08-18 15:34:07.387024 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:34:07.387158 | node1 | Tuesday 18 August 2026 15:34:07 +0000 (0:00:00.302) 0:00:34.578 ******** 2026-08-18 15:34:07.449789 | node1 | ok: [node1] 2026-08-18 15:34:07.449881 | node1 | ok: [node2] 2026-08-18 15:34:07.450024 | node1 | ok: [node3] 2026-08-18 15:34:07.450137 | node1 | 2026-08-18 15:34:07.450274 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:34:07.450414 | node1 | Tuesday 18 August 2026 15:34:07 +0000 (0:00:00.073) 0:00:34.652 ******** 2026-08-18 15:34:07.544792 | node1 | ok: [node1] 2026-08-18 15:34:07.545007 | node1 | ok: [node2] 2026-08-18 15:34:07.545307 | node1 | ok: [node3] 2026-08-18 15:34:07.545616 | node1 | 2026-08-18 15:34:07.545853 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:34:07.546062 | node1 | Tuesday 18 August 2026 15:34:07 +0000 (0:00:00.095) 0:00:34.747 ******** 2026-08-18 15:34:07.611735 | node1 | ok: [node1] => { 2026-08-18 15:34:07.611862 | node1 | "changed": false, 2026-08-18 15:34:07.612053 | node1 | "msg": "All assertions passed" 2026-08-18 15:34:07.612276 | node1 | } 2026-08-18 15:34:07.612526 | node1 | ok: [node2] => { 2026-08-18 15:34:07.612713 | node1 | "changed": false, 2026-08-18 15:34:07.612919 | node1 | "msg": "All assertions passed" 2026-08-18 15:34:07.613103 | node1 | } 2026-08-18 15:34:07.613322 | node1 | ok: [node3] => { 2026-08-18 15:34:07.613579 | node1 | "changed": false, 2026-08-18 15:34:07.613826 | node1 | "msg": "All assertions passed" 2026-08-18 15:34:07.614015 | node1 | } 2026-08-18 15:34:07.614151 | node1 | 2026-08-18 15:34:07.614382 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:34:07.614599 | node1 | Tuesday 18 August 2026 15:34:07 +0000 (0:00:00.066) 0:00:34.814 ******** 2026-08-18 15:34:09.198568 | node1 | ok: [node1] 2026-08-18 15:34:09.198650 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:34:09.198801 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:34:09.198913 | node1 | 2026-08-18 15:34:09.199049 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:34:09.199178 | node1 | Tuesday 18 August 2026 15:34:09 +0000 (0:00:01.586) 0:00:36.401 ******** 2026-08-18 15:34:09.305998 | node1 | skipping: [node1] 2026-08-18 15:34:09.306160 | node1 | skipping: [node2] 2026-08-18 15:34:09.306361 | node1 | skipping: [node3] 2026-08-18 15:34:09.306534 | node1 | 2026-08-18 15:34:09.306739 | node1 | TASK [vexxhost.ceph.mgr : Apply the manager service spec] ********************** 2026-08-18 15:34:09.306939 | node1 | Tuesday 18 August 2026 15:34:09 +0000 (0:00:00.107) 0:00:36.508 ******** 2026-08-18 15:34:10.801861 | node1 | ok: [node1] 2026-08-18 15:34:10.801971 | node1 | 2026-08-18 15:34:10.802123 | node1 | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ******** 2026-08-18 15:34:10.802248 | node1 | Tuesday 18 August 2026 15:34:10 +0000 (0:00:01.496) 0:00:38.004 ******** 2026-08-18 15:34:12.289593 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:34:12.289668 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:34:12.289679 | node1 | ok: [node1] 2026-08-18 15:34:12.289689 | node1 | 2026-08-18 15:34:12.289699 | node1 | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] ************************** 2026-08-18 15:34:12.289709 | node1 | Tuesday 18 August 2026 15:34:12 +0000 (0:00:01.486) 0:00:39.490 ******** 2026-08-18 15:34:22.391009 | node1 | ok: [node1] => (item={'name': 'diskprediction_local'}) 2026-08-18 15:34:22.391069 | node1 | ok: [node1] => (item={'name': 'dashboard'}) 2026-08-18 15:34:22.391171 | node1 | ok: [node1] => (item={'name': 'iostat'}) 2026-08-18 15:34:22.391783 | node1 | ok: [node1] => (item={'name': 'prometheus'}) 2026-08-18 15:34:22.391799 | node1 | ok: [node1] => (item={'name': 'rgw'}) 2026-08-18 15:34:22.391804 | node1 | 2026-08-18 15:34:22.391808 | node1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-18 15:34:22.391813 | node1 | 2026-08-18 15:34:22.391817 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:34:22.391821 | node1 | Tuesday 18 August 2026 15:34:22 +0000 (0:00:10.103) 0:00:49.594 ******** 2026-08-18 15:34:23.310966 | node1 | ok: [node1] 2026-08-18 15:34:23.311058 | node1 | ok: [node2] 2026-08-18 15:34:23.311070 | node1 | ok: [node3] 2026-08-18 15:34:23.311377 | node1 | 2026-08-18 15:34:23.311427 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:34:23.311432 | node1 | Tuesday 18 August 2026 15:34:23 +0000 (0:00:00.919) 0:00:50.513 ******** 2026-08-18 15:34:23.555954 | node1 | ok: [node1] 2026-08-18 15:34:23.556021 | node1 | ok: [node2] 2026-08-18 15:34:23.556393 | node1 | ok: [node3] 2026-08-18 15:34:23.556441 | node1 | 2026-08-18 15:34:23.556447 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:34:23.556462 | node1 | Tuesday 18 August 2026 15:34:23 +0000 (0:00:00.245) 0:00:50.758 ******** 2026-08-18 15:34:23.584233 | node1 | skipping: [node1] 2026-08-18 15:34:23.627532 | node1 | skipping: [node2] 2026-08-18 15:34:23.627598 | node1 | skipping: [node3] 2026-08-18 15:34:23.627910 | node1 | 2026-08-18 15:34:23.627957 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:34:23.627963 | node1 | Tuesday 18 August 2026 15:34:23 +0000 (0:00:00.071) 0:00:50.830 ******** 2026-08-18 15:34:23.860332 | node1 | ok: [node1] 2026-08-18 15:34:23.860409 | node1 | ok: [node2] 2026-08-18 15:34:23.860529 | node1 | ok: [node3] 2026-08-18 15:34:23.860573 | node1 | 2026-08-18 15:34:23.860799 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:34:23.860843 | node1 | Tuesday 18 August 2026 15:34:23 +0000 (0:00:00.232) 0:00:51.063 ******** 2026-08-18 15:34:23.962078 | node1 | ok: [node1] => { 2026-08-18 15:34:23.963435 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:34:23.963457 | node1 | } 2026-08-18 15:34:23.963464 | node1 | ok: [node2] => { 2026-08-18 15:34:23.963470 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:34:23.963476 | node1 | } 2026-08-18 15:34:23.963481 | node1 | ok: [node3] => { 2026-08-18 15:34:23.963487 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:34:23.963492 | node1 | } 2026-08-18 15:34:23.963498 | node1 | 2026-08-18 15:34:23.963504 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:34:23.963510 | node1 | Tuesday 18 August 2026 15:34:23 +0000 (0:00:00.101) 0:00:51.164 ******** 2026-08-18 15:34:24.326028 | node1 | ok: [node1] 2026-08-18 15:34:24.326104 | node1 | ok: [node3] 2026-08-18 15:34:24.326481 | node1 | ok: [node2] 2026-08-18 15:34:24.326524 | node1 | 2026-08-18 15:34:24.326530 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:34:24.326535 | node1 | Tuesday 18 August 2026 15:34:24 +0000 (0:00:00.364) 0:00:51.528 ******** 2026-08-18 15:34:24.352055 | node1 | skipping: [node1] 2026-08-18 15:34:24.411072 | node1 | skipping: [node2] 2026-08-18 15:34:24.411153 | node1 | skipping: [node3] 2026-08-18 15:34:24.411469 | node1 | 2026-08-18 15:34:24.411517 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:34:24.411523 | node1 | Tuesday 18 August 2026 15:34:24 +0000 (0:00:00.084) 0:00:51.613 ******** 2026-08-18 15:34:24.497926 | node1 | skipping: [node1] 2026-08-18 15:34:24.498425 | node1 | skipping: [node2] 2026-08-18 15:34:24.498439 | node1 | skipping: [node3] 2026-08-18 15:34:24.498449 | node1 | 2026-08-18 15:34:24.498458 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:34:24.498468 | node1 | Tuesday 18 August 2026 15:34:24 +0000 (0:00:00.086) 0:00:51.700 ******** 2026-08-18 15:34:24.730959 | node1 | ok: [node1] 2026-08-18 15:34:24.731032 | node1 | ok: [node2] 2026-08-18 15:34:24.731407 | node1 | ok: [node3] 2026-08-18 15:34:24.731451 | node1 | 2026-08-18 15:34:24.731457 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:34:24.731462 | node1 | Tuesday 18 August 2026 15:34:24 +0000 (0:00:00.232) 0:00:51.933 ******** 2026-08-18 15:34:25.735064 | node1 | ok: [node1] 2026-08-18 15:34:25.735141 | node1 | ok: [node2] 2026-08-18 15:34:25.735544 | node1 | ok: [node3] 2026-08-18 15:34:25.735591 | node1 | 2026-08-18 15:34:25.735598 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:34:25.735603 | node1 | Tuesday 18 August 2026 15:34:25 +0000 (0:00:01.004) 0:00:52.937 ******** 2026-08-18 15:34:25.831170 | node1 | ok: [node1] => { 2026-08-18 15:34:25.831233 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:34:25.832117 | node1 | } 2026-08-18 15:34:25.832156 | node1 | ok: [node2] => { 2026-08-18 15:34:25.832161 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:34:25.832166 | node1 | } 2026-08-18 15:34:25.832170 | node1 | ok: [node3] => { 2026-08-18 15:34:25.832174 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:34:25.832188 | node1 | } 2026-08-18 15:34:25.832192 | node1 | 2026-08-18 15:34:25.832196 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:34:25.832200 | node1 | Tuesday 18 August 2026 15:34:25 +0000 (0:00:00.096) 0:00:53.034 ******** 2026-08-18 15:34:26.188464 | node1 | ok: [node1] 2026-08-18 15:34:26.188528 | node1 | ok: [node2] 2026-08-18 15:34:26.188940 | node1 | ok: [node3] 2026-08-18 15:34:26.188983 | node1 | 2026-08-18 15:34:26.188988 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:34:26.188994 | node1 | Tuesday 18 August 2026 15:34:26 +0000 (0:00:00.356) 0:00:53.391 ******** 2026-08-18 15:34:28.133886 | node1 | ok: [node1] 2026-08-18 15:34:28.133950 | node1 | ok: [node3] 2026-08-18 15:34:28.134008 | node1 | ok: [node2] 2026-08-18 15:34:28.134310 | node1 | 2026-08-18 15:34:28.134355 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:34:28.134361 | node1 | Tuesday 18 August 2026 15:34:28 +0000 (0:00:01.945) 0:00:55.336 ******** 2026-08-18 15:34:28.162584 | node1 | skipping: [node1] 2026-08-18 15:34:28.187878 | node1 | skipping: [node2] 2026-08-18 15:34:28.187954 | node1 | skipping: [node3] 2026-08-18 15:34:28.188045 | node1 | 2026-08-18 15:34:28.188158 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:34:28.188251 | node1 | Tuesday 18 August 2026 15:34:28 +0000 (0:00:00.054) 0:00:55.391 ******** 2026-08-18 15:34:28.232015 | node1 | skipping: [node1] 2026-08-18 15:34:28.232160 | node1 | skipping: [node2] 2026-08-18 15:34:28.232344 | node1 | skipping: [node3] 2026-08-18 15:34:28.232601 | node1 | 2026-08-18 15:34:28.232831 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:34:28.233037 | node1 | Tuesday 18 August 2026 15:34:28 +0000 (0:00:00.043) 0:00:55.434 ******** 2026-08-18 15:34:28.254557 | node1 | skipping: [node1] 2026-08-18 15:34:28.274802 | node1 | skipping: [node2] 2026-08-18 15:34:28.275011 | node1 | skipping: [node3] 2026-08-18 15:34:28.275198 | node1 | 2026-08-18 15:34:28.275419 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:34:28.275614 | node1 | Tuesday 18 August 2026 15:34:28 +0000 (0:00:00.042) 0:00:55.476 ******** 2026-08-18 15:34:29.338628 | node1 | ok: [node2] 2026-08-18 15:34:29.338818 | node1 | ok: [node1] 2026-08-18 15:34:29.339018 | node1 | ok: [node3] 2026-08-18 15:34:29.339208 | node1 | 2026-08-18 15:34:29.339489 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:34:29.339700 | node1 | Tuesday 18 August 2026 15:34:29 +0000 (0:00:01.064) 0:00:56.541 ******** 2026-08-18 15:34:29.787550 | node1 | ok: [node1] 2026-08-18 15:34:29.787623 | node1 | ok: [node2] 2026-08-18 15:34:29.787696 | node1 | ok: [node3] 2026-08-18 15:34:29.787784 | node1 | 2026-08-18 15:34:29.787886 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:34:29.787983 | node1 | Tuesday 18 August 2026 15:34:29 +0000 (0:00:00.449) 0:00:56.990 ******** 2026-08-18 15:34:30.696227 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:34:30.696328 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:34:30.696335 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:34:30.696342 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:34:30.696349 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:34:30.696356 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:34:30.696362 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:34:30.696460 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:34:30.698422 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:34:30.698498 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:34:30.698511 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:34:30.698520 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:34:30.698547 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:34:30.698578 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:34:30.698588 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:34:30.698597 | node1 | 2026-08-18 15:34:30.698607 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:34:30.698617 | node1 | Tuesday 18 August 2026 15:34:30 +0000 (0:00:00.907) 0:00:57.897 ******** 2026-08-18 15:34:31.242497 | node1 | ok: [node1] 2026-08-18 15:34:31.242539 | node1 | ok: [node2] 2026-08-18 15:34:31.242544 | node1 | ok: [node3] 2026-08-18 15:34:31.242548 | node1 | 2026-08-18 15:34:31.242553 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:34:31.242557 | node1 | Tuesday 18 August 2026 15:34:31 +0000 (0:00:00.528) 0:00:58.426 ******** 2026-08-18 15:34:31.242561 | node1 | 2026-08-18 15:34:31.242565 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:34:31.242569 | node1 | Tuesday 18 August 2026 15:34:31 +0000 (0:00:00.005) 0:00:58.431 ******** 2026-08-18 15:34:31.242573 | node1 | 2026-08-18 15:34:31.242577 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:34:31.242581 | node1 | Tuesday 18 August 2026 15:34:31 +0000 (0:00:00.004) 0:00:58.436 ******** 2026-08-18 15:34:31.242585 | node1 | 2026-08-18 15:34:31.242589 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:34:31.242729 | node1 | Tuesday 18 August 2026 15:34:31 +0000 (0:00:00.007) 0:00:58.444 ******** 2026-08-18 15:34:31.622417 | node1 | ok: [node1] 2026-08-18 15:34:31.622476 | node1 | ok: [node2] 2026-08-18 15:34:31.622487 | node1 | ok: [node3] 2026-08-18 15:34:31.622497 | node1 | 2026-08-18 15:34:31.622507 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:34:31.622517 | node1 | Tuesday 18 August 2026 15:34:31 +0000 (0:00:00.379) 0:00:58.823 ******** 2026-08-18 15:34:31.854971 | node1 | ok: [node1] 2026-08-18 15:34:31.855086 | node1 | ok: [node2] 2026-08-18 15:34:31.855098 | node1 | ok: [node3] 2026-08-18 15:34:31.855109 | node1 | 2026-08-18 15:34:31.855120 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:34:31.855131 | node1 | Tuesday 18 August 2026 15:34:31 +0000 (0:00:00.232) 0:00:59.056 ******** 2026-08-18 15:34:31.952488 | node1 | ok: [node2] => { 2026-08-18 15:34:31.952570 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:34:31.952589 | node1 | } 2026-08-18 15:34:31.952789 | node1 | ok: [node1] => { 2026-08-18 15:34:31.953018 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:34:31.953241 | node1 | } 2026-08-18 15:34:31.953456 | node1 | ok: [node3] => { 2026-08-18 15:34:31.953752 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:34:31.953955 | node1 | } 2026-08-18 15:34:31.954150 | node1 | 2026-08-18 15:34:31.954394 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:34:31.954593 | node1 | Tuesday 18 August 2026 15:34:31 +0000 (0:00:00.098) 0:00:59.154 ******** 2026-08-18 15:34:32.332966 | node1 | ok: [node2] 2026-08-18 15:34:32.333149 | node1 | ok: [node1] 2026-08-18 15:34:32.333344 | node1 | ok: [node3] 2026-08-18 15:34:32.333525 | node1 | 2026-08-18 15:34:32.333734 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:34:32.333934 | node1 | Tuesday 18 August 2026 15:34:32 +0000 (0:00:00.380) 0:00:59.535 ******** 2026-08-18 15:34:35.419545 | node1 | ok: [node2] 2026-08-18 15:34:35.419692 | node1 | ok: [node3] 2026-08-18 15:34:35.419888 | node1 | ok: [node1] 2026-08-18 15:34:35.420067 | node1 | 2026-08-18 15:34:35.420281 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:34:35.420510 | node1 | Tuesday 18 August 2026 15:34:35 +0000 (0:00:03.086) 0:01:02.621 ******** 2026-08-18 15:34:36.531465 | node1 | ok: [node2] 2026-08-18 15:34:36.531564 | node1 | ok: [node3] 2026-08-18 15:34:36.531576 | node1 | ok: [node1] 2026-08-18 15:34:36.531586 | node1 | 2026-08-18 15:34:36.531596 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:34:36.531606 | node1 | Tuesday 18 August 2026 15:34:36 +0000 (0:00:01.110) 0:01:03.732 ******** 2026-08-18 15:34:36.744577 | node1 | ok: [node1] 2026-08-18 15:34:36.745058 | node1 | ok: [node2] 2026-08-18 15:34:36.745073 | node1 | ok: [node3] 2026-08-18 15:34:36.745085 | node1 | 2026-08-18 15:34:36.745096 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:34:36.745108 | node1 | Tuesday 18 August 2026 15:34:36 +0000 (0:00:00.214) 0:01:03.946 ******** 2026-08-18 15:34:37.186971 | node1 | ok: [node1] 2026-08-18 15:34:37.187013 | node1 | ok: [node2] 2026-08-18 15:34:37.187018 | node1 | ok: [node3] 2026-08-18 15:34:37.187022 | node1 | 2026-08-18 15:34:37.187027 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:34:37.187032 | node1 | Tuesday 18 August 2026 15:34:37 +0000 (0:00:00.441) 0:01:04.388 ******** 2026-08-18 15:34:37.755179 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:34:37.755389 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:34:37.755411 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:34:37.755424 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:34:37.755437 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:34:37.755454 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:34:37.756048 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:34:37.756105 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:34:37.756110 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:34:37.756115 | node1 | 2026-08-18 15:34:37.756120 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:34:37.756170 | node1 | Tuesday 18 August 2026 15:34:37 +0000 (0:00:00.568) 0:01:04.957 ******** 2026-08-18 15:34:38.198445 | node1 | ok: [node3] 2026-08-18 15:34:38.198505 | node1 | ok: [node1] 2026-08-18 15:34:38.198517 | node1 | ok: [node2] 2026-08-18 15:34:38.198526 | node1 | 2026-08-18 15:34:38.198536 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:34:38.198545 | node1 | Tuesday 18 August 2026 15:34:38 +0000 (0:00:00.442) 0:01:05.399 ******** 2026-08-18 15:34:38.653229 | node1 | ok: [node1] 2026-08-18 15:34:38.653286 | node1 | ok: [node2] 2026-08-18 15:34:38.653296 | node1 | ok: [node3] 2026-08-18 15:34:38.653309 | node1 | 2026-08-18 15:34:38.653497 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:34:38.653712 | node1 | Tuesday 18 August 2026 15:34:38 +0000 (0:00:00.438) 0:01:05.838 ******** 2026-08-18 15:34:38.653915 | node1 | 2026-08-18 15:34:38.654128 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:34:38.654348 | node1 | Tuesday 18 August 2026 15:34:38 +0000 (0:00:00.005) 0:01:05.844 ******** 2026-08-18 15:34:38.654581 | node1 | 2026-08-18 15:34:38.654800 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:34:38.655012 | node1 | Tuesday 18 August 2026 15:34:38 +0000 (0:00:00.005) 0:01:05.849 ******** 2026-08-18 15:34:38.655203 | node1 | 2026-08-18 15:34:38.655420 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:34:38.655634 | node1 | Tuesday 18 August 2026 15:34:38 +0000 (0:00:00.005) 0:01:05.855 ******** 2026-08-18 15:34:39.058037 | node1 | ok: [node2] 2026-08-18 15:34:39.058219 | node1 | ok: [node1] 2026-08-18 15:34:39.058415 | node1 | ok: [node3] 2026-08-18 15:34:39.058600 | node1 | 2026-08-18 15:34:39.058809 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:34:39.059011 | node1 | Tuesday 18 August 2026 15:34:39 +0000 (0:00:00.405) 0:01:06.260 ******** 2026-08-18 15:34:39.110719 | node1 | ok: [node1] => { 2026-08-18 15:34:39.110889 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:34:39.111080 | node1 | } 2026-08-18 15:34:39.111277 | node1 | ok: [node2] => { 2026-08-18 15:34:39.111480 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:34:39.111672 | node1 | } 2026-08-18 15:34:39.111929 | node1 | ok: [node3] => { 2026-08-18 15:34:39.112134 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:34:39.112322 | node1 | } 2026-08-18 15:34:39.112555 | node1 | 2026-08-18 15:34:39.112759 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:34:39.112957 | node1 | Tuesday 18 August 2026 15:34:39 +0000 (0:00:00.052) 0:01:06.313 ******** 2026-08-18 15:34:39.419525 | node1 | ok: [node1] 2026-08-18 15:34:39.419812 | node1 | ok: [node2] 2026-08-18 15:34:39.420077 | node1 | ok: [node3] 2026-08-18 15:34:39.420314 | node1 | 2026-08-18 15:34:39.420652 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:34:39.420946 | node1 | Tuesday 18 August 2026 15:34:39 +0000 (0:00:00.307) 0:01:06.621 ******** 2026-08-18 15:34:39.514486 | node1 | skipping: [node1] 2026-08-18 15:34:39.514653 | node1 | skipping: [node2] 2026-08-18 15:34:39.514872 | node1 | skipping: [node3] 2026-08-18 15:34:39.515042 | node1 | 2026-08-18 15:34:39.515257 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:34:39.515493 | node1 | Tuesday 18 August 2026 15:34:39 +0000 (0:00:00.092) 0:01:06.713 ******** 2026-08-18 15:34:39.551392 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:34:39.596640 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:34:39.596848 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:34:39.597239 | node1 | 2026-08-18 15:34:39.597492 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:34:39.597708 | node1 | Tuesday 18 August 2026 15:34:39 +0000 (0:00:00.085) 0:01:06.799 ******** 2026-08-18 15:34:40.674171 | node1 | ok: [node1] 2026-08-18 15:34:40.674363 | node1 | ok: [node2] 2026-08-18 15:34:40.674575 | node1 | ok: [node3] 2026-08-18 15:34:40.674767 | node1 | 2026-08-18 15:34:40.674981 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:34:40.675188 | node1 | Tuesday 18 August 2026 15:34:40 +0000 (0:00:01.077) 0:01:07.876 ******** 2026-08-18 15:34:41.324041 | node1 | ok: [node2] => (item=chronyd) 2026-08-18 15:34:41.324408 | node1 | ok: [node1] => (item=chronyd) 2026-08-18 15:34:41.324426 | node1 | ok: [node3] => (item=chronyd) 2026-08-18 15:34:41.324713 | node1 | ok: [node2] => (item=sshd) 2026-08-18 15:34:41.324857 | node1 | ok: [node1] => (item=sshd) 2026-08-18 15:34:41.325053 | node1 | ok: [node3] => (item=sshd) 2026-08-18 15:34:41.325239 | node1 | 2026-08-18 15:34:41.325496 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:34:41.325695 | node1 | Tuesday 18 August 2026 15:34:41 +0000 (0:00:00.650) 0:01:08.526 ******** 2026-08-18 15:34:41.531618 | node1 | ok: [node1] 2026-08-18 15:34:41.531789 | node1 | ok: [node2] 2026-08-18 15:34:41.531989 | node1 | ok: [node3] 2026-08-18 15:34:41.532173 | node1 | 2026-08-18 15:34:41.532409 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:34:41.532624 | node1 | Tuesday 18 August 2026 15:34:41 +0000 (0:00:00.207) 0:01:08.733 ******** 2026-08-18 15:34:41.786780 | node1 | ok: [node2] 2026-08-18 15:34:41.786968 | node1 | ok: [node1] 2026-08-18 15:34:41.787168 | node1 | ok: [node3] 2026-08-18 15:34:41.787352 | node1 | 2026-08-18 15:34:41.787626 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:34:41.787843 | node1 | Tuesday 18 August 2026 15:34:41 +0000 (0:00:00.255) 0:01:08.988 ******** 2026-08-18 15:34:42.217664 | node1 | ok: [node1] 2026-08-18 15:34:42.217846 | node1 | ok: [node3] 2026-08-18 15:34:42.218046 | node1 | ok: [node2] 2026-08-18 15:34:42.218256 | node1 | 2026-08-18 15:34:42.218477 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:34:42.218684 | node1 | Tuesday 18 August 2026 15:34:42 +0000 (0:00:00.430) 0:01:09.419 ******** 2026-08-18 15:34:42.246938 | node1 | skipping: [node1] 2026-08-18 15:34:42.275198 | node1 | skipping: [node2] 2026-08-18 15:34:42.275397 | node1 | skipping: [node3] 2026-08-18 15:34:42.275765 | node1 | 2026-08-18 15:34:42.275969 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:34:42.276165 | node1 | Tuesday 18 August 2026 15:34:42 +0000 (0:00:00.058) 0:01:09.478 ******** 2026-08-18 15:34:42.657624 | node1 | ok: [node2] 2026-08-18 15:34:42.657801 | node1 | ok: [node1] 2026-08-18 15:34:42.658014 | node1 | ok: [node3] 2026-08-18 15:34:42.658204 | node1 | 2026-08-18 15:34:42.658430 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:34:42.658632 | node1 | Tuesday 18 August 2026 15:34:42 +0000 (0:00:00.381) 0:01:09.859 ******** 2026-08-18 15:34:43.109655 | node1 | ok: [node1] 2026-08-18 15:34:43.109723 | node1 | ok: [node3] 2026-08-18 15:34:43.110123 | node1 | ok: [node2] 2026-08-18 15:34:43.110170 | node1 | 2026-08-18 15:34:43.110176 | node1 | TASK [vexxhost.ceph.osd : Locate the cluster admin host] *********************** 2026-08-18 15:34:43.110181 | node1 | Tuesday 18 August 2026 15:34:43 +0000 (0:00:00.452) 0:01:10.312 ******** 2026-08-18 15:34:43.724495 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:34:43.724567 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:34:43.724588 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:34:43.724910 | node1 | 2026-08-18 15:34:43.724961 | node1 | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] ******* 2026-08-18 15:34:43.724967 | node1 | Tuesday 18 August 2026 15:34:43 +0000 (0:00:00.615) 0:01:10.927 ******** 2026-08-18 15:34:43.809883 | node1 | ok: [node1] 2026-08-18 15:34:43.809961 | node1 | ok: [node2] 2026-08-18 15:34:43.810017 | node1 | ok: [node3] 2026-08-18 15:34:43.810296 | node1 | 2026-08-18 15:34:43.810336 | node1 | TASK [vexxhost.ceph.osd : Set the admin mon config path] *********************** 2026-08-18 15:34:43.810342 | node1 | Tuesday 18 August 2026 15:34:43 +0000 (0:00:00.085) 0:01:11.012 ******** 2026-08-18 15:34:43.888415 | node1 | ok: [node1] 2026-08-18 15:34:43.888482 | node1 | ok: [node2] 2026-08-18 15:34:43.888576 | node1 | ok: [node3] 2026-08-18 15:34:43.888897 | node1 | 2026-08-18 15:34:43.888914 | node1 | TASK [Register this OSD host] ************************************************** 2026-08-18 15:34:43.888919 | node1 | Tuesday 18 August 2026 15:34:43 +0000 (0:00:00.078) 0:01:11.091 ******** 2026-08-18 15:34:44.032536 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:34:44.032601 | node1 | 2026-08-18 15:34:44.032690 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:34:44.032793 | node1 | Tuesday 18 August 2026 15:34:44 +0000 (0:00:00.144) 0:01:11.235 ******** 2026-08-18 15:34:45.478491 | node1 | ok: [node1] 2026-08-18 15:34:45.478570 | node1 | 2026-08-18 15:34:45.478584 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:34:45.478691 | node1 | Tuesday 18 August 2026 15:34:45 +0000 (0:00:01.444) 0:01:12.680 ******** 2026-08-18 15:34:45.545626 | node1 | ok: [node1] 2026-08-18 15:34:45.545800 | node1 | ok: [node2] 2026-08-18 15:34:45.545999 | node1 | ok: [node3] 2026-08-18 15:34:45.546177 | node1 | 2026-08-18 15:34:45.546381 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:34:45.546580 | node1 | Tuesday 18 August 2026 15:34:45 +0000 (0:00:00.067) 0:01:12.747 ******** 2026-08-18 15:34:45.605798 | node1 | ok: [node1] => { 2026-08-18 15:34:45.606023 | node1 | "changed": false, 2026-08-18 15:34:45.606202 | node1 | "msg": "All assertions passed" 2026-08-18 15:34:45.606390 | node1 | } 2026-08-18 15:34:45.606587 | node1 | ok: [node2] => { 2026-08-18 15:34:45.606780 | node1 | "changed": false, 2026-08-18 15:34:45.606977 | node1 | "msg": "All assertions passed" 2026-08-18 15:34:45.607155 | node1 | } 2026-08-18 15:34:45.607346 | node1 | ok: [node3] => { 2026-08-18 15:34:45.607537 | node1 | "changed": false, 2026-08-18 15:34:45.607730 | node1 | "msg": "All assertions passed" 2026-08-18 15:34:45.607990 | node1 | } 2026-08-18 15:34:45.608173 | node1 | 2026-08-18 15:34:45.608427 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:34:45.608628 | node1 | Tuesday 18 August 2026 15:34:45 +0000 (0:00:00.060) 0:01:12.808 ******** 2026-08-18 15:34:45.890030 | node1 | ok: [node1] 2026-08-18 15:34:45.890214 | node1 | ok: [node2] 2026-08-18 15:34:45.890404 | node1 | ok: [node3] 2026-08-18 15:34:45.890586 | node1 | 2026-08-18 15:34:45.890800 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:34:45.891001 | node1 | Tuesday 18 August 2026 15:34:45 +0000 (0:00:00.284) 0:01:13.092 ******** 2026-08-18 15:34:45.949917 | node1 | ok: [node1] 2026-08-18 15:34:45.949997 | node1 | ok: [node2] 2026-08-18 15:34:45.950167 | node1 | ok: [node3] 2026-08-18 15:34:45.950237 | node1 | 2026-08-18 15:34:45.950430 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:34:45.950497 | node1 | Tuesday 18 August 2026 15:34:45 +0000 (0:00:00.059) 0:01:13.152 ******** 2026-08-18 15:34:46.053814 | node1 | ok: [node1] 2026-08-18 15:34:46.054042 | node1 | ok: [node2] 2026-08-18 15:34:46.054288 | node1 | ok: [node3] 2026-08-18 15:34:46.054471 | node1 | 2026-08-18 15:34:46.054713 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:34:46.054916 | node1 | Tuesday 18 August 2026 15:34:46 +0000 (0:00:00.103) 0:01:13.256 ******** 2026-08-18 15:34:46.111102 | node1 | ok: [node1] => { 2026-08-18 15:34:46.111281 | node1 | "changed": false, 2026-08-18 15:34:46.111480 | node1 | "msg": "All assertions passed" 2026-08-18 15:34:46.111668 | node1 | } 2026-08-18 15:34:46.111864 | node1 | ok: [node2] => { 2026-08-18 15:34:46.112053 | node1 | "changed": false, 2026-08-18 15:34:46.112245 | node1 | "msg": "All assertions passed" 2026-08-18 15:34:46.112470 | node1 | } 2026-08-18 15:34:46.112665 | node1 | ok: [node3] => { 2026-08-18 15:34:46.112855 | node1 | "changed": false, 2026-08-18 15:34:46.113045 | node1 | "msg": "All assertions passed" 2026-08-18 15:34:46.113231 | node1 | } 2026-08-18 15:34:46.113407 | node1 | 2026-08-18 15:34:46.113617 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:34:46.113814 | node1 | Tuesday 18 August 2026 15:34:46 +0000 (0:00:00.057) 0:01:13.313 ******** 2026-08-18 15:34:47.596033 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:34:47.596132 | node1 | ok: [node1] 2026-08-18 15:34:47.596223 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:34:47.596317 | node1 | 2026-08-18 15:34:47.596409 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:34:47.596511 | node1 | Tuesday 18 August 2026 15:34:47 +0000 (0:00:01.485) 0:01:14.798 ******** 2026-08-18 15:34:47.671983 | node1 | skipping: [node1] 2026-08-18 15:34:47.672027 | node1 | skipping: [node2] 2026-08-18 15:34:47.672130 | node1 | skipping: [node3] 2026-08-18 15:34:47.672230 | node1 | 2026-08-18 15:34:47.672329 | node1 | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] ************** 2026-08-18 15:34:47.672431 | node1 | Tuesday 18 August 2026 15:34:47 +0000 (0:00:00.076) 0:01:14.874 ******** 2026-08-18 15:34:47.693762 | node1 | skipping: [node1] 2026-08-18 15:34:47.693823 | node1 | 2026-08-18 15:34:47.693925 | node1 | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] ********* 2026-08-18 15:34:47.694029 | node1 | Tuesday 18 August 2026 15:34:47 +0000 (0:00:00.021) 0:01:14.896 ******** 2026-08-18 15:34:48.958761 | node1 | ok: [node1] 2026-08-18 15:34:48.958861 | node1 | ok: [node2] 2026-08-18 15:34:48.958978 | node1 | ok: [node3] 2026-08-18 15:34:48.959093 | node1 | 2026-08-18 15:34:48.959229 | node1 | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ******** 2026-08-18 15:34:48.959359 | node1 | Tuesday 18 August 2026 15:34:48 +0000 (0:00:01.263) 0:01:16.160 ******** 2026-08-18 15:34:48.989676 | node1 | skipping: [node1] => (item=/dev/ceph-node1-osd0/data) 2026-08-18 15:34:49.056167 | node1 | skipping: [node2] => (item=/dev/ceph-node2-osd0/data) 2026-08-18 15:34:49.056284 | node1 | skipping: [node1] => (item=/dev/ceph-node1-osd1/data) 2026-08-18 15:34:49.056445 | node1 | skipping: [node1] => (item=/dev/ceph-node1-osd2/data) 2026-08-18 15:34:49.056572 | node1 | skipping: [node2] => (item=/dev/ceph-node2-osd1/data) 2026-08-18 15:34:49.056735 | node1 | skipping: [node1] 2026-08-18 15:34:49.056933 | node1 | skipping: [node3] => (item=/dev/ceph-node3-osd0/data) 2026-08-18 15:34:49.057121 | node1 | skipping: [node2] => (item=/dev/ceph-node2-osd2/data) 2026-08-18 15:34:49.057312 | node1 | skipping: [node2] 2026-08-18 15:34:49.057507 | node1 | skipping: [node3] => (item=/dev/ceph-node3-osd1/data) 2026-08-18 15:34:49.057703 | node1 | skipping: [node3] => (item=/dev/ceph-node3-osd2/data) 2026-08-18 15:34:49.058063 | node1 | skipping: [node3] 2026-08-18 15:34:49.058255 | node1 | 2026-08-18 15:34:49.058475 | node1 | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] *** 2026-08-18 15:34:49.058680 | node1 | Tuesday 18 August 2026 15:34:49 +0000 (0:00:00.098) 0:01:16.258 ******** 2026-08-18 15:34:50.556842 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:34:50.557065 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:34:50.557302 | node1 | ok: [node1] 2026-08-18 15:34:50.557528 | node1 | 2026-08-18 15:34:50.557779 | node1 | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] *** 2026-08-18 15:34:50.558021 | node1 | Tuesday 18 August 2026 15:34:50 +0000 (0:00:01.500) 0:01:17.759 ******** 2026-08-18 15:34:50.620900 | node1 | skipping: [node1] 2026-08-18 15:34:50.621092 | node1 | 2026-08-18 15:34:50.621317 | node1 | PLAY [Apply Ceph configuration] ************************************************ 2026-08-18 15:34:50.621515 | node1 | 2026-08-18 15:34:50.621735 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:34:50.621957 | node1 | Tuesday 18 August 2026 15:34:50 +0000 (0:00:00.064) 0:01:17.823 ******** 2026-08-18 15:34:51.559528 | node1 | ok: [node1] 2026-08-18 15:34:51.559606 | node1 | ok: [node2] 2026-08-18 15:34:51.559756 | node1 | ok: [node3] 2026-08-18 15:34:51.559883 | node1 | 2026-08-18 15:34:51.560017 | node1 | TASK [vexxhost.ceph.configure : Locate the cluster admin host] ***************** 2026-08-18 15:34:51.560144 | node1 | Tuesday 18 August 2026 15:34:51 +0000 (0:00:00.938) 0:01:18.762 ******** 2026-08-18 15:34:52.135104 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:34:52.135173 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:34:52.135186 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:34:52.135195 | node1 | 2026-08-18 15:34:52.135205 | node1 | TASK [vexxhost.ceph.configure : Select the admin host] ************************* 2026-08-18 15:34:52.135214 | node1 | Tuesday 18 August 2026 15:34:52 +0000 (0:00:00.574) 0:01:19.336 ******** 2026-08-18 15:34:52.184745 | node1 | ok: [node1] 2026-08-18 15:34:52.184826 | node1 | ok: [node2] 2026-08-18 15:34:52.185342 | node1 | ok: [node3] 2026-08-18 15:34:52.185394 | node1 | 2026-08-18 15:34:52.185402 | node1 | TASK [vexxhost.ceph.configure : Set the admin mon config path] ***************** 2026-08-18 15:34:52.185409 | node1 | Tuesday 18 August 2026 15:34:52 +0000 (0:00:00.050) 0:01:19.387 ******** 2026-08-18 15:34:52.241126 | node1 | ok: [node1] 2026-08-18 15:34:52.241601 | node1 | ok: [node2] 2026-08-18 15:34:52.241648 | node1 | ok: [node3] 2026-08-18 15:34:52.241654 | node1 | 2026-08-18 15:34:52.241659 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 15:34:52.241663 | node1 | Tuesday 18 August 2026 15:34:52 +0000 (0:00:00.056) 0:01:19.443 ******** 2026-08-18 15:34:52.300299 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/config.yml for node1, node2, node3 2026-08-18 15:34:52.300395 | node1 | 2026-08-18 15:34:52.300589 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 15:34:52.300634 | node1 | Tuesday 18 August 2026 15:34:52 +0000 (0:00:00.059) 0:01:19.503 ******** 2026-08-18 15:35:00.683898 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/standby_behaviour) 2026-08-18 15:35:00.684516 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/RGW_API_SSL_VERIFY) 2026-08-18 15:35:00.684586 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_CEPHFS) 2026-08-18 15:35:00.684597 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_ISCSI) 2026-08-18 15:35:00.684627 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_MIRRORING) 2026-08-18 15:35:00.684645 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_NFS) 2026-08-18 15:35:00.684758 | node1 | 2026-08-18 15:35:00.684849 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 15:35:00.684958 | node1 | Tuesday 18 August 2026 15:35:00 +0000 (0:00:08.383) 0:01:27.886 ******** 2026-08-18 15:35:00.749353 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/ec_profiles.yml for node1, node2, node3 2026-08-18 15:35:00.749431 | node1 | 2026-08-18 15:35:00.749539 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 15:35:00.749670 | node1 | Tuesday 18 August 2026 15:35:00 +0000 (0:00:00.065) 0:01:27.952 ******** 2026-08-18 15:35:02.280180 | node1 | ok: [node1] => (item=ec_hdd_s3) 2026-08-18 15:35:02.280253 | node1 | 2026-08-18 15:35:02.280487 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 15:35:02.280575 | node1 | Tuesday 18 August 2026 15:35:02 +0000 (0:00:01.530) 0:01:29.482 ******** 2026-08-18 15:35:02.342735 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/crush_rules.yml for node1, node2, node3 2026-08-18 15:35:02.342805 | node1 | 2026-08-18 15:35:02.342898 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 15:35:02.343029 | node1 | Tuesday 18 August 2026 15:35:02 +0000 (0:00:00.063) 0:01:29.545 ******** 2026-08-18 15:35:06.641315 | node1 | ok: [node1] => (item=rep_hdd) 2026-08-18 15:35:06.641394 | node1 | ok: [node1] => (item=rep_lab) 2026-08-18 15:35:06.641446 | node1 | ok: [node1] => (item=ec_hdd_s3) 2026-08-18 15:35:06.641750 | node1 | 2026-08-18 15:35:06.641802 | node1 | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 15:35:06.641808 | node1 | Tuesday 18 August 2026 15:35:06 +0000 (0:00:04.298) 0:01:33.843 ******** 2026-08-18 15:35:06.707913 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/pools.yml for node1, node2, node3 2026-08-18 15:35:06.707996 | node1 | 2026-08-18 15:35:06.708200 | node1 | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 15:35:06.708261 | node1 | Tuesday 18 August 2026 15:35:06 +0000 (0:00:00.066) 0:01:33.910 ******** 2026-08-18 15:35:36.744651 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.data) 2026-08-18 15:35:36.744713 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.index) 2026-08-18 15:35:36.745397 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.non-ec) 2026-08-18 15:35:36.745450 | node1 | ok: [node1] => (item=molecule-1.rgw.control) 2026-08-18 15:35:36.745456 | node1 | ok: [node1] => (item=molecule-1.rgw.log) 2026-08-18 15:35:36.745460 | node1 | ok: [node1] => (item=molecule-1.rgw.meta) 2026-08-18 15:35:36.745464 | node1 | 2026-08-18 15:35:36.745469 | node1 | TASK [vexxhost.ceph.configure : Configure CephX keys] ************************** 2026-08-18 15:35:36.745474 | node1 | Tuesday 18 August 2026 15:35:36 +0000 (0:00:30.036) 0:02:03.947 ******** 2026-08-18 15:35:36.791829 | node1 | skipping: [node1] 2026-08-18 15:35:36.791891 | node1 | skipping: [node2] 2026-08-18 15:35:36.792270 | node1 | skipping: [node3] 2026-08-18 15:35:36.792318 | node1 | 2026-08-18 15:35:36.792323 | node1 | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] ********** 2026-08-18 15:35:36.792328 | node1 | Tuesday 18 August 2026 15:35:36 +0000 (0:00:00.047) 0:02:03.994 ******** 2026-08-18 15:35:36.862443 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for node1, node2, node3 2026-08-18 15:35:36.862522 | node1 | 2026-08-18 15:35:36.862747 | node1 | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] *** 2026-08-18 15:35:36.862798 | node1 | Tuesday 18 August 2026 15:35:36 +0000 (0:00:00.070) 0:02:04.065 ******** 2026-08-18 15:35:38.325159 | node1 | ok: [node1] 2026-08-18 15:35:38.325244 | node1 | 2026-08-18 15:35:38.325585 | node1 | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] ********* 2026-08-18 15:35:38.325648 | node1 | Tuesday 18 August 2026 15:35:38 +0000 (0:00:01.462) 0:02:05.527 ******** 2026-08-18 15:35:39.876565 | node1 | ok: [node1] 2026-08-18 15:35:39.876636 | node1 | 2026-08-18 15:35:39.876735 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate] ***************** 2026-08-18 15:35:39.876826 | node1 | Tuesday 18 August 2026 15:35:39 +0000 (0:00:01.551) 0:02:07.079 ******** 2026-08-18 15:35:39.906339 | node1 | skipping: [node1] 2026-08-18 15:35:39.906589 | node1 | 2026-08-18 15:35:39.906818 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] ************* 2026-08-18 15:35:39.907024 | node1 | Tuesday 18 August 2026 15:35:39 +0000 (0:00:00.029) 0:02:07.108 ******** 2026-08-18 15:35:39.933224 | node1 | skipping: [node1] 2026-08-18 15:35:39.933382 | node1 | 2026-08-18 15:35:39.933642 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 15:35:39.933849 | node1 | Tuesday 18 August 2026 15:35:39 +0000 (0:00:00.026) 0:02:07.135 ******** 2026-08-18 15:35:39.970835 | node1 | skipping: [node1] 2026-08-18 15:35:39.971021 | node1 | 2026-08-18 15:35:39.971223 | node1 | TASK [vexxhost.ceph.configure : Create a self-signed certificate] ************** 2026-08-18 15:35:39.971427 | node1 | Tuesday 18 August 2026 15:35:39 +0000 (0:00:00.037) 0:02:07.173 ******** 2026-08-18 15:35:40.006672 | node1 | skipping: [node1] 2026-08-18 15:35:40.006783 | node1 | 2026-08-18 15:35:40.006926 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 15:35:40.007056 | node1 | Tuesday 18 August 2026 15:35:40 +0000 (0:00:00.036) 0:02:07.209 ******** 2026-08-18 15:35:40.043804 | node1 | skipping: [node1] 2026-08-18 15:35:40.043975 | node1 | 2026-08-18 15:35:40.044255 | node1 | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] *** 2026-08-18 15:35:40.044508 | node1 | Tuesday 18 August 2026 15:35:40 +0000 (0:00:00.036) 0:02:07.246 ******** 2026-08-18 15:35:40.097339 | node1 | skipping: [node1] => (item=ceph mgr module disable dashboard) 2026-08-18 15:35:40.097545 | node1 | skipping: [node1] => (item=ceph mgr module enable dashboard) 2026-08-18 15:35:40.097743 | node1 | skipping: [node1] => (item=ceph orch reconfig mgr) 2026-08-18 15:35:40.097938 | node1 | skipping: [node1] 2026-08-18 15:35:40.098126 | node1 | 2026-08-18 15:35:40.098378 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 15:35:40.098584 | node1 | Tuesday 18 August 2026 15:35:40 +0000 (0:00:00.053) 0:02:07.299 ******** 2026-08-18 15:35:40.166133 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard_users.yml for node1, node2, node3 2026-08-18 15:35:40.166296 | node1 | 2026-08-18 15:35:40.166542 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 15:35:40.166738 | node1 | Tuesday 18 August 2026 15:35:40 +0000 (0:00:00.069) 0:02:07.368 ******** 2026-08-18 15:35:46.313502 | node1 | ok: [node1] => (item=None) 2026-08-18 15:35:46.313679 | node1 | ok: [node1] => (item=None) 2026-08-18 15:35:46.313937 | node1 | ok: [node1 -> {{ ceph_configure_admin_host }}] 2026-08-18 15:35:46.314132 | node1 | 2026-08-18 15:35:46.314347 | node1 | PLAY [Deploy Ceph RADOS Gateways] ********************************************** 2026-08-18 15:35:46.314488 | node1 | 2026-08-18 15:35:46.314687 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:35:46.314890 | node1 | Tuesday 18 August 2026 15:35:46 +0000 (0:00:06.147) 0:02:13.516 ******** 2026-08-18 15:35:47.262524 | node1 | ok: [node1] 2026-08-18 15:35:47.262698 | node1 | ok: [node2] 2026-08-18 15:35:47.262890 | node1 | ok: [node3] 2026-08-18 15:35:47.263076 | node1 | 2026-08-18 15:35:47.263284 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:35:47.263487 | node1 | Tuesday 18 August 2026 15:35:47 +0000 (0:00:00.948) 0:02:14.465 ******** 2026-08-18 15:35:47.484065 | node1 | ok: [node1] 2026-08-18 15:35:47.484267 | node1 | ok: [node2] 2026-08-18 15:35:47.484579 | node1 | ok: [node3] 2026-08-18 15:35:47.484788 | node1 | 2026-08-18 15:35:47.485017 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:35:47.485230 | node1 | Tuesday 18 August 2026 15:35:47 +0000 (0:00:00.221) 0:02:14.686 ******** 2026-08-18 15:35:47.548220 | node1 | skipping: [node1] 2026-08-18 15:35:47.548597 | node1 | skipping: [node2] 2026-08-18 15:35:47.548703 | node1 | skipping: [node3] 2026-08-18 15:35:47.549226 | node1 | 2026-08-18 15:35:47.549259 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:35:47.549589 | node1 | Tuesday 18 August 2026 15:35:47 +0000 (0:00:00.064) 0:02:14.750 ******** 2026-08-18 15:35:47.778538 | node1 | ok: [node1] 2026-08-18 15:35:47.778733 | node1 | ok: [node2] 2026-08-18 15:35:47.778931 | node1 | ok: [node3] 2026-08-18 15:35:47.779138 | node1 | 2026-08-18 15:35:47.779405 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:35:47.779616 | node1 | Tuesday 18 August 2026 15:35:47 +0000 (0:00:00.230) 0:02:14.981 ******** 2026-08-18 15:35:47.870725 | node1 | ok: [node1] => { 2026-08-18 15:35:47.870920 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:35:47.871115 | node1 | } 2026-08-18 15:35:47.871312 | node1 | ok: [node2] => { 2026-08-18 15:35:47.871605 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:35:47.871879 | node1 | } 2026-08-18 15:35:47.872158 | node1 | ok: [node3] => { 2026-08-18 15:35:47.872447 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:35:47.872717 | node1 | } 2026-08-18 15:35:47.872916 | node1 | 2026-08-18 15:35:47.873121 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:35:47.873324 | node1 | Tuesday 18 August 2026 15:35:47 +0000 (0:00:00.092) 0:02:15.073 ******** 2026-08-18 15:35:48.213937 | node1 | ok: [node2] 2026-08-18 15:35:48.214120 | node1 | ok: [node3] 2026-08-18 15:35:48.214309 | node1 | ok: [node1] 2026-08-18 15:35:48.214488 | node1 | 2026-08-18 15:35:48.214709 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:35:48.214911 | node1 | Tuesday 18 August 2026 15:35:48 +0000 (0:00:00.342) 0:02:15.416 ******** 2026-08-18 15:35:48.296167 | node1 | skipping: [node1] 2026-08-18 15:35:48.296408 | node1 | skipping: [node2] 2026-08-18 15:35:48.296627 | node1 | skipping: [node3] 2026-08-18 15:35:48.296809 | node1 | 2026-08-18 15:35:48.297029 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:35:48.297248 | node1 | Tuesday 18 August 2026 15:35:48 +0000 (0:00:00.082) 0:02:15.498 ******** 2026-08-18 15:35:48.384869 | node1 | skipping: [node1] 2026-08-18 15:35:48.385051 | node1 | skipping: [node2] 2026-08-18 15:35:48.385243 | node1 | skipping: [node3] 2026-08-18 15:35:48.385442 | node1 | 2026-08-18 15:35:48.385737 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:35:48.385947 | node1 | Tuesday 18 August 2026 15:35:48 +0000 (0:00:00.088) 0:02:15.587 ******** 2026-08-18 15:35:48.608609 | node1 | ok: [node1] 2026-08-18 15:35:48.608907 | node1 | ok: [node2] 2026-08-18 15:35:48.609146 | node1 | ok: [node3] 2026-08-18 15:35:48.609471 | node1 | 2026-08-18 15:35:48.609623 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:35:48.609906 | node1 | Tuesday 18 August 2026 15:35:48 +0000 (0:00:00.223) 0:02:15.811 ******** 2026-08-18 15:35:49.859112 | node1 | ok: [node1] 2026-08-18 15:35:49.859208 | node1 | ok: [node3] 2026-08-18 15:35:49.859339 | node1 | ok: [node2] 2026-08-18 15:35:49.859458 | node1 | 2026-08-18 15:35:49.859592 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:35:49.859730 | node1 | Tuesday 18 August 2026 15:35:49 +0000 (0:00:01.250) 0:02:17.061 ******** 2026-08-18 15:35:49.959076 | node1 | ok: [node1] => { 2026-08-18 15:35:49.959313 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:35:49.959585 | node1 | } 2026-08-18 15:35:49.959847 | node1 | ok: [node2] => { 2026-08-18 15:35:49.960118 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:35:49.960361 | node1 | } 2026-08-18 15:35:49.960675 | node1 | ok: [node3] => { 2026-08-18 15:35:49.960937 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:35:49.961173 | node1 | } 2026-08-18 15:35:49.961408 | node1 | 2026-08-18 15:35:49.961690 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:35:49.961932 | node1 | Tuesday 18 August 2026 15:35:49 +0000 (0:00:00.099) 0:02:17.161 ******** 2026-08-18 15:35:50.318254 | node1 | ok: [node1] 2026-08-18 15:35:50.318403 | node1 | ok: [node2] 2026-08-18 15:35:50.318592 | node1 | ok: [node3] 2026-08-18 15:35:50.318769 | node1 | 2026-08-18 15:35:50.318973 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:35:50.319171 | node1 | Tuesday 18 August 2026 15:35:50 +0000 (0:00:00.359) 0:02:17.520 ******** 2026-08-18 15:35:52.269226 | node1 | ok: [node1] 2026-08-18 15:35:52.269295 | node1 | ok: [node2] 2026-08-18 15:35:52.269336 | node1 | ok: [node3] 2026-08-18 15:35:52.269653 | node1 | 2026-08-18 15:35:52.269698 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:35:52.269704 | node1 | Tuesday 18 August 2026 15:35:52 +0000 (0:00:01.951) 0:02:19.471 ******** 2026-08-18 15:35:52.326122 | node1 | skipping: [node1] 2026-08-18 15:35:52.327032 | node1 | skipping: [node2] 2026-08-18 15:35:52.327071 | node1 | skipping: [node3] 2026-08-18 15:35:52.327076 | node1 | 2026-08-18 15:35:52.327081 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:35:52.327086 | node1 | Tuesday 18 August 2026 15:35:52 +0000 (0:00:00.056) 0:02:19.528 ******** 2026-08-18 15:35:52.382268 | node1 | skipping: [node1] 2026-08-18 15:35:52.382835 | node1 | skipping: [node2] 2026-08-18 15:35:52.382880 | node1 | skipping: [node3] 2026-08-18 15:35:52.382885 | node1 | 2026-08-18 15:35:52.382890 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:35:52.382894 | node1 | Tuesday 18 August 2026 15:35:52 +0000 (0:00:00.056) 0:02:19.585 ******** 2026-08-18 15:35:52.436438 | node1 | skipping: [node1] 2026-08-18 15:35:52.436845 | node1 | skipping: [node2] 2026-08-18 15:35:52.436863 | node1 | skipping: [node3] 2026-08-18 15:35:52.436872 | node1 | 2026-08-18 15:35:52.437089 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:35:52.437132 | node1 | Tuesday 18 August 2026 15:35:52 +0000 (0:00:00.053) 0:02:19.639 ******** 2026-08-18 15:35:53.635776 | node1 | ok: [node1] 2026-08-18 15:35:53.635835 | node1 | ok: [node3] 2026-08-18 15:35:53.635962 | node1 | ok: [node2] 2026-08-18 15:35:53.636078 | node1 | 2026-08-18 15:35:53.636218 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:35:53.636348 | node1 | Tuesday 18 August 2026 15:35:53 +0000 (0:00:01.198) 0:02:20.838 ******** 2026-08-18 15:35:54.079028 | node1 | ok: [node1] 2026-08-18 15:35:54.079240 | node1 | ok: [node3] 2026-08-18 15:35:54.079457 | node1 | ok: [node2] 2026-08-18 15:35:54.079659 | node1 | 2026-08-18 15:35:54.079890 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:35:54.080152 | node1 | Tuesday 18 August 2026 15:35:54 +0000 (0:00:00.443) 0:02:21.281 ******** 2026-08-18 15:35:55.030562 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:35:55.030641 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:35:55.030719 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:35:55.030812 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:35:55.030895 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:35:55.030984 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:35:55.031075 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:35:55.031167 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:35:55.031257 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:35:55.031353 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:35:55.031449 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:35:55.031542 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:35:55.031639 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:35:55.031737 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:35:55.031833 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:35:55.031914 | node1 | 2026-08-18 15:35:55.032006 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:35:55.032096 | node1 | Tuesday 18 August 2026 15:35:55 +0000 (0:00:00.951) 0:02:22.233 ******** 2026-08-18 15:35:55.599903 | node1 | ok: [node1] 2026-08-18 15:35:55.600088 | node1 | ok: [node3] 2026-08-18 15:35:55.600297 | node1 | ok: [node2] 2026-08-18 15:35:55.600517 | node1 | 2026-08-18 15:35:55.600773 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:35:55.600985 | node1 | Tuesday 18 August 2026 15:35:55 +0000 (0:00:00.532) 0:02:22.766 ******** 2026-08-18 15:35:55.601201 | node1 | 2026-08-18 15:35:55.601413 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:35:55.601624 | node1 | Tuesday 18 August 2026 15:35:55 +0000 (0:00:00.011) 0:02:22.777 ******** 2026-08-18 15:35:55.601838 | node1 | 2026-08-18 15:35:55.602053 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:35:55.602261 | node1 | Tuesday 18 August 2026 15:35:55 +0000 (0:00:00.011) 0:02:22.788 ******** 2026-08-18 15:35:55.602453 | node1 | 2026-08-18 15:35:55.602657 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:35:55.602859 | node1 | Tuesday 18 August 2026 15:35:55 +0000 (0:00:00.013) 0:02:22.802 ******** 2026-08-18 15:35:55.987518 | node1 | ok: [node1] 2026-08-18 15:35:55.987642 | node1 | ok: [node2] 2026-08-18 15:35:55.987784 | node1 | ok: [node3] 2026-08-18 15:35:55.987910 | node1 | 2026-08-18 15:35:55.988053 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:35:55.988231 | node1 | Tuesday 18 August 2026 15:35:55 +0000 (0:00:00.387) 0:02:23.189 ******** 2026-08-18 15:35:56.218559 | node1 | ok: [node1] 2026-08-18 15:35:56.218641 | node1 | ok: [node2] 2026-08-18 15:35:56.218711 | node1 | ok: [node3] 2026-08-18 15:35:56.218791 | node1 | 2026-08-18 15:35:56.218896 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:35:56.218992 | node1 | Tuesday 18 August 2026 15:35:56 +0000 (0:00:00.231) 0:02:23.421 ******** 2026-08-18 15:35:56.306433 | node1 | ok: [node1] => { 2026-08-18 15:35:56.306575 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:35:56.306693 | node1 | } 2026-08-18 15:35:56.306820 | node1 | ok: [node2] => { 2026-08-18 15:35:56.306982 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:35:56.307076 | node1 | } 2026-08-18 15:35:56.307214 | node1 | ok: [node3] => { 2026-08-18 15:35:56.307340 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:35:56.307459 | node1 | } 2026-08-18 15:35:56.307577 | node1 | 2026-08-18 15:35:56.307709 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:35:56.307838 | node1 | Tuesday 18 August 2026 15:35:56 +0000 (0:00:00.087) 0:02:23.508 ******** 2026-08-18 15:35:56.685702 | node1 | ok: [node2] 2026-08-18 15:35:56.685818 | node1 | ok: [node1] 2026-08-18 15:35:56.685949 | node1 | ok: [node3] 2026-08-18 15:35:56.686071 | node1 | 2026-08-18 15:35:56.686211 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:35:56.686343 | node1 | Tuesday 18 August 2026 15:35:56 +0000 (0:00:00.379) 0:02:23.887 ******** 2026-08-18 15:35:59.836938 | node1 | ok: [node2] 2026-08-18 15:35:59.837084 | node1 | ok: [node1] 2026-08-18 15:35:59.837331 | node1 | ok: [node3] 2026-08-18 15:35:59.837581 | node1 | 2026-08-18 15:35:59.837779 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:35:59.838031 | node1 | Tuesday 18 August 2026 15:35:59 +0000 (0:00:03.151) 0:02:27.039 ******** 2026-08-18 15:36:01.049034 | node1 | ok: [node1] 2026-08-18 15:36:01.049084 | node1 | ok: [node3] 2026-08-18 15:36:01.049861 | node1 | ok: [node2] 2026-08-18 15:36:01.049884 | node1 | 2026-08-18 15:36:01.049895 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:36:01.049905 | node1 | Tuesday 18 August 2026 15:36:01 +0000 (0:00:01.211) 0:02:28.251 ******** 2026-08-18 15:36:01.257476 | node1 | ok: [node1] 2026-08-18 15:36:01.257531 | node1 | ok: [node2] 2026-08-18 15:36:01.257542 | node1 | ok: [node3] 2026-08-18 15:36:01.257552 | node1 | 2026-08-18 15:36:01.257562 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:36:01.257571 | node1 | Tuesday 18 August 2026 15:36:01 +0000 (0:00:00.207) 0:02:28.459 ******** 2026-08-18 15:36:01.710943 | node1 | ok: [node1] 2026-08-18 15:36:01.711005 | node1 | ok: [node3] 2026-08-18 15:36:01.711016 | node1 | ok: [node2] 2026-08-18 15:36:01.711026 | node1 | 2026-08-18 15:36:01.711036 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:36:01.711046 | node1 | Tuesday 18 August 2026 15:36:01 +0000 (0:00:00.453) 0:02:28.912 ******** 2026-08-18 15:36:02.295616 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:36:02.295673 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:36:02.295684 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:36:02.295694 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:36:02.295705 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:36:02.295714 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:36:02.295731 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:36:02.295741 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:36:02.295750 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:36:02.295759 | node1 | 2026-08-18 15:36:02.295775 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:36:02.295787 | node1 | Tuesday 18 August 2026 15:36:02 +0000 (0:00:00.584) 0:02:29.496 ******** 2026-08-18 15:36:02.723538 | node1 | ok: [node1] 2026-08-18 15:36:02.723649 | node1 | ok: [node2] 2026-08-18 15:36:02.723797 | node1 | ok: [node3] 2026-08-18 15:36:02.723940 | node1 | 2026-08-18 15:36:02.724104 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:36:02.724335 | node1 | Tuesday 18 August 2026 15:36:02 +0000 (0:00:00.429) 0:02:29.926 ******** 2026-08-18 15:36:03.218595 | node1 | ok: [node1] 2026-08-18 15:36:03.218813 | node1 | ok: [node2] 2026-08-18 15:36:03.219042 | node1 | ok: [node3] 2026-08-18 15:36:03.219251 | node1 | 2026-08-18 15:36:03.219485 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:36:03.219711 | node1 | Tuesday 18 August 2026 15:36:03 +0000 (0:00:00.457) 0:02:30.383 ******** 2026-08-18 15:36:03.219912 | node1 | 2026-08-18 15:36:03.220145 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:36:03.220393 | node1 | Tuesday 18 August 2026 15:36:03 +0000 (0:00:00.013) 0:02:30.396 ******** 2026-08-18 15:36:03.220607 | node1 | 2026-08-18 15:36:03.220834 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:36:03.221055 | node1 | Tuesday 18 August 2026 15:36:03 +0000 (0:00:00.013) 0:02:30.410 ******** 2026-08-18 15:36:03.221369 | node1 | 2026-08-18 15:36:03.221593 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:36:03.221810 | node1 | Tuesday 18 August 2026 15:36:03 +0000 (0:00:00.011) 0:02:30.421 ******** 2026-08-18 15:36:03.604076 | node1 | ok: [node1] 2026-08-18 15:36:03.604266 | node1 | ok: [node2] 2026-08-18 15:36:03.604498 | node1 | ok: [node3] 2026-08-18 15:36:03.604688 | node1 | 2026-08-18 15:36:03.604905 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:36:03.605104 | node1 | Tuesday 18 August 2026 15:36:03 +0000 (0:00:00.384) 0:02:30.805 ******** 2026-08-18 15:36:03.675644 | node1 | ok: [node1] => { 2026-08-18 15:36:03.675822 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:36:03.676019 | node1 | } 2026-08-18 15:36:03.676260 | node1 | ok: [node2] => { 2026-08-18 15:36:03.676555 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:36:03.676756 | node1 | } 2026-08-18 15:36:03.676957 | node1 | ok: [node3] => { 2026-08-18 15:36:03.677156 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:36:03.678044 | node1 | } 2026-08-18 15:36:03.678102 | node1 | 2026-08-18 15:36:03.678114 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:36:03.678125 | node1 | Tuesday 18 August 2026 15:36:03 +0000 (0:00:00.072) 0:02:30.878 ******** 2026-08-18 15:36:03.953580 | node1 | ok: [node1] 2026-08-18 15:36:03.953627 | node1 | ok: [node2] 2026-08-18 15:36:03.953632 | node1 | ok: [node3] 2026-08-18 15:36:03.953637 | node1 | 2026-08-18 15:36:03.953642 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:36:03.953646 | node1 | Tuesday 18 August 2026 15:36:03 +0000 (0:00:00.277) 0:02:31.155 ******** 2026-08-18 15:36:03.978005 | node1 | skipping: [node1] 2026-08-18 15:36:04.016933 | node1 | skipping: [node2] 2026-08-18 15:36:04.016977 | node1 | skipping: [node3] 2026-08-18 15:36:04.016983 | node1 | 2026-08-18 15:36:04.016988 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:36:04.016992 | node1 | Tuesday 18 August 2026 15:36:04 +0000 (0:00:00.063) 0:02:31.219 ******** 2026-08-18 15:36:04.090758 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:36:04.090801 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:36:04.090806 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:36:04.090810 | node1 | 2026-08-18 15:36:04.090815 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:36:04.090819 | node1 | Tuesday 18 August 2026 15:36:04 +0000 (0:00:00.073) 0:02:31.293 ******** 2026-08-18 15:36:05.447776 | node1 | ok: [node3] 2026-08-18 15:36:05.447865 | node1 | ok: [node1] 2026-08-18 15:36:05.447901 | node1 | ok: [node2] 2026-08-18 15:36:05.447920 | node1 | 2026-08-18 15:36:05.447934 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:36:05.447947 | node1 | Tuesday 18 August 2026 15:36:05 +0000 (0:00:01.356) 0:02:32.649 ******** 2026-08-18 15:36:06.100538 | node1 | ok: [node2] => (item=chronyd) 2026-08-18 15:36:06.100810 | node1 | ok: [node1] => (item=chronyd) 2026-08-18 15:36:06.100819 | node1 | ok: [node3] => (item=chronyd) 2026-08-18 15:36:06.100825 | node1 | ok: [node2] => (item=sshd) 2026-08-18 15:36:06.100830 | node1 | ok: [node1] => (item=sshd) 2026-08-18 15:36:06.100836 | node1 | ok: [node3] => (item=sshd) 2026-08-18 15:36:06.100842 | node1 | 2026-08-18 15:36:06.100848 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:36:06.100859 | node1 | Tuesday 18 August 2026 15:36:06 +0000 (0:00:00.653) 0:02:33.302 ******** 2026-08-18 15:36:06.323930 | node1 | ok: [node1] 2026-08-18 15:36:06.324123 | node1 | ok: [node2] 2026-08-18 15:36:06.324335 | node1 | ok: [node3] 2026-08-18 15:36:06.324584 | node1 | 2026-08-18 15:36:06.324807 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:36:06.325033 | node1 | Tuesday 18 August 2026 15:36:06 +0000 (0:00:00.223) 0:02:33.526 ******** 2026-08-18 15:36:06.619485 | node1 | ok: [node1] 2026-08-18 15:36:06.619545 | node1 | ok: [node2] 2026-08-18 15:36:06.619652 | node1 | ok: [node3] 2026-08-18 15:36:06.619742 | node1 | 2026-08-18 15:36:06.619846 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:36:06.619948 | node1 | Tuesday 18 August 2026 15:36:06 +0000 (0:00:00.295) 0:02:33.822 ******** 2026-08-18 15:36:07.044939 | node1 | ok: [node1] 2026-08-18 15:36:07.045067 | node1 | ok: [node2] 2026-08-18 15:36:07.045276 | node1 | ok: [node3] 2026-08-18 15:36:07.045463 | node1 | 2026-08-18 15:36:07.045679 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:36:07.045889 | node1 | Tuesday 18 August 2026 15:36:07 +0000 (0:00:00.425) 0:02:34.247 ******** 2026-08-18 15:36:07.095331 | node1 | skipping: [node1] 2026-08-18 15:36:07.095504 | node1 | skipping: [node2] 2026-08-18 15:36:07.095695 | node1 | skipping: [node3] 2026-08-18 15:36:07.095875 | node1 | 2026-08-18 15:36:07.096090 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:36:07.096294 | node1 | Tuesday 18 August 2026 15:36:07 +0000 (0:00:00.050) 0:02:34.298 ******** 2026-08-18 15:36:07.468672 | node1 | ok: [node2] 2026-08-18 15:36:07.468866 | node1 | ok: [node1] 2026-08-18 15:36:07.469079 | node1 | ok: [node3] 2026-08-18 15:36:07.469367 | node1 | 2026-08-18 15:36:07.469669 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:36:07.469858 | node1 | Tuesday 18 August 2026 15:36:07 +0000 (0:00:00.372) 0:02:34.671 ******** 2026-08-18 15:36:07.911956 | node1 | ok: [node2] 2026-08-18 15:36:07.912161 | node1 | ok: [node1] 2026-08-18 15:36:07.912485 | node1 | ok: [node3] 2026-08-18 15:36:07.912763 | node1 | 2026-08-18 15:36:07.913107 | node1 | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] *********************** 2026-08-18 15:36:07.913355 | node1 | Tuesday 18 August 2026 15:36:07 +0000 (0:00:00.443) 0:02:35.114 ******** 2026-08-18 15:36:08.488151 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:36:08.488224 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:36:08.488359 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:36:08.488496 | node1 | 2026-08-18 15:36:08.488643 | node1 | TASK [vexxhost.ceph.rgw : Select the admin host] ******************************* 2026-08-18 15:36:08.488772 | node1 | Tuesday 18 August 2026 15:36:08 +0000 (0:00:00.576) 0:02:35.690 ******** 2026-08-18 15:36:08.562936 | node1 | ok: [node1] 2026-08-18 15:36:08.563108 | node1 | ok: [node2] 2026-08-18 15:36:08.563297 | node1 | ok: [node3] 2026-08-18 15:36:08.563476 | node1 | 2026-08-18 15:36:08.563690 | node1 | TASK [vexxhost.ceph.rgw : Set the admin mon config path] *********************** 2026-08-18 15:36:08.563943 | node1 | Tuesday 18 August 2026 15:36:08 +0000 (0:00:00.075) 0:02:35.765 ******** 2026-08-18 15:36:08.628602 | node1 | ok: [node1] 2026-08-18 15:36:08.628798 | node1 | ok: [node2] 2026-08-18 15:36:08.628995 | node1 | ok: [node3] 2026-08-18 15:36:08.629177 | node1 | 2026-08-18 15:36:08.629377 | node1 | TASK [Register this RGW host] ************************************************** 2026-08-18 15:36:08.629612 | node1 | Tuesday 18 August 2026 15:36:08 +0000 (0:00:00.065) 0:02:35.831 ******** 2026-08-18 15:36:08.732658 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:36:08.732829 | node1 | 2026-08-18 15:36:08.733041 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:36:08.733242 | node1 | Tuesday 18 August 2026 15:36:08 +0000 (0:00:00.104) 0:02:35.935 ******** 2026-08-18 15:36:10.130520 | node1 | ok: [node1] 2026-08-18 15:36:10.130623 | node1 | 2026-08-18 15:36:10.130636 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:36:10.130647 | node1 | Tuesday 18 August 2026 15:36:10 +0000 (0:00:01.396) 0:02:37.331 ******** 2026-08-18 15:36:10.188248 | node1 | ok: [node1] 2026-08-18 15:36:10.188583 | node1 | ok: [node2] 2026-08-18 15:36:10.188660 | node1 | ok: [node3] 2026-08-18 15:36:10.188680 | node1 | 2026-08-18 15:36:10.188987 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:36:10.189047 | node1 | Tuesday 18 August 2026 15:36:10 +0000 (0:00:00.058) 0:02:37.390 ******** 2026-08-18 15:36:10.261066 | node1 | ok: [node1] => { 2026-08-18 15:36:10.262386 | node1 | "changed": false, 2026-08-18 15:36:10.262458 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:10.262466 | node1 | } 2026-08-18 15:36:10.262471 | node1 | ok: [node2] => { 2026-08-18 15:36:10.262476 | node1 | "changed": false, 2026-08-18 15:36:10.262480 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:10.262502 | node1 | } 2026-08-18 15:36:10.262507 | node1 | ok: [node3] => { 2026-08-18 15:36:10.262510 | node1 | "changed": false, 2026-08-18 15:36:10.262514 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:10.262518 | node1 | } 2026-08-18 15:36:10.262523 | node1 | 2026-08-18 15:36:10.262528 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:36:10.262534 | node1 | Tuesday 18 August 2026 15:36:10 +0000 (0:00:00.072) 0:02:37.463 ******** 2026-08-18 15:36:10.552214 | node1 | ok: [node2] 2026-08-18 15:36:10.552324 | node1 | ok: [node1] 2026-08-18 15:36:10.552416 | node1 | ok: [node3] 2026-08-18 15:36:10.552832 | node1 | 2026-08-18 15:36:10.552890 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:36:10.552899 | node1 | Tuesday 18 August 2026 15:36:10 +0000 (0:00:00.291) 0:02:37.754 ******** 2026-08-18 15:36:10.624034 | node1 | ok: [node1] 2026-08-18 15:36:10.624097 | node1 | ok: [node2] 2026-08-18 15:36:10.624199 | node1 | ok: [node3] 2026-08-18 15:36:10.624413 | node1 | 2026-08-18 15:36:10.624428 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:36:10.624577 | node1 | Tuesday 18 August 2026 15:36:10 +0000 (0:00:00.071) 0:02:37.826 ******** 2026-08-18 15:36:10.727597 | node1 | ok: [node1] 2026-08-18 15:36:10.727677 | node1 | ok: [node2] 2026-08-18 15:36:10.728254 | node1 | ok: [node3] 2026-08-18 15:36:10.728314 | node1 | 2026-08-18 15:36:10.728323 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:36:10.728331 | node1 | Tuesday 18 August 2026 15:36:10 +0000 (0:00:00.103) 0:02:37.929 ******** 2026-08-18 15:36:10.802098 | node1 | ok: [node1] => { 2026-08-18 15:36:10.802187 | node1 | "changed": false, 2026-08-18 15:36:10.803775 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:10.803855 | node1 | } 2026-08-18 15:36:10.803863 | node1 | ok: [node2] => { 2026-08-18 15:36:10.803870 | node1 | "changed": false, 2026-08-18 15:36:10.803876 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:10.803882 | node1 | } 2026-08-18 15:36:10.803888 | node1 | ok: [node3] => { 2026-08-18 15:36:10.803893 | node1 | "changed": false, 2026-08-18 15:36:10.803899 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:10.803905 | node1 | } 2026-08-18 15:36:10.803911 | node1 | 2026-08-18 15:36:10.803917 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:36:10.803924 | node1 | Tuesday 18 August 2026 15:36:10 +0000 (0:00:00.074) 0:02:38.004 ******** 2026-08-18 15:36:12.283336 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:36:12.283469 | node1 | ok: [node1] 2026-08-18 15:36:12.283482 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:36:12.283546 | node1 | 2026-08-18 15:36:12.283805 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:36:12.283881 | node1 | Tuesday 18 August 2026 15:36:12 +0000 (0:00:01.481) 0:02:39.485 ******** 2026-08-18 15:36:12.383974 | node1 | skipping: [node1] 2026-08-18 15:36:12.384091 | node1 | skipping: [node2] 2026-08-18 15:36:12.384103 | node1 | skipping: [node3] 2026-08-18 15:36:12.384115 | node1 | 2026-08-18 15:36:12.384399 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] **** 2026-08-18 15:36:12.384479 | node1 | Tuesday 18 August 2026 15:36:12 +0000 (0:00:00.100) 0:02:39.586 ******** 2026-08-18 15:36:12.440482 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/multisite.yml for node1 2026-08-18 15:36:12.440619 | node1 | 2026-08-18 15:36:12.440632 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW realms] ******************************** 2026-08-18 15:36:12.440739 | node1 | Tuesday 18 August 2026 15:36:12 +0000 (0:00:00.056) 0:02:39.642 ******** 2026-08-18 15:36:13.557993 | node1 | ok: [node1] => (item=molecule) 2026-08-18 15:36:13.558124 | node1 | 2026-08-18 15:36:13.558179 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zonegroups] **************************** 2026-08-18 15:36:13.558387 | node1 | Tuesday 18 August 2026 15:36:13 +0000 (0:00:01.117) 0:02:40.760 ******** 2026-08-18 15:36:15.549806 | node1 | ok: [node1] => (item=molecule) 2026-08-18 15:36:15.550221 | node1 | 2026-08-18 15:36:15.550282 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zones] ********************************* 2026-08-18 15:36:15.550290 | node1 | Tuesday 18 August 2026 15:36:15 +0000 (0:00:01.992) 0:02:42.752 ******** 2026-08-18 15:36:18.288092 | node1 | ok: [node1] => (item=None) 2026-08-18 15:36:18.288204 | node1 | ok: [node1 -> {{ ceph_rgw_admin_host }}] 2026-08-18 15:36:18.288465 | node1 | 2026-08-18 15:36:18.288527 | node1 | TASK [vexxhost.ceph.rgw : Commit the RGW period] ******************************* 2026-08-18 15:36:18.288638 | node1 | Tuesday 18 August 2026 15:36:18 +0000 (0:00:02.738) 0:02:45.490 ******** 2026-08-18 15:36:18.346164 | node1 | skipping: [node1] 2026-08-18 15:36:18.346239 | node1 | 2026-08-18 15:36:18.346449 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 15:36:18.346469 | node1 | Tuesday 18 August 2026 15:36:18 +0000 (0:00:00.058) 0:02:45.548 ******** 2026-08-18 15:36:18.400409 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/services.yml for node1 2026-08-18 15:36:18.400486 | node1 | 2026-08-18 15:36:18.400707 | node1 | TASK [vexxhost.ceph.rgw : Snapshot current RGW service specs] ****************** 2026-08-18 15:36:18.400745 | node1 | Tuesday 18 August 2026 15:36:18 +0000 (0:00:00.054) 0:02:45.603 ******** 2026-08-18 15:36:19.796613 | node1 | ok: [node1] 2026-08-18 15:36:19.796772 | node1 | 2026-08-18 15:36:19.796786 | node1 | TASK [vexxhost.ceph.rgw : Index current RGW specs by service name] ************* 2026-08-18 15:36:19.796801 | node1 | Tuesday 18 August 2026 15:36:19 +0000 (0:00:01.396) 0:02:46.999 ******** 2026-08-18 15:36:19.844007 | node1 | ok: [node1] 2026-08-18 15:36:19.844087 | node1 | 2026-08-18 15:36:19.844186 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 15:36:19.844283 | node1 | Tuesday 18 August 2026 15:36:19 +0000 (0:00:00.047) 0:02:47.047 ******** 2026-08-18 15:36:21.324741 | node1 | ok: [node1] => (item=molecule) 2026-08-18 15:36:21.324820 | node1 | 2026-08-18 15:36:21.325013 | node1 | TASK [vexxhost.ceph.rgw : Redeploy RGW services whose redeploy-triggering keys changed] *** 2026-08-18 15:36:21.325053 | node1 | Tuesday 18 August 2026 15:36:21 +0000 (0:00:01.480) 0:02:48.527 ******** 2026-08-18 15:36:21.382455 | node1 | skipping: [node1] => (item=rgw.molecule) 2026-08-18 15:36:21.383034 | node1 | skipping: [node1] 2026-08-18 15:36:21.383063 | node1 | 2026-08-18 15:36:21.383070 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone / zonegroup / pools] ********* 2026-08-18 15:36:21.383077 | node1 | Tuesday 18 August 2026 15:36:21 +0000 (0:00:00.057) 0:02:48.584 ******** 2026-08-18 15:36:21.433973 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/cleanup.yml for node1 2026-08-18 15:36:21.434071 | node1 | 2026-08-18 15:36:21.434281 | node1 | TASK [vexxhost.ceph.rgw : List RGW zones] ************************************** 2026-08-18 15:36:21.434328 | node1 | Tuesday 18 August 2026 15:36:21 +0000 (0:00:00.052) 0:02:48.636 ******** 2026-08-18 15:36:22.459951 | node1 | ok: [node1] 2026-08-18 15:36:22.460017 | node1 | 2026-08-18 15:36:22.460219 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zonegroup] ************************ 2026-08-18 15:36:22.460264 | node1 | Tuesday 18 August 2026 15:36:22 +0000 (0:00:01.025) 0:02:49.662 ******** 2026-08-18 15:36:22.503726 | node1 | skipping: [node1] 2026-08-18 15:36:22.503767 | node1 | 2026-08-18 15:36:22.504004 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone] ***************************** 2026-08-18 15:36:22.504048 | node1 | Tuesday 18 August 2026 15:36:22 +0000 (0:00:00.044) 0:02:49.706 ******** 2026-08-18 15:36:22.542803 | node1 | skipping: [node1] 2026-08-18 15:36:22.542853 | node1 | 2026-08-18 15:36:22.543090 | node1 | TASK [vexxhost.ceph.rgw : Get the current pool deletion setting] *************** 2026-08-18 15:36:22.543202 | node1 | Tuesday 18 August 2026 15:36:22 +0000 (0:00:00.038) 0:02:49.745 ******** 2026-08-18 15:36:22.581216 | node1 | skipping: [node1] 2026-08-18 15:36:22.581373 | node1 | 2026-08-18 15:36:22.581586 | node1 | TASK [vexxhost.ceph.rgw : Allow pool deletion] ********************************* 2026-08-18 15:36:22.581789 | node1 | Tuesday 18 August 2026 15:36:22 +0000 (0:00:00.038) 0:02:49.783 ******** 2026-08-18 15:36:22.614163 | node1 | skipping: [node1] 2026-08-18 15:36:22.614345 | node1 | 2026-08-18 15:36:22.614554 | node1 | TASK [vexxhost.ceph.rgw : Remove the default RGW pools] ************************ 2026-08-18 15:36:22.614753 | node1 | Tuesday 18 August 2026 15:36:22 +0000 (0:00:00.033) 0:02:49.816 ******** 2026-08-18 15:36:22.681724 | node1 | skipping: [node1] => (item=default.rgw.control) 2026-08-18 15:36:22.681887 | node1 | skipping: [node1] => (item=default.rgw.log) 2026-08-18 15:36:22.682080 | node1 | skipping: [node1] => (item=default.rgw.meta) 2026-08-18 15:36:22.682276 | node1 | skipping: [node1] 2026-08-18 15:36:22.682454 | node1 | 2026-08-18 15:36:22.682659 | node1 | TASK [vexxhost.ceph.rgw : Restore the configured pool deletion setting] ******** 2026-08-18 15:36:22.682884 | node1 | Tuesday 18 August 2026 15:36:22 +0000 (0:00:00.067) 0:02:49.884 ******** 2026-08-18 15:36:22.717047 | node1 | skipping: [node1] 2026-08-18 15:36:22.717190 | node1 | 2026-08-18 15:36:22.717395 | node1 | TASK [vexxhost.ceph.rgw : Remove the temporary pool deletion setting] ********** 2026-08-18 15:36:22.717593 | node1 | Tuesday 18 August 2026 15:36:22 +0000 (0:00:00.035) 0:02:49.919 ******** 2026-08-18 15:36:22.798664 | node1 | skipping: [node1] 2026-08-18 15:36:22.798799 | node1 | 2026-08-18 15:36:22.799015 | node1 | PLAY [Deploy Ceph monitoring stack] ******************************************** 2026-08-18 15:36:22.799197 | node1 | 2026-08-18 15:36:22.799450 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:36:22.799691 | node1 | Tuesday 18 August 2026 15:36:22 +0000 (0:00:00.081) 0:02:50.001 ******** 2026-08-18 15:36:23.772461 | node1 | ok: [node1] 2026-08-18 15:36:23.772651 | node1 | ok: [node2] 2026-08-18 15:36:23.772847 | node1 | ok: [node3] 2026-08-18 15:36:23.773027 | node1 | 2026-08-18 15:36:23.773258 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:36:23.773446 | node1 | Tuesday 18 August 2026 15:36:23 +0000 (0:00:00.973) 0:02:50.974 ******** 2026-08-18 15:36:23.999568 | node1 | ok: [node1] 2026-08-18 15:36:23.999737 | node1 | ok: [node2] 2026-08-18 15:36:23.999942 | node1 | ok: [node3] 2026-08-18 15:36:24.000136 | node1 | 2026-08-18 15:36:24.000338 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:36:24.000573 | node1 | Tuesday 18 August 2026 15:36:23 +0000 (0:00:00.227) 0:02:51.202 ******** 2026-08-18 15:36:24.065727 | node1 | skipping: [node1] 2026-08-18 15:36:24.065952 | node1 | skipping: [node2] 2026-08-18 15:36:24.066172 | node1 | skipping: [node3] 2026-08-18 15:36:24.066321 | node1 | 2026-08-18 15:36:24.066534 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:36:24.066721 | node1 | Tuesday 18 August 2026 15:36:24 +0000 (0:00:00.066) 0:02:51.268 ******** 2026-08-18 15:36:24.318034 | node1 | ok: [node1] 2026-08-18 15:36:24.318180 | node1 | ok: [node2] 2026-08-18 15:36:24.318381 | node1 | ok: [node3] 2026-08-18 15:36:24.318566 | node1 | 2026-08-18 15:36:24.318775 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:36:24.318976 | node1 | Tuesday 18 August 2026 15:36:24 +0000 (0:00:00.252) 0:02:51.520 ******** 2026-08-18 15:36:24.402281 | node1 | ok: [node1] => { 2026-08-18 15:36:24.402460 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:36:24.402657 | node1 | } 2026-08-18 15:36:24.402861 | node1 | ok: [node2] => { 2026-08-18 15:36:24.403072 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:36:24.403263 | node1 | } 2026-08-18 15:36:24.403462 | node1 | ok: [node3] => { 2026-08-18 15:36:24.403666 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:36:24.403855 | node1 | } 2026-08-18 15:36:24.404039 | node1 | 2026-08-18 15:36:24.404884 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:36:24.404904 | node1 | Tuesday 18 August 2026 15:36:24 +0000 (0:00:00.084) 0:02:51.605 ******** 2026-08-18 15:36:24.743633 | node1 | ok: [node1] 2026-08-18 15:36:24.743826 | node1 | ok: [node2] 2026-08-18 15:36:24.744040 | node1 | ok: [node3] 2026-08-18 15:36:24.744223 | node1 | 2026-08-18 15:36:24.744487 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:36:24.744737 | node1 | Tuesday 18 August 2026 15:36:24 +0000 (0:00:00.340) 0:02:51.945 ******** 2026-08-18 15:36:24.820310 | node1 | skipping: [node1] 2026-08-18 15:36:24.820587 | node1 | skipping: [node2] 2026-08-18 15:36:24.820794 | node1 | skipping: [node3] 2026-08-18 15:36:24.820972 | node1 | 2026-08-18 15:36:24.821178 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:36:24.821374 | node1 | Tuesday 18 August 2026 15:36:24 +0000 (0:00:00.077) 0:02:52.022 ******** 2026-08-18 15:36:24.908727 | node1 | skipping: [node1] 2026-08-18 15:36:24.908911 | node1 | skipping: [node2] 2026-08-18 15:36:24.909128 | node1 | skipping: [node3] 2026-08-18 15:36:24.909313 | node1 | 2026-08-18 15:36:24.909521 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:36:24.909721 | node1 | Tuesday 18 August 2026 15:36:24 +0000 (0:00:00.088) 0:02:52.111 ******** 2026-08-18 15:36:25.134550 | node1 | ok: [node1] 2026-08-18 15:36:25.134717 | node1 | ok: [node2] 2026-08-18 15:36:25.134911 | node1 | ok: [node3] 2026-08-18 15:36:25.135094 | node1 | 2026-08-18 15:36:25.135296 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:36:25.135494 | node1 | Tuesday 18 August 2026 15:36:25 +0000 (0:00:00.225) 0:02:52.337 ******** 2026-08-18 15:36:26.472323 | node1 | ok: [node1] 2026-08-18 15:36:26.472530 | node1 | ok: [node2] 2026-08-18 15:36:26.472742 | node1 | ok: [node3] 2026-08-18 15:36:26.472938 | node1 | 2026-08-18 15:36:26.473159 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:36:26.473368 | node1 | Tuesday 18 August 2026 15:36:26 +0000 (0:00:01.337) 0:02:53.674 ******** 2026-08-18 15:36:26.566953 | node1 | ok: [node1] => { 2026-08-18 15:36:26.567169 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:36:26.567362 | node1 | } 2026-08-18 15:36:26.567561 | node1 | ok: [node2] => { 2026-08-18 15:36:26.567773 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:36:26.567962 | node1 | } 2026-08-18 15:36:26.568160 | node1 | ok: [node3] => { 2026-08-18 15:36:26.568357 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:36:26.568581 | node1 | } 2026-08-18 15:36:26.568754 | node1 | 2026-08-18 15:36:26.568959 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:36:26.569182 | node1 | Tuesday 18 August 2026 15:36:26 +0000 (0:00:00.094) 0:02:53.769 ******** 2026-08-18 15:36:26.947937 | node1 | ok: [node1] 2026-08-18 15:36:26.948117 | node1 | ok: [node2] 2026-08-18 15:36:26.948312 | node1 | ok: [node3] 2026-08-18 15:36:26.948530 | node1 | 2026-08-18 15:36:26.948739 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:36:26.948942 | node1 | Tuesday 18 August 2026 15:36:26 +0000 (0:00:00.380) 0:02:54.150 ******** 2026-08-18 15:36:28.884816 | node1 | ok: [node1] 2026-08-18 15:36:28.885804 | node1 | ok: [node2] 2026-08-18 15:36:28.885871 | node1 | ok: [node3] 2026-08-18 15:36:28.885882 | node1 | 2026-08-18 15:36:28.885893 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:36:28.885903 | node1 | Tuesday 18 August 2026 15:36:28 +0000 (0:00:01.937) 0:02:56.087 ******** 2026-08-18 15:36:28.908437 | node1 | skipping: [node1] 2026-08-18 15:36:28.934530 | node1 | skipping: [node2] 2026-08-18 15:36:28.934606 | node1 | skipping: [node3] 2026-08-18 15:36:28.934741 | node1 | 2026-08-18 15:36:28.935046 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:36:28.935097 | node1 | Tuesday 18 August 2026 15:36:28 +0000 (0:00:00.050) 0:02:56.137 ******** 2026-08-18 15:36:28.987582 | node1 | skipping: [node1] 2026-08-18 15:36:28.988221 | node1 | skipping: [node2] 2026-08-18 15:36:28.988272 | node1 | skipping: [node3] 2026-08-18 15:36:28.988280 | node1 | 2026-08-18 15:36:28.988287 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:36:28.988293 | node1 | Tuesday 18 August 2026 15:36:28 +0000 (0:00:00.052) 0:02:56.190 ******** 2026-08-18 15:36:29.017920 | node1 | skipping: [node1] 2026-08-18 15:36:29.046337 | node1 | skipping: [node2] 2026-08-18 15:36:29.046401 | node1 | skipping: [node3] 2026-08-18 15:36:29.046478 | node1 | 2026-08-18 15:36:29.046591 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:36:29.046725 | node1 | Tuesday 18 August 2026 15:36:29 +0000 (0:00:00.058) 0:02:56.249 ******** 2026-08-18 15:36:30.312146 | node1 | ok: [node1] 2026-08-18 15:36:30.312192 | node1 | ok: [node2] 2026-08-18 15:36:30.312197 | node1 | ok: [node3] 2026-08-18 15:36:30.312201 | node1 | 2026-08-18 15:36:30.312206 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:36:30.312211 | node1 | Tuesday 18 August 2026 15:36:30 +0000 (0:00:01.265) 0:02:57.514 ******** 2026-08-18 15:36:30.740665 | node1 | ok: [node1] 2026-08-18 15:36:30.740725 | node1 | ok: [node2] 2026-08-18 15:36:30.740830 | node1 | ok: [node3] 2026-08-18 15:36:30.741116 | node1 | 2026-08-18 15:36:30.741132 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:36:30.741137 | node1 | Tuesday 18 August 2026 15:36:30 +0000 (0:00:00.428) 0:02:57.943 ******** 2026-08-18 15:36:31.627004 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:36:31.627069 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:36:31.627253 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:36:31.627326 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:36:31.627349 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:36:31.627936 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:36:31.628003 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:36:31.628014 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:36:31.628023 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:36:31.628032 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:36:31.628945 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:36:31.629264 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:36:31.629502 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:36:31.629740 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:36:31.629946 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:36:31.630143 | node1 | 2026-08-18 15:36:31.630361 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:36:31.630570 | node1 | Tuesday 18 August 2026 15:36:31 +0000 (0:00:00.885) 0:02:58.829 ******** 2026-08-18 15:36:32.238479 | node1 | ok: [node1] 2026-08-18 15:36:32.238669 | node1 | ok: [node2] 2026-08-18 15:36:32.238880 | node1 | ok: [node3] 2026-08-18 15:36:32.239078 | node1 | 2026-08-18 15:36:32.239316 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:36:32.239504 | node1 | Tuesday 18 August 2026 15:36:32 +0000 (0:00:00.596) 0:02:59.425 ******** 2026-08-18 15:36:32.239678 | node1 | 2026-08-18 15:36:32.239895 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:36:32.240090 | node1 | Tuesday 18 August 2026 15:36:32 +0000 (0:00:00.004) 0:02:59.430 ******** 2026-08-18 15:36:32.240334 | node1 | 2026-08-18 15:36:32.240600 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:36:32.240804 | node1 | Tuesday 18 August 2026 15:36:32 +0000 (0:00:00.004) 0:02:59.435 ******** 2026-08-18 15:36:32.240993 | node1 | 2026-08-18 15:36:32.241194 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:36:32.241396 | node1 | Tuesday 18 August 2026 15:36:32 +0000 (0:00:00.005) 0:02:59.441 ******** 2026-08-18 15:36:32.604092 | node1 | ok: [node3] 2026-08-18 15:36:32.604244 | node1 | ok: [node2] 2026-08-18 15:36:32.604583 | node1 | ok: [node1] 2026-08-18 15:36:32.604736 | node1 | 2026-08-18 15:36:32.604992 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:36:32.605139 | node1 | Tuesday 18 August 2026 15:36:32 +0000 (0:00:00.365) 0:02:59.806 ******** 2026-08-18 15:36:32.829374 | node1 | ok: [node1] 2026-08-18 15:36:32.829542 | node1 | ok: [node2] 2026-08-18 15:36:32.829754 | node1 | ok: [node3] 2026-08-18 15:36:32.829929 | node1 | 2026-08-18 15:36:32.830127 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:36:32.830328 | node1 | Tuesday 18 August 2026 15:36:32 +0000 (0:00:00.225) 0:03:00.032 ******** 2026-08-18 15:36:32.988238 | node1 | ok: [node2] => { 2026-08-18 15:36:32.988467 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:36:32.988685 | node1 | } 2026-08-18 15:36:32.988882 | node1 | ok: [node3] => { 2026-08-18 15:36:32.989092 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:36:32.989270 | node1 | } 2026-08-18 15:36:32.989468 | node1 | ok: [node1] => { 2026-08-18 15:36:32.989692 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:36:32.989863 | node1 | } 2026-08-18 15:36:32.990039 | node1 | 2026-08-18 15:36:32.990241 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:36:32.990438 | node1 | Tuesday 18 August 2026 15:36:32 +0000 (0:00:00.158) 0:03:00.190 ******** 2026-08-18 15:36:33.424209 | node1 | ok: [node1] 2026-08-18 15:36:33.424456 | node1 | ok: [node2] 2026-08-18 15:36:33.424618 | node1 | ok: [node3] 2026-08-18 15:36:33.424800 | node1 | 2026-08-18 15:36:33.425035 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:36:33.425235 | node1 | Tuesday 18 August 2026 15:36:33 +0000 (0:00:00.435) 0:03:00.626 ******** 2026-08-18 15:36:36.586528 | node1 | ok: [node2] 2026-08-18 15:36:36.586593 | node1 | ok: [node1] 2026-08-18 15:36:36.586683 | node1 | ok: [node3] 2026-08-18 15:36:36.586773 | node1 | 2026-08-18 15:36:36.586869 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:36:36.586962 | node1 | Tuesday 18 August 2026 15:36:36 +0000 (0:00:03.162) 0:03:03.789 ******** 2026-08-18 15:36:37.812387 | node1 | ok: [node2] 2026-08-18 15:36:37.812455 | node1 | ok: [node1] 2026-08-18 15:36:37.812466 | node1 | ok: [node3] 2026-08-18 15:36:37.812475 | node1 | 2026-08-18 15:36:37.812833 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:36:37.812899 | node1 | Tuesday 18 August 2026 15:36:37 +0000 (0:00:01.224) 0:03:05.014 ******** 2026-08-18 15:36:38.029845 | node1 | ok: [node1] 2026-08-18 15:36:38.029954 | node1 | ok: [node2] 2026-08-18 15:36:38.030478 | node1 | ok: [node3] 2026-08-18 15:36:38.030529 | node1 | 2026-08-18 15:36:38.030537 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:36:38.030544 | node1 | Tuesday 18 August 2026 15:36:38 +0000 (0:00:00.218) 0:03:05.232 ******** 2026-08-18 15:36:38.494448 | node1 | ok: [node1] 2026-08-18 15:36:38.494514 | node1 | ok: [node2] 2026-08-18 15:36:38.494588 | node1 | ok: [node3] 2026-08-18 15:36:38.494874 | node1 | 2026-08-18 15:36:38.494915 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:36:38.494921 | node1 | Tuesday 18 August 2026 15:36:38 +0000 (0:00:00.464) 0:03:05.697 ******** 2026-08-18 15:36:39.088518 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:36:39.088577 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:36:39.088595 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:36:39.089681 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:36:39.089706 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:36:39.089713 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:36:39.089719 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:36:39.089740 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:36:39.089746 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:36:39.089752 | node1 | 2026-08-18 15:36:39.089759 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:36:39.089764 | node1 | Tuesday 18 August 2026 15:36:39 +0000 (0:00:00.593) 0:03:06.290 ******** 2026-08-18 15:36:39.521801 | node1 | ok: [node1] 2026-08-18 15:36:39.521924 | node1 | ok: [node2] 2026-08-18 15:36:39.522489 | node1 | ok: [node3] 2026-08-18 15:36:39.522556 | node1 | 2026-08-18 15:36:39.522565 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:36:39.522573 | node1 | Tuesday 18 August 2026 15:36:39 +0000 (0:00:00.433) 0:03:06.723 ******** 2026-08-18 15:36:39.978952 | node1 | ok: [node1] 2026-08-18 15:36:39.979059 | node1 | ok: [node2] 2026-08-18 15:36:39.979071 | node1 | ok: [node3] 2026-08-18 15:36:39.979134 | node1 | 2026-08-18 15:36:39.980117 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:36:39.980176 | node1 | Tuesday 18 August 2026 15:36:39 +0000 (0:00:00.439) 0:03:07.163 ******** 2026-08-18 15:36:39.980181 | node1 | 2026-08-18 15:36:39.980186 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:36:39.980190 | node1 | Tuesday 18 August 2026 15:36:39 +0000 (0:00:00.006) 0:03:07.170 ******** 2026-08-18 15:36:39.980194 | node1 | 2026-08-18 15:36:39.980198 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:36:39.980202 | node1 | Tuesday 18 August 2026 15:36:39 +0000 (0:00:00.005) 0:03:07.175 ******** 2026-08-18 15:36:39.980206 | node1 | 2026-08-18 15:36:39.980211 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:36:39.980242 | node1 | Tuesday 18 August 2026 15:36:39 +0000 (0:00:00.005) 0:03:07.181 ******** 2026-08-18 15:36:40.371468 | node1 | ok: [node1] 2026-08-18 15:36:40.371541 | node1 | ok: [node2] 2026-08-18 15:36:40.371923 | node1 | ok: [node3] 2026-08-18 15:36:40.371968 | node1 | 2026-08-18 15:36:40.371974 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:36:40.371979 | node1 | Tuesday 18 August 2026 15:36:40 +0000 (0:00:00.392) 0:03:07.574 ******** 2026-08-18 15:36:40.426771 | node1 | ok: [node1] => { 2026-08-18 15:36:40.428077 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:36:40.428128 | node1 | } 2026-08-18 15:36:40.428136 | node1 | ok: [node2] => { 2026-08-18 15:36:40.428142 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:36:40.428148 | node1 | } 2026-08-18 15:36:40.428153 | node1 | ok: [node3] => { 2026-08-18 15:36:40.428159 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:36:40.428164 | node1 | } 2026-08-18 15:36:40.428170 | node1 | 2026-08-18 15:36:40.428176 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:36:40.428182 | node1 | Tuesday 18 August 2026 15:36:40 +0000 (0:00:00.055) 0:03:07.629 ******** 2026-08-18 15:36:40.722392 | node1 | ok: [node1] 2026-08-18 15:36:40.722451 | node1 | ok: [node2] 2026-08-18 15:36:40.722877 | node1 | ok: [node3] 2026-08-18 15:36:40.722963 | node1 | 2026-08-18 15:36:40.722969 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:36:40.722975 | node1 | Tuesday 18 August 2026 15:36:40 +0000 (0:00:00.294) 0:03:07.924 ******** 2026-08-18 15:36:40.750678 | node1 | skipping: [node1] 2026-08-18 15:36:40.789469 | node1 | skipping: [node2] 2026-08-18 15:36:40.789538 | node1 | skipping: [node3] 2026-08-18 15:36:40.789630 | node1 | 2026-08-18 15:36:40.789731 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:36:40.789870 | node1 | Tuesday 18 August 2026 15:36:40 +0000 (0:00:00.068) 0:03:07.992 ******** 2026-08-18 15:36:40.872993 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:36:40.873070 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:36:40.873410 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 15:36:40.873445 | node1 | 2026-08-18 15:36:40.873460 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:36:40.873479 | node1 | Tuesday 18 August 2026 15:36:40 +0000 (0:00:00.083) 0:03:08.075 ******** 2026-08-18 15:36:42.075070 | node1 | ok: [node1] 2026-08-18 15:36:42.075206 | node1 | ok: [node2] 2026-08-18 15:36:42.075760 | node1 | ok: [node3] 2026-08-18 15:36:42.076071 | node1 | 2026-08-18 15:36:42.076081 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:36:42.076088 | node1 | Tuesday 18 August 2026 15:36:42 +0000 (0:00:01.202) 0:03:09.277 ******** 2026-08-18 15:36:43.735858 | node1 | ok: [node1] => (item=chronyd) 2026-08-18 15:36:43.735936 | node1 | ok: [node2] => (item=chronyd) 2026-08-18 15:36:43.735948 | node1 | ok: [node3] => (item=chronyd) 2026-08-18 15:36:43.736459 | node1 | ok: [node1] => (item=sshd) 2026-08-18 15:36:43.736520 | node1 | ok: [node2] => (item=sshd) 2026-08-18 15:36:43.736527 | node1 | ok: [node3] => (item=sshd) 2026-08-18 15:36:43.736534 | node1 | 2026-08-18 15:36:43.736540 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:36:43.736552 | node1 | Tuesday 18 August 2026 15:36:43 +0000 (0:00:01.660) 0:03:10.938 ******** 2026-08-18 15:36:43.960526 | node1 | ok: [node1] 2026-08-18 15:36:43.960622 | node1 | ok: [node2] 2026-08-18 15:36:43.960758 | node1 | ok: [node3] 2026-08-18 15:36:43.960878 | node1 | 2026-08-18 15:36:43.961018 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:36:43.961161 | node1 | Tuesday 18 August 2026 15:36:43 +0000 (0:00:00.224) 0:03:11.163 ******** 2026-08-18 15:36:44.204031 | node1 | ok: [node1] 2026-08-18 15:36:44.204224 | node1 | ok: [node2] 2026-08-18 15:36:44.204472 | node1 | ok: [node3] 2026-08-18 15:36:44.204662 | node1 | 2026-08-18 15:36:44.204878 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:36:44.205079 | node1 | Tuesday 18 August 2026 15:36:44 +0000 (0:00:00.243) 0:03:11.406 ******** 2026-08-18 15:36:44.650444 | node1 | ok: [node1] 2026-08-18 15:36:44.650630 | node1 | ok: [node2] 2026-08-18 15:36:44.650889 | node1 | ok: [node3] 2026-08-18 15:36:44.651078 | node1 | 2026-08-18 15:36:44.651296 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:36:44.651500 | node1 | Tuesday 18 August 2026 15:36:44 +0000 (0:00:00.446) 0:03:11.852 ******** 2026-08-18 15:36:44.704668 | node1 | skipping: [node1] 2026-08-18 15:36:44.704855 | node1 | skipping: [node2] 2026-08-18 15:36:44.705047 | node1 | skipping: [node3] 2026-08-18 15:36:44.705231 | node1 | 2026-08-18 15:36:44.705439 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:36:44.705638 | node1 | Tuesday 18 August 2026 15:36:44 +0000 (0:00:00.054) 0:03:11.907 ******** 2026-08-18 15:36:45.064067 | node1 | ok: [node1] 2026-08-18 15:36:45.064248 | node1 | ok: [node2] 2026-08-18 15:36:45.064493 | node1 | ok: [node3] 2026-08-18 15:36:45.064686 | node1 | 2026-08-18 15:36:45.064916 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:36:45.065107 | node1 | Tuesday 18 August 2026 15:36:45 +0000 (0:00:00.359) 0:03:12.266 ******** 2026-08-18 15:36:45.518127 | node1 | ok: [node1] 2026-08-18 15:36:45.518280 | node1 | ok: [node3] 2026-08-18 15:36:45.518516 | node1 | ok: [node2] 2026-08-18 15:36:45.518705 | node1 | 2026-08-18 15:36:45.518919 | node1 | TASK [vexxhost.ceph.monitoring : Locate the cluster admin host] **************** 2026-08-18 15:36:45.519137 | node1 | Tuesday 18 August 2026 15:36:45 +0000 (0:00:00.453) 0:03:12.720 ******** 2026-08-18 15:36:46.097617 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:36:46.097760 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:36:46.097774 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:36:46.097787 | node1 | 2026-08-18 15:36:46.097887 | node1 | TASK [vexxhost.ceph.monitoring : Select the admin host] ************************ 2026-08-18 15:36:46.097974 | node1 | Tuesday 18 August 2026 15:36:46 +0000 (0:00:00.579) 0:03:13.300 ******** 2026-08-18 15:36:46.176235 | node1 | ok: [node1] 2026-08-18 15:36:46.176367 | node1 | ok: [node2] 2026-08-18 15:36:46.176595 | node1 | ok: [node3] 2026-08-18 15:36:46.176775 | node1 | 2026-08-18 15:36:46.176976 | node1 | TASK [vexxhost.ceph.monitoring : Set the admin mon config path] **************** 2026-08-18 15:36:46.177173 | node1 | Tuesday 18 August 2026 15:36:46 +0000 (0:00:00.078) 0:03:13.378 ******** 2026-08-18 15:36:46.245858 | node1 | ok: [node1] 2026-08-18 15:36:46.246008 | node1 | ok: [node2] 2026-08-18 15:36:46.246220 | node1 | ok: [node3] 2026-08-18 15:36:46.246419 | node1 | 2026-08-18 15:36:46.246656 | node1 | TASK [vexxhost.ceph.monitoring : Pin monitoring container images] ************** 2026-08-18 15:36:46.246881 | node1 | Tuesday 18 August 2026 15:36:46 +0000 (0:00:00.069) 0:03:13.448 ******** 2026-08-18 15:36:46.277805 | node1 | skipping: [node1] 2026-08-18 15:36:46.277994 | node1 | 2026-08-18 15:36:46.278205 | node1 | TASK [vexxhost.ceph.monitoring : Apply the monitoring service specs] *********** 2026-08-18 15:36:46.278396 | node1 | Tuesday 18 August 2026 15:36:46 +0000 (0:00:00.032) 0:03:13.480 ******** 2026-08-18 15:36:47.724423 | node1 | ok: [node1] => (item=ceph-exporter) 2026-08-18 15:36:47.724613 | node1 | 2026-08-18 15:36:47.724819 | node1 | PLAY RECAP ********************************************************************* 2026-08-18 15:36:47.725047 | node1 | node1 : ok=231 changed=0 unreachable=0 failed=0 skipped=57 rescued=0 ignored=0 2026-08-18 15:36:47.725266 | node1 | node2 : ok=200 changed=0 unreachable=0 failed=0 skipped=39 rescued=0 ignored=0 2026-08-18 15:36:47.725505 | node1 | node3 : ok=200 changed=0 unreachable=0 failed=0 skipped=39 rescued=0 ignored=0 2026-08-18 15:36:47.725828 | node1 | 2026-08-18 15:36:47.726010 | node1 | 2026-08-18 15:36:47.726208 | node1 | TASKS RECAP ******************************************************************** 2026-08-18 15:36:47.726430 | node1 | Tuesday 18 August 2026 15:36:47 +0000 (0:00:01.446) 0:03:14.927 ******** 2026-08-18 15:36:47.726618 | node1 | =============================================================================== 2026-08-18 15:36:47.726815 | node1 | vexxhost.ceph.configure : Configure pools ------------------------------ 30.04s 2026-08-18 15:36:47.727014 | node1 | vexxhost.ceph.mgr : Configure ceph-mgr modules ------------------------- 10.10s 2026-08-18 15:36:47.727205 | node1 | vexxhost.ceph.configure : Apply central Ceph configuration -------------- 8.38s 2026-08-18 15:36:47.727402 | node1 | vexxhost.ceph.configure : Configure dashboard users --------------------- 6.15s 2026-08-18 15:36:47.727601 | node1 | vexxhost.ceph.configure : Configure CRUSH rules ------------------------- 4.30s 2026-08-18 15:36:47.727801 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.16s 2026-08-18 15:36:47.727998 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.15s 2026-08-18 15:36:47.728192 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.14s 2026-08-18 15:36:47.728502 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.10s 2026-08-18 15:36:47.728702 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.09s 2026-08-18 15:36:47.728900 | node1 | vexxhost.ceph.rgw : Configure RGW zones --------------------------------- 2.74s 2026-08-18 15:36:47.729096 | node1 | vexxhost.ceph.rgw : Configure RGW zonegroups ---------------------------- 1.99s 2026-08-18 15:36:47.729273 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.95s 2026-08-18 15:36:47.729397 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.95s 2026-08-18 15:36:47.729519 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.94s 2026-08-18 15:36:47.729640 | node1 | vexxhost.ceph.cephadm : Ensure services are started --------------------- 1.66s 2026-08-18 15:36:47.729762 | node1 | vexxhost.ceph.mon : Apply the monitor service spec ---------------------- 1.59s 2026-08-18 15:36:47.729888 | node1 | vexxhost.ceph.cephadm_host : Register the host (labels) ----------------- 1.59s 2026-08-18 15:36:47.730011 | node1 | vexxhost.ceph.mon : Wait for this monitor's daemon to be present -------- 1.58s 2026-08-18 15:36:47.730134 | node1 | vexxhost.ceph.configure : Get the current dashboard certificate --------- 1.55s 2026-08-18 15:36:47.821857 | node1 | INFO [default > idempotence] Executed: Successful 2026-08-18 15:36:47.832206 | node1 | INFO [default > side_effect] Executing 2026-08-18 15:36:47.832683 | node1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 15:36:47.839479 | node1 | INFO [default > verify] Executing 2026-08-18 15:36:48.463293 | node1 | 2026-08-18 15:36:48.463436 | node1 | PLAY [Verify the deployed Ceph cluster] **************************************** 2026-08-18 15:36:48.463628 | node1 | 2026-08-18 15:36:48.463837 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:36:48.464047 | node1 | Tuesday 18 August 2026 15:36:48 +0000 (0:00:00.007) 0:00:00.007 ******** 2026-08-18 15:36:49.576551 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python 2026-08-18 15:36:49.576779 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 15:36:49.577008 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:36:49.577265 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:36:49.577569 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:36:49.586024 | node1 | ok: [node1] 2026-08-18 15:36:49.586227 | node1 | 2026-08-18 15:36:49.586446 | node1 | TASK [Get cluster health] ****************************************************** 2026-08-18 15:36:49.586619 | node1 | Tuesday 18 August 2026 15:36:49 +0000 (0:00:01.122) 0:00:01.129 ******** 2026-08-18 15:36:51.201282 | node1 | ok: [node1] 2026-08-18 15:36:51.201358 | node1 | 2026-08-18 15:36:51.201505 | node1 | TASK [Assert the cluster is HEALTH_OK] ***************************************** 2026-08-18 15:36:51.201635 | node1 | Tuesday 18 August 2026 15:36:51 +0000 (0:00:01.614) 0:00:02.744 ******** 2026-08-18 15:36:51.235467 | node1 | ok: [node1] => { 2026-08-18 15:36:51.235662 | node1 | "changed": false, 2026-08-18 15:36:51.235861 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:51.236052 | node1 | } 2026-08-18 15:36:51.236236 | node1 | 2026-08-18 15:36:51.236476 | node1 | TASK [Get monitor quorum] ****************************************************** 2026-08-18 15:36:51.236812 | node1 | Tuesday 18 August 2026 15:36:51 +0000 (0:00:00.034) 0:00:02.778 ******** 2026-08-18 15:36:52.789075 | node1 | ok: [node1] 2026-08-18 15:36:52.789309 | node1 | 2026-08-18 15:36:52.789586 | node1 | TASK [Assert every monitor is in quorum] *************************************** 2026-08-18 15:36:52.789977 | node1 | Tuesday 18 August 2026 15:36:52 +0000 (0:00:01.553) 0:00:04.332 ******** 2026-08-18 15:36:52.824086 | node1 | ok: [node1] => { 2026-08-18 15:36:52.824289 | node1 | "changed": false, 2026-08-18 15:36:52.824582 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:52.824786 | node1 | } 2026-08-18 15:36:52.824975 | node1 | 2026-08-18 15:36:52.825187 | node1 | TASK [Get manager status] ****************************************************** 2026-08-18 15:36:52.825388 | node1 | Tuesday 18 August 2026 15:36:52 +0000 (0:00:00.035) 0:00:04.368 ******** 2026-08-18 15:36:54.314320 | node1 | ok: [node1] 2026-08-18 15:36:54.314413 | node1 | 2026-08-18 15:36:54.314427 | node1 | TASK [Assert a manager is active] ********************************************** 2026-08-18 15:36:54.314438 | node1 | Tuesday 18 August 2026 15:36:54 +0000 (0:00:01.488) 0:00:05.856 ******** 2026-08-18 15:36:54.349210 | node1 | ok: [node1] => { 2026-08-18 15:36:54.349266 | node1 | "changed": false, 2026-08-18 15:36:54.349272 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:54.349279 | node1 | } 2026-08-18 15:36:54.349284 | node1 | 2026-08-18 15:36:54.349289 | node1 | TASK [Get OSD stat] ************************************************************ 2026-08-18 15:36:54.349295 | node1 | Tuesday 18 August 2026 15:36:54 +0000 (0:00:00.035) 0:00:05.891 ******** 2026-08-18 15:36:55.685130 | node1 | ok: [node1] 2026-08-18 15:36:55.685177 | node1 | 2026-08-18 15:36:55.685185 | node1 | TASK [Assert all OSDs are up and in] ******************************************* 2026-08-18 15:36:55.685191 | node1 | Tuesday 18 August 2026 15:36:55 +0000 (0:00:01.336) 0:00:07.228 ******** 2026-08-18 15:36:55.720528 | node1 | ok: [node1] => { 2026-08-18 15:36:55.720602 | node1 | "changed": false, 2026-08-18 15:36:55.720614 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:55.720624 | node1 | } 2026-08-18 15:36:55.720634 | node1 | 2026-08-18 15:36:55.720643 | node1 | TASK [List orchestrator services] ********************************************** 2026-08-18 15:36:55.720653 | node1 | Tuesday 18 August 2026 15:36:55 +0000 (0:00:00.035) 0:00:07.263 ******** 2026-08-18 15:36:57.150907 | node1 | ok: [node1] 2026-08-18 15:36:57.150976 | node1 | 2026-08-18 15:36:57.151289 | node1 | TASK [Assert every orchestrator service has all its daemons running] *********** 2026-08-18 15:36:57.151338 | node1 | Tuesday 18 August 2026 15:36:57 +0000 (0:00:01.430) 0:00:08.694 ******** 2026-08-18 15:36:57.272717 | node1 | ok: [node1] => (item=ceph-exporter) => { 2026-08-18 15:36:57.272807 | node1 | "ansible_loop_var": "item", 2026-08-18 15:36:57.275959 | node1 | "changed": false, 2026-08-18 15:36:57.275973 | node1 | "item": { 2026-08-18 15:36:57.275978 | node1 | "events": [ 2026-08-18 15:36:57.275982 | node1 | "2026-08-18T15:33:40.542891Z service:ceph-exporter [INFO] \"service was created\"" 2026-08-18 15:36:57.275987 | node1 | ], 2026-08-18 15:36:57.275991 | node1 | "placement": { 2026-08-18 15:36:57.275995 | node1 | "host_pattern": "*" 2026-08-18 15:36:57.276000 | node1 | }, 2026-08-18 15:36:57.276004 | node1 | "service_name": "ceph-exporter", 2026-08-18 15:36:57.276008 | node1 | "service_type": "ceph-exporter", 2026-08-18 15:36:57.276012 | node1 | "spec": { 2026-08-18 15:36:57.276016 | node1 | "prio_limit": 5, 2026-08-18 15:36:57.276020 | node1 | "stats_period": 5 2026-08-18 15:36:57.276024 | node1 | }, 2026-08-18 15:36:57.276028 | node1 | "status": { 2026-08-18 15:36:57.276032 | node1 | "created": "2026-08-18T15:33:31.469998Z", 2026-08-18 15:36:57.276036 | node1 | "last_refresh": "2026-08-18T15:33:46.149826Z", 2026-08-18 15:36:57.276040 | node1 | "ports": [ 2026-08-18 15:36:57.276044 | node1 | 9926 2026-08-18 15:36:57.276048 | node1 | ], 2026-08-18 15:36:57.276052 | node1 | "running": 3, 2026-08-18 15:36:57.276056 | node1 | "size": 3 2026-08-18 15:36:57.276060 | node1 | } 2026-08-18 15:36:57.276064 | node1 | }, 2026-08-18 15:36:57.276068 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:57.276072 | node1 | } 2026-08-18 15:36:57.276076 | node1 | ok: [node1] => (item=crash) => { 2026-08-18 15:36:57.276080 | node1 | "ansible_loop_var": "item", 2026-08-18 15:36:57.276084 | node1 | "changed": false, 2026-08-18 15:36:57.276088 | node1 | "item": { 2026-08-18 15:36:57.276092 | node1 | "placement": { 2026-08-18 15:36:57.276096 | node1 | "host_pattern": "*" 2026-08-18 15:36:57.276100 | node1 | }, 2026-08-18 15:36:57.276104 | node1 | "service_name": "crash", 2026-08-18 15:36:57.276107 | node1 | "service_type": "crash", 2026-08-18 15:36:57.276111 | node1 | "status": { 2026-08-18 15:36:57.276115 | node1 | "created": "2026-08-18T15:23:40.396420Z", 2026-08-18 15:36:57.276122 | node1 | "last_refresh": "2026-08-18T15:33:46.150192Z", 2026-08-18 15:36:57.276126 | node1 | "running": 3, 2026-08-18 15:36:57.276131 | node1 | "size": 3 2026-08-18 15:36:57.276250 | node1 | } 2026-08-18 15:36:57.276419 | node1 | }, 2026-08-18 15:36:57.276539 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:57.276653 | node1 | } 2026-08-18 15:36:57.276769 | node1 | ok: [node1] => (item=mgr) => { 2026-08-18 15:36:57.276884 | node1 | "ansible_loop_var": "item", 2026-08-18 15:36:57.276998 | node1 | "changed": false, 2026-08-18 15:36:57.277112 | node1 | "item": { 2026-08-18 15:36:57.277254 | node1 | "placement": { 2026-08-18 15:36:57.277373 | node1 | "label": "mgr" 2026-08-18 15:36:57.277485 | node1 | }, 2026-08-18 15:36:57.277600 | node1 | "service_name": "mgr", 2026-08-18 15:36:57.277715 | node1 | "service_type": "mgr", 2026-08-18 15:36:57.277827 | node1 | "status": { 2026-08-18 15:36:57.277944 | node1 | "created": "2026-08-18T15:24:31.158559Z", 2026-08-18 15:36:57.278062 | node1 | "last_refresh": "2026-08-18T15:33:46.150358Z", 2026-08-18 15:36:57.278190 | node1 | "running": 3, 2026-08-18 15:36:57.278303 | node1 | "size": 3 2026-08-18 15:36:57.278414 | node1 | } 2026-08-18 15:36:57.278531 | node1 | }, 2026-08-18 15:36:57.278646 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:57.278757 | node1 | } 2026-08-18 15:36:57.278870 | node1 | ok: [node1] => (item=mon) => { 2026-08-18 15:36:57.278985 | node1 | "ansible_loop_var": "item", 2026-08-18 15:36:57.279098 | node1 | "changed": false, 2026-08-18 15:36:57.279211 | node1 | "item": { 2026-08-18 15:36:57.279323 | node1 | "placement": { 2026-08-18 15:36:57.279435 | node1 | "label": "mon" 2026-08-18 15:36:57.279546 | node1 | }, 2026-08-18 15:36:57.279665 | node1 | "service_name": "mon", 2026-08-18 15:36:57.279781 | node1 | "service_type": "mon", 2026-08-18 15:36:57.279893 | node1 | "status": { 2026-08-18 15:36:57.280007 | node1 | "created": "2026-08-18T15:24:15.048658Z", 2026-08-18 15:36:57.280124 | node1 | "last_refresh": "2026-08-18T15:33:46.149655Z", 2026-08-18 15:36:57.280237 | node1 | "running": 3, 2026-08-18 15:36:57.280351 | node1 | "size": 3 2026-08-18 15:36:57.280479 | node1 | } 2026-08-18 15:36:57.280592 | node1 | }, 2026-08-18 15:36:57.280707 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:57.280819 | node1 | } 2026-08-18 15:36:57.280936 | node1 | ok: [node1] => (item=osd.default) => { 2026-08-18 15:36:57.281050 | node1 | "ansible_loop_var": "item", 2026-08-18 15:36:57.281164 | node1 | "changed": false, 2026-08-18 15:36:57.281290 | node1 | "item": { 2026-08-18 15:36:57.281404 | node1 | "placement": { 2026-08-18 15:36:57.281518 | node1 | "host_pattern": "node1" 2026-08-18 15:36:57.281635 | node1 | }, 2026-08-18 15:36:57.281750 | node1 | "service_id": "default", 2026-08-18 15:36:57.282148 | node1 | "service_name": "osd.default", 2026-08-18 15:36:57.282272 | node1 | "service_type": "osd", 2026-08-18 15:36:57.282389 | node1 | "spec": { 2026-08-18 15:36:57.282506 | node1 | "data_devices": { 2026-08-18 15:36:57.282621 | node1 | "paths": [ 2026-08-18 15:36:57.282738 | node1 | "/dev/ceph-node1-osd0/data" 2026-08-18 15:36:57.282851 | node1 | ] 2026-08-18 15:36:57.282963 | node1 | }, 2026-08-18 15:36:57.283079 | node1 | "filter_logic": "AND", 2026-08-18 15:36:57.283194 | node1 | "objectstore": "bluestore" 2026-08-18 15:36:57.283306 | node1 | }, 2026-08-18 15:36:57.283419 | node1 | "status": { 2026-08-18 15:36:57.283536 | node1 | "created": "2026-08-18T15:25:11.623355Z", 2026-08-18 15:36:57.283654 | node1 | "last_refresh": "2026-08-18T15:33:46.149059Z", 2026-08-18 15:36:57.283767 | node1 | "running": 9, 2026-08-18 15:36:57.283879 | node1 | "size": 9 2026-08-18 15:36:57.283991 | node1 | } 2026-08-18 15:36:57.284103 | node1 | }, 2026-08-18 15:36:57.284219 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:57.284333 | node1 | } 2026-08-18 15:36:57.284467 | node1 | ok: [node1] => (item=rgw.molecule) => { 2026-08-18 15:36:57.284587 | node1 | "ansible_loop_var": "item", 2026-08-18 15:36:57.284703 | node1 | "changed": false, 2026-08-18 15:36:57.284817 | node1 | "item": { 2026-08-18 15:36:57.284931 | node1 | "events": [ 2026-08-18 15:36:57.285057 | node1 | "2026-08-18T15:33:15.601686Z service:rgw.molecule [INFO] \"service was created\"" 2026-08-18 15:36:57.285170 | node1 | ], 2026-08-18 15:36:57.285319 | node1 | "placement": { 2026-08-18 15:36:57.285436 | node1 | "count_per_host": 1, 2026-08-18 15:36:57.285549 | node1 | "label": "rgw" 2026-08-18 15:36:57.285661 | node1 | }, 2026-08-18 15:36:57.285776 | node1 | "service_id": "molecule", 2026-08-18 15:36:57.285891 | node1 | "service_name": "rgw.molecule", 2026-08-18 15:36:57.286007 | node1 | "service_type": "rgw", 2026-08-18 15:36:57.286119 | node1 | "spec": { 2026-08-18 15:36:57.286233 | node1 | "generate_cert": true, 2026-08-18 15:36:57.286351 | node1 | "rgw_exit_timeout_secs": 120, 2026-08-18 15:36:57.286466 | node1 | "rgw_frontend_port": 8080, 2026-08-18 15:36:57.286582 | node1 | "rgw_realm": "molecule", 2026-08-18 15:36:57.286697 | node1 | "rgw_zone": "molecule-1", 2026-08-18 15:36:57.286814 | node1 | "rgw_zonegroup": "molecule", 2026-08-18 15:36:57.286936 | node1 | "ssl": true 2026-08-18 15:36:57.287047 | node1 | }, 2026-08-18 15:36:57.287160 | node1 | "status": { 2026-08-18 15:36:57.287277 | node1 | "created": "2026-08-18T15:33:15.574178Z", 2026-08-18 15:36:57.287396 | node1 | "last_refresh": "2026-08-18T15:33:46.149456Z", 2026-08-18 15:36:57.287508 | node1 | "ports": [ 2026-08-18 15:36:57.287619 | node1 | 8080 2026-08-18 15:36:57.287730 | node1 | ], 2026-08-18 15:36:57.287842 | node1 | "running": 3, 2026-08-18 15:36:57.287955 | node1 | "size": 3 2026-08-18 15:36:57.288065 | node1 | } 2026-08-18 15:36:57.288176 | node1 | }, 2026-08-18 15:36:57.288292 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:57.288418 | node1 | } 2026-08-18 15:36:57.288529 | node1 | 2026-08-18 15:36:57.288645 | node1 | TASK [List pools] ************************************************************** 2026-08-18 15:36:57.288763 | node1 | Tuesday 18 August 2026 15:36:57 +0000 (0:00:00.121) 0:00:08.816 ******** 2026-08-18 15:36:58.641664 | node1 | ok: [node1] 2026-08-18 15:36:58.641745 | node1 | 2026-08-18 15:36:58.642087 | node1 | TASK [Assert every declared pool exists] *************************************** 2026-08-18 15:36:58.642135 | node1 | Tuesday 18 August 2026 15:36:58 +0000 (0:00:01.368) 0:00:10.185 ******** 2026-08-18 15:36:58.725860 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.data) => { 2026-08-18 15:36:58.728522 | node1 | "ansible_loop_var": "item", 2026-08-18 15:36:58.728590 | node1 | "changed": false, 2026-08-18 15:36:58.728603 | node1 | "item": { 2026-08-18 15:36:58.728613 | node1 | "application": "rgw", 2026-08-18 15:36:58.728624 | node1 | "name": "molecule-1.rgw.buckets.data", 2026-08-18 15:36:58.728636 | node1 | "pg_autoscale_mode": true, 2026-08-18 15:36:58.728645 | node1 | "rule_name": "replicated_rule", 2026-08-18 15:36:58.728654 | node1 | "type": "replicated" 2026-08-18 15:36:58.728666 | node1 | }, 2026-08-18 15:36:58.728675 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:58.728687 | node1 | } 2026-08-18 15:36:58.728700 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.index) => { 2026-08-18 15:36:58.728714 | node1 | "ansible_loop_var": "item", 2026-08-18 15:36:58.728728 | node1 | "changed": false, 2026-08-18 15:36:58.728738 | node1 | "item": { 2026-08-18 15:36:58.728748 | node1 | "application": "rgw", 2026-08-18 15:36:58.728759 | node1 | "name": "molecule-1.rgw.buckets.index", 2026-08-18 15:36:58.728769 | node1 | "pg_autoscale_mode": "off", 2026-08-18 15:36:58.728778 | node1 | "pg_num": 8, 2026-08-18 15:36:58.728788 | node1 | "pgp_num": 8, 2026-08-18 15:36:58.728798 | node1 | "rule_name": "replicated_rule", 2026-08-18 15:36:58.728808 | node1 | "type": "replicated" 2026-08-18 15:36:58.728818 | node1 | }, 2026-08-18 15:36:58.728827 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:58.728846 | node1 | } 2026-08-18 15:36:58.728856 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.non-ec) => { 2026-08-18 15:36:58.728866 | node1 | "ansible_loop_var": "item", 2026-08-18 15:36:58.728875 | node1 | "changed": false, 2026-08-18 15:36:58.728886 | node1 | "item": { 2026-08-18 15:36:58.729321 | node1 | "application": "rgw", 2026-08-18 15:36:58.729345 | node1 | "name": "molecule-1.rgw.buckets.non-ec", 2026-08-18 15:36:58.729356 | node1 | "pg_autoscale_mode": "off", 2026-08-18 15:36:58.729366 | node1 | "pg_num": 8, 2026-08-18 15:36:58.729378 | node1 | "pgp_num": 8, 2026-08-18 15:36:58.729428 | node1 | "rule_name": "replicated_rule", 2026-08-18 15:36:58.729560 | node1 | "type": "replicated" 2026-08-18 15:36:58.729677 | node1 | }, 2026-08-18 15:36:58.729796 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:58.729913 | node1 | } 2026-08-18 15:36:58.730055 | node1 | ok: [node1] => (item=molecule-1.rgw.control) => { 2026-08-18 15:36:58.730178 | node1 | "ansible_loop_var": "item", 2026-08-18 15:36:58.730308 | node1 | "changed": false, 2026-08-18 15:36:58.730428 | node1 | "item": { 2026-08-18 15:36:58.730547 | node1 | "application": "rgw", 2026-08-18 15:36:58.730666 | node1 | "name": "molecule-1.rgw.control", 2026-08-18 15:36:58.730785 | node1 | "pg_autoscale_mode": "off", 2026-08-18 15:36:58.730902 | node1 | "pg_num": 8, 2026-08-18 15:36:58.731018 | node1 | "pgp_num": 8, 2026-08-18 15:36:58.731150 | node1 | "rule_name": "replicated_rule", 2026-08-18 15:36:58.731267 | node1 | "type": "replicated" 2026-08-18 15:36:58.731394 | node1 | }, 2026-08-18 15:36:58.731518 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:58.731634 | node1 | } 2026-08-18 15:36:58.731756 | node1 | ok: [node1] => (item=molecule-1.rgw.log) => { 2026-08-18 15:36:58.731876 | node1 | "ansible_loop_var": "item", 2026-08-18 15:36:58.731994 | node1 | "changed": false, 2026-08-18 15:36:58.732109 | node1 | "item": { 2026-08-18 15:36:58.732227 | node1 | "application": "rgw", 2026-08-18 15:36:58.732346 | node1 | "name": "molecule-1.rgw.log", 2026-08-18 15:36:58.732497 | node1 | "pg_autoscale_mode": "off", 2026-08-18 15:36:58.732619 | node1 | "pg_num": 8, 2026-08-18 15:36:58.732737 | node1 | "pgp_num": 8, 2026-08-18 15:36:58.732856 | node1 | "rule_name": "replicated_rule", 2026-08-18 15:36:58.732974 | node1 | "type": "replicated" 2026-08-18 15:36:58.733088 | node1 | }, 2026-08-18 15:36:58.733206 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:58.733320 | node1 | } 2026-08-18 15:36:58.733441 | node1 | ok: [node1] => (item=molecule-1.rgw.meta) => { 2026-08-18 15:36:58.733560 | node1 | "ansible_loop_var": "item", 2026-08-18 15:36:58.733683 | node1 | "changed": false, 2026-08-18 15:36:58.733799 | node1 | "item": { 2026-08-18 15:36:58.733915 | node1 | "application": "rgw", 2026-08-18 15:36:58.734051 | node1 | "name": "molecule-1.rgw.meta", 2026-08-18 15:36:58.734169 | node1 | "pg_autoscale_mode": "off", 2026-08-18 15:36:58.734308 | node1 | "pg_num": 8, 2026-08-18 15:36:58.734421 | node1 | "pgp_num": 8, 2026-08-18 15:36:58.734535 | node1 | "rule_name": "replicated_rule", 2026-08-18 15:36:58.734647 | node1 | "type": "replicated" 2026-08-18 15:36:58.734759 | node1 | }, 2026-08-18 15:36:58.734875 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:58.734986 | node1 | } 2026-08-18 15:36:58.735095 | node1 | 2026-08-18 15:36:58.735212 | node1 | TASK [Get the RGW zonegroup] *************************************************** 2026-08-18 15:36:58.735329 | node1 | Tuesday 18 August 2026 15:36:58 +0000 (0:00:00.083) 0:00:10.269 ******** 2026-08-18 15:36:59.741988 | node1 | ok: [node1] 2026-08-18 15:36:59.742068 | node1 | 2026-08-18 15:36:59.742459 | node1 | TASK [Assert the zonegroup has a master zone] ********************************** 2026-08-18 15:36:59.742580 | node1 | Tuesday 18 August 2026 15:36:59 +0000 (0:00:01.016) 0:00:11.285 ******** 2026-08-18 15:36:59.803293 | node1 | ok: [node1] => { 2026-08-18 15:36:59.804043 | node1 | "changed": false, 2026-08-18 15:36:59.804077 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:59.804086 | node1 | } 2026-08-18 15:36:59.804092 | node1 | 2026-08-18 15:36:59.804099 | node1 | TASK [Probe the RGW S3 endpoint (anonymous)] *********************************** 2026-08-18 15:36:59.804106 | node1 | Tuesday 18 August 2026 15:36:59 +0000 (0:00:00.061) 0:00:11.346 ******** 2026-08-18 15:37:00.290589 | node1 | ok: [node1] 2026-08-18 15:37:00.290665 | node1 | 2026-08-18 15:37:00.290963 | node1 | TASK [Assert the RGW endpoint returns an S3 listing] *************************** 2026-08-18 15:37:00.290986 | node1 | Tuesday 18 August 2026 15:37:00 +0000 (0:00:00.487) 0:00:11.833 ******** 2026-08-18 15:37:00.334382 | node1 | ok: [node1] => { 2026-08-18 15:37:00.334493 | node1 | "changed": false, 2026-08-18 15:37:00.335112 | node1 | "msg": "All assertions passed" 2026-08-18 15:37:00.335133 | node1 | } 2026-08-18 15:37:00.335140 | node1 | 2026-08-18 15:37:00.335146 | node1 | TASK [Create a test pool] ****************************************************** 2026-08-18 15:37:00.335152 | node1 | Tuesday 18 August 2026 15:37:00 +0000 (0:00:00.044) 0:00:11.878 ******** 2026-08-18 15:37:09.289070 | node1 | changed: [node1] 2026-08-18 15:37:09.289140 | node1 | 2026-08-18 15:37:09.289230 | node1 | TASK [Create a test CephX key] ************************************************* 2026-08-18 15:37:09.289319 | node1 | Tuesday 18 August 2026 15:37:09 +0000 (0:00:08.953) 0:00:20.832 ******** 2026-08-18 15:37:12.317034 | node1 | changed: [node1] 2026-08-18 15:37:12.317180 | node1 | 2026-08-18 15:37:12.317408 | node1 | TASK [Read the test key back] ************************************************** 2026-08-18 15:37:12.317629 | node1 | Tuesday 18 August 2026 15:37:12 +0000 (0:00:03.028) 0:00:23.860 ******** 2026-08-18 15:37:14.008286 | node1 | ok: [node1] 2026-08-18 15:37:14.008343 | node1 | 2026-08-18 15:37:14.008355 | node1 | TASK [Assert the key info is correct] ****************************************** 2026-08-18 15:37:14.008366 | node1 | Tuesday 18 August 2026 15:37:14 +0000 (0:00:01.690) 0:00:25.551 ******** 2026-08-18 15:37:14.046821 | node1 | ok: [node1] => { 2026-08-18 15:37:14.048053 | node1 | "changed": false, 2026-08-18 15:37:14.048119 | node1 | "msg": "All assertions passed" 2026-08-18 15:37:14.048134 | node1 | } 2026-08-18 15:37:14.048145 | node1 | 2026-08-18 15:37:14.048156 | node1 | TASK [Remove the test CephX key] *********************************************** 2026-08-18 15:37:14.048167 | node1 | Tuesday 18 August 2026 15:37:14 +0000 (0:00:00.039) 0:00:25.590 ******** 2026-08-18 15:37:17.120460 | node1 | changed: [node1] 2026-08-18 15:37:17.120511 | node1 | 2026-08-18 15:37:17.120519 | node1 | PLAY RECAP ********************************************************************* 2026-08-18 15:37:17.120526 | node1 | node1 : ok=22 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-08-18 15:37:17.120538 | node1 | 2026-08-18 15:37:17.121807 | node1 | 2026-08-18 15:37:17.121866 | node1 | TASKS RECAP ******************************************************************** 2026-08-18 15:37:17.121878 | node1 | Tuesday 18 August 2026 15:37:17 +0000 (0:00:03.072) 0:00:28.663 ******** 2026-08-18 15:37:17.121888 | node1 | =============================================================================== 2026-08-18 15:37:17.121897 | node1 | Create a test pool ------------------------------------------------------ 8.95s 2026-08-18 15:37:17.121906 | node1 | Remove the test CephX key ----------------------------------------------- 3.07s 2026-08-18 15:37:17.121923 | node1 | Create a test CephX key ------------------------------------------------- 3.03s 2026-08-18 15:37:17.124462 | node1 | Read the test key back -------------------------------------------------- 1.69s 2026-08-18 15:37:17.124522 | node1 | Get cluster health ------------------------------------------------------ 1.61s 2026-08-18 15:37:17.124533 | node1 | Get monitor quorum ------------------------------------------------------ 1.55s 2026-08-18 15:37:17.124542 | node1 | Get manager status ------------------------------------------------------ 1.49s 2026-08-18 15:37:17.124551 | node1 | List orchestrator services ---------------------------------------------- 1.43s 2026-08-18 15:37:17.124560 | node1 | List pools -------------------------------------------------------------- 1.37s 2026-08-18 15:37:17.124568 | node1 | Get OSD stat ------------------------------------------------------------ 1.34s 2026-08-18 15:37:17.124577 | node1 | Gathering Facts --------------------------------------------------------- 1.12s 2026-08-18 15:37:17.124586 | node1 | Get the RGW zonegroup --------------------------------------------------- 1.02s 2026-08-18 15:37:17.124595 | node1 | Probe the RGW S3 endpoint (anonymous) ----------------------------------- 0.49s 2026-08-18 15:37:17.124604 | node1 | Assert every orchestrator service has all its daemons running ----------- 0.12s 2026-08-18 15:37:17.124612 | node1 | Assert every declared pool exists --------------------------------------- 0.08s 2026-08-18 15:37:17.124627 | node1 | Assert the zonegroup has a master zone ---------------------------------- 0.06s 2026-08-18 15:37:17.124849 | node1 | Assert the RGW endpoint returns an S3 listing --------------------------- 0.04s 2026-08-18 15:37:17.125238 | node1 | Assert the key info is correct ------------------------------------------ 0.04s 2026-08-18 15:37:17.125507 | node1 | Assert every monitor is in quorum --------------------------------------- 0.04s 2026-08-18 15:37:17.125767 | node1 | Assert a manager is active ---------------------------------------------- 0.04s 2026-08-18 15:37:17.203232 | node1 | INFO [default > verify] Executed: Successful 2026-08-18 15:37:17.214065 | node1 | INFO [default > cleanup] Executing 2026-08-18 15:37:17.214956 | node1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 15:37:17.220125 | node1 | INFO [default > destroy] Executing 2026-08-18 15:37:17.220241 | node1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-18 15:37:17.220393 | node1 | INFO [default > destroy] Executed: Successful 2026-08-18 15:37:17.220780 | node1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-08-18 15:37:27.729936 | node1 | ok: Runtime: 0:17:00.835668 2026-08-18 15:37:27.770983 | 2026-08-18 15:37:27.771075 | PLAY RECAP 2026-08-18 15:37:27.771128 | node1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 15:37:27.771153 | 2026-08-18 15:37:27.927130 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-18 15:37:27.948691 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-18 15:37:28.627669 | 2026-08-18 15:37:28.627817 | PLAY [all] 2026-08-18 15:37:28.640289 | 2026-08-18 15:37:28.640368 | TASK [fetch-output : Set log path for multiple nodes] 2026-08-18 15:37:28.694304 | node1 | ok 2026-08-18 15:37:28.699862 | node2 | ok 2026-08-18 15:37:28.715363 | node3 | ok 2026-08-18 15:37:28.721940 | 2026-08-18 15:37:28.722073 | TASK [fetch-output : Set log path for single node] 2026-08-18 15:37:28.758745 | node1 | skipping: Conditional result was False 2026-08-18 15:37:28.770175 | node2 | skipping: Conditional result was False 2026-08-18 15:37:28.770697 | node3 | skipping: Conditional result was False 2026-08-18 15:37:28.781213 | 2026-08-18 15:37:28.781351 | LOOP [fetch-output : Ensure local output dirs] 2026-08-18 15:37:29.161847 | node1 -> localhost | changed: "/var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/work/logs/node1" 2026-08-18 15:37:29.176083 | node2 -> localhost | changed: "/var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/work/logs/node2" 2026-08-18 15:37:29.181205 | node3 -> localhost | changed: "/var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/work/logs/node3" 2026-08-18 15:37:29.365526 | node1 -> localhost | changed: "/var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/work/artifacts" 2026-08-18 15:37:29.415683 | node2 -> localhost | ok: "/var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/work/artifacts" 2026-08-18 15:37:29.427163 | node3 -> localhost | ok: "/var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/work/artifacts" 2026-08-18 15:37:29.587201 | node1 -> localhost | changed: "/var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/work/docs" 2026-08-18 15:37:29.640082 | node2 -> localhost | ok: "/var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/work/docs" 2026-08-18 15:37:29.640239 | node2 -> localhost | changed: All items complete 2026-08-18 15:37:29.640294 | 2026-08-18 15:37:29.643748 | node3 -> localhost | ok: "/var/lib/zuul/builds/baccb7c3338d47c5af70a1aad390f60c/work/docs" 2026-08-18 15:37:29.705440 | 2026-08-18 15:37:29.705712 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-08-18 15:37:30.294590 | node1 | changed: .d..t...... ./ 2026-08-18 15:37:30.294820 | node1 | changed: All items complete 2026-08-18 15:37:30.294865 | 2026-08-18 15:37:30.299309 | node3 | changed: .d..t...... ./ 2026-08-18 15:37:30.303471 | node2 | changed: .d..t...... ./ 2026-08-18 15:37:30.725033 | node1 | changed: .d..t...... ./ 2026-08-18 15:37:30.751829 | node3 | ok 2026-08-18 15:37:30.774165 | node2 | ok 2026-08-18 15:37:31.170978 | node1 | changed: .d..t...... ./ 2026-08-18 15:37:31.194409 | node3 | ok 2026-08-18 15:37:31.216851 | node2 | ok 2026-08-18 15:37:31.216929 | node2 | changed: All items complete 2026-08-18 15:37:31.217025 | 2026-08-18 15:37:31.243488 | 2026-08-18 15:37:31.243661 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-08-18 15:37:31.594852 | node1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006525 2026-08-18 15:37:31.825169 | node1 -> localhost | ok: Item: docs Runtime: 0:00:00.006138 2026-08-18 15:37:31.855528 | 2026-08-18 15:37:31.855665 | PLAY [all] 2026-08-18 15:37:31.862303 | 2026-08-18 15:37:31.862374 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-08-18 15:37:32.275219 | node1 | changed 2026-08-18 15:37:32.457876 | node2 | changed 2026-08-18 15:37:32.463540 | node3 | changed 2026-08-18 15:37:32.477639 | 2026-08-18 15:37:32.477691 | PLAY RECAP 2026-08-18 15:37:32.477741 | node1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 15:37:32.477769 | node2 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 15:37:32.477793 | node3 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 15:37:32.477811 | 2026-08-18 15:37:32.669100 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-18 15:37:32.686588 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-08-18 15:37:33.310266 | 2026-08-18 15:37:33.310391 | PLAY [localhost] 2026-08-18 15:37:33.320233 | 2026-08-18 15:37:33.320306 | TASK [Generate Zuul manifest] 2026-08-18 15:37:33.338657 | localhost | ok 2026-08-18 15:37:33.353475 | 2026-08-18 15:37:33.353550 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-08-18 15:37:33.753173 | localhost | changed 2026-08-18 15:37:33.765737 | 2026-08-18 15:37:33.765815 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-08-18 15:37:33.849042 | localhost | ok 2026-08-18 15:37:33.857648 | 2026-08-18 15:37:33.857711 | TASK [Upload logs] 2026-08-18 15:37:33.877518 | localhost | ok 2026-08-18 15:37:33.993837 | 2026-08-18 15:37:33.994002 | TASK [Set zuul-log-path fact] 2026-08-18 15:37:34.016377 | localhost | ok 2026-08-18 15:37:34.030387 | 2026-08-18 15:37:34.030476 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-18 15:37:34.061988 | localhost | ok 2026-08-18 15:37:34.072337 | 2026-08-18 15:37:34.072479 | TASK [upload-logs : Create log directories] 2026-08-18 15:37:34.419405 | localhost | changed 2026-08-18 15:37:34.424767 | 2026-08-18 15:37:34.424843 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-08-18 15:37:34.821903 | localhost -> localhost | ok: Runtime: 0:00:00.006064 2026-08-18 15:37:34.829500 | 2026-08-18 15:37:34.829787 | TASK [upload-logs : Upload logs to log server] 2026-08-18 15:37:35.308413 | localhost | Output suppressed because no_log was given 2026-08-18 15:37:35.313522 | 2026-08-18 15:37:35.313585 | LOOP [upload-logs : Compress console log and json output] 2026-08-18 15:37:35.359563 | localhost | skipping: Conditional result was False 2026-08-18 15:37:35.368570 | localhost | skipping: Conditional result was False 2026-08-18 15:37:35.379170 | 2026-08-18 15:37:35.379359 | LOOP [upload-logs : Upload compressed console log and json output] 2026-08-18 15:37:35.422154 | localhost | skipping: Conditional result was False 2026-08-18 15:37:35.422652 | 2026-08-18 15:37:35.426110 | localhost | skipping: Conditional result was False 2026-08-18 15:37:35.444905 | 2026-08-18 15:37:35.445125 | LOOP [upload-logs : Upload console log and json output]