2026-08-18 14:17:57.728284 | Job console starting
2026-08-18 14:17:57.764532 | Updating git repos
2026-08-18 14:17:57.794611 | Cloning repos into workspace
2026-08-18 14:17:57.909159 | Restoring repo states
2026-08-18 14:17:57.917504 | Merging changes
2026-08-18 14:17:58.261581 | Checking out repos
2026-08-18 14:17:58.317289 | Preparing playbooks
2026-08-18 14:17:59.298755 | Running Ansible setup
2026-08-18 14:18:04.210545 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-18 14:18:04.848114 | 
2026-08-18 14:18:04.848230 | PLAY [localhost]
2026-08-18 14:18:04.855502 | 
2026-08-18 14:18:04.855571 | TASK [Gathering Facts]
2026-08-18 14:18:05.760716 | localhost | ok
2026-08-18 14:18:05.767738 | 
2026-08-18 14:18:05.767814 | TASK [Setup log path fact]
2026-08-18 14:18:05.785962 | localhost | ok
2026-08-18 14:18:05.795726 | 
2026-08-18 14:18:05.795789 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-18 14:18:05.827221 | localhost | ok
2026-08-18 14:18:05.835317 | 
2026-08-18 14:18:05.835390 | TASK [emit-job-header : Print job information]
2026-08-18 14:18:05.866526 | # Job Information
2026-08-18 14:18:05.866765 | Ansible Version: 2.16.18
2026-08-18 14:18:05.866823 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy
2026-08-18 14:18:05.866856 | Pipeline: check
2026-08-18 14:18:05.866886 | Executor: 2d72f0692154
2026-08-18 14:18:05.866914 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/123
2026-08-18 14:18:05.866947 | Event ID: 5c848740-9b0f-11f1-99bf-ae0b2ea94fad
2026-08-18 14:18:05.871035 | 
2026-08-18 14:18:05.871120 | LOOP [emit-job-header : Print node information]
2026-08-18 14:18:06.004509 | localhost | ok:
2026-08-18 14:18:06.005033 | localhost | # Node Information
2026-08-18 14:18:06.005081 | localhost | Inventory Hostname: node1
2026-08-18 14:18:06.005113 | localhost | Hostname: np0000190009
2026-08-18 14:18:06.005142 | localhost | Username: zuul
2026-08-18 14:18:06.005174 | localhost | Distro: Ubuntu 22.04
2026-08-18 14:18:06.005202 | localhost | Provider: yul1
2026-08-18 14:18:06.005229 | localhost | Region: ca-ymq-1
2026-08-18 14:18:06.005255 | localhost | Label: ubuntu-jammy
2026-08-18 14:18:06.005282 | localhost | Product Name: OpenStack Nova
2026-08-18 14:18:06.005309 | localhost | Interface IP: 199.204.45.129
2026-08-18 14:18:06.046982 | localhost | ok:
2026-08-18 14:18:06.047082 | localhost | # Node Information
2026-08-18 14:18:06.047136 | localhost | Inventory Hostname: node2
2026-08-18 14:18:06.047181 | localhost | Hostname: np0000190010
2026-08-18 14:18:06.047224 | localhost | Username: zuul
2026-08-18 14:18:06.047265 | localhost | Distro: Ubuntu 22.04
2026-08-18 14:18:06.047305 | localhost | Provider: yul1
2026-08-18 14:18:06.047346 | localhost | Region: ca-ymq-1
2026-08-18 14:18:06.047385 | localhost | Label: ubuntu-jammy
2026-08-18 14:18:06.047424 | localhost | Product Name: OpenStack Nova
2026-08-18 14:18:06.047466 | localhost | Interface IP: 199.204.45.38
2026-08-18 14:18:06.089832 | localhost | ok:
2026-08-18 14:18:06.089922 | localhost | # Node Information
2026-08-18 14:18:06.089973 | localhost | Inventory Hostname: node3
2026-08-18 14:18:06.090017 | localhost | Hostname: np0000190011
2026-08-18 14:18:06.090059 | localhost | Username: zuul
2026-08-18 14:18:06.090101 | localhost | Distro: Ubuntu 22.04
2026-08-18 14:18:06.090141 | localhost | Provider: yul1
2026-08-18 14:18:06.090180 | localhost | Region: ca-ymq-1
2026-08-18 14:18:06.090219 | localhost | Label: ubuntu-jammy
2026-08-18 14:18:06.090258 | localhost | Product Name: OpenStack Nova
2026-08-18 14:18:06.090297 | localhost | Interface IP: 199.204.45.72
2026-08-18 14:18:06.107540 | 
2026-08-18 14:18:06.107673 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-08-18 14:18:06.460798 | localhost -> localhost | changed
2026-08-18 14:18:06.468867 | 
2026-08-18 14:18:06.468981 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-08-18 14:18:07.320695 | localhost -> localhost | changed
2026-08-18 14:18:07.331223 | 
2026-08-18 14:18:07.331291 | PLAY [all]
2026-08-18 14:18:07.342552 | 
2026-08-18 14:18:07.342661 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-08-18 14:18:07.561433 | node1 -> localhost | ok
2026-08-18 14:18:07.569292 | 
2026-08-18 14:18:07.569385 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-08-18 14:18:07.609711 | node1 | ok
2026-08-18 14:18:07.613738 | node2 | ok
2026-08-18 14:18:07.618573 | node3 | ok
2026-08-18 14:18:07.687274 | node1 | included: /var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-18 14:18:07.687392 | node2 | included: /var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-18 14:18:07.687416 | node3 | included: /var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-18 14:18:07.693521 | 
2026-08-18 14:18:07.693593 | TASK [add-build-sshkey : Create Temp SSH key]
2026-08-18 14:18:08.366006 | node1 -> localhost | Generating public/private rsa key pair.
2026-08-18 14:18:08.366230 | node1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/work/81c9357e7f4d4ad8bd1ee7d0bdf9ff50_id_rsa
2026-08-18 14:18:08.366274 | node1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/work/81c9357e7f4d4ad8bd1ee7d0bdf9ff50_id_rsa.pub
2026-08-18 14:18:08.366308 | node1 -> localhost | The key fingerprint is:
2026-08-18 14:18:08.366339 | node1 -> localhost | SHA256:KJMEP7T9Y+QlYhWCpx4+XB25B9zjrc/rbMHvh1dKO50 zuul-build-sshkey
2026-08-18 14:18:08.366370 | node1 -> localhost | The key's randomart image is:
2026-08-18 14:18:08.366400 | node1 -> localhost | +---[RSA 3072]----+
2026-08-18 14:18:08.366431 | node1 -> localhost | |  . ....o+       |
2026-08-18 14:18:08.366462 | node1 -> localhost | |   +.o.o= o      |
2026-08-18 14:18:08.366493 | node1 -> localhost | |    =o+.o=.o     |
2026-08-18 14:18:08.366522 | node1 -> localhost | |   .o+.*ooo .    |
2026-08-18 14:18:08.366552 | node1 -> localhost | |   ++o. S. o     |
2026-08-18 14:18:08.366581 | node1 -> localhost | |    =o . .. o . .|
2026-08-18 14:18:08.366610 | node1 -> localhost | |     .     o + =o|
2026-08-18 14:18:08.366639 | node1 -> localhost | |           .+ *E+|
2026-08-18 14:18:08.366668 | node1 -> localhost | |           o+o.+ |
2026-08-18 14:18:08.366697 | node1 -> localhost | +----[SHA256]-----+
2026-08-18 14:18:08.366764 | node1 -> localhost | ok: Runtime: 0:00:00.312284
2026-08-18 14:18:08.374650 | 
2026-08-18 14:18:08.374728 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-08-18 14:18:08.408843 | node1 | ok
2026-08-18 14:18:08.413131 | node2 | ok
2026-08-18 14:18:08.426927 | node3 | ok
2026-08-18 14:18:08.443162 | node1 | included: /var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-18 14:18:08.443212 | node2 | included: /var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-18 14:18:08.443235 | node3 | included: /var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-18 14:18:08.455729 | 
2026-08-18 14:18:08.455790 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-08-18 14:18:08.481811 | node1 | skipping: Conditional result was False
2026-08-18 14:18:08.492981 | node2 | skipping: Conditional result was False
2026-08-18 14:18:08.503367 | node3 | skipping: Conditional result was False
2026-08-18 14:18:08.510061 | 
2026-08-18 14:18:08.510126 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-08-18 14:18:08.951563 | node1 | changed
2026-08-18 14:18:08.957767 | node2 | changed
2026-08-18 14:18:08.963347 | node3 | changed
2026-08-18 14:18:08.969088 | 
2026-08-18 14:18:08.969157 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-08-18 14:18:09.145075 | node1 | ok
2026-08-18 14:18:09.163082 | node2 | ok
2026-08-18 14:18:09.168904 | node3 | ok
2026-08-18 14:18:09.174916 | 
2026-08-18 14:18:09.174982 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-08-18 14:18:09.634428 | node1 | changed
2026-08-18 14:18:09.664114 | node2 | changed
2026-08-18 14:18:09.669455 | node3 | changed
2026-08-18 14:18:09.675297 | 
2026-08-18 14:18:09.675359 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-08-18 14:18:10.157931 | node3 | changed
2026-08-18 14:18:10.176684 | node1 | changed
2026-08-18 14:18:10.196626 | node2 | changed
2026-08-18 14:18:10.204600 | 
2026-08-18 14:18:10.204668 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-08-18 14:18:10.235479 | node1 | skipping: Conditional result was False
2026-08-18 14:18:10.238394 | node2 | skipping: Conditional result was False
2026-08-18 14:18:10.248811 | node3 | skipping: Conditional result was False
2026-08-18 14:18:10.255860 | 
2026-08-18 14:18:10.255946 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-08-18 14:18:10.665778 | node1 -> localhost | changed
2026-08-18 14:18:10.694654 | 
2026-08-18 14:18:10.694804 | TASK [add-build-sshkey : Add back temp key]
2026-08-18 14:18:10.962852 | node1 -> localhost | Identity added: /var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/work/81c9357e7f4d4ad8bd1ee7d0bdf9ff50_id_rsa (zuul-build-sshkey)
2026-08-18 14:18:10.963155 | node1 -> localhost | ok: Runtime: 0:00:00.012727
2026-08-18 14:18:10.970107 | 
2026-08-18 14:18:10.970190 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-08-18 14:18:11.320764 | node1 | ok
2026-08-18 14:18:11.339456 | node3 | ok
2026-08-18 14:18:11.345093 | node2 | ok
2026-08-18 14:18:11.351094 | 
2026-08-18 14:18:11.351156 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-08-18 14:18:11.388006 | node1 | skipping: Conditional result was False
2026-08-18 14:18:11.388818 | node2 | skipping: Conditional result was False
2026-08-18 14:18:11.399344 | node3 | skipping: Conditional result was False
2026-08-18 14:18:11.420895 | 
2026-08-18 14:18:11.420999 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-08-18 14:18:11.777942 | node1 | ok
2026-08-18 14:18:11.782031 | node2 | ok
2026-08-18 14:18:11.785809 | node3 | ok
2026-08-18 14:18:11.790991 | 
2026-08-18 14:18:11.791057 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-08-18 14:18:12.454986 | node3 | Output suppressed because no_log was given
2026-08-18 14:18:12.462517 | node1 | Output suppressed because no_log was given
2026-08-18 14:18:12.469889 | node2 | Output suppressed because no_log was given
2026-08-18 14:18:12.488290 | 
2026-08-18 14:18:12.488375 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-08-18 14:18:12.677621 | node1 | ok: "logs"
2026-08-18 14:18:12.677886 | node1 | ok: All items complete
2026-08-18 14:18:12.677920 | 
2026-08-18 14:18:12.697591 | node2 | ok: "logs"
2026-08-18 14:18:12.705372 | node3 | ok: "logs"
2026-08-18 14:18:12.838079 | node1 | ok: "artifacts"
2026-08-18 14:18:12.855423 | node3 | ok: "artifacts"
2026-08-18 14:18:12.859992 | node2 | ok: "artifacts"
2026-08-18 14:18:12.993470 | node1 | ok: "docs"
2026-08-18 14:18:13.024804 | node3 | ok: "docs"
2026-08-18 14:18:13.034352 | node2 | ok: "docs"
2026-08-18 14:18:13.034419 | node2 | ok: All items complete
2026-08-18 14:18:13.034454 | 
2026-08-18 14:18:13.052201 | 
2026-08-18 14:18:13.052317 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-08-18 14:18:13.258456 | node1 | changed: "logs"
2026-08-18 14:18:13.270429 | node3 | changed: "logs"
2026-08-18 14:18:13.287271 | node2 | changed: "logs"
2026-08-18 14:18:13.437353 | node1 | changed: "artifacts"
2026-08-18 14:18:13.452363 | node2 | changed: "artifacts"
2026-08-18 14:18:13.456460 | node3 | changed: "artifacts"
2026-08-18 14:18:13.603321 | node1 | changed: "docs"
2026-08-18 14:18:13.625185 | node2 | changed: "docs"
2026-08-18 14:18:13.625246 | node2 | changed: All items complete
2026-08-18 14:18:13.625271 | 
2026-08-18 14:18:13.629745 | node3 | changed: "docs"
2026-08-18 14:18:13.655727 | 
2026-08-18 14:18:13.655879 | PLAY RECAP
2026-08-18 14:18:13.655935 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-18 14:18:13.655966 | node1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-18 14:18:13.655991 | node2 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-18 14:18:13.656015 | node3 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-18 14:18:13.656064 | 
2026-08-18 14:18:13.843808 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-18 14:18:13.857149 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-18 14:18:14.476797 | 
2026-08-18 14:18:14.477141 | PLAY [all]
2026-08-18 14:18:14.491450 | 
2026-08-18 14:18:14.491647 | TASK [setup-uv : Extract archive]
2026-08-18 14:18:16.719874 | node2 | changed
2026-08-18 14:18:16.779868 | node3 | changed
2026-08-18 14:18:16.810902 | node1 | changed
2026-08-18 14:18:16.816348 | 
2026-08-18 14:18:16.816437 | TASK [setup-uv : Print version]
2026-08-18 14:18:17.180107 | node2 | uv 0.8.13
2026-08-18 14:18:17.198319 | node3 | uv 0.8.13
2026-08-18 14:18:17.165114 | node1 | uv 0.8.13
2026-08-18 14:18:17.390557 | node1 | ok: Runtime: 0:00:00.011561
2026-08-18 14:18:17.399751 | node2 | ok: Runtime: 0:00:00.012200
2026-08-18 14:18:17.407912 | node3 | ok: Runtime: 0:00:00.010797
2026-08-18 14:18:17.423931 | 
2026-08-18 14:18:17.424027 | TASK [Install Ansible collection siblings]
2026-08-18 14:18:17.740540 | node1 | ok:
2026-08-18 14:18:17.740756 | node1 | Skipping community.crypto: no checked-out sibling
2026-08-18 14:18:17.740819 | node1 | Skipping community.docker: no checked-out sibling
2026-08-18 14:18:17.740868 | node1 | Skipping community.general: no checked-out sibling
2026-08-18 14:18:17.740915 | node1 | Skipping ansible.utils: no checked-out sibling
2026-08-18 14:18:17.740982 | node1 | Skipping vexxhost.containers: no checked-out sibling
2026-08-18 14:18:17.744507 | 
2026-08-18 14:18:17.744589 | PLAY RECAP
2026-08-18 14:18:17.744674 | node1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-18 14:18:17.744734 | node2 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-18 14:18:17.744791 | node3 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-18 14:18:17.744834 | 
2026-08-18 14:18:17.881390 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-18 14:18:17.891901 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-18 14:18:18.534298 | 
2026-08-18 14:18:18.534449 | PLAY [all]
2026-08-18 14:18:18.547639 | 
2026-08-18 14:18:18.547772 | LOOP [Check inventory directories]
2026-08-18 14:18:18.882669 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-18 14:18:19.044115 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory"
2026-08-18 14:18:19.206758 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory"
2026-08-18 14:18:19.291684 | 
2026-08-18 14:18:19.291874 | LOOP [Copy inventory file for Zuul]
2026-08-18 14:18:20.053765 | node1 | changed:
2026-08-18 14:18:20.053983 | node1 | {
2026-08-18 14:18:20.054021 | node1 |   "ansible_loop_var": "item",
2026-08-18 14:18:20.054052 | node1 |   "changed": false,
2026-08-18 14:18:20.054080 | node1 |   "failed": false,
2026-08-18 14:18:20.054114 | node1 |   "invocation": {
2026-08-18 14:18:20.054141 | node1 |     "module_args": {
2026-08-18 14:18:20.054182 | node1 |       "checksum_algorithm": "sha1",
2026-08-18 14:18:20.054207 | node1 |       "follow": true,
2026-08-18 14:18:20.054232 | node1 |       "get_attributes": true,
2026-08-18 14:18:20.054259 | node1 |       "get_checksum": true,
2026-08-18 14:18:20.054284 | node1 |       "get_mime": true,
2026-08-18 14:18:20.054309 | node1 |       "path": "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-18 14:18:20.054333 | node1 |     }
2026-08-18 14:18:20.054358 | node1 |   },
2026-08-18 14:18:20.054382 | node1 |   "item": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-18 14:18:20.054405 | node1 |   "stat": {
2026-08-18 14:18:20.054429 | node1 |     "atime": 1787062692.3543978,
2026-08-18 14:18:20.054453 | node1 |     "attr_flags": "e",
2026-08-18 14:18:20.054477 | node1 |     "attributes": [
2026-08-18 14:18:20.054501 | node1 |       "extents"
2026-08-18 14:18:20.054525 | node1 |     ],
2026-08-18 14:18:20.054549 | node1 |     "block_size": 4096,
2026-08-18 14:18:20.054573 | node1 |     "blocks": 8,
2026-08-18 14:18:20.054598 | node1 |     "charset": "unknown",
2026-08-18 14:18:20.054624 | node1 |     "ctime": 1787062692.3624017,
2026-08-18 14:18:20.054649 | node1 |     "dev": 64513,
2026-08-18 14:18:20.054674 | node1 |     "device_type": 0,
2026-08-18 14:18:20.054698 | node1 |     "executable": true,
2026-08-18 14:18:20.054722 | node1 |     "exists": true,
2026-08-18 14:18:20.054746 | node1 |     "gid": 1000,
2026-08-18 14:18:20.054770 | node1 |     "gr_name": "zuul",
2026-08-18 14:18:20.054793 | node1 |     "inode": 1042461,
2026-08-18 14:18:20.054817 | node1 |     "isblk": false,
2026-08-18 14:18:20.054841 | node1 |     "ischr": false,
2026-08-18 14:18:20.054865 | node1 |     "isdir": true,
2026-08-18 14:18:20.054888 | node1 |     "isfifo": false,
2026-08-18 14:18:20.054912 | node1 |     "isgid": false,
2026-08-18 14:18:20.054934 | node1 |     "islnk": false,
2026-08-18 14:18:20.054957 | node1 |     "isreg": false,
2026-08-18 14:18:20.054980 | node1 |     "issock": false,
2026-08-18 14:18:20.055003 | node1 |     "isuid": false,
2026-08-18 14:18:20.055026 | node1 |     "mimetype": "unknown",
2026-08-18 14:18:20.055049 | node1 |     "mode": "0755",
2026-08-18 14:18:20.055072 | node1 |     "mtime": 1787062678.2076874,
2026-08-18 14:18:20.055094 | node1 |     "nlink": 10,
2026-08-18 14:18:20.055118 | node1 |     "path": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-18 14:18:20.055142 | node1 |     "pw_name": "zuul",
2026-08-18 14:18:20.055214 | node1 |     "readable": true,
2026-08-18 14:18:20.055241 | node1 |     "rgrp": true,
2026-08-18 14:18:20.055266 | node1 |     "roth": true,
2026-08-18 14:18:20.055290 | node1 |     "rusr": true,
2026-08-18 14:18:20.055315 | node1 |     "size": 4096,
2026-08-18 14:18:20.055339 | node1 |     "uid": 1000,
2026-08-18 14:18:20.055363 | node1 |     "version": "2861648987",
2026-08-18 14:18:20.055387 | node1 |     "wgrp": false,
2026-08-18 14:18:20.055413 | node1 |     "woth": false,
2026-08-18 14:18:20.055438 | node1 |     "writeable": true,
2026-08-18 14:18:20.055463 | node1 |     "wusr": true,
2026-08-18 14:18:20.055486 | node1 |     "xgrp": true,
2026-08-18 14:18:20.055510 | node1 |     "xoth": true,
2026-08-18 14:18:20.055534 | node1 |     "xusr": true
2026-08-18 14:18:20.055558 | node1 |   }
2026-08-18 14:18:20.055582 | node1 | }
2026-08-18 14:18:20.055627 | node1 | ok: All items complete
2026-08-18 14:18:20.055657 | 
2026-08-18 14:18:20.057073 | node1 | skipping: Conditional result was False
2026-08-18 14:18:20.057658 | node1 | skipping: Conditional result was False
2026-08-18 14:18:20.074841 | 
2026-08-18 14:18:20.075047 | LOOP [Switch "ansible_host" to private IP]
2026-08-18 14:18:20.403352 | node1 | changed: 3 replacements made
2026-08-18 14:18:20.404948 | node1 | skipping: Conditional result was False
2026-08-18 14:18:20.405775 | node1 | skipping: Conditional result was False
2026-08-18 14:18:20.422957 | 
2026-08-18 14:18:20.423151 | TASK [Run Molecule scenario]
2026-08-18 14:18:21.061694 | node1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-08-18 14:18:21.773380 | node1 |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-08-18 14:18:21.950366 | node1 | Using CPython 3.13.7
2026-08-18 14:18:21.950463 | node1 | Creating virtual environment at: .venv
2026-08-18 14:18:21.991818 | node1 | Downloading pygments (1.2MiB)
2026-08-18 14:18:21.996675 | node1 | Downloading netaddr (2.2MiB)
2026-08-18 14:18:21.996877 | node1 | Downloading ansible-core (2.1MiB)
2026-08-18 14:18:21.997283 | node1 | Downloading cryptography (4.3MiB)
2026-08-18 14:18:22.212732 | node1 |  Downloading netaddr
2026-08-18 14:18:22.221231 | node1 |  Downloading cryptography
2026-08-18 14:18:22.266639 | node1 |  Downloading pygments
2026-08-18 14:18:22.385226 | node1 |  Downloading ansible-core
2026-08-18 14:18:22.424353 | node1 | Installed 42 packages in 38ms
2026-08-18 14:18:23.512265 | node1 | INFO     Collection 'vexxhost.ceph' detected.
2026-08-18 14:18:23.512355 | node1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-08-18 14:18:24.135838 | node1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-08-18 14:18:24.135955 | node1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-08-18 14:18:48.176953 | node1 | INFO     [default > dependency] Executing
2026-08-18 14:18:48.177127 | node1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-08-18 14:18:48.177375 | node1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-08-18 14:18:48.177550 | node1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-08-18 14:18:48.184831 | node1 | INFO     [default > cleanup] Executing
2026-08-18 14:18:48.185103 | node1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-18 14:18:48.190303 | node1 | INFO     [default > destroy] Executing
2026-08-18 14:18:48.190352 | node1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-08-18 14:18:48.190397 | node1 | INFO     [default > destroy] Executed: Successful
2026-08-18 14:18:48.195529 | node1 | INFO     [default > syntax] Executing
2026-08-18 14:18:49.349077 | node1 |
2026-08-18 14:18:49.349320 | node1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-18 14:18:49.415463 | node1 | INFO     [default > syntax] Executed: Successful
2026-08-18 14:18:49.427392 | node1 | INFO     [default > create] Executing
2026-08-18 14:18:49.429422 | node1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-18 14:18:49.434380 | node1 | INFO     [default > prepare] Executing
2026-08-18 14:18:50.163642 | node1 |
2026-08-18 14:18:50.163769 | node1 | PLAY [Prepare] *****************************************************************
2026-08-18 14:18:50.164011 | node1 |
2026-08-18 14:18:50.164279 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 14:18:50.164505 | node1 | Tuesday 18 August 2026  14:18:50 +0000 (0:00:00.030)       0:00:00.030 ********
2026-08-18 14:18:51.333753 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python
2026-08-18 14:18:51.333866 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 14:18:51.334108 | node1 | interpreter could change the meaning of that path. See
2026-08-18 14:18:51.334243 | node1 | https://docs.ansible.com/ansible-
2026-08-18 14:18:51.334391 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 14:18:51.360537 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python
2026-08-18 14:18:51.360752 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 14:18:51.360985 | node1 | interpreter could change the meaning of that path. See
2026-08-18 14:18:51.361190 | node1 | https://docs.ansible.com/ansible-
2026-08-18 14:18:51.361417 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 14:18:51.370274 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python
2026-08-18 14:18:51.370514 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 14:18:51.370785 | node1 | interpreter could change the meaning of that path. See
2026-08-18 14:18:51.371122 | node1 | https://docs.ansible.com/ansible-
2026-08-18 14:18:51.371297 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 14:18:51.379591 | node1 | ok: [node1]
2026-08-18 14:18:51.379799 | node1 | ok: [node3]
2026-08-18 14:18:51.380018 | node1 | ok: [node2]
2026-08-18 14:18:51.380218 | node1 |
2026-08-18 14:18:51.380450 | node1 | TASK [Configure short hostname] ************************************************
2026-08-18 14:18:51.380671 | node1 | Tuesday 18 August 2026  14:18:51 +0000 (0:00:01.216)       0:00:01.246 ********
2026-08-18 14:18:52.095052 | node1 | changed: [node1]
2026-08-18 14:18:52.095227 | node1 | changed: [node3]
2026-08-18 14:18:52.095427 | node1 | changed: [node2]
2026-08-18 14:18:52.095614 | node1 |
2026-08-18 14:18:52.095824 | node1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-08-18 14:18:52.096029 | node1 | Tuesday 18 August 2026  14:18:52 +0000 (0:00:00.714)       0:00:01.961 ********
2026-08-18 14:18:52.352844 | node1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-08-18 14:18:52.353045 | node1 | with a mode of 0700, this may cause issues when running as another user. To
2026-08-18 14:18:52.353253 | node1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-08-18 14:18:52.384620 | node1 | changed: [node3]
2026-08-18 14:18:52.386020 | node1 | changed: [node2]
2026-08-18 14:18:52.386096 | node1 | changed: [node1]
2026-08-18 14:18:52.386111 | node1 |
2026-08-18 14:18:52.386126 | node1 | TASK [Update apt cache] ********************************************************
2026-08-18 14:18:52.386138 | node1 | Tuesday 18 August 2026  14:18:52 +0000 (0:00:00.290)       0:00:02.251 ********
2026-08-18 14:18:59.548352 | node1 | changed: [node1]
2026-08-18 14:18:59.548549 | node1 | changed: [node2]
2026-08-18 14:18:59.548562 | node1 | changed: [node3]
2026-08-18 14:18:59.548573 | node1 |
2026-08-18 14:18:59.548584 | node1 | PLAY [Create devices for Ceph] *************************************************
2026-08-18 14:18:59.548594 | node1 |
2026-08-18 14:18:59.548604 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 14:18:59.548613 | node1 | Tuesday 18 August 2026  14:18:59 +0000 (0:00:07.162)       0:00:09.413 ********
2026-08-18 14:19:00.296101 | node1 | ok: [node1]
2026-08-18 14:19:00.296142 | node1 | ok: [node2]
2026-08-18 14:19:00.296149 | node1 | ok: [node3]
2026-08-18 14:19:00.296156 | node1 |
2026-08-18 14:19:00.296162 | node1 | TASK [Install depedencies] *****************************************************
2026-08-18 14:19:00.296168 | node1 | Tuesday 18 August 2026  14:19:00 +0000 (0:00:00.748)       0:00:10.162 ********
2026-08-18 14:19:30.588318 | node1 | changed: [node3]
2026-08-18 14:19:30.588422 | node1 | changed: [node2]
2026-08-18 14:19:30.588428 | node1 | changed: [node1]
2026-08-18 14:19:30.588432 | node1 |
2026-08-18 14:19:30.588437 | node1 | TASK [Start up service] ********************************************************
2026-08-18 14:19:30.588442 | node1 | Tuesday 18 August 2026  14:19:30 +0000 (0:00:30.292)       0:00:40.455 ********
2026-08-18 14:19:31.166012 | node1 | ok: [node3]
2026-08-18 14:19:31.166108 | node1 | ok: [node1]
2026-08-18 14:19:31.166117 | node1 | ok: [node2]
2026-08-18 14:19:31.166123 | node1 |
2026-08-18 14:19:31.166130 | node1 | TASK [Generate lvm.conf] *******************************************************
2026-08-18 14:19:31.166146 | node1 | Tuesday 18 August 2026  14:19:31 +0000 (0:00:00.576)       0:00:41.032 ********
2026-08-18 14:19:31.474560 | node1 | ok: [node1]
2026-08-18 14:19:31.474722 | node1 | ok: [node3]
2026-08-18 14:19:31.474934 | node1 | ok: [node2]
2026-08-18 14:19:31.475126 | node1 |
2026-08-18 14:19:31.475342 | node1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-08-18 14:19:31.475565 | node1 | Tuesday 18 August 2026  14:19:31 +0000 (0:00:00.309)       0:00:41.341 ********
2026-08-18 14:19:32.115966 | node1 | changed: [node1]
2026-08-18 14:19:32.116106 | node1 | changed: [node2]
2026-08-18 14:19:32.116313 | node1 | changed: [node3]
2026-08-18 14:19:32.116500 | node1 |
2026-08-18 14:19:32.116717 | node1 | TASK [Get list of all loopback devices] ****************************************
2026-08-18 14:19:32.116925 | node1 | Tuesday 18 August 2026  14:19:32 +0000 (0:00:00.641)       0:00:41.983 ********
2026-08-18 14:19:32.336306 | node1 | ok: [node1]
2026-08-18 14:19:32.336459 | node1 | ok: [node3]
2026-08-18 14:19:32.336772 | node1 | ok: [node2]
2026-08-18 14:19:32.337068 | node1 |
2026-08-18 14:19:32.337333 | node1 | TASK [Fail if there is any existing loopback devices] **************************
2026-08-18 14:19:32.337548 | node1 | Tuesday 18 August 2026  14:19:32 +0000 (0:00:00.220)       0:00:42.203 ********
2026-08-18 14:19:32.368888 | node1 | skipping: [node1]
2026-08-18 14:19:32.369174 | node1 | skipping: [node2]
2026-08-18 14:19:32.369380 | node1 | skipping: [node3]
2026-08-18 14:19:32.369579 | node1 |
2026-08-18 14:19:32.369805 | node1 | TASK [Create devices for Ceph] *************************************************
2026-08-18 14:19:32.370165 | node1 | Tuesday 18 August 2026  14:19:32 +0000 (0:00:00.032)       0:00:42.235 ********
2026-08-18 14:19:32.935014 | node1 | changed: [node1] => (item=osd0)
2026-08-18 14:19:32.935143 | node1 | changed: [node2] => (item=osd0)
2026-08-18 14:19:32.935301 | node1 | changed: [node3] => (item=osd0)
2026-08-18 14:19:32.935449 | node1 | changed: [node1] => (item=osd1)
2026-08-18 14:19:32.935593 | node1 | changed: [node2] => (item=osd1)
2026-08-18 14:19:32.935738 | node1 | changed: [node3] => (item=osd1)
2026-08-18 14:19:32.935879 | node1 | changed: [node1] => (item=osd2)
2026-08-18 14:19:32.936015 | node1 | changed: [node3] => (item=osd2)
2026-08-18 14:19:32.936171 | node1 | changed: [node2] => (item=osd2)
2026-08-18 14:19:32.936333 | node1 |
2026-08-18 14:19:32.936478 | node1 | TASK [Set permissions on loopback devices] *************************************
2026-08-18 14:19:32.936613 | node1 | Tuesday 18 August 2026  14:19:32 +0000 (0:00:00.566)       0:00:42.802 ********
2026-08-18 14:19:33.581785 | node1 | changed: [node1] => (item=osd0)
2026-08-18 14:19:33.582177 | node1 | changed: [node3] => (item=osd0)
2026-08-18 14:19:33.582418 | node1 | changed: [node2] => (item=osd0)
2026-08-18 14:19:33.582634 | node1 | changed: [node1] => (item=osd1)
2026-08-18 14:19:33.582846 | node1 | changed: [node3] => (item=osd1)
2026-08-18 14:19:33.583140 | node1 | changed: [node2] => (item=osd1)
2026-08-18 14:19:33.583357 | node1 | changed: [node3] => (item=osd2)
2026-08-18 14:19:33.583570 | node1 | changed: [node1] => (item=osd2)
2026-08-18 14:19:33.583763 | node1 | changed: [node2] => (item=osd2)
2026-08-18 14:19:33.583948 | node1 |
2026-08-18 14:19:33.584149 | node1 | TASK [Start loop devices] ******************************************************
2026-08-18 14:19:33.584348 | node1 | Tuesday 18 August 2026  14:19:33 +0000 (0:00:00.646)       0:00:43.448 ********
2026-08-18 14:19:34.290697 | node1 | changed: [node3] => (item=osd0)
2026-08-18 14:19:34.290871 | node1 | changed: [node1] => (item=osd0)
2026-08-18 14:19:34.291081 | node1 | changed: [node2] => (item=osd0)
2026-08-18 14:19:34.291294 | node1 | changed: [node2] => (item=osd1)
2026-08-18 14:19:34.291497 | node1 | changed: [node3] => (item=osd1)
2026-08-18 14:19:34.291691 | node1 | changed: [node1] => (item=osd1)
2026-08-18 14:19:34.291892 | node1 | changed: [node1] => (item=osd2)
2026-08-18 14:19:34.292076 | node1 | changed: [node2] => (item=osd2)
2026-08-18 14:19:34.292269 | node1 | changed: [node3] => (item=osd2)
2026-08-18 14:19:34.292458 | node1 |
2026-08-18 14:19:34.292666 | node1 | TASK [Create a volume group for each loop device] ******************************
2026-08-18 14:19:34.292870 | node1 | Tuesday 18 August 2026  14:19:34 +0000 (0:00:00.709)       0:00:44.157 ********
2026-08-18 14:19:37.553538 | node1 | changed: [node3] => (item=osd0)
2026-08-18 14:19:37.553721 | node1 | changed: [node2] => (item=osd0)
2026-08-18 14:19:37.553958 | node1 | changed: [node1] => (item=osd0)
2026-08-18 14:19:37.554192 | node1 | changed: [node1] => (item=osd1)
2026-08-18 14:19:37.554387 | node1 | changed: [node3] => (item=osd1)
2026-08-18 14:19:37.554587 | node1 | changed: [node2] => (item=osd1)
2026-08-18 14:19:37.554789 | node1 | changed: [node3] => (item=osd2)
2026-08-18 14:19:37.555033 | node1 | changed: [node1] => (item=osd2)
2026-08-18 14:19:37.555249 | node1 | changed: [node2] => (item=osd2)
2026-08-18 14:19:37.555447 | node1 |
2026-08-18 14:19:37.555669 | node1 | TASK [Create a logical volume for each loop device] ****************************
2026-08-18 14:19:37.555929 | node1 | Tuesday 18 August 2026  14:19:37 +0000 (0:00:03.262)       0:00:47.420 ********
2026-08-18 14:19:39.543654 | node1 | changed: [node3] => (item=ceph-node3-osd0)
2026-08-18 14:19:39.543736 | node1 | changed: [node1] => (item=ceph-node1-osd0)
2026-08-18 14:19:39.543881 | node1 | changed: [node2] => (item=ceph-node2-osd0)
2026-08-18 14:19:39.544026 | node1 | changed: [node3] => (item=ceph-node3-osd1)
2026-08-18 14:19:39.544147 | node1 | changed: [node1] => (item=ceph-node1-osd1)
2026-08-18 14:19:39.544274 | node1 | changed: [node2] => (item=ceph-node2-osd1)
2026-08-18 14:19:39.544404 | node1 | changed: [node3] => (item=ceph-node3-osd2)
2026-08-18 14:19:39.544525 | node1 | changed: [node1] => (item=ceph-node1-osd2)
2026-08-18 14:19:39.544652 | node1 | changed: [node2] => (item=ceph-node2-osd2)
2026-08-18 14:19:39.544775 | node1 |
2026-08-18 14:19:39.544908 | node1 | PLAY RECAP *********************************************************************
2026-08-18 14:19:39.545057 | node1 | node1                      : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-18 14:19:39.545189 | node1 | node2                      : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-18 14:19:39.545359 | node1 | node3                      : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-18 14:19:39.545480 | node1 |
2026-08-18 14:19:39.545598 | node1 |
2026-08-18 14:19:39.545722 | node1 | TASKS RECAP ********************************************************************
2026-08-18 14:19:39.545848 | node1 | Tuesday 18 August 2026  14:19:39 +0000 (0:00:01.989)       0:00:49.410 ********
2026-08-18 14:19:39.545998 | node1 | ===============================================================================
2026-08-18 14:19:39.546111 | node1 | Install depedencies ---------------------------------------------------- 30.29s
2026-08-18 14:19:39.546230 | node1 | Update apt cache -------------------------------------------------------- 7.16s
2026-08-18 14:19:39.546353 | node1 | Create a volume group for each loop device ------------------------------ 3.26s
2026-08-18 14:19:39.546475 | node1 | Create a logical volume for each loop device ---------------------------- 1.99s
2026-08-18 14:19:39.546595 | node1 | Gathering Facts --------------------------------------------------------- 1.22s
2026-08-18 14:19:39.546715 | node1 | Gathering Facts --------------------------------------------------------- 0.75s
2026-08-18 14:19:39.546837 | node1 | Configure short hostname ------------------------------------------------ 0.71s
2026-08-18 14:19:39.546960 | node1 | Start loop devices ------------------------------------------------------ 0.71s
2026-08-18 14:19:39.547155 | node1 | Set permissions on loopback devices ------------------------------------- 0.65s
2026-08-18 14:19:39.547262 | node1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.64s
2026-08-18 14:19:39.547381 | node1 | Start up service -------------------------------------------------------- 0.58s
2026-08-18 14:19:39.547501 | node1 | Create devices for Ceph ------------------------------------------------- 0.57s
2026-08-18 14:19:39.547622 | node1 | Generate lvm.conf ------------------------------------------------------- 0.31s
2026-08-18 14:19:39.547742 | node1 | Ensure hostname inside hosts file --------------------------------------- 0.29s
2026-08-18 14:19:39.547862 | node1 | Get list of all loopback devices ---------------------------------------- 0.22s
2026-08-18 14:19:39.547985 | node1 | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-08-18 14:19:39.624894 | node1 | INFO     [default > prepare] Executed: Successful
2026-08-18 14:19:39.634164 | node1 | INFO     [default > converge] Executing
2026-08-18 14:19:40.681445 | node1 |
2026-08-18 14:19:40.681528 | node1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-08-18 14:19:40.681667 | node1 |
2026-08-18 14:19:40.681812 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 14:19:40.681988 | node1 | Tuesday 18 August 2026  14:19:40 +0000 (0:00:00.078)       0:00:00.078 ********
2026-08-18 14:19:41.819198 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python
2026-08-18 14:19:41.819655 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 14:19:41.819691 | node1 | interpreter could change the meaning of that path. See
2026-08-18 14:19:41.819860 | node1 | https://docs.ansible.com/ansible-
2026-08-18 14:19:41.820079 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 14:19:41.854519 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python
2026-08-18 14:19:41.854586 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 14:19:41.854732 | node1 | interpreter could change the meaning of that path. See
2026-08-18 14:19:41.854850 | node1 | https://docs.ansible.com/ansible-
2026-08-18 14:19:41.854978 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 14:19:41.865285 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python
2026-08-18 14:19:41.865394 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 14:19:41.865505 | node1 | interpreter could change the meaning of that path. See
2026-08-18 14:19:41.865628 | node1 | https://docs.ansible.com/ansible-
2026-08-18 14:19:41.865759 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 14:19:41.919126 | node1 | ok: [node3]
2026-08-18 14:19:41.919294 | node1 | ok: [node1]
2026-08-18 14:19:41.919501 | node1 | ok: [node2]
2026-08-18 14:19:41.919694 | node1 |
2026-08-18 14:19:41.919909 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:19:41.920121 | node1 | Tuesday 18 August 2026  14:19:41 +0000 (0:00:01.237)       0:00:01.316 ********
2026-08-18 14:19:42.218498 | node1 | ok: [node2]
2026-08-18 14:19:42.218704 | node1 | ok: [node1]
2026-08-18 14:19:42.218952 | node1 | ok: [node3]
2026-08-18 14:19:42.219175 | node1 |
2026-08-18 14:19:42.219411 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:19:42.219644 | node1 | Tuesday 18 August 2026  14:19:42 +0000 (0:00:00.299)       0:00:01.615 ********
2026-08-18 14:19:42.296486 | node1 | skipping: [node1]
2026-08-18 14:19:42.296678 | node1 | skipping: [node2]
2026-08-18 14:19:42.296884 | node1 | skipping: [node3]
2026-08-18 14:19:42.297150 | node1 |
2026-08-18 14:19:42.297440 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 14:19:42.297702 | node1 | Tuesday 18 August 2026  14:19:42 +0000 (0:00:00.078)       0:00:01.693 ********
2026-08-18 14:19:42.619247 | node1 | changed: [node1]
2026-08-18 14:19:42.619416 | node1 | changed: [node3]
2026-08-18 14:19:42.619617 | node1 | changed: [node2]
2026-08-18 14:19:42.619820 | node1 |
2026-08-18 14:19:42.620030 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:19:42.620234 | node1 | Tuesday 18 August 2026  14:19:42 +0000 (0:00:00.322)       0:00:02.016 ********
2026-08-18 14:19:42.719679 | node1 | ok: [node1] => {
2026-08-18 14:19:42.719885 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 14:19:42.720089 | node1 | }
2026-08-18 14:19:42.720321 | node1 | ok: [node3] => {
2026-08-18 14:19:42.720544 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 14:19:42.720741 | node1 | }
2026-08-18 14:19:42.720972 | node1 | ok: [node2] => {
2026-08-18 14:19:42.721195 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 14:19:42.721387 | node1 | }
2026-08-18 14:19:42.721589 | node1 |
2026-08-18 14:19:42.721935 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:19:42.722127 | node1 | Tuesday 18 August 2026  14:19:42 +0000 (0:00:00.100)       0:00:02.116 ********
2026-08-18 14:19:43.522509 | node1 | changed: [node1]
2026-08-18 14:19:43.522704 | node1 | changed: [node2]
2026-08-18 14:19:43.522939 | node1 | changed: [node3]
2026-08-18 14:19:43.523158 | node1 |
2026-08-18 14:19:43.523405 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:19:43.523637 | node1 | Tuesday 18 August 2026  14:19:43 +0000 (0:00:00.802)       0:00:02.919 ********
2026-08-18 14:19:43.555053 | node1 | skipping: [node1]
2026-08-18 14:19:43.623643 | node1 | skipping: [node2]
2026-08-18 14:19:43.623790 | node1 | skipping: [node3]
2026-08-18 14:19:43.624042 | node1 |
2026-08-18 14:19:43.624278 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:19:43.624450 | node1 | Tuesday 18 August 2026  14:19:43 +0000 (0:00:00.101)       0:00:03.021 ********
2026-08-18 14:19:43.713877 | node1 | skipping: [node1]
2026-08-18 14:19:43.714106 | node1 | skipping: [node2]
2026-08-18 14:19:43.714310 | node1 | skipping: [node3]
2026-08-18 14:19:43.714508 | node1 |
2026-08-18 14:19:43.714733 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:19:43.714968 | node1 | Tuesday 18 August 2026  14:19:43 +0000 (0:00:00.090)       0:00:03.111 ********
2026-08-18 14:19:43.947534 | node1 | ok: [node1]
2026-08-18 14:19:43.947713 | node1 | ok: [node2]
2026-08-18 14:19:43.947922 | node1 | ok: [node3]
2026-08-18 14:19:43.948120 | node1 |
2026-08-18 14:19:43.948343 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:19:43.948567 | node1 | Tuesday 18 August 2026  14:19:43 +0000 (0:00:00.233)       0:00:03.344 ********
2026-08-18 14:19:45.370312 | node1 | ok: [node1]
2026-08-18 14:19:45.370376 | node1 | ok: [node3]
2026-08-18 14:19:45.370427 | node1 | ok: [node2]
2026-08-18 14:19:45.370505 | node1 |
2026-08-18 14:19:45.370601 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:19:45.370694 | node1 | Tuesday 18 August 2026  14:19:45 +0000 (0:00:01.423)       0:00:04.767 ********
2026-08-18 14:19:45.477053 | node1 | ok: [node1] => {
2026-08-18 14:19:45.477276 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 14:19:45.477481 | node1 | }
2026-08-18 14:19:45.477690 | node1 | ok: [node2] => {
2026-08-18 14:19:45.477933 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 14:19:45.478212 | node1 | }
2026-08-18 14:19:45.478415 | node1 | ok: [node3] => {
2026-08-18 14:19:45.478625 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 14:19:45.478817 | node1 | }
2026-08-18 14:19:45.478995 | node1 |
2026-08-18 14:19:45.479200 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:19:45.479401 | node1 | Tuesday 18 August 2026  14:19:45 +0000 (0:00:00.106)       0:00:04.874 ********
2026-08-18 14:19:46.290155 | node1 | changed: [node2]
2026-08-18 14:19:46.290354 | node1 | changed: [node1]
2026-08-18 14:19:46.290565 | node1 | changed: [node3]
2026-08-18 14:19:46.290754 | node1 |
2026-08-18 14:19:46.290966 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:19:46.291172 | node1 | Tuesday 18 August 2026  14:19:46 +0000 (0:00:00.812)       0:00:05.687 ********
2026-08-18 14:19:49.195588 | node1 | changed: [node1]
2026-08-18 14:19:49.195699 | node1 | changed: [node3]
2026-08-18 14:19:49.195707 | node1 | changed: [node2]
2026-08-18 14:19:49.195713 | node1 |
2026-08-18 14:19:49.195719 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 14:19:49.195725 | node1 | Tuesday 18 August 2026  14:19:49 +0000 (0:00:02.905)       0:00:08.592 ********
2026-08-18 14:19:49.219708 | node1 | skipping: [node1]
2026-08-18 14:19:49.247662 | node1 | skipping: [node2]
2026-08-18 14:19:49.248360 | node1 | skipping: [node3]
2026-08-18 14:19:49.248403 | node1 |
2026-08-18 14:19:49.248424 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 14:19:49.248434 | node1 | Tuesday 18 August 2026  14:19:49 +0000 (0:00:00.052)       0:00:08.644 ********
2026-08-18 14:19:49.278450 | node1 | skipping: [node1]
2026-08-18 14:19:49.305782 | node1 | skipping: [node2]
2026-08-18 14:19:49.305983 | node1 | skipping: [node3]
2026-08-18 14:19:49.306557 | node1 |
2026-08-18 14:19:49.306585 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 14:19:49.306595 | node1 | Tuesday 18 August 2026  14:19:49 +0000 (0:00:00.058)       0:00:08.703 ********
2026-08-18 14:19:49.335189 | node1 | skipping: [node1]
2026-08-18 14:19:49.363443 | node1 | skipping: [node2]
2026-08-18 14:19:49.363545 | node1 | skipping: [node3]
2026-08-18 14:19:49.363663 | node1 |
2026-08-18 14:19:49.363936 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 14:19:49.363971 | node1 | Tuesday 18 August 2026  14:19:49 +0000 (0:00:00.057)       0:00:08.760 ********
2026-08-18 14:21:04.786924 | node1 | changed: [node1]
2026-08-18 14:21:04.787007 | node1 | changed: [node3]
2026-08-18 14:21:04.787018 | node1 | changed: [node2]
2026-08-18 14:21:04.787329 | node1 |
2026-08-18 14:21:04.787373 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 14:21:04.787379 | node1 | Tuesday 18 August 2026  14:21:04 +0000 (0:01:15.423)       0:01:24.184 ********
2026-08-18 14:21:05.421815 | node1 | changed: [node2]
2026-08-18 14:21:05.422006 | node1 | changed: [node1]
2026-08-18 14:21:05.422218 | node1 | changed: [node3]
2026-08-18 14:21:05.422403 | node1 |
2026-08-18 14:21:05.422607 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 14:21:05.422798 | node1 | Tuesday 18 August 2026  14:21:05 +0000 (0:00:00.634)       0:01:24.819 ********
2026-08-18 14:21:06.355938 | node1 | changed: [node1] => (item={'path': '/etc/containerd'})
2026-08-18 14:21:06.356102 | node1 | changed: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 14:21:06.356315 | node1 | changed: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 14:21:06.356720 | node1 | changed: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 14:21:06.357044 | node1 | changed: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 14:21:06.357328 | node1 | changed: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 14:21:06.357549 | node1 | changed: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 14:21:06.357759 | node1 | changed: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 14:21:06.357985 | node1 | changed: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 14:21:06.358201 | node1 | changed: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 14:21:06.358407 | node1 | changed: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 14:21:06.358614 | node1 | changed: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 14:21:06.358986 | node1 | changed: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 14:21:06.359213 | node1 | changed: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 14:21:06.359427 | node1 | changed: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 14:21:06.359600 | node1 |
2026-08-18 14:21:06.359795 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 14:21:06.360010 | node1 | Tuesday 18 August 2026  14:21:06 +0000 (0:00:00.933)       0:01:25.753 ********
2026-08-18 14:21:06.977396 | node1 | changed: [node1]
2026-08-18 14:21:06.977460 | node1 | changed: [node3]
2026-08-18 14:21:06.977528 | node1 | changed: [node2]
2026-08-18 14:21:06.977618 | node1 |
2026-08-18 14:21:06.977713 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 14:21:06.977804 | node1 | Tuesday 18 August 2026  14:21:06 +0000 (0:00:00.594)       0:01:26.348 ********
2026-08-18 14:21:06.977886 | node1 |
2026-08-18 14:21:06.977995 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 14:21:06.978084 | node1 | Tuesday 18 August 2026  14:21:06 +0000 (0:00:00.011)       0:01:26.359 ********
2026-08-18 14:21:06.978165 | node1 |
2026-08-18 14:21:06.978255 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 14:21:06.978344 | node1 | Tuesday 18 August 2026  14:21:06 +0000 (0:00:00.008)       0:01:26.368 ********
2026-08-18 14:21:06.978423 | node1 |
2026-08-18 14:21:06.978515 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-18 14:21:06.978604 | node1 | Tuesday 18 August 2026  14:21:06 +0000 (0:00:00.006)       0:01:26.374 ********
2026-08-18 14:21:07.852363 | node1 | ok: [node2]
2026-08-18 14:21:07.852419 | node1 | ok: [node3]
2026-08-18 14:21:07.852425 | node1 | ok: [node1]
2026-08-18 14:21:07.852448 | node1 |
2026-08-18 14:21:07.852455 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-18 14:21:07.852461 | node1 | Tuesday 18 August 2026  14:21:07 +0000 (0:00:00.874)       0:01:27.249 ********
2026-08-18 14:21:08.321526 | node1 | changed: [node1]
2026-08-18 14:21:08.321612 | node1 | changed: [node2]
2026-08-18 14:21:08.322025 | node1 | changed: [node3]
2026-08-18 14:21:08.322416 | node1 |
2026-08-18 14:21:08.322445 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 14:21:08.322457 | node1 | Tuesday 18 August 2026  14:21:08 +0000 (0:00:00.469)       0:01:27.719 ********
2026-08-18 14:21:08.890294 | node1 | changed: [node1]
2026-08-18 14:21:08.890368 | node1 | changed: [node2]
2026-08-18 14:21:08.890749 | node1 | changed: [node3]
2026-08-18 14:21:08.890795 | node1 |
2026-08-18 14:21:08.890802 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:21:08.890807 | node1 | Tuesday 18 August 2026  14:21:08 +0000 (0:00:00.568)       0:01:28.287 ********
2026-08-18 14:21:09.139748 | node1 | ok: [node1]
2026-08-18 14:21:09.139829 | node1 | ok: [node2]
2026-08-18 14:21:09.139840 | node1 | ok: [node3]
2026-08-18 14:21:09.140144 | node1 |
2026-08-18 14:21:09.140188 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:21:09.140194 | node1 | Tuesday 18 August 2026  14:21:09 +0000 (0:00:00.249)       0:01:28.537 ********
2026-08-18 14:21:09.245738 | node1 | ok: [node1] => {
2026-08-18 14:21:09.246103 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 14:21:09.246186 | node1 | }
2026-08-18 14:21:09.246211 | node1 | ok: [node2] => {
2026-08-18 14:21:09.246228 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 14:21:09.246879 | node1 | }
2026-08-18 14:21:09.246923 | node1 | ok: [node3] => {
2026-08-18 14:21:09.246929 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 14:21:09.246934 | node1 | }
2026-08-18 14:21:09.246939 | node1 |
2026-08-18 14:21:09.246943 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:21:09.246948 | node1 | Tuesday 18 August 2026  14:21:09 +0000 (0:00:00.105)       0:01:28.642 ********
2026-08-18 14:21:10.247226 | node1 | changed: [node1]
2026-08-18 14:21:10.247351 | node1 | changed: [node3]
2026-08-18 14:21:10.247363 | node1 | changed: [node2]
2026-08-18 14:21:10.247373 | node1 |
2026-08-18 14:21:10.247443 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:21:10.247581 | node1 | Tuesday 18 August 2026  14:21:10 +0000 (0:00:01.001)       0:01:29.644 ********
2026-08-18 14:21:14.687854 | node1 | changed: [node2]
2026-08-18 14:21:14.688002 | node1 | changed: [node1]
2026-08-18 14:21:14.688016 | node1 | changed: [node3]
2026-08-18 14:21:14.688026 | node1 |
2026-08-18 14:21:14.688065 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 14:21:14.688166 | node1 | Tuesday 18 August 2026  14:21:14 +0000 (0:00:04.429)       0:01:34.073 ********
2026-08-18 14:21:15.780988 | node1 | ok: [node2]
2026-08-18 14:21:15.781179 | node1 | ok: [node1]
2026-08-18 14:21:15.781454 | node1 | ok: [node3]
2026-08-18 14:21:15.781667 | node1 |
2026-08-18 14:21:15.782060 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 14:21:15.782181 | node1 | Tuesday 18 August 2026  14:21:15 +0000 (0:00:01.103)       0:01:35.177 ********
2026-08-18 14:21:16.112422 | node1 | changed: [node1]
2026-08-18 14:21:16.112610 | node1 | changed: [node3]
2026-08-18 14:21:16.112731 | node1 | changed: [node2]
2026-08-18 14:21:16.112871 | node1 |
2026-08-18 14:21:16.112996 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 14:21:16.113125 | node1 | Tuesday 18 August 2026  14:21:16 +0000 (0:00:00.331)       0:01:35.509 ********
2026-08-18 14:21:16.575448 | node1 | changed: [node1]
2026-08-18 14:21:16.575656 | node1 | changed: [node3]
2026-08-18 14:21:16.575852 | node1 | changed: [node2]
2026-08-18 14:21:16.576053 | node1 |
2026-08-18 14:21:16.576261 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 14:21:16.576470 | node1 | Tuesday 18 August 2026  14:21:16 +0000 (0:00:00.463)       0:01:35.972 ********
2026-08-18 14:21:17.142013 | node1 | changed: [node1] => (item={'path': '/etc/docker'})
2026-08-18 14:21:17.142291 | node1 | changed: [node2] => (item={'path': '/etc/docker'})
2026-08-18 14:21:17.142305 | node1 | changed: [node3] => (item={'path': '/etc/docker'})
2026-08-18 14:21:17.142316 | node1 | changed: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 14:21:17.142326 | node1 | changed: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 14:21:17.142336 | node1 | changed: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 14:21:17.142345 | node1 | changed: [node1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 14:21:17.142354 | node1 | changed: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 14:21:17.142362 | node1 | changed: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 14:21:17.142378 | node1 |
2026-08-18 14:21:17.142388 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 14:21:17.142756 | node1 | Tuesday 18 August 2026  14:21:17 +0000 (0:00:00.564)       0:01:36.536 ********
2026-08-18 14:21:17.618205 | node1 | changed: [node1]
2026-08-18 14:21:17.618883 | node1 | changed: [node3]
2026-08-18 14:21:17.618936 | node1 | changed: [node2]
2026-08-18 14:21:17.618944 | node1 |
2026-08-18 14:21:17.618951 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 14:21:17.618957 | node1 | Tuesday 18 August 2026  14:21:17 +0000 (0:00:00.478)       0:01:37.015 ********
2026-08-18 14:21:18.137562 | node1 | changed: [node1]
2026-08-18 14:21:18.137637 | node1 | changed: [node3]
2026-08-18 14:21:18.138072 | node1 | changed: [node2]
2026-08-18 14:21:18.138143 | node1 |
2026-08-18 14:21:18.138154 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 14:21:18.138172 | node1 | Tuesday 18 August 2026  14:21:18 +0000 (0:00:00.488)       0:01:37.503 ********
2026-08-18 14:21:18.139230 | node1 |
2026-08-18 14:21:18.139281 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 14:21:18.139296 | node1 | Tuesday 18 August 2026  14:21:18 +0000 (0:00:00.010)       0:01:37.514 ********
2026-08-18 14:21:18.139303 | node1 |
2026-08-18 14:21:18.139309 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 14:21:18.139314 | node1 | Tuesday 18 August 2026  14:21:18 +0000 (0:00:00.010)       0:01:37.525 ********
2026-08-18 14:21:18.139320 | node1 |
2026-08-18 14:21:18.139326 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-18 14:21:18.139331 | node1 | Tuesday 18 August 2026  14:21:18 +0000 (0:00:00.009)       0:01:37.534 ********
2026-08-18 14:21:18.886933 | node1 | ok: [node1]
2026-08-18 14:21:18.887009 | node1 | ok: [node3]
2026-08-18 14:21:18.887581 | node1 | ok: [node2]
2026-08-18 14:21:18.887639 | node1 |
2026-08-18 14:21:18.887647 | node1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-18 14:21:18.887654 | node1 | Tuesday 18 August 2026  14:21:18 +0000 (0:00:00.749)       0:01:38.284 ********
2026-08-18 14:21:19.762227 | node1 | changed: [node1]
2026-08-18 14:21:19.762337 | node1 | changed: [node2]
2026-08-18 14:21:19.762344 | node1 | changed: [node3]
2026-08-18 14:21:19.762679 | node1 |
2026-08-18 14:21:19.762739 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 14:21:19.762745 | node1 | Tuesday 18 August 2026  14:21:19 +0000 (0:00:00.875)       0:01:39.159 ********
2026-08-18 14:21:20.335965 | node1 | changed: [node1]
2026-08-18 14:21:20.336042 | node1 | changed: [node3]
2026-08-18 14:21:20.336432 | node1 | changed: [node2]
2026-08-18 14:21:20.336481 | node1 |
2026-08-18 14:21:20.336487 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:21:20.336492 | node1 | Tuesday 18 August 2026  14:21:20 +0000 (0:00:00.573)       0:01:39.733 ********
2026-08-18 14:21:20.371744 | node1 | ok: [node1] => {
2026-08-18 14:21:20.371977 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 14:21:20.372026 | node1 | }
2026-08-18 14:21:20.405406 | node1 | ok: [node2] => {
2026-08-18 14:21:20.406026 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 14:21:20.406079 | node1 | }
2026-08-18 14:21:20.406091 | node1 | ok: [node3] => {
2026-08-18 14:21:20.406101 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 14:21:20.406114 | node1 | }
2026-08-18 14:21:20.406498 | node1 |
2026-08-18 14:21:20.406529 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:21:20.406537 | node1 | Tuesday 18 August 2026  14:21:20 +0000 (0:00:00.069)       0:01:39.802 ********
2026-08-18 14:21:22.034385 | node1 | changed: [node3]
2026-08-18 14:21:22.034465 | node1 | changed: [node2]
2026-08-18 14:21:22.035012 | node1 | changed: [node1]
2026-08-18 14:21:22.035063 | node1 |
2026-08-18 14:21:22.035071 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:21:22.035079 | node1 | Tuesday 18 August 2026  14:21:22 +0000 (0:00:01.628)       0:01:41.431 ********
2026-08-18 14:21:22.067346 | node1 | skipping: [node1]
2026-08-18 14:21:22.123610 | node1 | skipping: [node2]
2026-08-18 14:21:22.123700 | node1 | skipping: [node3]
2026-08-18 14:21:22.124100 | node1 |
2026-08-18 14:21:22.124141 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 14:21:22.124152 | node1 | Tuesday 18 August 2026  14:21:22 +0000 (0:00:00.089)       0:01:41.520 ********
2026-08-18 14:21:22.195448 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 14:21:22.195544 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 14:21:22.196146 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 14:21:22.196196 | node1 |
2026-08-18 14:21:22.196204 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 14:21:22.196211 | node1 | Tuesday 18 August 2026  14:21:22 +0000 (0:00:00.071)       0:01:41.592 ********
2026-08-18 14:21:26.757777 | node1 | changed: [node3]
2026-08-18 14:21:26.757853 | node1 | changed: [node1]
2026-08-18 14:21:26.758105 | node1 | changed: [node2]
2026-08-18 14:21:26.758215 | node1 |
2026-08-18 14:21:26.758528 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 14:21:26.758691 | node1 | Tuesday 18 August 2026  14:21:26 +0000 (0:00:04.562)       0:01:46.154 ********
2026-08-18 14:21:27.441255 | node1 | ok: [node1] => (item=chronyd)
2026-08-18 14:21:27.441343 | node1 | ok: [node3] => (item=chronyd)
2026-08-18 14:21:27.441358 | node1 | ok: [node2] => (item=chronyd)
2026-08-18 14:21:27.441960 | node1 | ok: [node1] => (item=sshd)
2026-08-18 14:21:27.442009 | node1 | ok: [node3] => (item=sshd)
2026-08-18 14:21:27.442014 | node1 | ok: [node2] => (item=sshd)
2026-08-18 14:21:27.442019 | node1 |
2026-08-18 14:21:27.442024 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 14:21:27.442029 | node1 | Tuesday 18 August 2026  14:21:27 +0000 (0:00:00.683)       0:01:46.838 ********
2026-08-18 14:21:27.674055 | node1 | ok: [node1]
2026-08-18 14:21:27.674161 | node1 | ok: [node3]
2026-08-18 14:21:27.674724 | node1 | ok: [node2]
2026-08-18 14:21:27.674777 | node1 |
2026-08-18 14:21:27.674786 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 14:21:27.674794 | node1 | Tuesday 18 August 2026  14:21:27 +0000 (0:00:00.232)       0:01:47.071 ********
2026-08-18 14:21:28.112664 | node1 | changed: [node1]
2026-08-18 14:21:28.112742 | node1 | changed: [node2]
2026-08-18 14:21:28.113301 | node1 | changed: [node3]
2026-08-18 14:21:28.113354 | node1 |
2026-08-18 14:21:28.113362 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 14:21:28.113370 | node1 | Tuesday 18 August 2026  14:21:28 +0000 (0:00:00.438)       0:01:47.509 ********
2026-08-18 14:21:28.604972 | node1 | changed: [node1]
2026-08-18 14:21:28.605043 | node1 | changed: [node2]
2026-08-18 14:21:28.605100 | node1 | changed: [node3]
2026-08-18 14:21:28.605406 | node1 |
2026-08-18 14:21:28.605583 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 14:21:28.605590 | node1 | Tuesday 18 August 2026  14:21:28 +0000 (0:00:00.492)       0:01:48.002 ********
2026-08-18 14:21:28.636921 | node1 | skipping: [node1]
2026-08-18 14:21:28.667649 | node1 | skipping: [node2]
2026-08-18 14:21:28.667742 | node1 | skipping: [node3]
2026-08-18 14:21:28.667861 | node1 |
2026-08-18 14:21:28.668177 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 14:21:28.668230 | node1 | Tuesday 18 August 2026  14:21:28 +0000 (0:00:00.062)       0:01:48.065 ********
2026-08-18 14:22:09.302378 | node1 | changed: [node2]
2026-08-18 14:22:09.302477 | node1 | changed: [node1]
2026-08-18 14:22:09.302490 | node1 | changed: [node3]
2026-08-18 14:22:09.302548 | node1 |
2026-08-18 14:22:09.302654 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 14:22:09.302752 | node1 | Tuesday 18 August 2026  14:22:09 +0000 (0:00:40.623)       0:02:28.688 ********
2026-08-18 14:22:09.809370 | node1 | changed: [node1]
2026-08-18 14:22:09.809447 | node1 | changed: [node2]
2026-08-18 14:22:09.809755 | node1 | changed: [node3]
2026-08-18 14:22:09.810012 | node1 |
2026-08-18 14:22:09.810231 | node1 | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] ***
2026-08-18 14:22:09.810439 | node1 | Tuesday 18 August 2026  14:22:09 +0000 (0:00:00.517)       0:02:29.206 ********
2026-08-18 14:22:09.926597 | node1 | ok: [node2]
2026-08-18 14:22:09.926750 | node1 | ok: [node1]
2026-08-18 14:22:09.926959 | node1 | ok: [node3]
2026-08-18 14:22:09.927183 | node1 |
2026-08-18 14:22:09.927798 | node1 | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] ***
2026-08-18 14:22:09.927823 | node1 | Tuesday 18 August 2026  14:22:09 +0000 (0:00:00.117)       0:02:29.323 ********
2026-08-18 14:22:09.998364 | node1 | ok: [node1] => {
2026-08-18 14:22:09.998558 | node1 |     "changed": false,
2026-08-18 14:22:09.998577 | node1 |     "msg": "All assertions passed"
2026-08-18 14:22:09.998703 | node1 | }
2026-08-18 14:22:09.998834 | node1 | ok: [node2] => {
2026-08-18 14:22:09.998958 | node1 |     "changed": false,
2026-08-18 14:22:09.999089 | node1 |     "msg": "All assertions passed"
2026-08-18 14:22:09.999282 | node1 | }
2026-08-18 14:22:09.999303 | node1 | ok: [node3] => {
2026-08-18 14:22:09.999436 | node1 |     "changed": false,
2026-08-18 14:22:09.999560 | node1 |     "msg": "All assertions passed"
2026-08-18 14:22:09.999678 | node1 | }
2026-08-18 14:22:09.999790 | node1 |
2026-08-18 14:22:09.999914 | node1 | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] *******************
2026-08-18 14:22:10.000036 | node1 | Tuesday 18 August 2026  14:22:09 +0000 (0:00:00.071)       0:02:29.395 ********
2026-08-18 14:22:10.065444 | node1 | ok: [node1]
2026-08-18 14:22:10.065500 | node1 | ok: [node2]
2026-08-18 14:22:10.065570 | node1 | ok: [node3]
2026-08-18 14:22:10.065672 | node1 |
2026-08-18 14:22:10.065779 | node1 | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] ***
2026-08-18 14:22:10.065884 | node1 | Tuesday 18 August 2026  14:22:10 +0000 (0:00:00.067)       0:02:29.462 ********
2026-08-18 14:22:10.620593 | node1 | ok: [node1] => (item=node1)
2026-08-18 14:22:10.620724 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 14:22:10.620923 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 14:22:10.621151 | node1 |
2026-08-18 14:22:10.621471 | node1 | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] ***
2026-08-18 14:22:10.621702 | node1 | Tuesday 18 August 2026  14:22:10 +0000 (0:00:00.555)       0:02:30.017 ********
2026-08-18 14:22:10.692747 | node1 | ok: [node1]
2026-08-18 14:22:10.692913 | node1 | ok: [node2]
2026-08-18 14:22:10.693101 | node1 | ok: [node3]
2026-08-18 14:22:10.693274 | node1 |
2026-08-18 14:22:10.693484 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] *******************************
2026-08-18 14:22:10.693683 | node1 | Tuesday 18 August 2026  14:22:10 +0000 (0:00:00.072)       0:02:30.090 ********
2026-08-18 14:22:10.814190 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap.yml for node1, node2, node3
2026-08-18 14:22:10.814340 | node1 |
2026-08-18 14:22:10.814560 | node1 | TASK [vexxhost.ceph.mon : Ensure /etc/ceph exists] *****************************
2026-08-18 14:22:10.814737 | node1 | Tuesday 18 August 2026  14:22:10 +0000 (0:00:00.121)       0:02:30.211 ********
2026-08-18 14:22:11.020950 | node1 | skipping: [node2]
2026-08-18 14:22:11.021172 | node1 | skipping: [node3]
2026-08-18 14:22:11.021434 | node1 | changed: [node1]
2026-08-18 14:22:11.021667 | node1 |
2026-08-18 14:22:11.022015 | node1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH private key] ***********
2026-08-18 14:22:11.022293 | node1 | Tuesday 18 August 2026  14:22:11 +0000 (0:00:00.206)       0:02:30.418 ********
2026-08-18 14:22:11.078696 | node1 | skipping: [node1]
2026-08-18 14:22:11.078937 | node1 | skipping: [node2]
2026-08-18 14:22:11.079144 | node1 | skipping: [node3]
2026-08-18 14:22:11.079373 | node1 |
2026-08-18 14:22:11.079577 | node1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH public key] ************
2026-08-18 14:22:11.079780 | node1 | Tuesday 18 August 2026  14:22:11 +0000 (0:00:00.057)       0:02:30.475 ********
2026-08-18 14:22:11.142783 | node1 | skipping: [node1]
2026-08-18 14:22:11.143000 | node1 | skipping: [node2]
2026-08-18 14:22:11.143219 | node1 | skipping: [node3]
2026-08-18 14:22:11.143424 | node1 |
2026-08-18 14:22:11.143653 | node1 | TASK [vexxhost.ceph.mon : Generate a cephadm SSH keypair when none was provided] ***
2026-08-18 14:22:11.143882 | node1 | Tuesday 18 August 2026  14:22:11 +0000 (0:00:00.064)       0:02:30.540 ********
2026-08-18 14:22:13.303986 | node1 | skipping: [node2]
2026-08-18 14:22:13.304024 | node1 | skipping: [node3]
2026-08-18 14:22:13.304029 | node1 | changed: [node1]
2026-08-18 14:22:13.304033 | node1 |
2026-08-18 14:22:13.304038 | node1 | TASK [vexxhost.ceph.mon : Create a temporary ceph.conf for bootstrap overrides] ***
2026-08-18 14:22:13.304042 | node1 | Tuesday 18 August 2026  14:22:13 +0000 (0:00:02.160)       0:02:32.700 ********
2026-08-18 14:22:13.600398 | node1 | skipping: [node2]
2026-08-18 14:22:13.600494 | node1 | skipping: [node3]
2026-08-18 14:22:13.600572 | node1 | changed: [node1]
2026-08-18 14:22:13.600877 | node1 |
2026-08-18 14:22:13.600924 | node1 | TASK [vexxhost.ceph.mon : Populate bootstrap ceph.conf overrides] **************
2026-08-18 14:22:13.600930 | node1 | Tuesday 18 August 2026  14:22:13 +0000 (0:00:00.296)       0:02:32.997 ********
2026-08-18 14:22:13.636380 | node1 | skipping: [node1]
2026-08-18 14:22:13.656868 | node1 | skipping: [node2]
2026-08-18 14:22:13.657476 | node1 | skipping: [node3]
2026-08-18 14:22:13.657527 | node1 |
2026-08-18 14:22:13.657536 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] *******************************
2026-08-18 14:22:13.657543 | node1 | Tuesday 18 August 2026  14:22:13 +0000 (0:00:00.056)       0:02:33.054 ********
2026-08-18 14:22:54.686081 | node1 | skipping: [node2]
2026-08-18 14:22:54.686151 | node1 | skipping: [node3]
2026-08-18 14:22:54.686565 | node1 | changed: [node1]
2026-08-18 14:22:54.686614 | node1 |
2026-08-18 14:22:54.686620 | node1 | TASK [vexxhost.ceph.mon : Remove the temporary ceph.conf] **********************
2026-08-18 14:22:54.686626 | node1 | Tuesday 18 August 2026  14:22:54 +0000 (0:00:41.029)       0:03:14.083 ********
2026-08-18 14:22:54.905146 | node1 | skipping: [node2]
2026-08-18 14:22:54.905209 | node1 | skipping: [node3]
2026-08-18 14:22:54.905856 | node1 | changed: [node1]
2026-08-18 14:22:54.905926 | node1 |
2026-08-18 14:22:54.905936 | node1 | TASK [Register this monitor host] **********************************************
2026-08-18 14:22:54.905943 | node1 | Tuesday 18 August 2026  14:22:54 +0000 (0:00:00.218)       0:03:14.302 ********
2026-08-18 14:22:55.042585 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 14:22:55.042661 | node1 |
2026-08-18 14:22:55.042904 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 14:22:55.042951 | node1 | Tuesday 18 August 2026  14:22:55 +0000 (0:00:00.137)       0:03:14.440 ********
2026-08-18 14:22:56.568784 | node1 | ok: [node1]
2026-08-18 14:22:56.568855 | node1 |
2026-08-18 14:22:56.568952 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 14:22:56.569085 | node1 | Tuesday 18 August 2026  14:22:56 +0000 (0:00:01.526)       0:03:15.966 ********
2026-08-18 14:22:56.643495 | node1 | ok: [node1]
2026-08-18 14:22:56.643565 | node1 | ok: [node2]
2026-08-18 14:22:56.643941 | node1 | ok: [node3]
2026-08-18 14:22:56.643988 | node1 |
2026-08-18 14:22:56.643998 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 14:22:56.644005 | node1 | Tuesday 18 August 2026  14:22:56 +0000 (0:00:00.074)       0:03:16.040 ********
2026-08-18 14:22:56.721000 | node1 | ok: [node1] => {
2026-08-18 14:22:56.721089 | node1 |     "changed": false,
2026-08-18 14:22:56.722725 | node1 |     "msg": "All assertions passed"
2026-08-18 14:22:56.722749 | node1 | }
2026-08-18 14:22:56.722757 | node1 | ok: [node2] => {
2026-08-18 14:22:56.722762 | node1 |     "changed": false,
2026-08-18 14:22:56.722768 | node1 |     "msg": "All assertions passed"
2026-08-18 14:22:56.722774 | node1 | }
2026-08-18 14:22:56.722780 | node1 | ok: [node3] => {
2026-08-18 14:22:56.722785 | node1 |     "changed": false,
2026-08-18 14:22:56.722791 | node1 |     "msg": "All assertions passed"
2026-08-18 14:22:56.722796 | node1 | }
2026-08-18 14:22:56.722802 | node1 |
2026-08-18 14:22:56.722808 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 14:22:56.722814 | node1 | Tuesday 18 August 2026  14:22:56 +0000 (0:00:00.077)       0:03:16.118 ********
2026-08-18 14:22:57.091838 | node1 | ok: [node1]
2026-08-18 14:22:57.091947 | node1 | changed: [node3]
2026-08-18 14:22:57.092075 | node1 | changed: [node2]
2026-08-18 14:22:57.092191 | node1 |
2026-08-18 14:22:57.092343 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 14:22:57.092470 | node1 | Tuesday 18 August 2026  14:22:57 +0000 (0:00:00.371)       0:03:16.489 ********
2026-08-18 14:22:57.164940 | node1 | ok: [node1]
2026-08-18 14:22:57.165832 | node1 | ok: [node2]
2026-08-18 14:22:57.165865 | node1 | ok: [node3]
2026-08-18 14:22:57.165871 | node1 |
2026-08-18 14:22:57.165876 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 14:22:57.165884 | node1 | Tuesday 18 August 2026  14:22:57 +0000 (0:00:00.072)       0:03:16.562 ********
2026-08-18 14:22:57.254701 | node1 | ok: [node1]
2026-08-18 14:22:57.254833 | node1 | ok: [node2]
2026-08-18 14:22:57.255411 | node1 | ok: [node3]
2026-08-18 14:22:57.255459 | node1 |
2026-08-18 14:22:57.255474 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 14:22:57.255483 | node1 | Tuesday 18 August 2026  14:22:57 +0000 (0:00:00.089)       0:03:16.651 ********
2026-08-18 14:22:57.333267 | node1 | ok: [node1] => {
2026-08-18 14:22:57.333341 | node1 |     "changed": false,
2026-08-18 14:22:57.333493 | node1 |     "msg": "All assertions passed"
2026-08-18 14:22:57.333634 | node1 | }
2026-08-18 14:22:57.333781 | node1 | ok: [node2] => {
2026-08-18 14:22:57.333945 | node1 |     "changed": false,
2026-08-18 14:22:57.334117 | node1 |     "msg": "All assertions passed"
2026-08-18 14:22:57.334224 | node1 | }
2026-08-18 14:22:57.334363 | node1 | ok: [node3] => {
2026-08-18 14:22:57.334504 | node1 |     "changed": false,
2026-08-18 14:22:57.334645 | node1 |     "msg": "All assertions passed"
2026-08-18 14:22:57.334780 | node1 | }
2026-08-18 14:22:57.334904 | node1 |
2026-08-18 14:22:57.335049 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 14:22:57.335186 | node1 | Tuesday 18 August 2026  14:22:57 +0000 (0:00:00.078)       0:03:16.730 ********
2026-08-18 14:23:23.794734 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:23:23.794818 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:23:23.795191 | node1 | changed: [node1]
2026-08-18 14:23:23.795234 | node1 |
2026-08-18 14:23:23.795240 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 14:23:23.795247 | node1 | Tuesday 18 August 2026  14:23:23 +0000 (0:00:26.461)       0:03:43.192 ********
2026-08-18 14:23:23.909506 | node1 | skipping: [node1]
2026-08-18 14:23:23.909565 | node1 | skipping: [node2]
2026-08-18 14:23:23.910149 | node1 | skipping: [node3]
2026-08-18 14:23:23.910228 | node1 |
2026-08-18 14:23:23.910240 | node1 | TASK [vexxhost.ceph.mon : Apply the monitor service spec] **********************
2026-08-18 14:23:23.910251 | node1 | Tuesday 18 August 2026  14:23:23 +0000 (0:00:00.114)       0:03:43.306 ********
2026-08-18 14:23:26.725299 | node1 | changed: [node1]
2026-08-18 14:23:26.725378 | node1 |
2026-08-18 14:23:26.725596 | node1 | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ********
2026-08-18 14:23:26.725642 | node1 | Tuesday 18 August 2026  14:23:26 +0000 (0:00:02.816)       0:03:46.122 ********
2026-08-18 14:23:28.372807 | node1 | ok: [node1]
2026-08-18 14:23:28.372886 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:23:28.372947 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:23:28.373242 | node1 |
2026-08-18 14:23:28.373288 | node1 | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] ***********************
2026-08-18 14:23:28.373294 | node1 | Tuesday 18 August 2026  14:23:28 +0000 (0:00:01.647)       0:03:47.770 ********
2026-08-18 14:23:28.981170 | node1 | ok: [node1] => (item=node1)
2026-08-18 14:23:28.981252 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 14:23:28.981320 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 14:23:28.981631 | node1 |
2026-08-18 14:23:28.981679 | node1 | TASK [vexxhost.ceph.mgr : Select the admin host] *******************************
2026-08-18 14:23:28.981686 | node1 | Tuesday 18 August 2026  14:23:28 +0000 (0:00:00.608)       0:03:48.378 ********
2026-08-18 14:23:29.060276 | node1 | ok: [node1]
2026-08-18 14:23:29.060350 | node1 | ok: [node2]
2026-08-18 14:23:29.060409 | node1 | ok: [node3]
2026-08-18 14:23:29.060494 | node1 |
2026-08-18 14:23:29.060590 | node1 | TASK [Register this manager host] **********************************************
2026-08-18 14:23:29.060683 | node1 | Tuesday 18 August 2026  14:23:29 +0000 (0:00:00.079)       0:03:48.457 ********
2026-08-18 14:23:29.190976 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 14:23:29.191145 | node1 |
2026-08-18 14:23:29.191365 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 14:23:29.191573 | node1 | Tuesday 18 August 2026  14:23:29 +0000 (0:00:00.130)       0:03:48.588 ********
2026-08-18 14:23:30.709390 | node1 | ok: [node1]
2026-08-18 14:23:30.709551 | node1 |
2026-08-18 14:23:30.709794 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 14:23:30.710075 | node1 | Tuesday 18 August 2026  14:23:30 +0000 (0:00:01.518)       0:03:50.106 ********
2026-08-18 14:23:30.782074 | node1 | ok: [node1]
2026-08-18 14:23:30.782311 | node1 | ok: [node2]
2026-08-18 14:23:30.782523 | node1 | ok: [node3]
2026-08-18 14:23:30.782892 | node1 |
2026-08-18 14:23:30.783152 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 14:23:30.783387 | node1 | Tuesday 18 August 2026  14:23:30 +0000 (0:00:00.072)       0:03:50.179 ********
2026-08-18 14:23:30.856460 | node1 | ok: [node1] => {
2026-08-18 14:23:30.856661 | node1 |     "changed": false,
2026-08-18 14:23:30.856876 | node1 |     "msg": "All assertions passed"
2026-08-18 14:23:30.857093 | node1 | }
2026-08-18 14:23:30.857301 | node1 | ok: [node2] => {
2026-08-18 14:23:30.857511 | node1 |     "changed": false,
2026-08-18 14:23:30.857724 | node1 |     "msg": "All assertions passed"
2026-08-18 14:23:30.857955 | node1 | }
2026-08-18 14:23:30.858168 | node1 | ok: [node3] => {
2026-08-18 14:23:30.858376 | node1 |     "changed": false,
2026-08-18 14:23:30.858586 | node1 |     "msg": "All assertions passed"
2026-08-18 14:23:30.858788 | node1 | }
2026-08-18 14:23:30.858970 | node1 |
2026-08-18 14:23:30.859185 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 14:23:30.859458 | node1 | Tuesday 18 August 2026  14:23:30 +0000 (0:00:00.074)       0:03:50.253 ********
2026-08-18 14:23:31.139560 | node1 | ok: [node1]
2026-08-18 14:23:31.139784 | node1 | ok: [node2]
2026-08-18 14:23:31.140029 | node1 | ok: [node3]
2026-08-18 14:23:31.140202 | node1 |
2026-08-18 14:23:31.140456 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 14:23:31.140672 | node1 | Tuesday 18 August 2026  14:23:31 +0000 (0:00:00.283)       0:03:50.536 ********
2026-08-18 14:23:31.212487 | node1 | ok: [node1]
2026-08-18 14:23:31.212688 | node1 | ok: [node2]
2026-08-18 14:23:31.212913 | node1 | ok: [node3]
2026-08-18 14:23:31.213104 | node1 |
2026-08-18 14:23:31.213348 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 14:23:31.213577 | node1 | Tuesday 18 August 2026  14:23:31 +0000 (0:00:00.072)       0:03:50.609 ********
2026-08-18 14:23:31.311708 | node1 | ok: [node1]
2026-08-18 14:23:31.311911 | node1 | ok: [node2]
2026-08-18 14:23:31.312148 | node1 | ok: [node3]
2026-08-18 14:23:31.312428 | node1 |
2026-08-18 14:23:31.312737 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 14:23:31.312982 | node1 | Tuesday 18 August 2026  14:23:31 +0000 (0:00:00.099)       0:03:50.708 ********
2026-08-18 14:23:31.384767 | node1 | ok: [node1] => {
2026-08-18 14:23:31.384853 | node1 |     "changed": false,
2026-08-18 14:23:31.384903 | node1 |     "msg": "All assertions passed"
2026-08-18 14:23:31.385010 | node1 | }
2026-08-18 14:23:31.385070 | node1 | ok: [node2] => {
2026-08-18 14:23:31.385168 | node1 |     "changed": false,
2026-08-18 14:23:31.385263 | node1 |     "msg": "All assertions passed"
2026-08-18 14:23:31.385353 | node1 | }
2026-08-18 14:23:31.385438 | node1 | ok: [node3] => {
2026-08-18 14:23:31.385536 | node1 |     "changed": false,
2026-08-18 14:23:31.385632 | node1 |     "msg": "All assertions passed"
2026-08-18 14:23:31.385704 | node1 | }
2026-08-18 14:23:31.385790 | node1 |
2026-08-18 14:23:31.385908 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 14:23:31.386022 | node1 | Tuesday 18 August 2026  14:23:31 +0000 (0:00:00.073)       0:03:50.782 ********
2026-08-18 14:23:36.590009 | node1 | ok: [node1]
2026-08-18 14:23:36.590126 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:23:36.590932 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:23:36.591004 | node1 |
2026-08-18 14:23:36.591018 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 14:23:36.591029 | node1 | Tuesday 18 August 2026  14:23:36 +0000 (0:00:05.204)       0:03:55.986 ********
2026-08-18 14:23:36.676955 | node1 | skipping: [node1]
2026-08-18 14:23:36.677013 | node1 | skipping: [node2]
2026-08-18 14:23:36.677402 | node1 | skipping: [node3]
2026-08-18 14:23:36.677451 | node1 |
2026-08-18 14:23:36.677457 | node1 | TASK [vexxhost.ceph.mgr : Apply the manager service spec] **********************
2026-08-18 14:23:36.677462 | node1 | Tuesday 18 August 2026  14:23:36 +0000 (0:00:00.087)       0:03:56.074 ********
2026-08-18 14:23:39.438395 | node1 | changed: [node1]
2026-08-18 14:23:39.438445 | node1 |
2026-08-18 14:23:39.438451 | node1 | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ********
2026-08-18 14:23:39.438456 | node1 | Tuesday 18 August 2026  14:23:39 +0000 (0:00:02.761)       0:03:58.835 ********
2026-08-18 14:23:40.938666 | node1 | ok: [node1]
2026-08-18 14:23:40.938742 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:23:40.938828 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:23:40.939147 | node1 |
2026-08-18 14:23:40.939188 | node1 | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] **************************
2026-08-18 14:23:40.939194 | node1 | Tuesday 18 August 2026  14:23:40 +0000 (0:00:01.500)       0:04:00.336 ********
2026-08-18 14:23:51.068081 | node1 | changed: [node1] => (item={'name': 'diskprediction_local'})
2026-08-18 14:23:51.068164 | node1 | changed: [node1] => (item={'name': 'dashboard'})
2026-08-18 14:23:51.068233 | node1 | ok: [node1] => (item={'name': 'iostat'})
2026-08-18 14:23:51.068326 | node1 | changed: [node1] => (item={'name': 'prometheus'})
2026-08-18 14:23:51.068422 | node1 | changed: [node1] => (item={'name': 'rgw'})
2026-08-18 14:23:51.068513 | node1 |
2026-08-18 14:23:51.068606 | node1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-08-18 14:23:51.068693 | node1 |
2026-08-18 14:23:51.068789 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 14:23:51.068886 | node1 | Tuesday 18 August 2026  14:23:51 +0000 (0:00:10.129)       0:04:10.465 ********
2026-08-18 14:23:52.061686 | node1 | ok: [node2]
2026-08-18 14:23:52.061763 | node1 | ok: [node1]
2026-08-18 14:23:52.061821 | node1 | ok: [node3]
2026-08-18 14:23:52.061927 | node1 |
2026-08-18 14:23:52.062045 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:23:52.062125 | node1 | Tuesday 18 August 2026  14:23:52 +0000 (0:00:00.993)       0:04:11.458 ********
2026-08-18 14:23:52.289975 | node1 | ok: [node1]
2026-08-18 14:23:52.290054 | node1 | ok: [node2]
2026-08-18 14:23:52.290436 | node1 | ok: [node3]
2026-08-18 14:23:52.290483 | node1 |
2026-08-18 14:23:52.290489 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:23:52.290495 | node1 | Tuesday 18 August 2026  14:23:52 +0000 (0:00:00.228)       0:04:11.687 ********
2026-08-18 14:23:52.320503 | node1 | skipping: [node1]
2026-08-18 14:23:52.368618 | node1 | skipping: [node2]
2026-08-18 14:23:52.368650 | node1 | skipping: [node3]
2026-08-18 14:23:52.368667 | node1 |
2026-08-18 14:23:52.368671 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 14:23:52.368676 | node1 | Tuesday 18 August 2026  14:23:52 +0000 (0:00:00.078)       0:04:11.765 ********
2026-08-18 14:23:52.608077 | node1 | ok: [node1]
2026-08-18 14:23:52.608163 | node1 | ok: [node2]
2026-08-18 14:23:52.608241 | node1 | ok: [node3]
2026-08-18 14:23:52.608309 | node1 |
2026-08-18 14:23:52.608413 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:23:52.608545 | node1 | Tuesday 18 August 2026  14:23:52 +0000 (0:00:00.239)       0:04:12.005 ********
2026-08-18 14:23:52.687035 | node1 | ok: [node1] => {
2026-08-18 14:23:52.687076 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 14:23:52.687082 | node1 | }
2026-08-18 14:23:52.687086 | node1 | ok: [node2] => {
2026-08-18 14:23:52.687090 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 14:23:52.687095 | node1 | }
2026-08-18 14:23:52.687099 | node1 | ok: [node3] => {
2026-08-18 14:23:52.687103 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 14:23:52.687107 | node1 | }
2026-08-18 14:23:52.687111 | node1 |
2026-08-18 14:23:52.687115 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:23:52.687120 | node1 | Tuesday 18 August 2026  14:23:52 +0000 (0:00:00.078)       0:04:12.083 ********
2026-08-18 14:23:53.026861 | node1 | ok: [node1]
2026-08-18 14:23:53.026929 | node1 | ok: [node2]
2026-08-18 14:23:53.026940 | node1 | ok: [node3]
2026-08-18 14:23:53.026950 | node1 |
2026-08-18 14:23:53.026960 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:23:53.026970 | node1 | Tuesday 18 August 2026  14:23:53 +0000 (0:00:00.338)       0:04:12.422 ********
2026-08-18 14:23:53.132062 | node1 | skipping: [node1]
2026-08-18 14:23:53.132123 | node1 | skipping: [node2]
2026-08-18 14:23:53.132226 | node1 | skipping: [node3]
2026-08-18 14:23:53.132316 | node1 |
2026-08-18 14:23:53.132420 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:23:53.132526 | node1 | Tuesday 18 August 2026  14:23:53 +0000 (0:00:00.106)       0:04:12.529 ********
2026-08-18 14:23:53.218853 | node1 | skipping: [node1]
2026-08-18 14:23:53.218914 | node1 | skipping: [node2]
2026-08-18 14:23:53.219348 | node1 | skipping: [node3]
2026-08-18 14:23:53.219435 | node1 |
2026-08-18 14:23:53.219441 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:23:53.219447 | node1 | Tuesday 18 August 2026  14:23:53 +0000 (0:00:00.086)       0:04:12.615 ********
2026-08-18 14:23:53.465057 | node1 | ok: [node2]
2026-08-18 14:23:53.465133 | node1 | ok: [node1]
2026-08-18 14:23:53.465241 | node1 | ok: [node3]
2026-08-18 14:23:53.465331 | node1 |
2026-08-18 14:23:53.465435 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:23:53.465534 | node1 | Tuesday 18 August 2026  14:23:53 +0000 (0:00:00.246)       0:04:12.862 ********
2026-08-18 14:23:54.590525 | node1 | ok: [node3]
2026-08-18 14:23:54.590604 | node1 | ok: [node1]
2026-08-18 14:23:54.590610 | node1 | ok: [node2]
2026-08-18 14:23:54.590615 | node1 |
2026-08-18 14:23:54.590620 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:23:54.590626 | node1 | Tuesday 18 August 2026  14:23:54 +0000 (0:00:01.124)       0:04:13.987 ********
2026-08-18 14:23:54.693655 | node1 | ok: [node1] => {
2026-08-18 14:23:54.693761 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 14:23:54.693826 | node1 | }
2026-08-18 14:23:54.694014 | node1 | ok: [node2] => {
2026-08-18 14:23:54.694109 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 14:23:54.694124 | node1 | }
2026-08-18 14:23:54.694681 | node1 | ok: [node3] => {
2026-08-18 14:23:54.694733 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 14:23:54.694739 | node1 | }
2026-08-18 14:23:54.694745 | node1 |
2026-08-18 14:23:54.694749 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:23:54.694766 | node1 | Tuesday 18 August 2026  14:23:54 +0000 (0:00:00.103)       0:04:14.090 ********
2026-08-18 14:23:55.098506 | node1 | ok: [node1]
2026-08-18 14:23:55.098621 | node1 | ok: [node2]
2026-08-18 14:23:55.099388 | node1 | ok: [node3]
2026-08-18 14:23:55.099442 | node1 |
2026-08-18 14:23:55.099450 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:23:55.099457 | node1 | Tuesday 18 August 2026  14:23:55 +0000 (0:00:00.404)       0:04:14.495 ********
2026-08-18 14:23:57.104065 | node1 | ok: [node2]
2026-08-18 14:23:57.104137 | node1 | ok: [node3]
2026-08-18 14:23:57.104502 | node1 | ok: [node1]
2026-08-18 14:23:57.104552 | node1 |
2026-08-18 14:23:57.104558 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 14:23:57.104563 | node1 | Tuesday 18 August 2026  14:23:57 +0000 (0:00:02.005)       0:04:16.501 ********
2026-08-18 14:23:57.139304 | node1 | skipping: [node1]
2026-08-18 14:23:57.168761 | node1 | skipping: [node2]
2026-08-18 14:23:57.169257 | node1 | skipping: [node3]
2026-08-18 14:23:57.169278 | node1 |
2026-08-18 14:23:57.169286 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 14:23:57.169293 | node1 | Tuesday 18 August 2026  14:23:57 +0000 (0:00:00.064)       0:04:16.566 ********
2026-08-18 14:23:57.199615 | node1 | skipping: [node1]
2026-08-18 14:23:57.226179 | node1 | skipping: [node2]
2026-08-18 14:23:57.226715 | node1 | skipping: [node3]
2026-08-18 14:23:57.226769 | node1 |
2026-08-18 14:23:57.226777 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 14:23:57.226784 | node1 | Tuesday 18 August 2026  14:23:57 +0000 (0:00:00.057)       0:04:16.623 ********
2026-08-18 14:23:57.263263 | node1 | skipping: [node1]
2026-08-18 14:23:57.297814 | node1 | skipping: [node2]
2026-08-18 14:23:57.298081 | node1 | skipping: [node3]
2026-08-18 14:23:57.298160 | node1 |
2026-08-18 14:23:57.298175 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 14:23:57.298390 | node1 | Tuesday 18 August 2026  14:23:57 +0000 (0:00:00.070)       0:04:16.694 ********
2026-08-18 14:23:58.397439 | node1 | ok: [node2]
2026-08-18 14:23:58.397531 | node1 | ok: [node3]
2026-08-18 14:23:58.397987 | node1 | ok: [node1]
2026-08-18 14:23:58.398049 | node1 |
2026-08-18 14:23:58.398257 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 14:23:58.398273 | node1 | Tuesday 18 August 2026  14:23:58 +0000 (0:00:01.100)       0:04:17.794 ********
2026-08-18 14:23:58.871221 | node1 | ok: [node2]
2026-08-18 14:23:58.871268 | node1 | ok: [node1]
2026-08-18 14:23:58.871275 | node1 | ok: [node3]
2026-08-18 14:23:58.871282 | node1 |
2026-08-18 14:23:58.871288 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 14:23:58.871295 | node1 | Tuesday 18 August 2026  14:23:58 +0000 (0:00:00.472)       0:04:18.267 ********
2026-08-18 14:23:59.830066 | node1 | ok: [node1] => (item={'path': '/etc/containerd'})
2026-08-18 14:23:59.830173 | node1 | ok: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 14:23:59.830194 | node1 | ok: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 14:23:59.830210 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 14:23:59.830228 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 14:23:59.830254 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 14:23:59.830704 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 14:23:59.830956 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 14:23:59.831178 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 14:23:59.831419 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 14:23:59.831653 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 14:23:59.831880 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 14:23:59.832127 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 14:23:59.832438 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 14:23:59.832573 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 14:23:59.832770 | node1 |
2026-08-18 14:23:59.832992 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 14:23:59.833206 | node1 | Tuesday 18 August 2026  14:23:59 +0000 (0:00:00.958)       0:04:19.225 ********
2026-08-18 14:24:00.480335 | node1 | ok: [node2]
2026-08-18 14:24:00.480477 | node1 | ok: [node3]
2026-08-18 14:24:00.480678 | node1 | ok: [node1]
2026-08-18 14:24:00.480866 | node1 |
2026-08-18 14:24:00.481078 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 14:24:00.481281 | node1 | Tuesday 18 August 2026  14:24:00 +0000 (0:00:00.622)       0:04:19.848 ********
2026-08-18 14:24:00.481455 | node1 |
2026-08-18 14:24:00.481670 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 14:24:00.481863 | node1 | Tuesday 18 August 2026  14:24:00 +0000 (0:00:00.010)       0:04:19.859 ********
2026-08-18 14:24:00.482181 | node1 |
2026-08-18 14:24:00.482410 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 14:24:00.482602 | node1 | Tuesday 18 August 2026  14:24:00 +0000 (0:00:00.011)       0:04:19.870 ********
2026-08-18 14:24:00.482782 | node1 |
2026-08-18 14:24:00.482983 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 14:24:00.483190 | node1 | Tuesday 18 August 2026  14:24:00 +0000 (0:00:00.006)       0:04:19.877 ********
2026-08-18 14:24:00.881695 | node1 | ok: [node3]
2026-08-18 14:24:00.881811 | node1 | ok: [node1]
2026-08-18 14:24:00.881823 | node1 | ok: [node2]
2026-08-18 14:24:00.881844 | node1 |
2026-08-18 14:24:00.882309 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:24:00.882379 | node1 | Tuesday 18 August 2026  14:24:00 +0000 (0:00:00.400)       0:04:20.278 ********
2026-08-18 14:24:01.122709 | node1 | ok: [node1]
2026-08-18 14:24:01.122777 | node1 | ok: [node3]
2026-08-18 14:24:01.122855 | node1 | ok: [node2]
2026-08-18 14:24:01.122934 | node1 |
2026-08-18 14:24:01.123032 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:24:01.123126 | node1 | Tuesday 18 August 2026  14:24:01 +0000 (0:00:00.241)       0:04:20.519 ********
2026-08-18 14:24:01.205099 | node1 | ok: [node1] => {
2026-08-18 14:24:01.205168 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 14:24:01.205270 | node1 | }
2026-08-18 14:24:01.205351 | node1 | ok: [node2] => {
2026-08-18 14:24:01.205450 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 14:24:01.205538 | node1 | }
2026-08-18 14:24:01.205620 | node1 | ok: [node3] => {
2026-08-18 14:24:01.205717 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 14:24:01.205850 | node1 | }
2026-08-18 14:24:01.205935 | node1 |
2026-08-18 14:24:01.206024 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:24:01.206130 | node1 | Tuesday 18 August 2026  14:24:01 +0000 (0:00:00.082)       0:04:20.602 ********
2026-08-18 14:24:01.590296 | node1 | ok: [node2]
2026-08-18 14:24:01.590376 | node1 | ok: [node1]
2026-08-18 14:24:01.590435 | node1 | ok: [node3]
2026-08-18 14:24:01.590522 | node1 |
2026-08-18 14:24:01.590619 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:24:01.590712 | node1 | Tuesday 18 August 2026  14:24:01 +0000 (0:00:00.384)       0:04:20.987 ********
2026-08-18 14:24:04.755931 | node1 | ok: [node2]
2026-08-18 14:24:04.756007 | node1 | ok: [node1]
2026-08-18 14:24:04.756065 | node1 | ok: [node3]
2026-08-18 14:24:04.756377 | node1 |
2026-08-18 14:24:04.756426 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 14:24:04.756432 | node1 | Tuesday 18 August 2026  14:24:04 +0000 (0:00:03.166)       0:04:24.153 ********
2026-08-18 14:24:05.863965 | node1 | ok: [node2]
2026-08-18 14:24:05.864213 | node1 | ok: [node1]
2026-08-18 14:24:05.864242 | node1 | ok: [node3]
2026-08-18 14:24:05.864275 | node1 |
2026-08-18 14:24:05.864505 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 14:24:05.864550 | node1 | Tuesday 18 August 2026  14:24:05 +0000 (0:00:01.107)       0:04:25.261 ********
2026-08-18 14:24:06.070146 | node1 | ok: [node1]
2026-08-18 14:24:06.070207 | node1 | ok: [node2]
2026-08-18 14:24:06.070573 | node1 | ok: [node3]
2026-08-18 14:24:06.070628 | node1 |
2026-08-18 14:24:06.070641 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 14:24:06.070658 | node1 | Tuesday 18 August 2026  14:24:06 +0000 (0:00:00.206)       0:04:25.467 ********
2026-08-18 14:24:06.518596 | node1 | ok: [node1]
2026-08-18 14:24:06.518708 | node1 | ok: [node2]
2026-08-18 14:24:06.519260 | node1 | ok: [node3]
2026-08-18 14:24:06.519330 | node1 |
2026-08-18 14:24:06.519338 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 14:24:06.519345 | node1 | Tuesday 18 August 2026  14:24:06 +0000 (0:00:00.448)       0:04:25.915 ********
2026-08-18 14:24:07.113084 | node1 | ok: [node2] => (item={'path': '/etc/docker'})
2026-08-18 14:24:07.113128 | node1 | ok: [node1] => (item={'path': '/etc/docker'})
2026-08-18 14:24:07.113134 | node1 | ok: [node3] => (item={'path': '/etc/docker'})
2026-08-18 14:24:07.113139 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 14:24:07.113144 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 14:24:07.113149 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 14:24:07.113153 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 14:24:07.113157 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 14:24:07.113161 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 14:24:07.113165 | node1 |
2026-08-18 14:24:07.113170 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 14:24:07.113174 | node1 | Tuesday 18 August 2026  14:24:07 +0000 (0:00:00.593)       0:04:26.509 ********
2026-08-18 14:24:07.545018 | node1 | ok: [node1]
2026-08-18 14:24:07.545065 | node1 | ok: [node2]
2026-08-18 14:24:07.545072 | node1 | ok: [node3]
2026-08-18 14:24:07.545079 | node1 |
2026-08-18 14:24:07.545085 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 14:24:07.545091 | node1 | Tuesday 18 August 2026  14:24:07 +0000 (0:00:00.432)       0:04:26.941 ********
2026-08-18 14:24:08.062296 | node1 | ok: [node2]
2026-08-18 14:24:08.062360 | node1 | ok: [node1]
2026-08-18 14:24:08.062412 | node1 | ok: [node3]
2026-08-18 14:24:08.063545 | node1 |
2026-08-18 14:24:08.063591 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 14:24:08.063597 | node1 | Tuesday 18 August 2026  14:24:07 +0000 (0:00:00.433)       0:04:27.375 ********
2026-08-18 14:24:08.063601 | node1 |
2026-08-18 14:24:08.063605 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 14:24:08.063609 | node1 | Tuesday 18 August 2026  14:24:07 +0000 (0:00:00.007)       0:04:27.382 ********
2026-08-18 14:24:08.063613 | node1 |
2026-08-18 14:24:08.063617 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 14:24:08.063621 | node1 | Tuesday 18 August 2026  14:24:07 +0000 (0:00:00.005)       0:04:27.388 ********
2026-08-18 14:24:08.063625 | node1 |
2026-08-18 14:24:08.063629 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 14:24:08.063633 | node1 | Tuesday 18 August 2026  14:24:08 +0000 (0:00:00.071)       0:04:27.459 ********
2026-08-18 14:24:08.452532 | node1 | ok: [node1]
2026-08-18 14:24:08.452612 | node1 | ok: [node2]
2026-08-18 14:24:08.452626 | node1 | ok: [node3]
2026-08-18 14:24:08.452945 | node1 |
2026-08-18 14:24:08.452988 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:24:08.452994 | node1 | Tuesday 18 August 2026  14:24:08 +0000 (0:00:00.390)       0:04:27.850 ********
2026-08-18 14:24:08.512851 | node1 | ok: [node1] => {
2026-08-18 14:24:08.512957 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 14:24:08.514057 | node1 | }
2026-08-18 14:24:08.514119 | node1 | ok: [node2] => {
2026-08-18 14:24:08.514131 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 14:24:08.514141 | node1 | }
2026-08-18 14:24:08.514150 | node1 | ok: [node3] => {
2026-08-18 14:24:08.514159 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 14:24:08.514167 | node1 | }
2026-08-18 14:24:08.514184 | node1 |
2026-08-18 14:24:08.514196 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:24:08.514492 | node1 | Tuesday 18 August 2026  14:24:08 +0000 (0:00:00.060)       0:04:27.910 ********
2026-08-18 14:24:08.833508 | node1 | ok: [node2]
2026-08-18 14:24:08.833568 | node1 | ok: [node1]
2026-08-18 14:24:08.833654 | node1 | ok: [node3]
2026-08-18 14:24:08.834037 | node1 |
2026-08-18 14:24:08.834124 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:24:08.834138 | node1 | Tuesday 18 August 2026  14:24:08 +0000 (0:00:00.320)       0:04:28.230 ********
2026-08-18 14:24:08.863170 | node1 | skipping: [node1]
2026-08-18 14:24:08.907686 | node1 | skipping: [node2]
2026-08-18 14:24:08.907774 | node1 | skipping: [node3]
2026-08-18 14:24:08.907888 | node1 |
2026-08-18 14:24:08.908111 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 14:24:08.908155 | node1 | Tuesday 18 August 2026  14:24:08 +0000 (0:00:00.074)       0:04:28.305 ********
2026-08-18 14:24:08.979323 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 14:24:08.979893 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 14:24:08.979938 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 14:24:08.979944 | node1 |
2026-08-18 14:24:08.979949 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 14:24:08.979953 | node1 | Tuesday 18 August 2026  14:24:08 +0000 (0:00:00.071)       0:04:28.376 ********
2026-08-18 14:24:10.162254 | node1 | ok: [node1]
2026-08-18 14:24:10.162381 | node1 | ok: [node3]
2026-08-18 14:24:10.162961 | node1 | ok: [node2]
2026-08-18 14:24:10.163015 | node1 |
2026-08-18 14:24:10.163023 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 14:24:10.163030 | node1 | Tuesday 18 August 2026  14:24:10 +0000 (0:00:01.182)       0:04:29.559 ********
2026-08-18 14:24:10.822569 | node1 | ok: [node1] => (item=chronyd)
2026-08-18 14:24:10.822624 | node1 | ok: [node3] => (item=chronyd)
2026-08-18 14:24:10.822724 | node1 | ok: [node2] => (item=chronyd)
2026-08-18 14:24:10.823269 | node1 | ok: [node1] => (item=sshd)
2026-08-18 14:24:10.823284 | node1 | ok: [node2] => (item=sshd)
2026-08-18 14:24:10.823288 | node1 | ok: [node3] => (item=sshd)
2026-08-18 14:24:10.823293 | node1 |
2026-08-18 14:24:10.823297 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 14:24:10.823302 | node1 | Tuesday 18 August 2026  14:24:10 +0000 (0:00:00.660)       0:04:30.220 ********
2026-08-18 14:24:11.052126 | node1 | ok: [node1]
2026-08-18 14:24:11.052196 | node1 | ok: [node2]
2026-08-18 14:24:11.052742 | node1 | ok: [node3]
2026-08-18 14:24:11.052763 | node1 |
2026-08-18 14:24:11.052770 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 14:24:11.052777 | node1 | Tuesday 18 August 2026  14:24:11 +0000 (0:00:00.229)       0:04:30.449 ********
2026-08-18 14:24:11.303054 | node1 | ok: [node1]
2026-08-18 14:24:11.303158 | node1 | ok: [node2]
2026-08-18 14:24:11.303702 | node1 | ok: [node3]
2026-08-18 14:24:11.303723 | node1 |
2026-08-18 14:24:11.303731 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 14:24:11.303738 | node1 | Tuesday 18 August 2026  14:24:11 +0000 (0:00:00.250)       0:04:30.700 ********
2026-08-18 14:24:11.731310 | node1 | ok: [node1]
2026-08-18 14:24:11.731359 | node1 | ok: [node2]
2026-08-18 14:24:11.731387 | node1 | ok: [node3]
2026-08-18 14:24:11.731396 | node1 |
2026-08-18 14:24:11.731404 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 14:24:11.731412 | node1 | Tuesday 18 August 2026  14:24:11 +0000 (0:00:00.427)       0:04:31.127 ********
2026-08-18 14:24:11.785112 | node1 | skipping: [node1]
2026-08-18 14:24:11.785152 | node1 | skipping: [node2]
2026-08-18 14:24:11.785157 | node1 | skipping: [node3]
2026-08-18 14:24:11.785161 | node1 |
2026-08-18 14:24:11.785165 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 14:24:11.785170 | node1 | Tuesday 18 August 2026  14:24:11 +0000 (0:00:00.054)       0:04:31.182 ********
2026-08-18 14:24:12.161975 | node1 | ok: [node1]
2026-08-18 14:24:12.162047 | node1 | ok: [node2]
2026-08-18 14:24:12.162451 | node1 | ok: [node3]
2026-08-18 14:24:12.162494 | node1 |
2026-08-18 14:24:12.162500 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 14:24:12.162505 | node1 | Tuesday 18 August 2026  14:24:12 +0000 (0:00:00.377)       0:04:31.559 ********
2026-08-18 14:24:12.616312 | node1 | ok: [node1]
2026-08-18 14:24:12.616381 | node1 | ok: [node2]
2026-08-18 14:24:12.616443 | node1 | ok: [node3]
2026-08-18 14:24:12.616776 | node1 |
2026-08-18 14:24:12.616823 | node1 | TASK [vexxhost.ceph.osd : Locate the cluster admin host] ***********************
2026-08-18 14:24:12.616829 | node1 | Tuesday 18 August 2026  14:24:12 +0000 (0:00:00.454)       0:04:32.013 ********
2026-08-18 14:24:13.200834 | node1 | ok: [node1] => (item=node1)
2026-08-18 14:24:13.200908 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 14:24:13.201480 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 14:24:13.201529 | node1 |
2026-08-18 14:24:13.201537 | node1 | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] *******
2026-08-18 14:24:13.201544 | node1 | Tuesday 18 August 2026  14:24:13 +0000 (0:00:00.584)       0:04:32.598 ********
2026-08-18 14:24:13.270998 | node1 | ok: [node1]
2026-08-18 14:24:13.271659 | node1 | ok: [node2]
2026-08-18 14:24:13.271708 | node1 | ok: [node3]
2026-08-18 14:24:13.271716 | node1 |
2026-08-18 14:24:13.271723 | node1 | TASK [vexxhost.ceph.osd : Set the admin mon config path] ***********************
2026-08-18 14:24:13.271729 | node1 | Tuesday 18 August 2026  14:24:13 +0000 (0:00:00.070)       0:04:32.668 ********
2026-08-18 14:24:13.336832 | node1 | ok: [node1]
2026-08-18 14:24:13.336890 | node1 | ok: [node2]
2026-08-18 14:24:13.337272 | node1 | ok: [node3]
2026-08-18 14:24:13.337313 | node1 |
2026-08-18 14:24:13.337319 | node1 | TASK [Register this OSD host] **************************************************
2026-08-18 14:24:13.337324 | node1 | Tuesday 18 August 2026  14:24:13 +0000 (0:00:00.066)       0:04:32.734 ********
2026-08-18 14:24:13.438828 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 14:24:13.438909 | node1 |
2026-08-18 14:24:13.438972 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 14:24:13.439087 | node1 | Tuesday 18 August 2026  14:24:13 +0000 (0:00:00.101)       0:04:32.836 ********
2026-08-18 14:24:14.887534 | node1 | ok: [node1]
2026-08-18 14:24:14.887590 | node1 |
2026-08-18 14:24:14.887597 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 14:24:14.887604 | node1 | Tuesday 18 August 2026  14:24:14 +0000 (0:00:01.447)       0:04:34.284 ********
2026-08-18 14:24:14.943646 | node1 | ok: [node1]
2026-08-18 14:24:14.943711 | node1 | ok: [node2]
2026-08-18 14:24:14.944090 | node1 | ok: [node3]
2026-08-18 14:24:14.944135 | node1 |
2026-08-18 14:24:14.944141 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 14:24:14.944146 | node1 | Tuesday 18 August 2026  14:24:14 +0000 (0:00:00.057)       0:04:34.341 ********
2026-08-18 14:24:15.006124 | node1 | ok: [node1] => {
2026-08-18 14:24:15.008356 | node1 |     "changed": false,
2026-08-18 14:24:15.008406 | node1 |     "msg": "All assertions passed"
2026-08-18 14:24:15.008415 | node1 | }
2026-08-18 14:24:15.008422 | node1 | ok: [node2] => {
2026-08-18 14:24:15.008428 | node1 |     "changed": false,
2026-08-18 14:24:15.008434 | node1 |     "msg": "All assertions passed"
2026-08-18 14:24:15.008440 | node1 | }
2026-08-18 14:24:15.008446 | node1 | ok: [node3] => {
2026-08-18 14:24:15.008452 | node1 |     "changed": false,
2026-08-18 14:24:15.008465 | node1 |     "msg": "All assertions passed"
2026-08-18 14:24:15.008471 | node1 | }
2026-08-18 14:24:15.008477 | node1 |
2026-08-18 14:24:15.008483 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 14:24:15.008502 | node1 | Tuesday 18 August 2026  14:24:15 +0000 (0:00:00.062)       0:04:34.403 ********
2026-08-18 14:24:15.326500 | node1 | ok: [node1]
2026-08-18 14:24:15.326579 | node1 | ok: [node2]
2026-08-18 14:24:15.326957 | node1 | ok: [node3]
2026-08-18 14:24:15.327004 | node1 |
2026-08-18 14:24:15.327011 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 14:24:15.327016 | node1 | Tuesday 18 August 2026  14:24:15 +0000 (0:00:00.320)       0:04:34.724 ********
2026-08-18 14:24:15.397643 | node1 | ok: [node1]
2026-08-18 14:24:15.397711 | node1 | ok: [node2]
2026-08-18 14:24:15.398084 | node1 | ok: [node3]
2026-08-18 14:24:15.398156 | node1 |
2026-08-18 14:24:15.398175 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 14:24:15.398342 | node1 | Tuesday 18 August 2026  14:24:15 +0000 (0:00:00.070)       0:04:34.794 ********
2026-08-18 14:24:15.494487 | node1 | ok: [node1]
2026-08-18 14:24:15.494555 | node1 | ok: [node2]
2026-08-18 14:24:15.495092 | node1 | ok: [node3]
2026-08-18 14:24:15.495139 | node1 |
2026-08-18 14:24:15.495146 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 14:24:15.495153 | node1 | Tuesday 18 August 2026  14:24:15 +0000 (0:00:00.097)       0:04:34.891 ********
2026-08-18 14:24:15.554691 | node1 | ok: [node1] => {
2026-08-18 14:24:15.554756 | node1 |     "changed": false,
2026-08-18 14:24:15.556187 | node1 |     "msg": "All assertions passed"
2026-08-18 14:24:15.556235 | node1 | }
2026-08-18 14:24:15.556243 | node1 | ok: [node2] => {
2026-08-18 14:24:15.556249 | node1 |     "changed": false,
2026-08-18 14:24:15.556255 | node1 |     "msg": "All assertions passed"
2026-08-18 14:24:15.556261 | node1 | }
2026-08-18 14:24:15.556267 | node1 | ok: [node3] => {
2026-08-18 14:24:15.556272 | node1 |     "changed": false,
2026-08-18 14:24:15.556278 | node1 |     "msg": "All assertions passed"
2026-08-18 14:24:15.556283 | node1 | }
2026-08-18 14:24:15.556289 | node1 |
2026-08-18 14:24:15.556295 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 14:24:15.556301 | node1 | Tuesday 18 August 2026  14:24:15 +0000 (0:00:00.060)       0:04:34.952 ********
2026-08-18 14:24:17.058359 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:24:17.058436 | node1 | ok: [node1]
2026-08-18 14:24:17.058887 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:24:17.058931 | node1 |
2026-08-18 14:24:17.058937 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 14:24:17.058943 | node1 | Tuesday 18 August 2026  14:24:17 +0000 (0:00:01.503)       0:04:36.455 ********
2026-08-18 14:24:17.148849 | node1 | skipping: [node1]
2026-08-18 14:24:17.148887 | node1 | skipping: [node2]
2026-08-18 14:24:17.149311 | node1 | skipping: [node3]
2026-08-18 14:24:17.149355 | node1 |
2026-08-18 14:24:17.149361 | node1 | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] **************
2026-08-18 14:24:17.149366 | node1 | Tuesday 18 August 2026  14:24:17 +0000 (0:00:00.090)       0:04:36.546 ********
2026-08-18 14:24:17.170614 | node1 | skipping: [node1]
2026-08-18 14:24:17.170688 | node1 |
2026-08-18 14:24:17.170921 | node1 | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] *********
2026-08-18 14:24:17.170961 | node1 | Tuesday 18 August 2026  14:24:17 +0000 (0:00:00.021)       0:04:36.568 ********
2026-08-18 14:24:18.507771 | node1 | ok: [node1]
2026-08-18 14:24:18.507875 | node1 | ok: [node3]
2026-08-18 14:24:18.508459 | node1 | ok: [node2]
2026-08-18 14:24:18.508511 | node1 |
2026-08-18 14:24:18.508519 | node1 | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ********
2026-08-18 14:24:18.508528 | node1 | Tuesday 18 August 2026  14:24:18 +0000 (0:00:01.336)       0:04:37.905 ********
2026-08-18 14:30:03.094155 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd0/data)
2026-08-18 14:30:03.094227 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd0/data)
2026-08-18 14:30:03.095367 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd0/data)
2026-08-18 14:30:03.095382 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd1/data)
2026-08-18 14:30:03.095395 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd1/data)
2026-08-18 14:30:03.095400 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd1/data)
2026-08-18 14:30:03.095404 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd2/data)
2026-08-18 14:30:03.095408 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd2/data)
2026-08-18 14:30:03.095412 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd2/data)
2026-08-18 14:30:03.095416 | node1 |
2026-08-18 14:30:03.095421 | node1 | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] ***
2026-08-18 14:30:03.095425 | node1 | Tuesday 18 August 2026  14:30:03 +0000 (0:05:44.586)       0:10:22.491 ********
2026-08-18 14:30:17.551139 | node1 | ok: [node1]
2026-08-18 14:30:17.551193 | node1 | FAILED - RETRYING: [node2 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (120 retries left).
2026-08-18 14:30:17.551201 | node1 | FAILED - RETRYING: [node3 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (120 retries left).
2026-08-18 14:30:17.551207 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:30:17.551213 | node1 | FAILED - RETRYING: [node2 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (119 retries left).
2026-08-18 14:30:17.551219 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:30:17.551224 | node1 |
2026-08-18 14:30:17.551231 | node1 | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] ***
2026-08-18 14:30:17.551236 | node1 | Tuesday 18 August 2026  14:30:17 +0000 (0:00:14.455)       0:10:36.947 ********
2026-08-18 14:30:17.614063 | node1 | skipping: [node1]
2026-08-18 14:30:17.614129 | node1 |
2026-08-18 14:30:17.614148 | node1 | PLAY [Apply Ceph configuration] ************************************************
2026-08-18 14:30:17.614160 | node1 |
2026-08-18 14:30:17.614379 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 14:30:17.614421 | node1 | Tuesday 18 August 2026  14:30:17 +0000 (0:00:00.064)       0:10:37.011 ********
2026-08-18 14:30:18.710165 | node1 | ok: [node1]
2026-08-18 14:30:18.710289 | node1 | ok: [node2]
2026-08-18 14:30:18.710347 | node1 | ok: [node3]
2026-08-18 14:30:18.710654 | node1 |
2026-08-18 14:30:18.710695 | node1 | TASK [vexxhost.ceph.configure : Locate the cluster admin host] *****************
2026-08-18 14:30:18.710701 | node1 | Tuesday 18 August 2026  14:30:18 +0000 (0:00:01.095)       0:10:38.107 ********
2026-08-18 14:30:19.256625 | node1 | ok: [node1] => (item=node1)
2026-08-18 14:30:19.257265 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 14:30:19.257289 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 14:30:19.257296 | node1 |
2026-08-18 14:30:19.257303 | node1 | TASK [vexxhost.ceph.configure : Select the admin host] *************************
2026-08-18 14:30:19.257309 | node1 | Tuesday 18 August 2026  14:30:19 +0000 (0:00:00.546)       0:10:38.654 ********
2026-08-18 14:30:19.313984 | node1 | ok: [node1]
2026-08-18 14:30:19.315157 | node1 | ok: [node2]
2026-08-18 14:30:19.315191 | node1 | ok: [node3]
2026-08-18 14:30:19.315202 | node1 |
2026-08-18 14:30:19.315221 | node1 | TASK [vexxhost.ceph.configure : Set the admin mon config path] *****************
2026-08-18 14:30:19.315232 | node1 | Tuesday 18 August 2026  14:30:19 +0000 (0:00:00.056)       0:10:38.711 ********
2026-08-18 14:30:19.365891 | node1 | ok: [node1]
2026-08-18 14:30:19.366641 | node1 | ok: [node2]
2026-08-18 14:30:19.366661 | node1 | ok: [node3]
2026-08-18 14:30:19.366669 | node1 |
2026-08-18 14:30:19.366675 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] **************
2026-08-18 14:30:19.366682 | node1 | Tuesday 18 August 2026  14:30:19 +0000 (0:00:00.052)       0:10:38.763 ********
2026-08-18 14:30:19.427081 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/config.yml for node1, node2, node3
2026-08-18 14:30:19.427141 | node1 |
2026-08-18 14:30:19.427245 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] **************
2026-08-18 14:30:19.427351 | node1 | Tuesday 18 August 2026  14:30:19 +0000 (0:00:00.061)       0:10:38.824 ********
2026-08-18 14:30:36.051901 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/standby_behaviour)
2026-08-18 14:30:36.052878 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/RGW_API_SSL_VERIFY)
2026-08-18 14:30:36.052900 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_CEPHFS)
2026-08-18 14:30:36.052908 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_ISCSI)
2026-08-18 14:30:36.052914 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_MIRRORING)
2026-08-18 14:30:36.052921 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_NFS)
2026-08-18 14:30:36.052927 | node1 |
2026-08-18 14:30:36.052933 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] ***************
2026-08-18 14:30:36.052939 | node1 | Tuesday 18 August 2026  14:30:36 +0000 (0:00:16.624)       0:10:55.449 ********
2026-08-18 14:30:36.118120 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/ec_profiles.yml for node1, node2, node3
2026-08-18 14:30:36.118188 | node1 |
2026-08-18 14:30:36.118243 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] ***************
2026-08-18 14:30:36.118335 | node1 | Tuesday 18 August 2026  14:30:36 +0000 (0:00:00.066)       0:10:55.515 ********
2026-08-18 14:30:39.447701 | node1 | changed: [node1] => (item=ec_hdd_s3)
2026-08-18 14:30:39.448107 | node1 |
2026-08-18 14:30:39.448362 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] *************************
2026-08-18 14:30:39.448372 | node1 | Tuesday 18 August 2026  14:30:39 +0000 (0:00:03.329)       0:10:58.844 ********
2026-08-18 14:30:39.513572 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/crush_rules.yml for node1, node2, node3
2026-08-18 14:30:39.513655 | node1 |
2026-08-18 14:30:39.513760 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] *************************
2026-08-18 14:30:39.513858 | node1 | Tuesday 18 August 2026  14:30:39 +0000 (0:00:00.065)       0:10:58.910 ********
2026-08-18 14:30:49.275880 | node1 | changed: [node1] => (item=rep_hdd)
2026-08-18 14:30:49.277076 | node1 | changed: [node1] => (item=rep_lab)
2026-08-18 14:30:49.277147 | node1 | changed: [node1] => (item=ec_hdd_s3)
2026-08-18 14:30:49.277161 | node1 |
2026-08-18 14:30:49.277171 | node1 | TASK [vexxhost.ceph.configure : Configure pools] *******************************
2026-08-18 14:30:49.277181 | node1 | Tuesday 18 August 2026  14:30:49 +0000 (0:00:09.761)       0:11:08.671 ********
2026-08-18 14:30:49.342724 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/pools.yml for node1, node2, node3
2026-08-18 14:30:49.342767 | node1 |
2026-08-18 14:30:49.343001 | node1 | TASK [vexxhost.ceph.configure : Configure pools] *******************************
2026-08-18 14:30:49.343044 | node1 | Tuesday 18 August 2026  14:30:49 +0000 (0:00:00.068)       0:11:08.740 ********
2026-08-18 14:31:20.075894 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.data)
2026-08-18 14:31:20.075985 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.index)
2026-08-18 14:31:20.076007 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.non-ec)
2026-08-18 14:31:20.076641 | node1 | changed: [node1] => (item=molecule-1.rgw.control)
2026-08-18 14:31:20.076684 | node1 | changed: [node1] => (item=molecule-1.rgw.log)
2026-08-18 14:31:20.076690 | node1 | changed: [node1] => (item=molecule-1.rgw.meta)
2026-08-18 14:31:20.076696 | node1 |
2026-08-18 14:31:20.076701 | node1 | TASK [vexxhost.ceph.configure : Configure CephX keys] **************************
2026-08-18 14:31:20.076706 | node1 | Tuesday 18 August 2026  14:31:20 +0000 (0:00:30.733)       0:11:39.473 ********
2026-08-18 14:31:20.128562 | node1 | skipping: [node1]
2026-08-18 14:31:20.128674 | node1 | skipping: [node2]
2026-08-18 14:31:20.129267 | node1 | skipping: [node3]
2026-08-18 14:31:20.129315 | node1 |
2026-08-18 14:31:20.129323 | node1 | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] **********
2026-08-18 14:31:20.129330 | node1 | Tuesday 18 August 2026  14:31:20 +0000 (0:00:00.052)       0:11:39.525 ********
2026-08-18 14:31:20.204011 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for node1, node2, node3
2026-08-18 14:31:20.204114 | node1 |
2026-08-18 14:31:20.204137 | node1 | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] ***
2026-08-18 14:31:20.204281 | node1 | Tuesday 18 August 2026  14:31:20 +0000 (0:00:00.076)       0:11:39.601 ********
2026-08-18 14:31:21.681459 | node1 | ok: [node1]
2026-08-18 14:31:21.681540 | node1 |
2026-08-18 14:31:21.681756 | node1 | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] *********
2026-08-18 14:31:21.681797 | node1 | Tuesday 18 August 2026  14:31:21 +0000 (0:00:01.477)       0:11:41.078 ********
2026-08-18 14:31:23.249199 | node1 | ok: [node1]
2026-08-18 14:31:23.249270 | node1 |
2026-08-18 14:31:23.249598 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate] *****************
2026-08-18 14:31:23.249622 | node1 | Tuesday 18 August 2026  14:31:23 +0000 (0:00:01.567)       0:11:42.646 ********
2026-08-18 14:31:23.283263 | node1 | skipping: [node1]
2026-08-18 14:31:23.283356 | node1 |
2026-08-18 14:31:23.283498 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] *************
2026-08-18 14:31:23.283644 | node1 | Tuesday 18 August 2026  14:31:23 +0000 (0:00:00.034)       0:11:42.680 ********
2026-08-18 14:31:23.319589 | node1 | skipping: [node1]
2026-08-18 14:31:23.319703 | node1 |
2026-08-18 14:31:23.320043 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] *****************
2026-08-18 14:31:23.320064 | node1 | Tuesday 18 August 2026  14:31:23 +0000 (0:00:00.036)       0:11:42.716 ********
2026-08-18 14:31:23.352282 | node1 | skipping: [node1]
2026-08-18 14:31:23.352682 | node1 |
2026-08-18 14:31:23.352731 | node1 | TASK [vexxhost.ceph.configure : Create a self-signed certificate] **************
2026-08-18 14:31:23.352737 | node1 | Tuesday 18 August 2026  14:31:23 +0000 (0:00:00.032)       0:11:42.749 ********
2026-08-18 14:31:25.063548 | node1 | changed: [node1]
2026-08-18 14:31:25.063601 | node1 |
2026-08-18 14:31:25.063609 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] *****************
2026-08-18 14:31:25.063615 | node1 | Tuesday 18 August 2026  14:31:25 +0000 (0:00:01.710)       0:11:44.460 ********
2026-08-18 14:31:25.104664 | node1 | ok: [node1]
2026-08-18 14:31:25.104706 | node1 |
2026-08-18 14:31:25.104711 | node1 | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] ***
2026-08-18 14:31:25.104717 | node1 | Tuesday 18 August 2026  14:31:25 +0000 (0:00:00.041)       0:11:44.501 ********
2026-08-18 14:31:31.807815 | node1 | changed: [node1] => (item=ceph mgr module disable dashboard)
2026-08-18 14:31:31.807924 | node1 | changed: [node1] => (item=ceph mgr module enable dashboard)
2026-08-18 14:31:31.808063 | node1 | changed: [node1] => (item=ceph orch reconfig mgr)
2026-08-18 14:31:31.808218 | node1 |
2026-08-18 14:31:31.808345 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] *********************
2026-08-18 14:31:31.808475 | node1 | Tuesday 18 August 2026  14:31:31 +0000 (0:00:06.703)       0:11:51.205 ********
2026-08-18 14:31:31.877132 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard_users.yml for node1, node2, node3
2026-08-18 14:31:31.877200 | node1 |
2026-08-18 14:31:31.877311 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] *********************
2026-08-18 14:31:31.877406 | node1 | Tuesday 18 August 2026  14:31:31 +0000 (0:00:00.069)       0:11:51.274 ********
2026-08-18 14:31:40.743093 | node1 | changed: [node1] => (item=None)
2026-08-18 14:31:40.743142 | node1 | changed: [node1] => (item=None)
2026-08-18 14:31:40.743147 | node1 | changed: [node1 -> {{ ceph_configure_admin_host }}]
2026-08-18 14:31:40.743152 | node1 |
2026-08-18 14:31:40.743156 | node1 | PLAY [Deploy Ceph RADOS Gateways] **********************************************
2026-08-18 14:31:40.743161 | node1 |
2026-08-18 14:31:40.743165 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 14:31:40.743169 | node1 | Tuesday 18 August 2026  14:31:40 +0000 (0:00:08.865)       0:12:00.140 ********
2026-08-18 14:31:41.892610 | node1 | ok: [node1]
2026-08-18 14:31:41.892687 | node1 | ok: [node3]
2026-08-18 14:31:41.892729 | node1 | ok: [node2]
2026-08-18 14:31:41.892832 | node1 |
2026-08-18 14:31:41.892920 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:31:41.893014 | node1 | Tuesday 18 August 2026  14:31:41 +0000 (0:00:01.149)       0:12:01.290 ********
2026-08-18 14:31:42.142463 | node1 | ok: [node1]
2026-08-18 14:31:42.142536 | node1 | ok: [node2]
2026-08-18 14:31:42.142618 | node1 | ok: [node3]
2026-08-18 14:31:42.142707 | node1 |
2026-08-18 14:31:42.142808 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:31:42.142923 | node1 | Tuesday 18 August 2026  14:31:42 +0000 (0:00:00.249)       0:12:01.539 ********
2026-08-18 14:31:42.209128 | node1 | skipping: [node1]
2026-08-18 14:31:42.209183 | node1 | skipping: [node2]
2026-08-18 14:31:42.209272 | node1 | skipping: [node3]
2026-08-18 14:31:42.209358 | node1 |
2026-08-18 14:31:42.209485 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 14:31:42.209625 | node1 | Tuesday 18 August 2026  14:31:42 +0000 (0:00:00.066)       0:12:01.606 ********
2026-08-18 14:31:42.445126 | node1 | ok: [node1]
2026-08-18 14:31:42.445194 | node1 | ok: [node2]
2026-08-18 14:31:42.445269 | node1 | ok: [node3]
2026-08-18 14:31:42.445369 | node1 |
2026-08-18 14:31:42.445467 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:31:42.445579 | node1 | Tuesday 18 August 2026  14:31:42 +0000 (0:00:00.236)       0:12:01.842 ********
2026-08-18 14:31:42.526110 | node1 | ok: [node1] => {
2026-08-18 14:31:42.527776 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 14:31:42.527824 | node1 | }
2026-08-18 14:31:42.527832 | node1 | ok: [node2] => {
2026-08-18 14:31:42.527838 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 14:31:42.527844 | node1 | }
2026-08-18 14:31:42.527849 | node1 | ok: [node3] => {
2026-08-18 14:31:42.527863 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 14:31:42.527868 | node1 | }
2026-08-18 14:31:42.527874 | node1 |
2026-08-18 14:31:42.527880 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:31:42.527886 | node1 | Tuesday 18 August 2026  14:31:42 +0000 (0:00:00.080)       0:12:01.923 ********
2026-08-18 14:31:42.872434 | node1 | ok: [node1]
2026-08-18 14:31:42.872486 | node1 | ok: [node3]
2026-08-18 14:31:42.872592 | node1 | ok: [node2]
2026-08-18 14:31:42.872947 | node1 |
2026-08-18 14:31:42.872990 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:31:42.872996 | node1 | Tuesday 18 August 2026  14:31:42 +0000 (0:00:00.346)       0:12:02.269 ********
2026-08-18 14:31:42.900937 | node1 | skipping: [node1]
2026-08-18 14:31:42.961640 | node1 | skipping: [node2]
2026-08-18 14:31:42.961708 | node1 | skipping: [node3]
2026-08-18 14:31:42.961781 | node1 |
2026-08-18 14:31:42.961978 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:31:42.962047 | node1 | Tuesday 18 August 2026  14:31:42 +0000 (0:00:00.089)       0:12:02.359 ********
2026-08-18 14:31:43.054567 | node1 | skipping: [node1]
2026-08-18 14:31:43.054625 | node1 | skipping: [node2]
2026-08-18 14:31:43.054721 | node1 | skipping: [node3]
2026-08-18 14:31:43.055093 | node1 |
2026-08-18 14:31:43.055134 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:31:43.055140 | node1 | Tuesday 18 August 2026  14:31:43 +0000 (0:00:00.092)       0:12:02.452 ********
2026-08-18 14:31:43.283729 | node1 | ok: [node1]
2026-08-18 14:31:43.283802 | node1 | ok: [node2]
2026-08-18 14:31:43.283890 | node1 | ok: [node3]
2026-08-18 14:31:43.283984 | node1 |
2026-08-18 14:31:43.284096 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:31:43.284190 | node1 | Tuesday 18 August 2026  14:31:43 +0000 (0:00:00.229)       0:12:02.681 ********
2026-08-18 14:31:44.423773 | node1 | ok: [node2]
2026-08-18 14:31:44.423857 | node1 | ok: [node3]
2026-08-18 14:31:44.423868 | node1 | ok: [node1]
2026-08-18 14:31:44.424172 | node1 |
2026-08-18 14:31:44.424215 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:31:44.424221 | node1 | Tuesday 18 August 2026  14:31:44 +0000 (0:00:01.139)       0:12:03.821 ********
2026-08-18 14:31:44.523676 | node1 | ok: [node1] => {
2026-08-18 14:31:44.523764 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 14:31:44.523770 | node1 | }
2026-08-18 14:31:44.523775 | node1 | ok: [node2] => {
2026-08-18 14:31:44.523779 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 14:31:44.523783 | node1 | }
2026-08-18 14:31:44.523787 | node1 | ok: [node3] => {
2026-08-18 14:31:44.523791 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 14:31:44.523795 | node1 | }
2026-08-18 14:31:44.523799 | node1 |
2026-08-18 14:31:44.523803 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:31:44.523816 | node1 | Tuesday 18 August 2026  14:31:44 +0000 (0:00:00.098)       0:12:03.919 ********
2026-08-18 14:31:44.912914 | node1 | ok: [node2]
2026-08-18 14:31:44.913055 | node1 | ok: [node1]
2026-08-18 14:31:44.913269 | node1 | ok: [node3]
2026-08-18 14:31:44.913442 | node1 |
2026-08-18 14:31:44.913656 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:31:44.913857 | node1 | Tuesday 18 August 2026  14:31:44 +0000 (0:00:00.390)       0:12:04.309 ********
2026-08-18 14:31:46.911508 | node1 | ok: [node2]
2026-08-18 14:31:46.911665 | node1 | ok: [node1]
2026-08-18 14:31:46.911992 | node1 | ok: [node3]
2026-08-18 14:31:46.912270 | node1 |
2026-08-18 14:31:46.912575 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 14:31:46.912889 | node1 | Tuesday 18 August 2026  14:31:46 +0000 (0:00:01.998)       0:12:06.308 ********
2026-08-18 14:31:46.958255 | node1 | skipping: [node1]
2026-08-18 14:31:46.958427 | node1 | skipping: [node2]
2026-08-18 14:31:46.958659 | node1 | skipping: [node3]
2026-08-18 14:31:46.958861 | node1 |
2026-08-18 14:31:46.959085 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 14:31:46.959429 | node1 | Tuesday 18 August 2026  14:31:46 +0000 (0:00:00.047)       0:12:06.355 ********
2026-08-18 14:31:46.984216 | node1 | skipping: [node1]
2026-08-18 14:31:47.013651 | node1 | skipping: [node2]
2026-08-18 14:31:47.013820 | node1 | skipping: [node3]
2026-08-18 14:31:47.014058 | node1 |
2026-08-18 14:31:47.014285 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 14:31:47.014487 | node1 | Tuesday 18 August 2026  14:31:47 +0000 (0:00:00.055)       0:12:06.410 ********
2026-08-18 14:31:47.067802 | node1 | skipping: [node1]
2026-08-18 14:31:47.067928 | node1 | skipping: [node2]
2026-08-18 14:31:47.068085 | node1 | skipping: [node3]
2026-08-18 14:31:47.068285 | node1 |
2026-08-18 14:31:47.068554 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 14:31:47.068784 | node1 | Tuesday 18 August 2026  14:31:47 +0000 (0:00:00.054)       0:12:06.465 ********
2026-08-18 14:31:48.229837 | node1 | ok: [node3]
2026-08-18 14:31:48.229891 | node1 | ok: [node2]
2026-08-18 14:31:48.229898 | node1 | ok: [node1]
2026-08-18 14:31:48.229921 | node1 |
2026-08-18 14:31:48.229928 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 14:31:48.229935 | node1 | Tuesday 18 August 2026  14:31:48 +0000 (0:00:01.161)       0:12:07.626 ********
2026-08-18 14:31:48.702889 | node1 | ok: [node1]
2026-08-18 14:31:48.702944 | node1 | ok: [node2]
2026-08-18 14:31:48.702951 | node1 | ok: [node3]
2026-08-18 14:31:48.702957 | node1 |
2026-08-18 14:31:48.702964 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 14:31:48.702970 | node1 | Tuesday 18 August 2026  14:31:48 +0000 (0:00:00.472)       0:12:08.099 ********
2026-08-18 14:31:49.684464 | node1 | ok: [node1] => (item={'path': '/etc/containerd'})
2026-08-18 14:31:49.684513 | node1 | ok: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 14:31:49.684520 | node1 | ok: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 14:31:49.684526 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 14:31:49.684533 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 14:31:49.684538 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 14:31:49.684553 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 14:31:49.684559 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 14:31:49.684565 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 14:31:49.684570 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 14:31:49.684578 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 14:31:49.684585 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 14:31:49.684593 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 14:31:49.684600 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 14:31:49.684606 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 14:31:49.684612 | node1 |
2026-08-18 14:31:49.684617 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 14:31:49.684636 | node1 | Tuesday 18 August 2026  14:31:49 +0000 (0:00:00.979)       0:12:09.078 ********
2026-08-18 14:31:50.278210 | node1 | ok: [node2]
2026-08-18 14:31:50.278270 | node1 | ok: [node1]
2026-08-18 14:31:50.278370 | node1 | ok: [node3]
2026-08-18 14:31:50.278454 | node1 |
2026-08-18 14:31:50.278550 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 14:31:50.278671 | node1 | Tuesday 18 August 2026  14:31:50 +0000 (0:00:00.560)       0:12:09.639 ********
2026-08-18 14:31:50.278736 | node1 |
2026-08-18 14:31:50.278828 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 14:31:50.278919 | node1 | Tuesday 18 August 2026  14:31:50 +0000 (0:00:00.013)       0:12:09.652 ********
2026-08-18 14:31:50.279001 | node1 |
2026-08-18 14:31:50.279094 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 14:31:50.279251 | node1 | Tuesday 18 August 2026  14:31:50 +0000 (0:00:00.011)       0:12:09.663 ********
2026-08-18 14:31:50.279332 | node1 |
2026-08-18 14:31:50.279424 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 14:31:50.279515 | node1 | Tuesday 18 August 2026  14:31:50 +0000 (0:00:00.011)       0:12:09.675 ********
2026-08-18 14:31:50.673643 | node1 | ok: [node1]
2026-08-18 14:31:50.673852 | node1 | ok: [node2]
2026-08-18 14:31:50.674153 | node1 | ok: [node3]
2026-08-18 14:31:50.674314 | node1 |
2026-08-18 14:31:50.674595 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:31:50.674874 | node1 | Tuesday 18 August 2026  14:31:50 +0000 (0:00:00.395)       0:12:10.070 ********
2026-08-18 14:31:50.921184 | node1 | ok: [node1]
2026-08-18 14:31:50.921361 | node1 | ok: [node2]
2026-08-18 14:31:50.921564 | node1 | ok: [node3]
2026-08-18 14:31:50.921765 | node1 |
2026-08-18 14:31:50.922031 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:31:50.922254 | node1 | Tuesday 18 August 2026  14:31:50 +0000 (0:00:00.247)       0:12:10.318 ********
2026-08-18 14:31:51.000396 | node1 | ok: [node1] => {
2026-08-18 14:31:51.000868 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 14:31:51.001219 | node1 | }
2026-08-18 14:31:51.001608 | node1 | ok: [node2] => {
2026-08-18 14:31:51.001851 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 14:31:51.002185 | node1 | }
2026-08-18 14:31:51.002815 | node1 | ok: [node3] => {
2026-08-18 14:31:51.002831 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 14:31:51.002841 | node1 | }
2026-08-18 14:31:51.002912 | node1 |
2026-08-18 14:31:51.003230 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:31:51.003476 | node1 | Tuesday 18 August 2026  14:31:50 +0000 (0:00:00.078)       0:12:10.397 ********
2026-08-18 14:31:51.383900 | node1 | ok: [node2]
2026-08-18 14:31:51.384127 | node1 | ok: [node3]
2026-08-18 14:31:51.384334 | node1 | ok: [node1]
2026-08-18 14:31:51.384516 | node1 |
2026-08-18 14:31:51.384726 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:31:51.384927 | node1 | Tuesday 18 August 2026  14:31:51 +0000 (0:00:00.383)       0:12:10.780 ********
2026-08-18 14:31:54.490049 | node1 | ok: [node1]
2026-08-18 14:31:54.490549 | node1 | ok: [node2]
2026-08-18 14:31:54.490568 | node1 | ok: [node3]
2026-08-18 14:31:54.490582 | node1 |
2026-08-18 14:31:54.490595 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 14:31:54.490608 | node1 | Tuesday 18 August 2026  14:31:54 +0000 (0:00:03.106)       0:12:13.887 ********
2026-08-18 14:31:55.715886 | node1 | ok: [node3]
2026-08-18 14:31:55.715991 | node1 | ok: [node2]
2026-08-18 14:31:55.716132 | node1 | ok: [node1]
2026-08-18 14:31:55.716268 | node1 |
2026-08-18 14:31:55.716416 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 14:31:55.716553 | node1 | Tuesday 18 August 2026  14:31:55 +0000 (0:00:01.225)       0:12:15.112 ********
2026-08-18 14:31:55.937304 | node1 | ok: [node1]
2026-08-18 14:31:55.937445 | node1 | ok: [node2]
2026-08-18 14:31:55.937727 | node1 | ok: [node3]
2026-08-18 14:31:55.938033 | node1 |
2026-08-18 14:31:55.938168 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 14:31:55.938372 | node1 | Tuesday 18 August 2026  14:31:55 +0000 (0:00:00.221)       0:12:15.334 ********
2026-08-18 14:31:56.387528 | node1 | ok: [node1]
2026-08-18 14:31:56.387635 | node1 | ok: [node2]
2026-08-18 14:31:56.387780 | node1 | ok: [node3]
2026-08-18 14:31:56.387906 | node1 |
2026-08-18 14:31:56.388079 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 14:31:56.388208 | node1 | Tuesday 18 August 2026  14:31:56 +0000 (0:00:00.450)       0:12:15.784 ********
2026-08-18 14:31:56.990056 | node1 | ok: [node1] => (item={'path': '/etc/docker'})
2026-08-18 14:31:56.990136 | node1 | ok: [node3] => (item={'path': '/etc/docker'})
2026-08-18 14:31:56.990198 | node1 | ok: [node2] => (item={'path': '/etc/docker'})
2026-08-18 14:31:56.992068 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 14:31:56.992171 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 14:31:56.992182 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 14:31:56.992192 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 14:31:56.992202 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 14:31:56.992212 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 14:31:56.992221 | node1 |
2026-08-18 14:31:56.992232 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 14:31:56.992249 | node1 | Tuesday 18 August 2026  14:31:56 +0000 (0:00:00.602)       0:12:16.386 ********
2026-08-18 14:31:57.428281 | node1 | ok: [node1]
2026-08-18 14:31:57.428384 | node1 | ok: [node2]
2026-08-18 14:31:57.428977 | node1 | ok: [node3]
2026-08-18 14:31:57.429043 | node1 |
2026-08-18 14:31:57.429052 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 14:31:57.429060 | node1 | Tuesday 18 August 2026  14:31:57 +0000 (0:00:00.439)       0:12:16.825 ********
2026-08-18 14:31:57.915220 | node1 | ok: [node1]
2026-08-18 14:31:57.915292 | node1 | ok: [node2]
2026-08-18 14:31:57.915350 | node1 | ok: [node3]
2026-08-18 14:31:57.916467 | node1 |
2026-08-18 14:31:57.916514 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 14:31:57.916520 | node1 | Tuesday 18 August 2026  14:31:57 +0000 (0:00:00.452)       0:12:17.278 ********
2026-08-18 14:31:57.916525 | node1 |
2026-08-18 14:31:57.916529 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 14:31:57.916533 | node1 | Tuesday 18 August 2026  14:31:57 +0000 (0:00:00.011)       0:12:17.289 ********
2026-08-18 14:31:57.916537 | node1 |
2026-08-18 14:31:57.916540 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 14:31:57.916544 | node1 | Tuesday 18 August 2026  14:31:57 +0000 (0:00:00.011)       0:12:17.301 ********
2026-08-18 14:31:57.916548 | node1 |
2026-08-18 14:31:57.916586 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 14:31:57.916590 | node1 | Tuesday 18 August 2026  14:31:57 +0000 (0:00:00.011)       0:12:17.312 ********
2026-08-18 14:31:58.313009 | node1 | ok: [node1]
2026-08-18 14:31:58.313084 | node1 | ok: [node3]
2026-08-18 14:31:58.313140 | node1 | ok: [node2]
2026-08-18 14:31:58.313446 | node1 |
2026-08-18 14:31:58.313489 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:31:58.313495 | node1 | Tuesday 18 August 2026  14:31:58 +0000 (0:00:00.397)       0:12:17.710 ********
2026-08-18 14:31:58.370086 | node1 | ok: [node1] => {
2026-08-18 14:31:58.371508 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 14:31:58.371558 | node1 | }
2026-08-18 14:31:58.371565 | node1 | ok: [node2] => {
2026-08-18 14:31:58.371572 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 14:31:58.371578 | node1 | }
2026-08-18 14:31:58.371583 | node1 | ok: [node3] => {
2026-08-18 14:31:58.371595 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 14:31:58.371600 | node1 | }
2026-08-18 14:31:58.371606 | node1 |
2026-08-18 14:31:58.371612 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:31:58.371618 | node1 | Tuesday 18 August 2026  14:31:58 +0000 (0:00:00.057)       0:12:17.767 ********
2026-08-18 14:31:58.695925 | node1 | ok: [node3]
2026-08-18 14:31:58.696047 | node1 | ok: [node2]
2026-08-18 14:31:58.696628 | node1 | ok: [node1]
2026-08-18 14:31:58.696709 | node1 |
2026-08-18 14:31:58.696721 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:31:58.696731 | node1 | Tuesday 18 August 2026  14:31:58 +0000 (0:00:00.325)       0:12:18.092 ********
2026-08-18 14:31:58.723923 | node1 | skipping: [node1]
2026-08-18 14:31:58.769635 | node1 | skipping: [node2]
2026-08-18 14:31:58.769693 | node1 | skipping: [node3]
2026-08-18 14:31:58.769782 | node1 |
2026-08-18 14:31:58.770021 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 14:31:58.770100 | node1 | Tuesday 18 August 2026  14:31:58 +0000 (0:00:00.074)       0:12:18.167 ********
2026-08-18 14:31:58.807253 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 14:31:58.849278 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 14:31:58.849407 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 14:31:58.849534 | node1 |
2026-08-18 14:31:58.849665 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 14:31:58.849797 | node1 | Tuesday 18 August 2026  14:31:58 +0000 (0:00:00.079)       0:12:18.246 ********
2026-08-18 14:32:00.089119 | node1 | ok: [node2]
2026-08-18 14:32:00.089234 | node1 | ok: [node3]
2026-08-18 14:32:00.089357 | node1 | ok: [node1]
2026-08-18 14:32:00.089486 | node1 |
2026-08-18 14:32:00.089613 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 14:32:00.089739 | node1 | Tuesday 18 August 2026  14:32:00 +0000 (0:00:01.239)       0:12:19.486 ********
2026-08-18 14:32:00.772235 | node1 | ok: [node2] => (item=chronyd)
2026-08-18 14:32:00.772449 | node1 | ok: [node3] => (item=chronyd)
2026-08-18 14:32:00.772713 | node1 | ok: [node1] => (item=chronyd)
2026-08-18 14:32:00.772940 | node1 | ok: [node2] => (item=sshd)
2026-08-18 14:32:00.773181 | node1 | ok: [node3] => (item=sshd)
2026-08-18 14:32:00.773432 | node1 | ok: [node1] => (item=sshd)
2026-08-18 14:32:00.773639 | node1 |
2026-08-18 14:32:00.773852 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 14:32:00.774108 | node1 | Tuesday 18 August 2026  14:32:00 +0000 (0:00:00.682)       0:12:20.168 ********
2026-08-18 14:32:00.989040 | node1 | ok: [node1]
2026-08-18 14:32:00.989191 | node1 | ok: [node2]
2026-08-18 14:32:00.989394 | node1 | ok: [node3]
2026-08-18 14:32:00.989582 | node1 |
2026-08-18 14:32:00.989795 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 14:32:00.990033 | node1 | Tuesday 18 August 2026  14:32:00 +0000 (0:00:00.217)       0:12:20.386 ********
2026-08-18 14:32:01.262264 | node1 | ok: [node2]
2026-08-18 14:32:01.262476 | node1 | ok: [node1]
2026-08-18 14:32:01.262737 | node1 | ok: [node3]
2026-08-18 14:32:01.262933 | node1 |
2026-08-18 14:32:01.263226 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 14:32:01.263440 | node1 | Tuesday 18 August 2026  14:32:01 +0000 (0:00:00.272)       0:12:20.658 ********
2026-08-18 14:32:01.730461 | node1 | ok: [node2]
2026-08-18 14:32:01.730654 | node1 | ok: [node1]
2026-08-18 14:32:01.730861 | node1 | ok: [node3]
2026-08-18 14:32:01.731075 | node1 |
2026-08-18 14:32:01.731300 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 14:32:01.731513 | node1 | Tuesday 18 August 2026  14:32:01 +0000 (0:00:00.468)       0:12:21.127 ********
2026-08-18 14:32:01.782342 | node1 | skipping: [node1]
2026-08-18 14:32:01.782531 | node1 | skipping: [node2]
2026-08-18 14:32:01.782728 | node1 | skipping: [node3]
2026-08-18 14:32:01.782914 | node1 |
2026-08-18 14:32:01.783154 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 14:32:01.783404 | node1 | Tuesday 18 August 2026  14:32:01 +0000 (0:00:00.051)       0:12:21.179 ********
2026-08-18 14:32:02.197225 | node1 | ok: [node1]
2026-08-18 14:32:02.197429 | node1 | ok: [node2]
2026-08-18 14:32:02.197659 | node1 | ok: [node3]
2026-08-18 14:32:02.197858 | node1 |
2026-08-18 14:32:02.198222 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 14:32:02.198539 | node1 | Tuesday 18 August 2026  14:32:02 +0000 (0:00:00.414)       0:12:21.594 ********
2026-08-18 14:32:02.670025 | node1 | ok: [node1]
2026-08-18 14:32:02.671289 | node1 | ok: [node2]
2026-08-18 14:32:02.671328 | node1 | ok: [node3]
2026-08-18 14:32:02.671341 | node1 |
2026-08-18 14:32:02.671352 | node1 | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] ***********************
2026-08-18 14:32:02.671363 | node1 | Tuesday 18 August 2026  14:32:02 +0000 (0:00:00.473)       0:12:22.067 ********
2026-08-18 14:32:03.285421 | node1 | ok: [node1] => (item=node1)
2026-08-18 14:32:03.286026 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 14:32:03.286091 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 14:32:03.286103 | node1 |
2026-08-18 14:32:03.286121 | node1 | TASK [vexxhost.ceph.rgw : Select the admin host] *******************************
2026-08-18 14:32:03.286131 | node1 | Tuesday 18 August 2026  14:32:03 +0000 (0:00:00.615)       0:12:22.682 ********
2026-08-18 14:32:03.365844 | node1 | ok: [node1]
2026-08-18 14:32:03.365944 | node1 | ok: [node2]
2026-08-18 14:32:03.366196 | node1 | ok: [node3]
2026-08-18 14:32:03.366242 | node1 |
2026-08-18 14:32:03.366412 | node1 | TASK [vexxhost.ceph.rgw : Set the admin mon config path] ***********************
2026-08-18 14:32:03.366424 | node1 | Tuesday 18 August 2026  14:32:03 +0000 (0:00:00.080)       0:12:22.763 ********
2026-08-18 14:32:03.443567 | node1 | ok: [node1]
2026-08-18 14:32:03.443633 | node1 | ok: [node2]
2026-08-18 14:32:03.443644 | node1 | ok: [node3]
2026-08-18 14:32:03.443654 | node1 |
2026-08-18 14:32:03.443664 | node1 | TASK [Register this RGW host] **************************************************
2026-08-18 14:32:03.443674 | node1 | Tuesday 18 August 2026  14:32:03 +0000 (0:00:00.076)       0:12:22.839 ********
2026-08-18 14:32:03.555358 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 14:32:03.555424 | node1 |
2026-08-18 14:32:03.555435 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 14:32:03.555445 | node1 | Tuesday 18 August 2026  14:32:03 +0000 (0:00:00.112)       0:12:22.951 ********
2026-08-18 14:32:04.984919 | node1 | ok: [node1]
2026-08-18 14:32:04.984994 | node1 |
2026-08-18 14:32:04.985006 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 14:32:04.985017 | node1 | Tuesday 18 August 2026  14:32:04 +0000 (0:00:01.429)       0:12:24.381 ********
2026-08-18 14:32:05.053072 | node1 | ok: [node1]
2026-08-18 14:32:05.053148 | node1 | ok: [node2]
2026-08-18 14:32:05.053159 | node1 | ok: [node3]
2026-08-18 14:32:05.053168 | node1 |
2026-08-18 14:32:05.053178 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 14:32:05.053209 | node1 | Tuesday 18 August 2026  14:32:05 +0000 (0:00:00.067)       0:12:24.448 ********
2026-08-18 14:32:05.125878 | node1 | ok: [node1] => {
2026-08-18 14:32:05.125967 | node1 |     "changed": false,
2026-08-18 14:32:05.125979 | node1 |     "msg": "All assertions passed"
2026-08-18 14:32:05.125990 | node1 | }
2026-08-18 14:32:05.125999 | node1 | ok: [node2] => {
2026-08-18 14:32:05.126008 | node1 |     "changed": false,
2026-08-18 14:32:05.126017 | node1 |     "msg": "All assertions passed"
2026-08-18 14:32:05.126026 | node1 | }
2026-08-18 14:32:05.126035 | node1 | ok: [node3] => {
2026-08-18 14:32:05.126043 | node1 |     "changed": false,
2026-08-18 14:32:05.126052 | node1 |     "msg": "All assertions passed"
2026-08-18 14:32:05.126061 | node1 | }
2026-08-18 14:32:05.126070 | node1 |
2026-08-18 14:32:05.126079 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 14:32:05.126089 | node1 | Tuesday 18 August 2026  14:32:05 +0000 (0:00:00.071)       0:12:24.520 ********
2026-08-18 14:32:05.409945 | node1 | ok: [node1]
2026-08-18 14:32:05.409988 | node1 | ok: [node2]
2026-08-18 14:32:05.409993 | node1 | ok: [node3]
2026-08-18 14:32:05.409998 | node1 |
2026-08-18 14:32:05.410003 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 14:32:05.410007 | node1 | Tuesday 18 August 2026  14:32:05 +0000 (0:00:00.286)       0:12:24.806 ********
2026-08-18 14:32:05.484730 | node1 | ok: [node1]
2026-08-18 14:32:05.484798 | node1 | ok: [node2]
2026-08-18 14:32:05.484810 | node1 | ok: [node3]
2026-08-18 14:32:05.484821 | node1 |
2026-08-18 14:32:05.484832 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 14:32:05.484843 | node1 | Tuesday 18 August 2026  14:32:05 +0000 (0:00:00.073)       0:12:24.880 ********
2026-08-18 14:32:05.582029 | node1 | ok: [node1]
2026-08-18 14:32:05.582143 | node1 | ok: [node2]
2026-08-18 14:32:05.582154 | node1 | ok: [node3]
2026-08-18 14:32:05.582164 | node1 |
2026-08-18 14:32:05.582175 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 14:32:05.582197 | node1 | Tuesday 18 August 2026  14:32:05 +0000 (0:00:00.097)       0:12:24.978 ********
2026-08-18 14:32:05.646143 | node1 | ok: [node1] => {
2026-08-18 14:32:05.646358 | node1 |     "changed": false,
2026-08-18 14:32:05.646648 | node1 |     "msg": "All assertions passed"
2026-08-18 14:32:05.647010 | node1 | }
2026-08-18 14:32:05.647261 | node1 | ok: [node2] => {
2026-08-18 14:32:05.647523 | node1 |     "changed": false,
2026-08-18 14:32:05.647781 | node1 |     "msg": "All assertions passed"
2026-08-18 14:32:05.648020 | node1 | }
2026-08-18 14:32:05.648256 | node1 | ok: [node3] => {
2026-08-18 14:32:05.648488 | node1 |     "changed": false,
2026-08-18 14:32:05.648630 | node1 |     "msg": "All assertions passed"
2026-08-18 14:32:05.648769 | node1 | }
2026-08-18 14:32:05.648900 | node1 |
2026-08-18 14:32:05.649046 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 14:32:05.649193 | node1 | Tuesday 18 August 2026  14:32:05 +0000 (0:00:00.064)       0:12:25.042 ********
2026-08-18 14:32:07.188071 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:32:07.188132 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:32:07.188139 | node1 | ok: [node1]
2026-08-18 14:32:07.188558 | node1 |
2026-08-18 14:32:07.188575 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 14:32:07.188582 | node1 | Tuesday 18 August 2026  14:32:07 +0000 (0:00:01.541)       0:12:26.584 ********
2026-08-18 14:32:07.269872 | node1 | skipping: [node1]
2026-08-18 14:32:07.269964 | node1 | skipping: [node2]
2026-08-18 14:32:07.269976 | node1 | skipping: [node3]
2026-08-18 14:32:07.269985 | node1 |
2026-08-18 14:32:07.269995 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] ****
2026-08-18 14:32:07.270005 | node1 | Tuesday 18 August 2026  14:32:07 +0000 (0:00:00.081)       0:12:26.666 ********
2026-08-18 14:32:07.328020 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/multisite.yml for node1
2026-08-18 14:32:07.328086 | node1 |
2026-08-18 14:32:07.328097 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW realms] ********************************
2026-08-18 14:32:07.328107 | node1 | Tuesday 18 August 2026  14:32:07 +0000 (0:00:00.058)       0:12:26.724 ********
2026-08-18 14:32:11.081125 | node1 | changed: [node1] => (item=molecule)
2026-08-18 14:32:11.081198 | node1 |
2026-08-18 14:32:11.081217 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zonegroups] ****************************
2026-08-18 14:32:11.081361 | node1 | Tuesday 18 August 2026  14:32:11 +0000 (0:00:03.753)       0:12:30.477 ********
2026-08-18 14:32:13.113211 | node1 | changed: [node1] => (item=molecule)
2026-08-18 14:32:13.113281 | node1 |
2026-08-18 14:32:13.113294 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zones] *********************************
2026-08-18 14:32:13.113304 | node1 | Tuesday 18 August 2026  14:32:13 +0000 (0:00:02.032)       0:12:32.509 ********
2026-08-18 14:32:15.074788 | node1 | changed: [node1] => (item=None)
2026-08-18 14:32:15.074882 | node1 | changed: [node1 -> {{ ceph_rgw_admin_host }}]
2026-08-18 14:32:15.074897 | node1 |
2026-08-18 14:32:15.075116 | node1 | TASK [vexxhost.ceph.rgw : Commit the RGW period] *******************************
2026-08-18 14:32:15.075159 | node1 | Tuesday 18 August 2026  14:32:15 +0000 (0:00:01.962)       0:12:34.472 ********
2026-08-18 14:32:16.478453 | node1 | changed: [node1]
2026-08-18 14:32:16.478530 | node1 |
2026-08-18 14:32:16.478736 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] *************************
2026-08-18 14:32:16.478778 | node1 | Tuesday 18 August 2026  14:32:16 +0000 (0:00:01.403)       0:12:35.875 ********
2026-08-18 14:32:16.526486 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/services.yml for node1
2026-08-18 14:32:16.526575 | node1 |
2026-08-18 14:32:16.526822 | node1 | TASK [vexxhost.ceph.rgw : Snapshot current RGW service specs] ******************
2026-08-18 14:32:16.527018 | node1 | Tuesday 18 August 2026  14:32:16 +0000 (0:00:00.048)       0:12:35.924 ********
2026-08-18 14:32:17.978613 | node1 | ok: [node1]
2026-08-18 14:32:17.978698 | node1 |
2026-08-18 14:32:17.978888 | node1 | TASK [vexxhost.ceph.rgw : Index current RGW specs by service name] *************
2026-08-18 14:32:17.978931 | node1 | Tuesday 18 August 2026  14:32:17 +0000 (0:00:01.451)       0:12:37.375 ********
2026-08-18 14:32:18.023920 | node1 | ok: [node1]
2026-08-18 14:32:18.024356 | node1 |
2026-08-18 14:32:18.024408 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] *************************
2026-08-18 14:32:18.024416 | node1 | Tuesday 18 August 2026  14:32:18 +0000 (0:00:00.045)       0:12:37.421 ********
2026-08-18 14:32:20.735322 | node1 | changed: [node1] => (item=molecule)
2026-08-18 14:32:20.735402 | node1 |
2026-08-18 14:32:20.735470 | node1 | TASK [vexxhost.ceph.rgw : Redeploy RGW services whose redeploy-triggering keys changed] ***
2026-08-18 14:32:20.735564 | node1 | Tuesday 18 August 2026  14:32:20 +0000 (0:00:02.711)       0:12:40.132 ********
2026-08-18 14:32:22.208914 | node1 | failed: [node1] (item=rgw.molecule) => {"ansible_loop_var": "item", "changed": true, "cmd": ["cephadm", "shell", "--fsid", "1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", "--config", "/var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.node1/config", "--", "ceph", "orch", "redeploy", "rgw.molecule"], "delta": "0:00:01.262249", "end": "2026-08-18 14:32:22.175922", "item": {"count_per_host": 1, "id": "molecule", "spec": {"generate_cert": true, "rgw_frontend_port": 8080, "rgw_realm": "molecule", "rgw_zone": "molecule-1", "rgw_zonegroup": "molecule", "ssl": true}}, "msg": "non-zero return code", "rc": 22, "start": "2026-08-18 14:32:20.913673", "stderr": "Error EINVAL: No daemons exist under service name \"rgw.molecule\". View currently running services using \"ceph orch ls\"", "stderr_lines": ["Error EINVAL: No daemons exist under service name \"rgw.molecule\". View currently running services using \"ceph orch ls\""], "stdout": "", "stdout_lines": []}
2026-08-18 14:32:22.223261 | node1 |
2026-08-18 14:32:22.223371 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone / zonegroup / pools] *********
2026-08-18 14:32:22.223492 | node1 | Tuesday 18 August 2026  14:32:22 +0000 (0:00:01.487)       0:12:41.620 ********
2026-08-18 14:32:22.282200 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/cleanup.yml for node2
2026-08-18 14:32:22.282263 | node1 |
2026-08-18 14:32:22.282349 | node1 | TASK [vexxhost.ceph.rgw : List RGW zones] **************************************
2026-08-18 14:32:22.282445 | node1 | Tuesday 18 August 2026  14:32:22 +0000 (0:00:00.058)       0:12:41.679 ********
2026-08-18 14:32:23.405003 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 14:32:23.405080 | node1 |
2026-08-18 14:32:23.405155 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zonegroup] ************************
2026-08-18 14:32:23.405271 | node1 | Tuesday 18 August 2026  14:32:23 +0000 (0:00:01.123)       0:12:42.802 ********
2026-08-18 14:32:23.445505 | node1 | skipping: [node2]
2026-08-18 14:32:23.445553 | node1 |
2026-08-18 14:32:23.445665 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone] *****************************
2026-08-18 14:32:23.445762 | node1 | Tuesday 18 August 2026  14:32:23 +0000 (0:00:00.040)       0:12:42.843 ********
2026-08-18 14:32:23.487142 | node1 | skipping: [node2]
2026-08-18 14:32:23.487188 | node1 |
2026-08-18 14:32:23.487310 | node1 | TASK [vexxhost.ceph.rgw : Get the current pool deletion setting] ***************
2026-08-18 14:32:23.487408 | node1 | Tuesday 18 August 2026  14:32:23 +0000 (0:00:00.041)       0:12:42.884 ********
2026-08-18 14:32:23.526062 | node1 | skipping: [node2]
2026-08-18 14:32:23.526130 | node1 |
2026-08-18 14:32:23.526189 | node1 | TASK [vexxhost.ceph.rgw : Allow pool deletion] *********************************
2026-08-18 14:32:23.526285 | node1 | Tuesday 18 August 2026  14:32:23 +0000 (0:00:00.038)       0:12:42.923 ********
2026-08-18 14:32:23.567595 | node1 | skipping: [node2]
2026-08-18 14:32:23.567675 | node1 |
2026-08-18 14:32:23.567859 | node1 | TASK [vexxhost.ceph.rgw : Remove the default RGW pools] ************************
2026-08-18 14:32:23.568057 | node1 | Tuesday 18 August 2026  14:32:23 +0000 (0:00:00.041)       0:12:42.964 ********
2026-08-18 14:32:23.631089 | node1 | skipping: [node2] => (item=default.rgw.control)
2026-08-18 14:32:23.631220 | node1 | skipping: [node2] => (item=default.rgw.log)
2026-08-18 14:32:23.631384 | node1 | skipping: [node2] => (item=default.rgw.meta)
2026-08-18 14:32:23.631518 | node1 | skipping: [node2]
2026-08-18 14:32:23.631655 | node1 |
2026-08-18 14:32:23.631808 | node1 | TASK [vexxhost.ceph.rgw : Restore the configured pool deletion setting] ********
2026-08-18 14:32:23.631936 | node1 | Tuesday 18 August 2026  14:32:23 +0000 (0:00:00.063)       0:12:43.028 ********
2026-08-18 14:32:23.676574 | node1 | skipping: [node2]
2026-08-18 14:32:23.676642 | node1 |
2026-08-18 14:32:23.676684 | node1 | TASK [vexxhost.ceph.rgw : Remove the temporary pool deletion setting] **********
2026-08-18 14:32:23.676787 | node1 | Tuesday 18 August 2026  14:32:23 +0000 (0:00:00.045)       0:12:43.074 ********
2026-08-18 14:32:23.769499 | node1 | skipping: [node2]
2026-08-18 14:32:23.769543 | node1 |
2026-08-18 14:32:23.769549 | node1 | PLAY [Deploy Ceph monitoring stack] ********************************************
2026-08-18 14:32:23.769554 | node1 |
2026-08-18 14:32:23.769558 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 14:32:23.769562 | node1 | Tuesday 18 August 2026  14:32:23 +0000 (0:00:00.092)       0:12:43.166 ********
2026-08-18 14:32:24.721003 | node1 | ok: [node3]
2026-08-18 14:32:24.721082 | node1 | ok: [node2]
2026-08-18 14:32:24.721373 | node1 |
2026-08-18 14:32:24.721418 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:32:24.721424 | node1 | Tuesday 18 August 2026  14:32:24 +0000 (0:00:00.951)       0:12:44.118 ********
2026-08-18 14:32:24.945985 | node1 | ok: [node2]
2026-08-18 14:32:24.946092 | node1 | ok: [node3]
2026-08-18 14:32:24.946121 | node1 |
2026-08-18 14:32:24.946232 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:32:24.946334 | node1 | Tuesday 18 August 2026  14:32:24 +0000 (0:00:00.224)       0:12:44.343 ********
2026-08-18 14:32:25.006677 | node1 | skipping: [node2]
2026-08-18 14:32:25.006795 | node1 | skipping: [node3]
2026-08-18 14:32:25.006818 | node1 |
2026-08-18 14:32:25.006975 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 14:32:25.007114 | node1 | Tuesday 18 August 2026  14:32:25 +0000 (0:00:00.060)       0:12:44.403 ********
2026-08-18 14:32:25.253368 | node1 | ok: [node2]
2026-08-18 14:32:25.253444 | node1 | ok: [node3]
2026-08-18 14:32:25.253544 | node1 |
2026-08-18 14:32:25.253659 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:32:25.253775 | node1 | Tuesday 18 August 2026  14:32:25 +0000 (0:00:00.247)       0:12:44.650 ********
2026-08-18 14:32:25.321187 | node1 | ok: [node2] => {
2026-08-18 14:32:25.321313 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 14:32:25.321491 | node1 | }
2026-08-18 14:32:25.321660 | node1 | ok: [node3] => {
2026-08-18 14:32:25.321844 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 14:32:25.322071 | node1 | }
2026-08-18 14:32:25.322230 | node1 |
2026-08-18 14:32:25.322431 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:32:25.322596 | node1 | Tuesday 18 August 2026  14:32:25 +0000 (0:00:00.067)       0:12:44.717 ********
2026-08-18 14:32:25.629154 | node1 | ok: [node2]
2026-08-18 14:32:25.629226 | node1 | ok: [node3]
2026-08-18 14:32:25.629306 | node1 |
2026-08-18 14:32:25.629409 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:32:25.629496 | node1 | Tuesday 18 August 2026  14:32:25 +0000 (0:00:00.308)       0:12:45.026 ********
2026-08-18 14:32:25.689339 | node1 | skipping: [node2]
2026-08-18 14:32:25.689402 | node1 | skipping: [node3]
2026-08-18 14:32:25.689505 | node1 |
2026-08-18 14:32:25.689595 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:32:25.689688 | node1 | Tuesday 18 August 2026  14:32:25 +0000 (0:00:00.059)       0:12:45.086 ********
2026-08-18 14:32:25.750613 | node1 | skipping: [node2]
2026-08-18 14:32:25.750663 | node1 | skipping: [node3]
2026-08-18 14:32:25.750673 | node1 |
2026-08-18 14:32:25.750683 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:32:25.750692 | node1 | Tuesday 18 August 2026  14:32:25 +0000 (0:00:00.060)       0:12:45.147 ********
2026-08-18 14:32:25.975411 | node1 | ok: [node2]
2026-08-18 14:32:25.975488 | node1 | ok: [node3]
2026-08-18 14:32:25.975530 | node1 |
2026-08-18 14:32:25.975631 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:32:25.975721 | node1 | Tuesday 18 August 2026  14:32:25 +0000 (0:00:00.225)       0:12:45.372 ********
2026-08-18 14:32:27.042804 | node1 | ok: [node2]
2026-08-18 14:32:27.042944 | node1 | ok: [node3]
2026-08-18 14:32:27.042957 | node1 |
2026-08-18 14:32:27.042971 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:32:27.043106 | node1 | Tuesday 18 August 2026  14:32:27 +0000 (0:00:01.067)       0:12:46.440 ********
2026-08-18 14:32:27.131859 | node1 | ok: [node2] => {
2026-08-18 14:32:27.131936 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 14:32:27.132613 | node1 | }
2026-08-18 14:32:27.132672 | node1 | ok: [node3] => {
2026-08-18 14:32:27.132678 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 14:32:27.132683 | node1 | }
2026-08-18 14:32:27.132688 | node1 |
2026-08-18 14:32:27.132693 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:32:27.132698 | node1 | Tuesday 18 August 2026  14:32:27 +0000 (0:00:00.088)       0:12:46.528 ********
2026-08-18 14:32:27.473193 | node1 | ok: [node2]
2026-08-18 14:32:27.473247 | node1 | ok: [node3]
2026-08-18 14:32:27.473356 | node1 |
2026-08-18 14:32:27.473451 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:32:27.473545 | node1 | Tuesday 18 August 2026  14:32:27 +0000 (0:00:00.341)       0:12:46.870 ********
2026-08-18 14:32:29.544709 | node1 | ok: [node3]
2026-08-18 14:32:29.544756 | node1 | ok: [node2]
2026-08-18 14:32:29.544762 | node1 |
2026-08-18 14:32:29.544767 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 14:32:29.544771 | node1 | Tuesday 18 August 2026  14:32:29 +0000 (0:00:02.071)       0:12:48.941 ********
2026-08-18 14:32:29.593294 | node1 | skipping: [node2]
2026-08-18 14:32:29.593413 | node1 | skipping: [node3]
2026-08-18 14:32:29.593535 | node1 |
2026-08-18 14:32:29.593676 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 14:32:29.593927 | node1 | Tuesday 18 August 2026  14:32:29 +0000 (0:00:00.048)       0:12:48.989 ********
2026-08-18 14:32:29.636965 | node1 | skipping: [node2]
2026-08-18 14:32:29.637099 | node1 | skipping: [node3]
2026-08-18 14:32:29.637221 | node1 |
2026-08-18 14:32:29.637367 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 14:32:29.637529 | node1 | Tuesday 18 August 2026  14:32:29 +0000 (0:00:00.044)       0:12:49.034 ********
2026-08-18 14:32:29.679628 | node1 | skipping: [node2]
2026-08-18 14:32:29.679737 | node1 | skipping: [node3]
2026-08-18 14:32:29.679863 | node1 |
2026-08-18 14:32:29.680008 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 14:32:29.680142 | node1 | Tuesday 18 August 2026  14:32:29 +0000 (0:00:00.042)       0:12:49.076 ********
2026-08-18 14:32:30.802133 | node1 | ok: [node2]
2026-08-18 14:32:30.802240 | node1 | ok: [node3]
2026-08-18 14:32:30.802368 | node1 |
2026-08-18 14:32:30.802555 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 14:32:30.802709 | node1 | Tuesday 18 August 2026  14:32:30 +0000 (0:00:01.122)       0:12:50.199 ********
2026-08-18 14:32:31.292162 | node1 | ok: [node2]
2026-08-18 14:32:31.292337 | node1 | ok: [node3]
2026-08-18 14:32:31.292412 | node1 |
2026-08-18 14:32:31.292575 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 14:32:31.292754 | node1 | Tuesday 18 August 2026  14:32:31 +0000 (0:00:00.489)       0:12:50.688 ********
2026-08-18 14:32:32.260910 | node1 | ok: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 14:32:32.261135 | node1 | ok: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 14:32:32.261352 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 14:32:32.261577 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 14:32:32.261824 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 14:32:32.262026 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 14:32:32.262465 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 14:32:32.262520 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 14:32:32.262730 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 14:32:32.262944 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 14:32:32.263184 | node1 |
2026-08-18 14:32:32.263341 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 14:32:32.263551 | node1 | Tuesday 18 August 2026  14:32:32 +0000 (0:00:00.968)       0:12:51.657 ********
2026-08-18 14:32:32.816349 | node1 | ok: [node2]
2026-08-18 14:32:32.816550 | node1 | ok: [node3]
2026-08-18 14:32:32.816822 | node1 |
2026-08-18 14:32:32.817160 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 14:32:32.817379 | node1 | Tuesday 18 August 2026  14:32:32 +0000 (0:00:00.542)       0:12:52.200 ********
2026-08-18 14:32:32.817580 | node1 |
2026-08-18 14:32:32.817817 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 14:32:32.818066 | node1 | Tuesday 18 August 2026  14:32:32 +0000 (0:00:00.006)       0:12:52.206 ********
2026-08-18 14:32:32.818264 | node1 |
2026-08-18 14:32:32.818480 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 14:32:32.818695 | node1 | Tuesday 18 August 2026  14:32:32 +0000 (0:00:00.006)       0:12:52.213 ********
2026-08-18 14:32:33.209572 | node1 | ok: [node3]
2026-08-18 14:32:33.209689 | node1 | ok: [node2]
2026-08-18 14:32:33.209948 | node1 |
2026-08-18 14:32:33.210219 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:32:33.210473 | node1 | Tuesday 18 August 2026  14:32:33 +0000 (0:00:00.392)       0:12:52.606 ********
2026-08-18 14:32:33.435552 | node1 | ok: [node2]
2026-08-18 14:32:33.435632 | node1 | ok: [node3]
2026-08-18 14:32:33.435703 | node1 |
2026-08-18 14:32:33.435806 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:32:33.435908 | node1 | Tuesday 18 August 2026  14:32:33 +0000 (0:00:00.226)       0:12:52.832 ********
2026-08-18 14:32:33.511213 | node1 | ok: [node2] => {
2026-08-18 14:32:33.511455 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 14:32:33.511661 | node1 | }
2026-08-18 14:32:33.511868 | node1 | ok: [node3] => {
2026-08-18 14:32:33.512086 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 14:32:33.512279 | node1 | }
2026-08-18 14:32:33.512464 | node1 |
2026-08-18 14:32:33.512678 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:32:33.513051 | node1 | Tuesday 18 August 2026  14:32:33 +0000 (0:00:00.075)       0:12:52.907 ********
2026-08-18 14:32:33.871766 | node1 | ok: [node2]
2026-08-18 14:32:33.871963 | node1 | ok: [node3]
2026-08-18 14:32:33.872158 | node1 |
2026-08-18 14:32:33.872383 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:32:33.872595 | node1 | Tuesday 18 August 2026  14:32:33 +0000 (0:00:00.360)       0:12:53.268 ********
2026-08-18 14:32:36.914765 | node1 | ok: [node2]
2026-08-18 14:32:36.914822 | node1 | ok: [node3]
2026-08-18 14:32:36.914829 | node1 |
2026-08-18 14:32:36.914835 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 14:32:36.914842 | node1 | Tuesday 18 August 2026  14:32:36 +0000 (0:00:03.043)       0:12:56.311 ********
2026-08-18 14:32:38.064699 | node1 | ok: [node2]
2026-08-18 14:32:38.064758 | node1 | ok: [node3]
2026-08-18 14:32:38.064765 | node1 |
2026-08-18 14:32:38.064771 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 14:32:38.064777 | node1 | Tuesday 18 August 2026  14:32:38 +0000 (0:00:01.149)       0:12:57.461 ********
2026-08-18 14:32:38.284593 | node1 | ok: [node2]
2026-08-18 14:32:38.284687 | node1 | ok: [node3]
2026-08-18 14:32:38.284702 | node1 |
2026-08-18 14:32:38.285038 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 14:32:38.285088 | node1 | Tuesday 18 August 2026  14:32:38 +0000 (0:00:00.220)       0:12:57.681 ********
2026-08-18 14:32:38.737009 | node1 | ok: [node2]
2026-08-18 14:32:38.737082 | node1 | ok: [node3]
2026-08-18 14:32:38.737154 | node1 |
2026-08-18 14:32:38.737271 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 14:32:38.737378 | node1 | Tuesday 18 August 2026  14:32:38 +0000 (0:00:00.452)       0:12:58.134 ********
2026-08-18 14:32:39.300539 | node1 | ok: [node2] => (item={'path': '/etc/docker'})
2026-08-18 14:32:39.300594 | node1 | ok: [node3] => (item={'path': '/etc/docker'})
2026-08-18 14:32:39.300603 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 14:32:39.300611 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 14:32:39.300617 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 14:32:39.300623 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 14:32:39.300628 | node1 |
2026-08-18 14:32:39.300634 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 14:32:39.300640 | node1 | Tuesday 18 August 2026  14:32:39 +0000 (0:00:00.562)       0:12:58.696 ********
2026-08-18 14:32:39.749040 | node1 | ok: [node2]
2026-08-18 14:32:39.749158 | node1 | ok: [node3]
2026-08-18 14:32:39.749170 | node1 |
2026-08-18 14:32:39.749340 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 14:32:39.749485 | node1 | Tuesday 18 August 2026  14:32:39 +0000 (0:00:00.449)       0:12:59.145 ********
2026-08-18 14:32:40.186608 | node1 | ok: [node3]
2026-08-18 14:32:40.186734 | node1 | ok: [node2]
2026-08-18 14:32:40.187767 | node1 |
2026-08-18 14:32:40.187818 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 14:32:40.187827 | node1 | Tuesday 18 August 2026  14:32:40 +0000 (0:00:00.425)       0:12:59.571 ********
2026-08-18 14:32:40.187833 | node1 |
2026-08-18 14:32:40.187839 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 14:32:40.187845 | node1 | Tuesday 18 August 2026  14:32:40 +0000 (0:00:00.006)       0:12:59.578 ********
2026-08-18 14:32:40.187861 | node1 |
2026-08-18 14:32:40.187866 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 14:32:40.187872 | node1 | Tuesday 18 August 2026  14:32:40 +0000 (0:00:00.005)       0:12:59.583 ********
2026-08-18 14:32:40.563207 | node1 | ok: [node2]
2026-08-18 14:32:40.563282 | node1 | ok: [node3]
2026-08-18 14:32:40.563804 | node1 |
2026-08-18 14:32:40.563849 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:32:40.563854 | node1 | Tuesday 18 August 2026  14:32:40 +0000 (0:00:00.376)       0:12:59.960 ********
2026-08-18 14:32:40.617506 | node1 | ok: [node2] => {
2026-08-18 14:32:40.617645 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 14:32:40.617774 | node1 | }
2026-08-18 14:32:40.617883 | node1 | ok: [node3] => {
2026-08-18 14:32:40.618009 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 14:32:40.618089 | node1 | }
2026-08-18 14:32:40.618173 | node1 |
2026-08-18 14:32:40.618269 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:32:40.618361 | node1 | Tuesday 18 August 2026  14:32:40 +0000 (0:00:00.053)       0:13:00.014 ********
2026-08-18 14:32:40.902810 | node1 | ok: [node2]
2026-08-18 14:32:40.902854 | node1 | ok: [node3]
2026-08-18 14:32:40.902859 | node1 |
2026-08-18 14:32:40.902864 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:32:40.902869 | node1 | Tuesday 18 August 2026  14:32:40 +0000 (0:00:00.285)       0:13:00.299 ********
2026-08-18 14:32:40.959270 | node1 | skipping: [node2]
2026-08-18 14:32:40.959356 | node1 | skipping: [node3]
2026-08-18 14:32:40.960024 | node1 |
2026-08-18 14:32:40.960112 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 14:32:40.960128 | node1 | Tuesday 18 August 2026  14:32:40 +0000 (0:00:00.053)       0:13:00.353 ********
2026-08-18 14:32:41.039161 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 14:32:41.039759 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 14:32:41.039828 | node1 |
2026-08-18 14:32:41.039838 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 14:32:41.039852 | node1 | Tuesday 18 August 2026  14:32:41 +0000 (0:00:00.081)       0:13:00.435 ********
2026-08-18 14:32:42.112132 | node1 | ok: [node3]
2026-08-18 14:32:42.112231 | node1 | ok: [node2]
2026-08-18 14:32:42.112350 | node1 |
2026-08-18 14:32:42.112494 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 14:32:42.112635 | node1 | Tuesday 18 August 2026  14:32:42 +0000 (0:00:01.074)       0:13:01.509 ********
2026-08-18 14:32:42.776717 | node1 | ok: [node2] => (item=chronyd)
2026-08-18 14:32:42.776794 | node1 | ok: [node3] => (item=chronyd)
2026-08-18 14:32:42.776811 | node1 | ok: [node2] => (item=sshd)
2026-08-18 14:32:42.777228 | node1 | ok: [node3] => (item=sshd)
2026-08-18 14:32:42.777266 | node1 |
2026-08-18 14:32:42.777272 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 14:32:42.777277 | node1 | Tuesday 18 August 2026  14:32:42 +0000 (0:00:00.664)       0:13:02.174 ********
2026-08-18 14:32:43.006279 | node1 | ok: [node2]
2026-08-18 14:32:43.006333 | node1 | ok: [node3]
2026-08-18 14:32:43.006340 | node1 |
2026-08-18 14:32:43.006347 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 14:32:43.006353 | node1 | Tuesday 18 August 2026  14:32:43 +0000 (0:00:00.229)       0:13:02.403 ********
2026-08-18 14:32:43.255181 | node1 | ok: [node2]
2026-08-18 14:32:43.255224 | node1 | ok: [node3]
2026-08-18 14:32:43.255230 | node1 |
2026-08-18 14:32:43.255235 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 14:32:43.255240 | node1 | Tuesday 18 August 2026  14:32:43 +0000 (0:00:00.249)       0:13:02.652 ********
2026-08-18 14:32:43.687029 | node1 | ok: [node2]
2026-08-18 14:32:43.687090 | node1 | ok: [node3]
2026-08-18 14:32:43.687416 | node1 |
2026-08-18 14:32:43.687456 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 14:32:43.687472 | node1 | Tuesday 18 August 2026  14:32:43 +0000 (0:00:00.432)       0:13:03.084 ********
2026-08-18 14:32:43.736683 | node1 | skipping: [node2]
2026-08-18 14:32:43.736759 | node1 | skipping: [node3]
2026-08-18 14:32:43.737103 | node1 |
2026-08-18 14:32:43.737155 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 14:32:43.737163 | node1 | Tuesday 18 August 2026  14:32:43 +0000 (0:00:00.049)       0:13:03.133 ********
2026-08-18 14:32:44.110149 | node1 | ok: [node3]
2026-08-18 14:32:44.110187 | node1 | ok: [node2]
2026-08-18 14:32:44.110192 | node1 |
2026-08-18 14:32:44.110197 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 14:32:44.110202 | node1 | Tuesday 18 August 2026  14:32:44 +0000 (0:00:00.373)       0:13:03.507 ********
2026-08-18 14:32:44.560898 | node1 | ok: [node2]
2026-08-18 14:32:44.560942 | node1 | ok: [node3]
2026-08-18 14:32:44.560948 | node1 |
2026-08-18 14:32:44.560953 | node1 | TASK [vexxhost.ceph.monitoring : Locate the cluster admin host] ****************
2026-08-18 14:32:44.560957 | node1 | Tuesday 18 August 2026  14:32:44 +0000 (0:00:00.450)       0:13:03.958 ********
2026-08-18 14:32:45.171623 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=node1)
2026-08-18 14:32:45.172040 | node1 | ok: [node2] => (item=node2)
2026-08-18 14:32:45.172451 | node1 | ok: [node2 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 14:32:45.172463 | node1 |
2026-08-18 14:32:45.172469 | node1 | TASK [vexxhost.ceph.monitoring : Select the admin host] ************************
2026-08-18 14:32:45.172474 | node1 | Tuesday 18 August 2026  14:32:45 +0000 (0:00:00.610)       0:13:04.568 ********
2026-08-18 14:32:45.240645 | node1 | ok: [node2]
2026-08-18 14:32:45.240743 | node1 | ok: [node3]
2026-08-18 14:32:45.240750 | node1 |
2026-08-18 14:32:45.240757 | node1 | TASK [vexxhost.ceph.monitoring : Set the admin mon config path] ****************
2026-08-18 14:32:45.240774 | node1 | Tuesday 18 August 2026  14:32:45 +0000 (0:00:00.068)       0:13:04.637 ********
2026-08-18 14:32:45.296113 | node1 | ok: [node2]
2026-08-18 14:32:45.296241 | node1 | ok: [node3]
2026-08-18 14:32:45.296252 | node1 |
2026-08-18 14:32:45.296321 | node1 | TASK [vexxhost.ceph.monitoring : Pin monitoring container images] **************
2026-08-18 14:32:45.296414 | node1 | Tuesday 18 August 2026  14:32:45 +0000 (0:00:00.055)       0:13:04.692 ********
2026-08-18 14:32:45.324918 | node1 | skipping: [node2]
2026-08-18 14:32:45.325010 | node1 |
2026-08-18 14:32:45.325094 | node1 | TASK [vexxhost.ceph.monitoring : Apply the monitoring service specs] ***********
2026-08-18 14:32:45.325233 | node1 | Tuesday 18 August 2026  14:32:45 +0000 (0:00:00.029)       0:13:04.722 ********
2026-08-18 14:32:48.172039 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=ceph-exporter)
2026-08-18 14:32:48.172211 | node1 |
2026-08-18 14:32:48.172597 | node1 | PLAY RECAP *********************************************************************
2026-08-18 14:32:48.172901 | node1 | node1                      : ok=204  changed=47   unreachable=0    failed=1    skipped=37   rescued=0    ignored=0
2026-08-18 14:32:48.173136 | node1 | node2                      : ok=210  changed=29   unreachable=0    failed=0    skipped=53   rescued=0    ignored=0
2026-08-18 14:32:48.173469 | node1 | node3                      : ok=206  changed=28   unreachable=0    failed=0    skipped=45   rescued=0    ignored=0
2026-08-18 14:32:48.173674 | node1 |
2026-08-18 14:32:48.173867 | node1 |
2026-08-18 14:32:48.174139 | node1 | TASKS RECAP ********************************************************************
2026-08-18 14:32:48.174350 | node1 | Tuesday 18 August 2026  14:32:48 +0000 (0:00:02.847)       0:13:07.569 ********
2026-08-18 14:32:48.174556 | node1 | ===============================================================================
2026-08-18 14:32:48.174805 | node1 | vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices ------ 344.59s
2026-08-18 14:32:48.175028 | node1 | vexxhost.containers.containerd : Install AppArmor packages ------------- 75.42s
2026-08-18 14:32:48.175244 | node1 | vexxhost.ceph.mon : Bootstrap the cluster ------------------------------ 41.03s
2026-08-18 14:32:48.175462 | node1 | vexxhost.ceph.cephadm : Pre-pull the Ceph image ------------------------ 40.62s
2026-08-18 14:32:48.175679 | node1 | vexxhost.ceph.configure : Configure pools ------------------------------ 30.73s
2026-08-18 14:32:48.175883 | node1 | vexxhost.ceph.cephadm_host : Register the host (labels) ---------------- 26.46s
2026-08-18 14:32:48.176110 | node1 | vexxhost.ceph.configure : Apply central Ceph configuration ------------- 16.62s
2026-08-18 14:32:48.176336 | node1 | vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host -- 14.46s
2026-08-18 14:32:48.176594 | node1 | vexxhost.ceph.mgr : Configure ceph-mgr modules ------------------------- 10.13s
2026-08-18 14:32:48.176854 | node1 | vexxhost.ceph.configure : Configure CRUSH rules ------------------------- 9.76s
2026-08-18 14:32:48.178440 | node1 | vexxhost.ceph.configure : Configure dashboard users --------------------- 8.87s
2026-08-18 14:32:48.178450 | node1 | vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate --- 6.70s
2026-08-18 14:32:48.178459 | node1 | vexxhost.ceph.cephadm_host : Register the host (labels) ----------------- 5.20s
2026-08-18 14:32:48.178465 | node1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 4.56s
2026-08-18 14:32:48.178471 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.43s
2026-08-18 14:32:48.178476 | node1 | vexxhost.ceph.rgw : Configure RGW realms -------------------------------- 3.75s
2026-08-18 14:32:48.178482 | node1 | vexxhost.ceph.configure : Configure erasure-code profiles --------------- 3.33s
2026-08-18 14:32:48.178580 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.17s
2026-08-18 14:32:48.178714 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.11s
2026-08-18 14:32:48.178848 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.04s
2026-08-18 14:32:48.302029 | node1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-18 14:32:48.302142 | node1 | ERROR    [default > converge] Executed: Failed
2026-08-18 14:32:48.302250 | node1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-18 14:32:48.662872 | node1 | ERROR
2026-08-18 14:32:48.663095 | node1 | {
2026-08-18 14:32:48.663159 | node1 |   "delta": "0:14:27.544492",
2026-08-18 14:32:48.663206 | node1 |   "end": "2026-08-18 14:32:48.372020",
2026-08-18 14:32:48.663234 | node1 |   "msg": "non-zero return code",
2026-08-18 14:32:48.663262 | node1 |   "rc": 2,
2026-08-18 14:32:48.663289 | node1 |   "start": "2026-08-18 14:18:20.827528"
2026-08-18 14:32:48.663313 | node1 | }
failure
2026-08-18 14:32:48.686152 | 
2026-08-18 14:32:48.691682 | PLAY RECAP
2026-08-18 14:32:48.691822 | node1 | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-08-18 14:32:48.691878 | 
2026-08-18 14:32:48.832535 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-18 14:32:48.845157 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-18 14:32:49.503671 | 
2026-08-18 14:32:49.503813 | PLAY [all]
2026-08-18 14:32:49.515913 | 
2026-08-18 14:32:49.515989 | TASK [fetch-output : Set log path for multiple nodes]
2026-08-18 14:32:49.569071 | node1 | ok
2026-08-18 14:32:49.576436 | node2 | ok
2026-08-18 14:32:49.583701 | node3 | ok
2026-08-18 14:32:49.588559 | 
2026-08-18 14:32:49.588665 | TASK [fetch-output : Set log path for single node]
2026-08-18 14:32:49.622513 | node1 | skipping: Conditional result was False
2026-08-18 14:32:49.623923 | node2 | skipping: Conditional result was False
2026-08-18 14:32:49.634482 | node3 | skipping: Conditional result was False
2026-08-18 14:32:49.645057 | 
2026-08-18 14:32:49.645163 | LOOP [fetch-output : Ensure local output dirs]
2026-08-18 14:32:50.021462 | node2 -> localhost | changed: "/var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/work/logs/node2"
2026-08-18 14:32:50.024133 | node1 -> localhost | changed: "/var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/work/logs/node1"
2026-08-18 14:32:50.026012 | node3 -> localhost | changed: "/var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/work/logs/node3"
2026-08-18 14:32:50.231580 | node1 -> localhost | changed: "/var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/work/artifacts"
2026-08-18 14:32:50.235468 | node2 -> localhost | ok: "/var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/work/artifacts"
2026-08-18 14:32:50.318120 | node3 -> localhost | ok: "/var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/work/artifacts"
2026-08-18 14:32:50.452065 | node1 -> localhost | changed: "/var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/work/docs"
2026-08-18 14:32:50.472822 | node2 -> localhost | ok: "/var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/work/docs"
2026-08-18 14:32:50.472990 | node2 -> localhost | changed: All items complete
2026-08-18 14:32:50.473048 | 
2026-08-18 14:32:50.544772 | node3 -> localhost | ok: "/var/lib/zuul/builds/81c9357e7f4d4ad8bd1ee7d0bdf9ff50/work/docs"
2026-08-18 14:32:50.592833 | 
2026-08-18 14:32:50.593007 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-08-18 14:32:51.179264 | node1 | changed: .d..t...... ./
2026-08-18 14:32:51.179512 | node1 | changed: All items complete
2026-08-18 14:32:51.179553 | 
2026-08-18 14:32:51.186087 | node3 | changed: .d..t...... ./
2026-08-18 14:32:51.205571 | node2 | changed: .d..t...... ./
2026-08-18 14:32:51.628331 | node1 | changed: .d..t...... ./
2026-08-18 14:32:51.654473 | node3 | ok
2026-08-18 14:32:51.697012 | node2 | ok
2026-08-18 14:32:52.084600 | node1 | changed: .d..t...... ./
2026-08-18 14:32:52.128196 | node3 | ok
2026-08-18 14:32:52.181147 | node2 | ok
2026-08-18 14:32:52.181232 | node2 | changed: All items complete
2026-08-18 14:32:52.181275 | 
2026-08-18 14:32:52.207956 | 
2026-08-18 14:32:52.208105 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-08-18 14:32:52.581892 | node1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008363
2026-08-18 14:32:52.813631 | node1 -> localhost | ok: Item: docs Runtime: 0:00:00.007247
2026-08-18 14:32:52.844890 | 
2026-08-18 14:32:52.845086 | PLAY [all]
2026-08-18 14:32:52.853971 | 
2026-08-18 14:32:52.854067 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-08-18 14:32:53.279206 | node1 | changed
2026-08-18 14:32:53.472326 | node3 | changed
2026-08-18 14:32:53.478904 | node2 | changed
2026-08-18 14:32:53.492883 | 
2026-08-18 14:32:53.492938 | PLAY RECAP
2026-08-18 14:32:53.493020 | node1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-18 14:32:53.493050 | node2 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-18 14:32:53.493074 | node3 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-18 14:32:53.493092 | 
2026-08-18 14:32:53.651775 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-18 14:32:53.668551 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-08-18 14:32:54.280324 | 
2026-08-18 14:32:54.280819 | PLAY [localhost]
2026-08-18 14:32:54.290498 | 
2026-08-18 14:32:54.290568 | TASK [Generate Zuul manifest]
2026-08-18 14:32:54.313531 | localhost | ok
2026-08-18 14:32:54.331371 | 
2026-08-18 14:32:54.331447 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-08-18 14:32:54.739469 | localhost | changed
2026-08-18 14:32:54.752557 | 
2026-08-18 14:32:54.752641 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-08-18 14:32:54.783927 | localhost | ok
2026-08-18 14:32:54.793250 | 
2026-08-18 14:32:54.793335 | TASK [Upload logs]
2026-08-18 14:32:54.814857 | localhost | ok
2026-08-18 14:32:54.910611 | 
2026-08-18 14:32:54.910752 | TASK [Set zuul-log-path fact]
2026-08-18 14:32:54.932658 | localhost | ok
2026-08-18 14:32:54.946076 | 
2026-08-18 14:32:54.946141 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-18 14:32:54.977023 | localhost | ok
2026-08-18 14:32:54.985975 | 
2026-08-18 14:32:54.986059 | TASK [upload-logs : Create log directories]
2026-08-18 14:32:55.362250 | localhost | changed
2026-08-18 14:32:55.369266 | 
2026-08-18 14:32:55.369362 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-08-18 14:32:55.725868 | localhost -> localhost | ok: Runtime: 0:00:00.005279
2026-08-18 14:32:55.731833 | 
2026-08-18 14:32:55.731899 | TASK [upload-logs : Upload logs to log server]
2026-08-18 14:32:56.238846 | localhost | Output suppressed because no_log was given
2026-08-18 14:32:56.244629 | 
2026-08-18 14:32:56.244694 | LOOP [upload-logs : Compress console log and json output]
2026-08-18 14:32:56.288844 | localhost | skipping: Conditional result was False
2026-08-18 14:32:56.295884 | localhost | skipping: Conditional result was False
2026-08-18 14:32:56.309130 | 
2026-08-18 14:32:56.309309 | LOOP [upload-logs : Upload compressed console log and json output]
2026-08-18 14:32:56.349466 | localhost | skipping: Conditional result was False
2026-08-18 14:32:56.349875 | 
2026-08-18 14:32:56.353258 | localhost | skipping: Conditional result was False
2026-08-18 14:32:56.362632 | 
2026-08-18 14:32:56.362748 | LOOP [upload-logs : Upload console log and json output]