2026-08-18 12:54:46.255120 | Job console starting 2026-08-18 12:54:46.284041 | Updating git repos 2026-08-18 12:54:46.320504 | Cloning repos into workspace 2026-08-18 12:54:46.937464 | Restoring repo states 2026-08-18 12:54:46.945973 | Merging changes 2026-08-18 12:54:47.482653 | Checking out repos 2026-08-18 12:54:47.700022 | Preparing playbooks 2026-08-18 12:54:52.076340 | Running Ansible setup 2026-08-18 12:54:55.743368 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-18 12:54:56.382258 | 2026-08-18 12:54:56.382404 | PLAY [localhost] 2026-08-18 12:54:56.390392 | 2026-08-18 12:54:56.390469 | TASK [Gathering Facts] 2026-08-18 12:54:57.251647 | localhost | ok 2026-08-18 12:54:57.261778 | 2026-08-18 12:54:57.275230 | TASK [Setup log path fact] 2026-08-18 12:54:57.301978 | localhost | ok 2026-08-18 12:54:57.313842 | 2026-08-18 12:54:57.313923 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-18 12:54:57.344828 | localhost | ok 2026-08-18 12:54:57.352896 | 2026-08-18 12:54:57.353026 | TASK [emit-job-header : Print job information] 2026-08-18 12:54:57.398782 | # Job Information 2026-08-18 12:54:57.399077 | Ansible Version: 2.16.18 2026-08-18 12:54:57.399153 | Job: ansible-collection-ceph-molecule-aio-ubuntu-jammy 2026-08-18 12:54:57.399207 | Pipeline: check 2026-08-18 12:54:57.399257 | Executor: 2d72f0692154 2026-08-18 12:54:57.399305 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/123 2026-08-18 12:54:57.399363 | Event ID: a98b4580-9b03-11f1-8895-8d0246b08d0b 2026-08-18 12:54:57.404430 | 2026-08-18 12:54:57.404507 | LOOP [emit-job-header : Print node information] 2026-08-18 12:54:57.499772 | localhost | ok: 2026-08-18 12:54:57.500514 | localhost | # Node Information 2026-08-18 12:54:57.500548 | localhost | Inventory Hostname: aio 2026-08-18 12:54:57.500572 | localhost | Hostname: np0000189978 2026-08-18 12:54:57.500593 | localhost | Username: zuul 2026-08-18 12:54:57.500616 | localhost | Distro: Ubuntu 22.04 2026-08-18 12:54:57.500637 | localhost | Provider: yul1 2026-08-18 12:54:57.500656 | localhost | Region: ca-ymq-1 2026-08-18 12:54:57.500675 | localhost | Label: ubuntu-jammy 2026-08-18 12:54:57.500694 | localhost | Product Name: OpenStack Nova 2026-08-18 12:54:57.500714 | localhost | Interface IP: 199.204.45.238 2026-08-18 12:54:57.517290 | 2026-08-18 12:54:57.517377 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-08-18 12:54:57.908043 | localhost -> localhost | changed 2026-08-18 12:54:57.917602 | 2026-08-18 12:54:57.917709 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-08-18 12:54:58.734636 | localhost -> localhost | changed 2026-08-18 12:54:58.744295 | 2026-08-18 12:54:58.744399 | PLAY [all] 2026-08-18 12:54:58.752217 | 2026-08-18 12:54:58.752294 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-08-18 12:54:58.990963 | aio -> localhost | ok 2026-08-18 12:54:59.000508 | 2026-08-18 12:54:59.000590 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-08-18 12:54:59.035038 | aio | ok 2026-08-18 12:54:59.049692 | aio | included: /var/lib/zuul/builds/9476cba38dac465e96d4f69f81745cf6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 12:54:59.055345 | 2026-08-18 12:54:59.055418 | TASK [add-build-sshkey : Create Temp SSH key] 2026-08-18 12:55:00.073990 | aio -> localhost | Generating public/private rsa key pair. 2026-08-18 12:55:00.074307 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/9476cba38dac465e96d4f69f81745cf6/work/9476cba38dac465e96d4f69f81745cf6_id_rsa 2026-08-18 12:55:00.074378 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/9476cba38dac465e96d4f69f81745cf6/work/9476cba38dac465e96d4f69f81745cf6_id_rsa.pub 2026-08-18 12:55:00.074413 | aio -> localhost | The key fingerprint is: 2026-08-18 12:55:00.074435 | aio -> localhost | SHA256:jAc3hS2sBusz4H7dpEXPvENm5phZH2QF8LAGLc6WIrQ zuul-build-sshkey 2026-08-18 12:55:00.074475 | aio -> localhost | The key's randomart image is: 2026-08-18 12:55:00.074499 | aio -> localhost | +---[RSA 3072]----+ 2026-08-18 12:55:00.074527 | aio -> localhost | | ..++... | 2026-08-18 12:55:00.074550 | aio -> localhost | | o =oo+ . | 2026-08-18 12:55:00.074571 | aio -> localhost | | . +.+o+o .. | 2026-08-18 12:55:00.074593 | aio -> localhost | | . E +=*o o | 2026-08-18 12:55:00.074614 | aio -> localhost | | . o o.+S+ o | 2026-08-18 12:55:00.074634 | aio -> localhost | | . + .o X . | 2026-08-18 12:55:00.074657 | aio -> localhost | | . + = @ o . | 2026-08-18 12:55:00.074679 | aio -> localhost | | . . o = + . | 2026-08-18 12:55:00.074702 | aio -> localhost | | . . | 2026-08-18 12:55:00.074722 | aio -> localhost | +----[SHA256]-----+ 2026-08-18 12:55:00.074779 | aio -> localhost | ok: Runtime: 0:00:00.624959 2026-08-18 12:55:00.080018 | 2026-08-18 12:55:00.080090 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-08-18 12:55:00.111077 | aio | ok 2026-08-18 12:55:00.124161 | aio | included: /var/lib/zuul/builds/9476cba38dac465e96d4f69f81745cf6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 12:55:00.132649 | 2026-08-18 12:55:00.132743 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-08-18 12:55:00.158387 | aio | skipping: Conditional result was False 2026-08-18 12:55:00.170840 | 2026-08-18 12:55:00.170956 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-08-18 12:55:00.612402 | aio | changed 2026-08-18 12:55:00.618859 | 2026-08-18 12:55:00.618957 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-08-18 12:55:00.805307 | aio | ok 2026-08-18 12:55:00.810545 | 2026-08-18 12:55:00.810615 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-08-18 12:55:01.284307 | aio | changed 2026-08-18 12:55:01.290647 | 2026-08-18 12:55:01.290716 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-08-18 12:55:01.793129 | aio | changed 2026-08-18 12:55:01.800353 | 2026-08-18 12:55:01.800513 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-08-18 12:55:01.827279 | aio | skipping: Conditional result was False 2026-08-18 12:55:01.839254 | 2026-08-18 12:55:01.839340 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-08-18 12:55:02.284349 | aio -> localhost | changed 2026-08-18 12:55:02.295773 | 2026-08-18 12:55:02.295838 | TASK [add-build-sshkey : Add back temp key] 2026-08-18 12:55:02.715468 | aio -> localhost | Identity added: /var/lib/zuul/builds/9476cba38dac465e96d4f69f81745cf6/work/9476cba38dac465e96d4f69f81745cf6_id_rsa (zuul-build-sshkey) 2026-08-18 12:55:02.715666 | aio -> localhost | ok: Runtime: 0:00:00.063844 2026-08-18 12:55:02.720493 | 2026-08-18 12:55:02.720556 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-08-18 12:55:03.001946 | aio | ok 2026-08-18 12:55:03.008538 | 2026-08-18 12:55:03.008637 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-08-18 12:55:03.045042 | aio | skipping: Conditional result was False 2026-08-18 12:55:03.060457 | 2026-08-18 12:55:03.060529 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-08-18 12:55:03.361114 | aio | ok 2026-08-18 12:55:03.366915 | 2026-08-18 12:55:03.366983 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-08-18 12:55:04.048308 | aio | Output suppressed because no_log was given 2026-08-18 12:55:04.059385 | 2026-08-18 12:55:04.059455 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-08-18 12:55:04.246706 | aio | ok: "logs" 2026-08-18 12:55:04.246950 | aio | ok: All items complete 2026-08-18 12:55:04.246980 | 2026-08-18 12:55:04.410910 | aio | ok: "artifacts" 2026-08-18 12:55:04.571099 | aio | ok: "docs" 2026-08-18 12:55:04.585020 | 2026-08-18 12:55:04.585237 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-08-18 12:55:04.787825 | aio | changed: "logs" 2026-08-18 12:55:04.944059 | aio | changed: "artifacts" 2026-08-18 12:55:05.096744 | aio | changed: "docs" 2026-08-18 12:55:05.113645 | 2026-08-18 12:55:05.113764 | PLAY RECAP 2026-08-18 12:55:05.113827 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 12:55:05.113866 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 12:55:05.113897 | 2026-08-18 12:55:05.259362 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-18 12:55:05.269239 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-18 12:55:05.872779 | 2026-08-18 12:55:05.872908 | PLAY [all] 2026-08-18 12:55:05.884105 | 2026-08-18 12:55:05.884194 | TASK [setup-uv : Extract archive] 2026-08-18 12:55:08.046058 | aio | changed 2026-08-18 12:55:08.056554 | 2026-08-18 12:55:08.057053 | TASK [setup-uv : Print version] 2026-08-18 12:55:08.406421 | aio | uv 0.8.13 2026-08-18 12:55:08.601428 | aio | ok: Runtime: 0:00:00.011770 2026-08-18 12:55:08.638364 | 2026-08-18 12:55:08.638449 | TASK [Install Ansible collection siblings] 2026-08-18 12:55:09.008713 | aio | ok: 2026-08-18 12:55:09.009034 | aio | Skipping community.crypto: no checked-out sibling 2026-08-18 12:55:09.009104 | aio | Skipping community.docker: no checked-out sibling 2026-08-18 12:55:09.009153 | aio | Skipping community.general: no checked-out sibling 2026-08-18 12:55:09.009199 | aio | Skipping ansible.utils: no checked-out sibling 2026-08-18 12:55:09.009245 | aio | Skipping vexxhost.containers: no checked-out sibling 2026-08-18 12:55:09.012386 | 2026-08-18 12:55:09.012481 | PLAY RECAP 2026-08-18 12:55:09.012581 | aio | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 12:55:09.012630 | 2026-08-18 12:55:09.210014 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-18 12:55:09.218787 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-18 12:55:09.832754 | 2026-08-18 12:55:09.832940 | PLAY [all] 2026-08-18 12:55:09.844973 | 2026-08-18 12:55:09.845079 | LOOP [Check inventory directories] 2026-08-18 12:55:10.166580 | aio | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-18 12:55:10.317657 | aio | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-08-18 12:55:10.455075 | aio | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-08-18 12:55:10.473398 | 2026-08-18 12:55:10.473624 | LOOP [Copy inventory file for Zuul] 2026-08-18 12:55:11.226505 | aio | changed: 2026-08-18 12:55:11.226768 | aio | { 2026-08-18 12:55:11.226856 | aio | "ansible_loop_var": "item", 2026-08-18 12:55:11.226947 | aio | "changed": false, 2026-08-18 12:55:11.227027 | aio | "failed": false, 2026-08-18 12:55:11.227088 | aio | "invocation": { 2026-08-18 12:55:11.227133 | aio | "module_args": { 2026-08-18 12:55:11.227182 | aio | "checksum_algorithm": "sha1", 2026-08-18 12:55:11.227224 | aio | "follow": true, 2026-08-18 12:55:11.227268 | aio | "get_attributes": true, 2026-08-18 12:55:11.227312 | aio | "get_checksum": true, 2026-08-18 12:55:11.227351 | aio | "get_mime": true, 2026-08-18 12:55:11.227384 | aio | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-18 12:55:11.227416 | aio | } 2026-08-18 12:55:11.227447 | aio | }, 2026-08-18 12:55:11.227478 | aio | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-18 12:55:11.227509 | aio | "stat": { 2026-08-18 12:55:11.227541 | aio | "atime": 1787057703.9419348, 2026-08-18 12:55:11.227573 | aio | "attr_flags": "e", 2026-08-18 12:55:11.227604 | aio | "attributes": [ 2026-08-18 12:55:11.227637 | aio | "extents" 2026-08-18 12:55:11.227668 | aio | ], 2026-08-18 12:55:11.227699 | aio | "block_size": 4096, 2026-08-18 12:55:11.227730 | aio | "blocks": 8, 2026-08-18 12:55:11.227908 | aio | "charset": "unknown", 2026-08-18 12:55:11.227970 | aio | "ctime": 1787057703.9499347, 2026-08-18 12:55:11.228002 | aio | "dev": 64513, 2026-08-18 12:55:11.228030 | aio | "device_type": 0, 2026-08-18 12:55:11.228056 | aio | "executable": true, 2026-08-18 12:55:11.228082 | aio | "exists": true, 2026-08-18 12:55:11.228108 | aio | "gid": 1000, 2026-08-18 12:55:11.228134 | aio | "gr_name": "zuul", 2026-08-18 12:55:11.228162 | aio | "inode": 1042461, 2026-08-18 12:55:11.228217 | aio | "isblk": false, 2026-08-18 12:55:11.228249 | aio | "ischr": false, 2026-08-18 12:55:11.228276 | aio | "isdir": true, 2026-08-18 12:55:11.228302 | aio | "isfifo": false, 2026-08-18 12:55:11.228328 | aio | "isgid": false, 2026-08-18 12:55:11.228354 | aio | "islnk": false, 2026-08-18 12:55:11.228379 | aio | "isreg": false, 2026-08-18 12:55:11.228405 | aio | "issock": false, 2026-08-18 12:55:11.228430 | aio | "isuid": false, 2026-08-18 12:55:11.228456 | aio | "mimetype": "unknown", 2026-08-18 12:55:11.228481 | aio | "mode": "0755", 2026-08-18 12:55:11.228506 | aio | "mtime": 1787057687.3588066, 2026-08-18 12:55:11.228532 | aio | "nlink": 10, 2026-08-18 12:55:11.228558 | aio | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-18 12:55:11.228585 | aio | "pw_name": "zuul", 2026-08-18 12:55:11.228617 | aio | "readable": true, 2026-08-18 12:55:11.228644 | aio | "rgrp": true, 2026-08-18 12:55:11.228671 | aio | "roth": true, 2026-08-18 12:55:11.228697 | aio | "rusr": true, 2026-08-18 12:55:11.228722 | aio | "size": 4096, 2026-08-18 12:55:11.228746 | aio | "uid": 1000, 2026-08-18 12:55:11.228771 | aio | "version": "4032260415", 2026-08-18 12:55:11.228797 | aio | "wgrp": false, 2026-08-18 12:55:11.228827 | aio | "woth": false, 2026-08-18 12:55:11.228854 | aio | "writeable": true, 2026-08-18 12:55:11.228882 | aio | "wusr": true, 2026-08-18 12:55:11.228908 | aio | "xgrp": true, 2026-08-18 12:55:11.228933 | aio | "xoth": true, 2026-08-18 12:55:11.228984 | aio | "xusr": true 2026-08-18 12:55:11.229013 | aio | } 2026-08-18 12:55:11.229039 | aio | } 2026-08-18 12:55:11.229092 | aio | ok: All items complete 2026-08-18 12:55:11.229125 | 2026-08-18 12:55:11.230939 | aio | skipping: Conditional result was False 2026-08-18 12:55:11.231920 | aio | skipping: Conditional result was False 2026-08-18 12:55:11.250188 | 2026-08-18 12:55:11.250363 | LOOP [Switch "ansible_host" to private IP] 2026-08-18 12:55:11.588106 | aio | changed: 1 replacements made 2026-08-18 12:55:11.589356 | aio | skipping: Conditional result was False 2026-08-18 12:55:11.589962 | aio | skipping: Conditional result was False 2026-08-18 12:55:11.604816 | 2026-08-18 12:55:11.605002 | TASK [Run Molecule scenario] 2026-08-18 12:55:12.272599 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-08-18 12:55:13.038156 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-08-18 12:55:13.210460 | aio | Using CPython 3.13.7 2026-08-18 12:55:13.210500 | aio | Creating virtual environment at: .venv 2026-08-18 12:55:13.296730 | aio | Downloading netaddr (2.2MiB) 2026-08-18 12:55:13.301315 | aio | Downloading cryptography (4.3MiB) 2026-08-18 12:55:13.304455 | aio | Downloading pygments (1.2MiB) 2026-08-18 12:55:13.304883 | aio | Downloading ansible-core (2.1MiB) 2026-08-18 12:55:13.500466 | aio | Downloading netaddr 2026-08-18 12:55:13.509387 | aio | Downloading cryptography 2026-08-18 12:55:13.551047 | aio | Downloading pygments 2026-08-18 12:55:13.656523 | aio | Downloading ansible-core 2026-08-18 12:55:13.683814 | aio | Installed 42 packages in 26ms 2026-08-18 12:55:14.814833 | aio | INFO Collection 'vexxhost.ceph' detected. 2026-08-18 12:55:14.814889 | aio | INFO Scenarios will be used from 'extensions/molecule' 2026-08-18 12:55:15.452022 | aio | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-08-18 12:55:15.452098 | aio | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-08-18 12:55:41.618593 | aio | INFO [default > dependency] Executing 2026-08-18 12:55:41.618753 | aio | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-08-18 12:55:41.619020 | aio | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-08-18 12:55:41.619200 | aio | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-08-18 12:55:41.626587 | aio | INFO [default > cleanup] Executing 2026-08-18 12:55:41.626940 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 12:55:41.633989 | aio | INFO [default > destroy] Executing 2026-08-18 12:55:41.634028 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-18 12:55:41.634121 | aio | INFO [default > destroy] Executed: Successful 2026-08-18 12:55:41.641475 | aio | INFO [default > syntax] Executing 2026-08-18 12:55:42.846948 | aio | 2026-08-18 12:55:42.847186 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-08-18 12:55:42.941640 | aio | INFO [default > syntax] Executed: Successful 2026-08-18 12:55:42.951395 | aio | INFO [default > create] Executing 2026-08-18 12:55:42.953463 | aio | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 12:55:42.959935 | aio | INFO [default > prepare] Executing 2026-08-18 12:55:43.680190 | aio | 2026-08-18 12:55:43.680353 | aio | PLAY [Prepare] ***************************************************************** 2026-08-18 12:55:43.680677 | aio | 2026-08-18 12:55:43.680897 | aio | TASK [Gathering Facts] ********************************************************* 2026-08-18 12:55:43.681066 | aio | Tuesday 18 August 2026 12:55:43 +0000 (0:00:00.031) 0:00:00.031 ******** 2026-08-18 12:55:44.797996 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-08-18 12:55:44.798252 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 12:55:44.798482 | aio | interpreter could change the meaning of that path. See 2026-08-18 12:55:44.798696 | aio | https://docs.ansible.com/ansible- 2026-08-18 12:55:44.798916 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 12:55:44.807252 | aio | ok: [aio] 2026-08-18 12:55:44.807449 | aio | 2026-08-18 12:55:44.807662 | aio | TASK [Configure short hostname] ************************************************ 2026-08-18 12:55:44.807868 | aio | Tuesday 18 August 2026 12:55:44 +0000 (0:00:01.128) 0:00:01.159 ******** 2026-08-18 12:55:45.765193 | aio | changed: [aio] 2026-08-18 12:55:45.765339 | aio | 2026-08-18 12:55:45.765671 | aio | TASK [Ensure hostname inside hosts file] *************************************** 2026-08-18 12:55:45.765907 | aio | Tuesday 18 August 2026 12:55:45 +0000 (0:00:00.957) 0:00:02.116 ******** 2026-08-18 12:55:46.059825 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-08-18 12:55:46.060003 | aio | with a mode of 0700, this may cause issues when running as another user. To 2026-08-18 12:55:46.060217 | aio | avoid this, create the remote_tmp dir with the correct permissions manually 2026-08-18 12:55:46.070283 | aio | changed: [aio] 2026-08-18 12:55:46.070400 | aio | 2026-08-18 12:55:46.070530 | aio | TASK [Update apt cache] ******************************************************** 2026-08-18 12:55:46.070668 | aio | Tuesday 18 August 2026 12:55:46 +0000 (0:00:00.305) 0:00:02.422 ******** 2026-08-18 12:55:53.241334 | aio | changed: [aio] 2026-08-18 12:55:53.241508 | aio | 2026-08-18 12:55:53.241795 | aio | PLAY [Create devices for Ceph] ************************************************* 2026-08-18 12:55:53.241983 | aio | 2026-08-18 12:55:53.242144 | aio | TASK [Gathering Facts] ********************************************************* 2026-08-18 12:55:53.242348 | aio | Tuesday 18 August 2026 12:55:53 +0000 (0:00:07.171) 0:00:09.593 ******** 2026-08-18 12:55:53.905656 | aio | ok: [aio] 2026-08-18 12:55:53.905755 | aio | 2026-08-18 12:55:53.905850 | aio | TASK [Install depedencies] ***************************************************** 2026-08-18 12:55:53.905982 | aio | Tuesday 18 August 2026 12:55:53 +0000 (0:00:00.664) 0:00:10.258 ******** 2026-08-18 12:56:14.476115 | aio | changed: [aio] 2026-08-18 12:56:14.476189 | aio | 2026-08-18 12:56:14.476382 | aio | TASK [Start up service] ******************************************************** 2026-08-18 12:56:14.476570 | aio | Tuesday 18 August 2026 12:56:14 +0000 (0:00:20.570) 0:00:30.828 ******** 2026-08-18 12:56:15.038796 | aio | ok: [aio] 2026-08-18 12:56:15.038883 | aio | 2026-08-18 12:56:15.038958 | aio | TASK [Generate lvm.conf] ******************************************************* 2026-08-18 12:56:15.039083 | aio | Tuesday 18 August 2026 12:56:15 +0000 (0:00:00.562) 0:00:31.391 ******** 2026-08-18 12:56:15.336458 | aio | ok: [aio] 2026-08-18 12:56:15.336635 | aio | 2026-08-18 12:56:15.336920 | aio | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-08-18 12:56:15.337168 | aio | Tuesday 18 August 2026 12:56:15 +0000 (0:00:00.297) 0:00:31.688 ******** 2026-08-18 12:56:15.977929 | aio | changed: [aio] 2026-08-18 12:56:15.978030 | aio | 2026-08-18 12:56:15.978293 | aio | TASK [Get list of all loopback devices] **************************************** 2026-08-18 12:56:15.978498 | aio | Tuesday 18 August 2026 12:56:15 +0000 (0:00:00.641) 0:00:32.330 ******** 2026-08-18 12:56:16.160126 | aio | ok: [aio] 2026-08-18 12:56:16.160241 | aio | 2026-08-18 12:56:16.160489 | aio | TASK [Fail if there is any existing loopback devices] ************************** 2026-08-18 12:56:16.160595 | aio | Tuesday 18 August 2026 12:56:16 +0000 (0:00:00.182) 0:00:32.512 ******** 2026-08-18 12:56:16.175165 | aio | skipping: [aio] 2026-08-18 12:56:16.175374 | aio | 2026-08-18 12:56:16.175631 | aio | TASK [Create devices for Ceph] ************************************************* 2026-08-18 12:56:16.175892 | aio | Tuesday 18 August 2026 12:56:16 +0000 (0:00:00.015) 0:00:32.527 ******** 2026-08-18 12:56:16.697596 | aio | changed: [aio] => (item=osd0) 2026-08-18 12:56:16.697682 | aio | changed: [aio] => (item=osd1) 2026-08-18 12:56:16.697823 | aio | changed: [aio] => (item=osd2) 2026-08-18 12:56:16.697945 | aio | 2026-08-18 12:56:16.698071 | aio | TASK [Set permissions on loopback devices] ************************************* 2026-08-18 12:56:16.698198 | aio | Tuesday 18 August 2026 12:56:16 +0000 (0:00:00.522) 0:00:33.050 ******** 2026-08-18 12:56:17.299722 | aio | changed: [aio] => (item=osd0) 2026-08-18 12:56:17.299870 | aio | changed: [aio] => (item=osd1) 2026-08-18 12:56:17.300072 | aio | changed: [aio] => (item=osd2) 2026-08-18 12:56:17.300262 | aio | 2026-08-18 12:56:17.300498 | aio | TASK [Start loop devices] ****************************************************** 2026-08-18 12:56:17.300704 | aio | Tuesday 18 August 2026 12:56:17 +0000 (0:00:00.601) 0:00:33.651 ******** 2026-08-18 12:56:17.964996 | aio | changed: [aio] => (item=osd0) 2026-08-18 12:56:17.965142 | aio | changed: [aio] => (item=osd1) 2026-08-18 12:56:17.965378 | aio | changed: [aio] => (item=osd2) 2026-08-18 12:56:17.965561 | aio | 2026-08-18 12:56:17.965792 | aio | TASK [Create a volume group for each loop device] ****************************** 2026-08-18 12:56:17.966016 | aio | Tuesday 18 August 2026 12:56:17 +0000 (0:00:00.665) 0:00:34.317 ******** 2026-08-18 12:56:21.007580 | aio | changed: [aio] => (item=osd0) 2026-08-18 12:56:21.007724 | aio | changed: [aio] => (item=osd1) 2026-08-18 12:56:21.007979 | aio | changed: [aio] => (item=osd2) 2026-08-18 12:56:21.008185 | aio | 2026-08-18 12:56:21.008477 | aio | TASK [Create a logical volume for each loop device] **************************** 2026-08-18 12:56:21.008703 | aio | Tuesday 18 August 2026 12:56:21 +0000 (0:00:03.042) 0:00:37.359 ******** 2026-08-18 12:56:23.911137 | aio | changed: [aio] => (item=ceph-aio-osd0) 2026-08-18 12:56:23.911250 | aio | changed: [aio] => (item=ceph-aio-osd1) 2026-08-18 12:56:23.911472 | aio | changed: [aio] => (item=ceph-aio-osd2) 2026-08-18 12:56:23.912012 | aio | 2026-08-18 12:56:23.912021 | aio | PLAY RECAP ********************************************************************* 2026-08-18 12:56:23.912105 | aio | aio : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 12:56:23.912322 | aio | 2026-08-18 12:56:23.912722 | aio | 2026-08-18 12:56:23.912925 | aio | TASKS RECAP ******************************************************************** 2026-08-18 12:56:23.913148 | aio | Tuesday 18 August 2026 12:56:23 +0000 (0:00:02.903) 0:00:40.263 ******** 2026-08-18 12:56:23.913411 | aio | =============================================================================== 2026-08-18 12:56:23.913610 | aio | Install depedencies ---------------------------------------------------- 20.57s 2026-08-18 12:56:23.913808 | aio | Update apt cache -------------------------------------------------------- 7.17s 2026-08-18 12:56:23.914020 | aio | Create a volume group for each loop device ------------------------------ 3.04s 2026-08-18 12:56:23.914211 | aio | Create a logical volume for each loop device ---------------------------- 2.90s 2026-08-18 12:56:23.914481 | aio | Gathering Facts --------------------------------------------------------- 1.13s 2026-08-18 12:56:23.914689 | aio | Configure short hostname ------------------------------------------------ 0.96s 2026-08-18 12:56:23.914890 | aio | Start loop devices ------------------------------------------------------ 0.67s 2026-08-18 12:56:23.915084 | aio | Gathering Facts --------------------------------------------------------- 0.66s 2026-08-18 12:56:23.915282 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.64s 2026-08-18 12:56:23.915479 | aio | Set permissions on loopback devices ------------------------------------- 0.60s 2026-08-18 12:56:23.915674 | aio | Start up service -------------------------------------------------------- 0.56s 2026-08-18 12:56:23.915863 | aio | Create devices for Ceph ------------------------------------------------- 0.52s 2026-08-18 12:56:23.916057 | aio | Ensure hostname inside hosts file --------------------------------------- 0.31s 2026-08-18 12:56:23.916250 | aio | Generate lvm.conf ------------------------------------------------------- 0.30s 2026-08-18 12:56:23.916482 | aio | Get list of all loopback devices ---------------------------------------- 0.18s 2026-08-18 12:56:23.916685 | aio | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-08-18 12:56:23.992470 | aio | INFO [default > prepare] Executed: Successful 2026-08-18 12:56:24.000407 | aio | INFO [default > converge] Executing 2026-08-18 12:56:24.973165 | aio | 2026-08-18 12:56:24.973274 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-18 12:56:24.973286 | aio | 2026-08-18 12:56:24.973320 | aio | TASK [Gathering Facts] ********************************************************* 2026-08-18 12:56:24.973423 | aio | Tuesday 18 August 2026 12:56:24 +0000 (0:00:00.055) 0:00:00.055 ******** 2026-08-18 12:56:26.172139 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-08-18 12:56:26.172218 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 12:56:26.172370 | aio | interpreter could change the meaning of that path. See 2026-08-18 12:56:26.172523 | aio | https://docs.ansible.com/ansible- 2026-08-18 12:56:26.172656 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 12:56:26.195258 | aio | ok: [aio] 2026-08-18 12:56:26.195532 | aio | 2026-08-18 12:56:26.195825 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 12:56:26.196096 | aio | Tuesday 18 August 2026 12:56:26 +0000 (0:00:01.221) 0:00:01.277 ******** 2026-08-18 12:56:26.511203 | aio | ok: [aio] 2026-08-18 12:56:26.511266 | aio | 2026-08-18 12:56:26.511347 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 12:56:26.511456 | aio | Tuesday 18 August 2026 12:56:26 +0000 (0:00:00.316) 0:00:01.593 ******** 2026-08-18 12:56:26.577429 | aio | skipping: [aio] 2026-08-18 12:56:26.577614 | aio | 2026-08-18 12:56:26.577832 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 12:56:26.578070 | aio | Tuesday 18 August 2026 12:56:26 +0000 (0:00:00.065) 0:00:01.659 ******** 2026-08-18 12:56:26.863091 | aio | changed: [aio] 2026-08-18 12:56:26.863306 | aio | 2026-08-18 12:56:26.863549 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 12:56:26.863766 | aio | Tuesday 18 August 2026 12:56:26 +0000 (0:00:00.285) 0:00:01.944 ******** 2026-08-18 12:56:26.959518 | aio | ok: [aio] => { 2026-08-18 12:56:26.959741 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 12:56:26.959967 | aio | } 2026-08-18 12:56:26.960167 | aio | 2026-08-18 12:56:26.960511 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 12:56:26.960784 | aio | Tuesday 18 August 2026 12:56:26 +0000 (0:00:00.096) 0:00:02.041 ******** 2026-08-18 12:56:27.747288 | aio | changed: [aio] 2026-08-18 12:56:27.747669 | aio | 2026-08-18 12:56:27.748037 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 12:56:27.748426 | aio | Tuesday 18 August 2026 12:56:27 +0000 (0:00:00.787) 0:00:02.829 ******** 2026-08-18 12:56:27.790663 | aio | skipping: [aio] 2026-08-18 12:56:27.790766 | aio | 2026-08-18 12:56:27.790783 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 12:56:27.790907 | aio | Tuesday 18 August 2026 12:56:27 +0000 (0:00:00.043) 0:00:02.872 ******** 2026-08-18 12:56:27.837806 | aio | skipping: [aio] 2026-08-18 12:56:27.837871 | aio | 2026-08-18 12:56:27.837938 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 12:56:27.838087 | aio | Tuesday 18 August 2026 12:56:27 +0000 (0:00:00.047) 0:00:02.919 ******** 2026-08-18 12:56:28.036751 | aio | ok: [aio] 2026-08-18 12:56:28.036832 | aio | 2026-08-18 12:56:28.036891 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 12:56:28.036995 | aio | Tuesday 18 August 2026 12:56:28 +0000 (0:00:00.198) 0:00:03.117 ******** 2026-08-18 12:56:29.232507 | aio | ok: [aio] 2026-08-18 12:56:29.232712 | aio | 2026-08-18 12:56:29.232725 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 12:56:29.232738 | aio | Tuesday 18 August 2026 12:56:29 +0000 (0:00:01.196) 0:00:04.314 ******** 2026-08-18 12:56:29.315386 | aio | ok: [aio] => { 2026-08-18 12:56:29.315447 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 12:56:29.315885 | aio | } 2026-08-18 12:56:29.315962 | aio | 2026-08-18 12:56:29.315968 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 12:56:29.315974 | aio | Tuesday 18 August 2026 12:56:29 +0000 (0:00:00.082) 0:00:04.396 ******** 2026-08-18 12:56:30.056741 | aio | changed: [aio] 2026-08-18 12:56:30.056862 | aio | 2026-08-18 12:56:30.056920 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 12:56:30.057122 | aio | Tuesday 18 August 2026 12:56:30 +0000 (0:00:00.741) 0:00:05.138 ******** 2026-08-18 12:56:32.910300 | aio | changed: [aio] 2026-08-18 12:56:32.911016 | aio | 2026-08-18 12:56:32.911030 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 12:56:32.911041 | aio | Tuesday 18 August 2026 12:56:32 +0000 (0:00:02.853) 0:00:07.992 ******** 2026-08-18 12:56:32.937398 | aio | skipping: [aio] 2026-08-18 12:56:32.937449 | aio | 2026-08-18 12:56:32.937562 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 12:56:32.937706 | aio | Tuesday 18 August 2026 12:56:32 +0000 (0:00:00.027) 0:00:08.019 ******** 2026-08-18 12:56:32.970339 | aio | skipping: [aio] 2026-08-18 12:56:32.970423 | aio | 2026-08-18 12:56:32.970629 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 12:56:32.970657 | aio | Tuesday 18 August 2026 12:56:32 +0000 (0:00:00.032) 0:00:08.052 ******** 2026-08-18 12:56:32.998573 | aio | skipping: [aio] 2026-08-18 12:56:32.998657 | aio | 2026-08-18 12:56:32.998762 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 12:56:32.998897 | aio | Tuesday 18 August 2026 12:56:32 +0000 (0:00:00.028) 0:00:08.080 ******** 2026-08-18 12:56:38.537143 | aio | changed: [aio] 2026-08-18 12:56:38.537218 | aio | 2026-08-18 12:56:38.537468 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 12:56:38.537530 | aio | Tuesday 18 August 2026 12:56:38 +0000 (0:00:05.538) 0:00:13.618 ******** 2026-08-18 12:56:39.108071 | aio | changed: [aio] 2026-08-18 12:56:39.108159 | aio | 2026-08-18 12:56:39.108222 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 12:56:39.108371 | aio | Tuesday 18 August 2026 12:56:39 +0000 (0:00:00.571) 0:00:14.189 ******** 2026-08-18 12:56:40.021501 | aio | changed: [aio] => (item={'path': '/etc/containerd'}) 2026-08-18 12:56:40.021580 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 12:56:40.022180 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 12:56:40.022343 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 12:56:40.022350 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 12:56:40.022356 | aio | 2026-08-18 12:56:40.022360 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 12:56:40.022365 | aio | Tuesday 18 August 2026 12:56:40 +0000 (0:00:00.913) 0:00:15.103 ******** 2026-08-18 12:56:40.656149 | aio | changed: [aio] 2026-08-18 12:56:40.656258 | aio | 2026-08-18 12:56:40.656271 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 12:56:40.656544 | aio | Tuesday 18 August 2026 12:56:40 +0000 (0:00:00.627) 0:00:15.730 ******** 2026-08-18 12:56:40.656643 | aio | 2026-08-18 12:56:40.656671 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 12:56:40.656685 | aio | Tuesday 18 August 2026 12:56:40 +0000 (0:00:00.006) 0:00:15.737 ******** 2026-08-18 12:56:41.578319 | aio | ok: [aio] 2026-08-18 12:56:41.578414 | aio | 2026-08-18 12:56:41.578461 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-18 12:56:41.578586 | aio | Tuesday 18 August 2026 12:56:41 +0000 (0:00:00.922) 0:00:16.660 ******** 2026-08-18 12:56:42.015457 | aio | changed: [aio] 2026-08-18 12:56:42.015566 | aio | 2026-08-18 12:56:42.015803 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 12:56:42.015824 | aio | Tuesday 18 August 2026 12:56:42 +0000 (0:00:00.436) 0:00:17.097 ******** 2026-08-18 12:56:42.573932 | aio | changed: [aio] 2026-08-18 12:56:42.574004 | aio | 2026-08-18 12:56:42.574169 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 12:56:42.574187 | aio | Tuesday 18 August 2026 12:56:42 +0000 (0:00:00.558) 0:00:17.655 ******** 2026-08-18 12:56:42.786782 | aio | ok: [aio] 2026-08-18 12:56:42.786858 | aio | 2026-08-18 12:56:42.786915 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 12:56:42.787072 | aio | Tuesday 18 August 2026 12:56:42 +0000 (0:00:00.212) 0:00:17.868 ******** 2026-08-18 12:56:42.858113 | aio | ok: [aio] => { 2026-08-18 12:56:42.858850 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 12:56:42.858906 | aio | } 2026-08-18 12:56:42.858912 | aio | 2026-08-18 12:56:42.858917 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 12:56:42.858922 | aio | Tuesday 18 August 2026 12:56:42 +0000 (0:00:00.071) 0:00:17.939 ******** 2026-08-18 12:56:43.759584 | aio | changed: [aio] 2026-08-18 12:56:43.759658 | aio | 2026-08-18 12:56:43.759886 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 12:56:43.759958 | aio | Tuesday 18 August 2026 12:56:43 +0000 (0:00:00.901) 0:00:18.841 ******** 2026-08-18 12:56:48.155597 | aio | changed: [aio] 2026-08-18 12:56:48.155712 | aio | 2026-08-18 12:56:48.155721 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 12:56:48.155861 | aio | Tuesday 18 August 2026 12:56:48 +0000 (0:00:04.396) 0:00:23.237 ******** 2026-08-18 12:56:49.569276 | aio | ok: [aio] 2026-08-18 12:56:49.569380 | aio | 2026-08-18 12:56:49.569393 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 12:56:49.569404 | aio | Tuesday 18 August 2026 12:56:49 +0000 (0:00:01.412) 0:00:24.649 ******** 2026-08-18 12:56:49.917721 | aio | changed: [aio] 2026-08-18 12:56:49.917851 | aio | 2026-08-18 12:56:49.917865 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 12:56:49.917882 | aio | Tuesday 18 August 2026 12:56:49 +0000 (0:00:00.349) 0:00:24.999 ******** 2026-08-18 12:56:50.392638 | aio | changed: [aio] 2026-08-18 12:56:50.392744 | aio | 2026-08-18 12:56:50.392759 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 12:56:50.392927 | aio | Tuesday 18 August 2026 12:56:50 +0000 (0:00:00.475) 0:00:25.474 ******** 2026-08-18 12:56:50.954728 | aio | changed: [aio] => (item={'path': '/etc/docker'}) 2026-08-18 12:56:50.954819 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 12:56:50.954837 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 12:56:50.955174 | aio | 2026-08-18 12:56:50.955257 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 12:56:50.955264 | aio | Tuesday 18 August 2026 12:56:50 +0000 (0:00:00.561) 0:00:26.036 ******** 2026-08-18 12:56:51.419668 | aio | changed: [aio] 2026-08-18 12:56:51.419764 | aio | 2026-08-18 12:56:51.419778 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 12:56:51.419910 | aio | Tuesday 18 August 2026 12:56:51 +0000 (0:00:00.465) 0:00:26.501 ******** 2026-08-18 12:56:51.888916 | aio | changed: [aio] 2026-08-18 12:56:51.888994 | aio | 2026-08-18 12:56:51.889495 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 12:56:51.889565 | aio | Tuesday 18 August 2026 12:56:51 +0000 (0:00:00.461) 0:00:26.962 ******** 2026-08-18 12:56:51.889571 | aio | 2026-08-18 12:56:51.889576 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 12:56:51.889581 | aio | Tuesday 18 August 2026 12:56:51 +0000 (0:00:00.007) 0:00:26.970 ******** 2026-08-18 12:56:52.616389 | aio | ok: [aio] 2026-08-18 12:56:52.616482 | aio | 2026-08-18 12:56:52.616497 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-18 12:56:52.616615 | aio | Tuesday 18 August 2026 12:56:52 +0000 (0:00:00.727) 0:00:27.697 ******** 2026-08-18 12:56:53.421337 | aio | changed: [aio] 2026-08-18 12:56:53.421438 | aio | 2026-08-18 12:56:53.421455 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 12:56:53.421619 | aio | Tuesday 18 August 2026 12:56:53 +0000 (0:00:00.805) 0:00:28.503 ******** 2026-08-18 12:56:53.968198 | aio | changed: [aio] 2026-08-18 12:56:53.968362 | aio | 2026-08-18 12:56:53.968860 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 12:56:53.968956 | aio | Tuesday 18 August 2026 12:56:53 +0000 (0:00:00.546) 0:00:29.049 ******** 2026-08-18 12:56:54.004717 | aio | ok: [aio] => { 2026-08-18 12:56:54.004802 | aio | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 12:56:54.004873 | aio | } 2026-08-18 12:56:54.005151 | aio | 2026-08-18 12:56:54.005187 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 12:56:54.005201 | aio | Tuesday 18 August 2026 12:56:54 +0000 (0:00:00.036) 0:00:29.086 ******** 2026-08-18 12:56:54.852189 | aio | changed: [aio] 2026-08-18 12:56:54.852281 | aio | 2026-08-18 12:56:54.852293 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 12:56:54.852514 | aio | Tuesday 18 August 2026 12:56:54 +0000 (0:00:00.847) 0:00:29.933 ******** 2026-08-18 12:56:54.892222 | aio | skipping: [aio] 2026-08-18 12:56:54.892284 | aio | 2026-08-18 12:56:54.892554 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 12:56:54.892637 | aio | Tuesday 18 August 2026 12:56:54 +0000 (0:00:00.040) 0:00:29.973 ******** 2026-08-18 12:56:54.939449 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 12:56:54.939790 | aio | 2026-08-18 12:56:54.939860 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 12:56:54.939867 | aio | Tuesday 18 August 2026 12:56:54 +0000 (0:00:00.047) 0:00:30.021 ******** 2026-08-18 12:57:00.324457 | aio | changed: [aio] 2026-08-18 12:57:00.324693 | aio | 2026-08-18 12:57:00.324706 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 12:57:00.324718 | aio | Tuesday 18 August 2026 12:57:00 +0000 (0:00:05.385) 0:00:35.406 ******** 2026-08-18 12:57:00.982275 | aio | ok: [aio] => (item=chronyd) 2026-08-18 12:57:00.982327 | aio | ok: [aio] => (item=sshd) 2026-08-18 12:57:00.982420 | aio | 2026-08-18 12:57:00.982629 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 12:57:00.982646 | aio | Tuesday 18 August 2026 12:57:00 +0000 (0:00:00.657) 0:00:36.064 ******** 2026-08-18 12:57:01.172200 | aio | ok: [aio] 2026-08-18 12:57:01.172263 | aio | 2026-08-18 12:57:01.172484 | aio | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 12:57:01.172500 | aio | Tuesday 18 August 2026 12:57:01 +0000 (0:00:00.189) 0:00:36.254 ******** 2026-08-18 12:57:01.596994 | aio | changed: [aio] 2026-08-18 12:57:01.597104 | aio | 2026-08-18 12:57:01.597117 | aio | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 12:57:01.597183 | aio | Tuesday 18 August 2026 12:57:01 +0000 (0:00:00.424) 0:00:36.678 ******** 2026-08-18 12:57:02.067882 | aio | changed: [aio] 2026-08-18 12:57:02.067952 | aio | 2026-08-18 12:57:02.067958 | aio | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 12:57:02.067964 | aio | Tuesday 18 August 2026 12:57:02 +0000 (0:00:00.470) 0:00:37.149 ******** 2026-08-18 12:57:02.101573 | aio | skipping: [aio] 2026-08-18 12:57:02.101590 | aio | 2026-08-18 12:57:02.101595 | aio | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 12:57:02.101600 | aio | Tuesday 18 August 2026 12:57:02 +0000 (0:00:00.034) 0:00:37.183 ******** 2026-08-18 12:57:44.728344 | aio | changed: [aio] 2026-08-18 12:57:44.728465 | aio | 2026-08-18 12:57:44.728525 | aio | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 12:57:44.728706 | aio | Tuesday 18 August 2026 12:57:44 +0000 (0:00:42.626) 0:01:19.810 ******** 2026-08-18 12:57:45.182474 | aio | changed: [aio] 2026-08-18 12:57:45.182551 | aio | 2026-08-18 12:57:45.182567 | aio | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] *** 2026-08-18 12:57:45.182707 | aio | Tuesday 18 August 2026 12:57:45 +0000 (0:00:00.454) 0:01:20.264 ******** 2026-08-18 12:57:45.299903 | aio | ok: [aio] 2026-08-18 12:57:45.299947 | aio | 2026-08-18 12:57:45.300163 | aio | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] *** 2026-08-18 12:57:45.300199 | aio | Tuesday 18 August 2026 12:57:45 +0000 (0:00:00.117) 0:01:20.381 ******** 2026-08-18 12:57:45.343344 | aio | ok: [aio] => { 2026-08-18 12:57:45.343927 | aio | "changed": false, 2026-08-18 12:57:45.343999 | aio | "msg": "All assertions passed" 2026-08-18 12:57:45.344006 | aio | } 2026-08-18 12:57:45.344012 | aio | 2026-08-18 12:57:45.344016 | aio | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] ******************* 2026-08-18 12:57:45.344022 | aio | Tuesday 18 August 2026 12:57:45 +0000 (0:00:00.043) 0:01:20.424 ******** 2026-08-18 12:57:45.385184 | aio | ok: [aio] 2026-08-18 12:57:45.385301 | aio | 2026-08-18 12:57:45.385588 | aio | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] *** 2026-08-18 12:57:45.385667 | aio | Tuesday 18 August 2026 12:57:45 +0000 (0:00:00.042) 0:01:20.466 ******** 2026-08-18 12:57:45.612236 | aio | ok: [aio] => (item=aio) 2026-08-18 12:57:45.612344 | aio | 2026-08-18 12:57:45.612400 | aio | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] *** 2026-08-18 12:57:45.612546 | aio | Tuesday 18 August 2026 12:57:45 +0000 (0:00:00.226) 0:01:20.693 ******** 2026-08-18 12:57:45.657582 | aio | ok: [aio] 2026-08-18 12:57:45.657666 | aio | 2026-08-18 12:57:45.657885 | aio | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 12:57:45.657936 | aio | Tuesday 18 August 2026 12:57:45 +0000 (0:00:00.045) 0:01:20.739 ******** 2026-08-18 12:57:45.737321 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap.yml for aio 2026-08-18 12:57:45.737435 | aio | 2026-08-18 12:57:45.737733 | aio | TASK [vexxhost.ceph.mon : Ensure /etc/ceph exists] ***************************** 2026-08-18 12:57:45.737784 | aio | Tuesday 18 August 2026 12:57:45 +0000 (0:00:00.079) 0:01:20.819 ******** 2026-08-18 12:57:45.946461 | aio | changed: [aio] 2026-08-18 12:57:45.946534 | aio | 2026-08-18 12:57:45.946731 | aio | TASK [vexxhost.ceph.mon : Write the caller-provided SSH private key] *********** 2026-08-18 12:57:45.946772 | aio | Tuesday 18 August 2026 12:57:45 +0000 (0:00:00.208) 0:01:21.028 ******** 2026-08-18 12:57:45.978287 | aio | skipping: [aio] 2026-08-18 12:57:45.978639 | aio | 2026-08-18 12:57:45.978694 | aio | TASK [vexxhost.ceph.mon : Write the caller-provided SSH public key] ************ 2026-08-18 12:57:45.978700 | aio | Tuesday 18 August 2026 12:57:45 +0000 (0:00:00.031) 0:01:21.060 ******** 2026-08-18 12:57:46.014109 | aio | skipping: [aio] 2026-08-18 12:57:46.014182 | aio | 2026-08-18 12:57:46.014290 | aio | TASK [vexxhost.ceph.mon : Generate a cephadm SSH keypair when none was provided] *** 2026-08-18 12:57:46.014412 | aio | Tuesday 18 August 2026 12:57:46 +0000 (0:00:00.036) 0:01:21.096 ******** 2026-08-18 12:57:48.374054 | aio | changed: [aio] 2026-08-18 12:57:48.374160 | aio | 2026-08-18 12:57:48.374506 | aio | TASK [vexxhost.ceph.mon : Create a temporary ceph.conf for bootstrap overrides] *** 2026-08-18 12:57:48.374558 | aio | Tuesday 18 August 2026 12:57:48 +0000 (0:00:02.359) 0:01:23.455 ******** 2026-08-18 12:57:48.669564 | aio | changed: [aio] 2026-08-18 12:57:48.669629 | aio | 2026-08-18 12:57:48.669852 | aio | TASK [vexxhost.ceph.mon : Populate bootstrap ceph.conf overrides] ************** 2026-08-18 12:57:48.669902 | aio | Tuesday 18 August 2026 12:57:48 +0000 (0:00:00.295) 0:01:23.751 ******** 2026-08-18 12:57:48.698812 | aio | skipping: [aio] 2026-08-18 12:57:48.698882 | aio | 2026-08-18 12:57:48.699118 | aio | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 12:57:48.699165 | aio | Tuesday 18 August 2026 12:57:48 +0000 (0:00:00.029) 0:01:23.780 ******** 2026-08-18 12:58:28.869372 | aio | changed: [aio] 2026-08-18 12:58:28.869645 | aio | 2026-08-18 12:58:28.869710 | aio | TASK [vexxhost.ceph.mon : Remove the temporary ceph.conf] ********************** 2026-08-18 12:58:28.869722 | aio | Tuesday 18 August 2026 12:58:28 +0000 (0:00:40.170) 0:02:03.951 ******** 2026-08-18 12:58:29.098179 | aio | changed: [aio] 2026-08-18 12:58:29.098781 | aio | 2026-08-18 12:58:29.098809 | aio | TASK [Register this monitor host] ********************************************** 2026-08-18 12:58:29.098835 | aio | Tuesday 18 August 2026 12:58:29 +0000 (0:00:00.228) 0:02:04.179 ******** 2026-08-18 12:58:29.168516 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-08-18 12:58:29.168579 | aio | 2026-08-18 12:58:29.168839 | aio | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 12:58:29.168854 | aio | Tuesday 18 August 2026 12:58:29 +0000 (0:00:00.070) 0:02:04.250 ******** 2026-08-18 12:58:30.796692 | aio | ok: [aio] 2026-08-18 12:58:30.796759 | aio | 2026-08-18 12:58:30.796849 | aio | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 12:58:30.796941 | aio | Tuesday 18 August 2026 12:58:30 +0000 (0:00:01.628) 0:02:05.878 ******** 2026-08-18 12:58:30.840437 | aio | ok: [aio] 2026-08-18 12:58:30.840506 | aio | 2026-08-18 12:58:30.840658 | aio | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 12:58:30.840785 | aio | Tuesday 18 August 2026 12:58:30 +0000 (0:00:00.043) 0:02:05.922 ******** 2026-08-18 12:58:30.880022 | aio | ok: [aio] => { 2026-08-18 12:58:30.880150 | aio | "changed": false, 2026-08-18 12:58:30.880271 | aio | "msg": "All assertions passed" 2026-08-18 12:58:30.880427 | aio | } 2026-08-18 12:58:30.880527 | aio | 2026-08-18 12:58:30.880667 | aio | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 12:58:30.880787 | aio | Tuesday 18 August 2026 12:58:30 +0000 (0:00:00.039) 0:02:05.961 ******** 2026-08-18 12:58:31.210954 | aio | ok: [aio] 2026-08-18 12:58:31.211010 | aio | 2026-08-18 12:58:31.211088 | aio | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 12:58:31.211185 | aio | Tuesday 18 August 2026 12:58:31 +0000 (0:00:00.331) 0:02:06.293 ******** 2026-08-18 12:58:31.254701 | aio | ok: [aio] 2026-08-18 12:58:31.254761 | aio | 2026-08-18 12:58:31.254849 | aio | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 12:58:31.254945 | aio | Tuesday 18 August 2026 12:58:31 +0000 (0:00:00.043) 0:02:06.336 ******** 2026-08-18 12:58:31.320540 | aio | ok: [aio] 2026-08-18 12:58:31.320604 | aio | 2026-08-18 12:58:31.320678 | aio | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 12:58:31.320771 | aio | Tuesday 18 August 2026 12:58:31 +0000 (0:00:00.065) 0:02:06.402 ******** 2026-08-18 12:58:31.355338 | aio | ok: [aio] => { 2026-08-18 12:58:31.355693 | aio | "changed": false, 2026-08-18 12:58:31.355705 | aio | "msg": "All assertions passed" 2026-08-18 12:58:31.355715 | aio | } 2026-08-18 12:58:31.355725 | aio | 2026-08-18 12:58:31.355766 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 12:58:31.355856 | aio | Tuesday 18 August 2026 12:58:31 +0000 (0:00:00.035) 0:02:06.437 ******** 2026-08-18 12:58:39.065295 | aio | changed: [aio] 2026-08-18 12:58:39.065385 | aio | 2026-08-18 12:58:39.065515 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 12:58:39.065636 | aio | Tuesday 18 August 2026 12:58:39 +0000 (0:00:07.709) 0:02:14.147 ******** 2026-08-18 12:58:39.115679 | aio | skipping: [aio] 2026-08-18 12:58:39.115742 | aio | 2026-08-18 12:58:39.115811 | aio | TASK [vexxhost.ceph.mon : Apply the monitor service spec] ********************** 2026-08-18 12:58:39.115900 | aio | Tuesday 18 August 2026 12:58:39 +0000 (0:00:00.050) 0:02:14.197 ******** 2026-08-18 12:58:42.071470 | aio | changed: [aio] 2026-08-18 12:58:42.071552 | aio | 2026-08-18 12:58:42.071760 | aio | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ******** 2026-08-18 12:58:42.071803 | aio | Tuesday 18 August 2026 12:58:42 +0000 (0:00:02.955) 0:02:17.153 ******** 2026-08-18 12:58:43.642933 | aio | ok: [aio] 2026-08-18 12:58:43.643035 | aio | 2026-08-18 12:58:43.643052 | aio | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] *********************** 2026-08-18 12:58:43.643212 | aio | Tuesday 18 August 2026 12:58:43 +0000 (0:00:01.571) 0:02:18.724 ******** 2026-08-18 12:58:43.853927 | aio | ok: [aio] => (item=aio) 2026-08-18 12:58:43.853968 | aio | 2026-08-18 12:58:43.853983 | aio | TASK [vexxhost.ceph.mgr : Select the admin host] ******************************* 2026-08-18 12:58:43.853988 | aio | Tuesday 18 August 2026 12:58:43 +0000 (0:00:00.210) 0:02:18.935 ******** 2026-08-18 12:58:43.896018 | aio | ok: [aio] 2026-08-18 12:58:43.896060 | aio | 2026-08-18 12:58:43.896066 | aio | TASK [Register this manager host] ********************************************** 2026-08-18 12:58:43.896072 | aio | Tuesday 18 August 2026 12:58:43 +0000 (0:00:00.041) 0:02:18.977 ******** 2026-08-18 12:58:43.957879 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-08-18 12:58:43.957904 | aio | 2026-08-18 12:58:43.957910 | aio | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 12:58:43.957914 | aio | Tuesday 18 August 2026 12:58:43 +0000 (0:00:00.062) 0:02:19.039 ******** 2026-08-18 12:58:45.381122 | aio | ok: [aio] 2026-08-18 12:58:45.381205 | aio | 2026-08-18 12:58:45.381578 | aio | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 12:58:45.381626 | aio | Tuesday 18 August 2026 12:58:45 +0000 (0:00:01.422) 0:02:20.462 ******** 2026-08-18 12:58:45.425935 | aio | ok: [aio] 2026-08-18 12:58:45.426339 | aio | 2026-08-18 12:58:45.426384 | aio | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 12:58:45.426394 | aio | Tuesday 18 August 2026 12:58:45 +0000 (0:00:00.044) 0:02:20.507 ******** 2026-08-18 12:58:45.472211 | aio | ok: [aio] => { 2026-08-18 12:58:45.472446 | aio | "changed": false, 2026-08-18 12:58:45.472521 | aio | "msg": "All assertions passed" 2026-08-18 12:58:45.473043 | aio | } 2026-08-18 12:58:45.473094 | aio | 2026-08-18 12:58:45.473101 | aio | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 12:58:45.473109 | aio | Tuesday 18 August 2026 12:58:45 +0000 (0:00:00.046) 0:02:20.554 ******** 2026-08-18 12:58:45.724346 | aio | ok: [aio] 2026-08-18 12:58:45.724422 | aio | 2026-08-18 12:58:45.724764 | aio | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 12:58:45.724812 | aio | Tuesday 18 August 2026 12:58:45 +0000 (0:00:00.252) 0:02:20.806 ******** 2026-08-18 12:58:45.770250 | aio | ok: [aio] 2026-08-18 12:58:45.770339 | aio | 2026-08-18 12:58:45.770592 | aio | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 12:58:45.770631 | aio | Tuesday 18 August 2026 12:58:45 +0000 (0:00:00.046) 0:02:20.852 ******** 2026-08-18 12:58:45.847297 | aio | ok: [aio] 2026-08-18 12:58:45.847354 | aio | 2026-08-18 12:58:45.847429 | aio | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 12:58:45.847521 | aio | Tuesday 18 August 2026 12:58:45 +0000 (0:00:00.077) 0:02:20.929 ******** 2026-08-18 12:58:45.890987 | aio | ok: [aio] => { 2026-08-18 12:58:45.891062 | aio | "changed": false, 2026-08-18 12:58:45.891173 | aio | "msg": "All assertions passed" 2026-08-18 12:58:45.891663 | aio | } 2026-08-18 12:58:45.891695 | aio | 2026-08-18 12:58:45.891702 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 12:58:45.891709 | aio | Tuesday 18 August 2026 12:58:45 +0000 (0:00:00.043) 0:02:20.973 ******** 2026-08-18 12:58:47.428021 | aio | ok: [aio] 2026-08-18 12:58:47.428430 | aio | 2026-08-18 12:58:47.428526 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 12:58:47.428703 | aio | Tuesday 18 August 2026 12:58:47 +0000 (0:00:01.534) 0:02:22.507 ******** 2026-08-18 12:58:47.483185 | aio | skipping: [aio] 2026-08-18 12:58:47.483247 | aio | 2026-08-18 12:58:47.483434 | aio | TASK [vexxhost.ceph.mgr : Apply the manager service spec] ********************** 2026-08-18 12:58:47.483471 | aio | Tuesday 18 August 2026 12:58:47 +0000 (0:00:00.057) 0:02:22.565 ******** 2026-08-18 12:58:50.209472 | aio | changed: [aio] 2026-08-18 12:58:50.209521 | aio | 2026-08-18 12:58:50.209527 | aio | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ******** 2026-08-18 12:58:50.209532 | aio | Tuesday 18 August 2026 12:58:50 +0000 (0:00:02.726) 0:02:25.291 ******** 2026-08-18 12:58:51.728683 | aio | ok: [aio] 2026-08-18 12:58:51.728785 | aio | 2026-08-18 12:58:51.728900 | aio | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] ************************** 2026-08-18 12:58:51.729047 | aio | Tuesday 18 August 2026 12:58:51 +0000 (0:00:01.519) 0:02:26.810 ******** 2026-08-18 12:59:00.971719 | aio | changed: [aio] => (item={'name': 'diskprediction_local'}) 2026-08-18 12:59:00.971847 | aio | changed: [aio] => (item={'name': 'dashboard'}) 2026-08-18 12:59:00.972047 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-08-18 12:59:00.972248 | aio | changed: [aio] => (item={'name': 'prometheus'}) 2026-08-18 12:59:00.972488 | aio | changed: [aio] => (item={'name': 'rgw'}) 2026-08-18 12:59:00.972652 | aio | 2026-08-18 12:59:00.972859 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-18 12:59:00.973033 | aio | 2026-08-18 12:59:00.973231 | aio | TASK [Gathering Facts] ********************************************************* 2026-08-18 12:59:00.973432 | aio | Tuesday 18 August 2026 12:59:00 +0000 (0:00:09.242) 0:02:36.053 ******** 2026-08-18 12:59:01.894929 | aio | ok: [aio] 2026-08-18 12:59:01.895058 | aio | 2026-08-18 12:59:01.895278 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 12:59:01.895640 | aio | Tuesday 18 August 2026 12:59:01 +0000 (0:00:00.921) 0:02:36.975 ******** 2026-08-18 12:59:02.098745 | aio | ok: [aio] 2026-08-18 12:59:02.098858 | aio | 2026-08-18 12:59:02.099070 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 12:59:02.099272 | aio | Tuesday 18 August 2026 12:59:02 +0000 (0:00:00.205) 0:02:37.180 ******** 2026-08-18 12:59:02.129939 | aio | skipping: [aio] 2026-08-18 12:59:02.130114 | aio | 2026-08-18 12:59:02.130332 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 12:59:02.130555 | aio | Tuesday 18 August 2026 12:59:02 +0000 (0:00:00.031) 0:02:37.211 ******** 2026-08-18 12:59:02.358031 | aio | ok: [aio] 2026-08-18 12:59:02.358138 | aio | 2026-08-18 12:59:02.358376 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 12:59:02.358588 | aio | Tuesday 18 August 2026 12:59:02 +0000 (0:00:00.227) 0:02:37.439 ******** 2026-08-18 12:59:02.420515 | aio | ok: [aio] => { 2026-08-18 12:59:02.420896 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 12:59:02.421112 | aio | } 2026-08-18 12:59:02.421379 | aio | 2026-08-18 12:59:02.421600 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 12:59:02.421799 | aio | Tuesday 18 August 2026 12:59:02 +0000 (0:00:00.062) 0:02:37.502 ******** 2026-08-18 12:59:02.725056 | aio | ok: [aio] 2026-08-18 12:59:02.725135 | aio | 2026-08-18 12:59:02.725225 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 12:59:02.725347 | aio | Tuesday 18 August 2026 12:59:02 +0000 (0:00:00.304) 0:02:37.806 ******** 2026-08-18 12:59:02.763517 | aio | skipping: [aio] 2026-08-18 12:59:02.763588 | aio | 2026-08-18 12:59:02.764398 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 12:59:02.764724 | aio | Tuesday 18 August 2026 12:59:02 +0000 (0:00:00.038) 0:02:37.845 ******** 2026-08-18 12:59:02.798793 | aio | skipping: [aio] 2026-08-18 12:59:02.798850 | aio | 2026-08-18 12:59:02.798955 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 12:59:02.799048 | aio | Tuesday 18 August 2026 12:59:02 +0000 (0:00:00.035) 0:02:37.880 ******** 2026-08-18 12:59:02.989917 | aio | ok: [aio] 2026-08-18 12:59:02.990061 | aio | 2026-08-18 12:59:02.990276 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 12:59:02.990474 | aio | Tuesday 18 August 2026 12:59:02 +0000 (0:00:00.190) 0:02:38.071 ******** 2026-08-18 12:59:04.185875 | aio | ok: [aio] 2026-08-18 12:59:04.185982 | aio | 2026-08-18 12:59:04.185995 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 12:59:04.186006 | aio | Tuesday 18 August 2026 12:59:04 +0000 (0:00:01.195) 0:02:39.266 ******** 2026-08-18 12:59:04.245163 | aio | ok: [aio] => { 2026-08-18 12:59:04.245229 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 12:59:04.245294 | aio | } 2026-08-18 12:59:04.245379 | aio | 2026-08-18 12:59:04.245476 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 12:59:04.245569 | aio | Tuesday 18 August 2026 12:59:04 +0000 (0:00:00.060) 0:02:39.326 ******** 2026-08-18 12:59:04.612903 | aio | ok: [aio] 2026-08-18 12:59:04.612989 | aio | 2026-08-18 12:59:04.612997 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 12:59:04.613004 | aio | Tuesday 18 August 2026 12:59:04 +0000 (0:00:00.367) 0:02:39.693 ******** 2026-08-18 12:59:06.574943 | aio | ok: [aio] 2026-08-18 12:59:06.575067 | aio | 2026-08-18 12:59:06.575513 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 12:59:06.575582 | aio | Tuesday 18 August 2026 12:59:06 +0000 (0:00:01.962) 0:02:41.656 ******** 2026-08-18 12:59:06.605128 | aio | skipping: [aio] 2026-08-18 12:59:06.605190 | aio | 2026-08-18 12:59:06.605485 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 12:59:06.605533 | aio | Tuesday 18 August 2026 12:59:06 +0000 (0:00:00.030) 0:02:41.686 ******** 2026-08-18 12:59:06.633076 | aio | skipping: [aio] 2026-08-18 12:59:06.633153 | aio | 2026-08-18 12:59:06.633194 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 12:59:06.633333 | aio | Tuesday 18 August 2026 12:59:06 +0000 (0:00:00.028) 0:02:41.715 ******** 2026-08-18 12:59:06.664589 | aio | skipping: [aio] 2026-08-18 12:59:06.664665 | aio | 2026-08-18 12:59:06.664897 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 12:59:06.664941 | aio | Tuesday 18 August 2026 12:59:06 +0000 (0:00:00.031) 0:02:41.746 ******** 2026-08-18 12:59:07.912614 | aio | ok: [aio] 2026-08-18 12:59:07.912897 | aio | 2026-08-18 12:59:07.912910 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 12:59:07.913148 | aio | Tuesday 18 August 2026 12:59:07 +0000 (0:00:01.247) 0:02:42.993 ******** 2026-08-18 12:59:08.356722 | aio | ok: [aio] 2026-08-18 12:59:08.356837 | aio | 2026-08-18 12:59:08.357145 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 12:59:08.357204 | aio | Tuesday 18 August 2026 12:59:08 +0000 (0:00:00.444) 0:02:43.438 ******** 2026-08-18 12:59:09.338211 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-08-18 12:59:09.338326 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 12:59:09.338386 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 12:59:09.339084 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 12:59:09.339145 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 12:59:09.339153 | aio | 2026-08-18 12:59:09.339161 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 12:59:09.339167 | aio | Tuesday 18 August 2026 12:59:09 +0000 (0:00:00.981) 0:02:44.420 ******** 2026-08-18 12:59:09.879890 | aio | ok: [aio] 2026-08-18 12:59:09.879942 | aio | 2026-08-18 12:59:09.880376 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 12:59:09.880400 | aio | Tuesday 18 August 2026 12:59:09 +0000 (0:00:00.534) 0:02:44.954 ******** 2026-08-18 12:59:09.880407 | aio | 2026-08-18 12:59:09.880413 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 12:59:09.880422 | aio | Tuesday 18 August 2026 12:59:09 +0000 (0:00:00.007) 0:02:44.961 ******** 2026-08-18 12:59:10.268360 | aio | ok: [aio] 2026-08-18 12:59:10.268401 | aio | 2026-08-18 12:59:10.268407 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 12:59:10.268412 | aio | Tuesday 18 August 2026 12:59:10 +0000 (0:00:00.387) 0:02:45.349 ******** 2026-08-18 12:59:10.476074 | aio | ok: [aio] 2026-08-18 12:59:10.476143 | aio | 2026-08-18 12:59:10.476442 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 12:59:10.476543 | aio | Tuesday 18 August 2026 12:59:10 +0000 (0:00:00.208) 0:02:45.557 ******** 2026-08-18 12:59:10.532801 | aio | ok: [aio] => { 2026-08-18 12:59:10.533027 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 12:59:10.533245 | aio | } 2026-08-18 12:59:10.533438 | aio | 2026-08-18 12:59:10.533653 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 12:59:10.533903 | aio | Tuesday 18 August 2026 12:59:10 +0000 (0:00:00.056) 0:02:45.614 ******** 2026-08-18 12:59:10.899286 | aio | ok: [aio] 2026-08-18 12:59:10.899442 | aio | 2026-08-18 12:59:10.899663 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 12:59:10.899883 | aio | Tuesday 18 August 2026 12:59:10 +0000 (0:00:00.366) 0:02:45.981 ******** 2026-08-18 12:59:13.944921 | aio | ok: [aio] 2026-08-18 12:59:13.945075 | aio | 2026-08-18 12:59:13.945329 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 12:59:13.945554 | aio | Tuesday 18 August 2026 12:59:13 +0000 (0:00:03.045) 0:02:49.026 ******** 2026-08-18 12:59:15.147421 | aio | ok: [aio] 2026-08-18 12:59:15.147486 | aio | 2026-08-18 12:59:15.147498 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 12:59:15.147508 | aio | Tuesday 18 August 2026 12:59:15 +0000 (0:00:01.201) 0:02:50.228 ******** 2026-08-18 12:59:15.370552 | aio | ok: [aio] 2026-08-18 12:59:15.370629 | aio | 2026-08-18 12:59:15.370667 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 12:59:15.370801 | aio | Tuesday 18 August 2026 12:59:15 +0000 (0:00:00.224) 0:02:50.452 ******** 2026-08-18 12:59:15.796328 | aio | ok: [aio] 2026-08-18 12:59:15.796393 | aio | 2026-08-18 12:59:15.796647 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 12:59:15.796691 | aio | Tuesday 18 August 2026 12:59:15 +0000 (0:00:00.425) 0:02:50.878 ******** 2026-08-18 12:59:16.341434 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-08-18 12:59:16.341553 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 12:59:16.342175 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 12:59:16.342238 | aio | 2026-08-18 12:59:16.342249 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 12:59:16.342257 | aio | Tuesday 18 August 2026 12:59:16 +0000 (0:00:00.544) 0:02:51.423 ******** 2026-08-18 12:59:16.755950 | aio | ok: [aio] 2026-08-18 12:59:16.756017 | aio | 2026-08-18 12:59:16.756102 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 12:59:16.756235 | aio | Tuesday 18 August 2026 12:59:16 +0000 (0:00:00.414) 0:02:51.838 ******** 2026-08-18 12:59:17.167411 | aio | ok: [aio] 2026-08-18 12:59:17.167468 | aio | 2026-08-18 12:59:17.167572 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 12:59:17.167945 | aio | Tuesday 18 August 2026 12:59:17 +0000 (0:00:00.405) 0:02:52.243 ******** 2026-08-18 12:59:17.167962 | aio | 2026-08-18 12:59:17.167972 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 12:59:17.167977 | aio | Tuesday 18 August 2026 12:59:17 +0000 (0:00:00.006) 0:02:52.249 ******** 2026-08-18 12:59:17.503374 | aio | ok: [aio] 2026-08-18 12:59:17.503451 | aio | 2026-08-18 12:59:17.503582 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 12:59:17.503729 | aio | Tuesday 18 August 2026 12:59:17 +0000 (0:00:00.335) 0:02:52.585 ******** 2026-08-18 12:59:17.534079 | aio | ok: [aio] => { 2026-08-18 12:59:17.534158 | aio | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 12:59:17.534567 | aio | } 2026-08-18 12:59:17.534604 | aio | 2026-08-18 12:59:17.534609 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 12:59:17.534627 | aio | Tuesday 18 August 2026 12:59:17 +0000 (0:00:00.030) 0:02:52.616 ******** 2026-08-18 12:59:17.788053 | aio | ok: [aio] 2026-08-18 12:59:17.788130 | aio | 2026-08-18 12:59:17.788377 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 12:59:17.788425 | aio | Tuesday 18 August 2026 12:59:17 +0000 (0:00:00.254) 0:02:52.870 ******** 2026-08-18 12:59:17.821345 | aio | skipping: [aio] 2026-08-18 12:59:17.821438 | aio | 2026-08-18 12:59:17.821677 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 12:59:17.821713 | aio | Tuesday 18 August 2026 12:59:17 +0000 (0:00:00.033) 0:02:52.903 ******** 2026-08-18 12:59:17.859704 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 12:59:17.859785 | aio | 2026-08-18 12:59:17.860025 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 12:59:17.860069 | aio | Tuesday 18 August 2026 12:59:17 +0000 (0:00:00.038) 0:02:52.941 ******** 2026-08-18 12:59:19.079120 | aio | ok: [aio] 2026-08-18 12:59:19.079196 | aio | 2026-08-18 12:59:19.079487 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 12:59:19.079535 | aio | Tuesday 18 August 2026 12:59:19 +0000 (0:00:01.219) 0:02:54.161 ******** 2026-08-18 12:59:19.732099 | aio | ok: [aio] => (item=chronyd) 2026-08-18 12:59:19.732206 | aio | ok: [aio] => (item=sshd) 2026-08-18 12:59:19.732464 | aio | 2026-08-18 12:59:19.732509 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 12:59:19.732705 | aio | Tuesday 18 August 2026 12:59:19 +0000 (0:00:00.652) 0:02:54.813 ******** 2026-08-18 12:59:19.920473 | aio | ok: [aio] 2026-08-18 12:59:19.920550 | aio | 2026-08-18 12:59:19.920577 | aio | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 12:59:19.920694 | aio | Tuesday 18 August 2026 12:59:19 +0000 (0:00:00.188) 0:02:55.002 ******** 2026-08-18 12:59:20.158679 | aio | ok: [aio] 2026-08-18 12:59:20.158742 | aio | 2026-08-18 12:59:20.158997 | aio | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 12:59:20.159043 | aio | Tuesday 18 August 2026 12:59:20 +0000 (0:00:00.238) 0:02:55.240 ******** 2026-08-18 12:59:20.555187 | aio | ok: [aio] 2026-08-18 12:59:20.555231 | aio | 2026-08-18 12:59:20.555237 | aio | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 12:59:20.555242 | aio | Tuesday 18 August 2026 12:59:20 +0000 (0:00:00.396) 0:02:55.636 ******** 2026-08-18 12:59:20.586007 | aio | skipping: [aio] 2026-08-18 12:59:20.586056 | aio | 2026-08-18 12:59:20.586063 | aio | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 12:59:20.586070 | aio | Tuesday 18 August 2026 12:59:20 +0000 (0:00:00.030) 0:02:55.667 ******** 2026-08-18 12:59:20.929315 | aio | ok: [aio] 2026-08-18 12:59:20.929831 | aio | 2026-08-18 12:59:20.929884 | aio | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 12:59:20.929892 | aio | Tuesday 18 August 2026 12:59:20 +0000 (0:00:00.343) 0:02:56.011 ******** 2026-08-18 12:59:21.331452 | aio | ok: [aio] 2026-08-18 12:59:21.331514 | aio | 2026-08-18 12:59:21.331709 | aio | TASK [vexxhost.ceph.osd : Locate the cluster admin host] *********************** 2026-08-18 12:59:21.331752 | aio | Tuesday 18 August 2026 12:59:21 +0000 (0:00:00.402) 0:02:56.413 ******** 2026-08-18 12:59:21.533430 | aio | ok: [aio] => (item=aio) 2026-08-18 12:59:21.533498 | aio | 2026-08-18 12:59:21.533728 | aio | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] ******* 2026-08-18 12:59:21.533772 | aio | Tuesday 18 August 2026 12:59:21 +0000 (0:00:00.201) 0:02:56.615 ******** 2026-08-18 12:59:21.569525 | aio | ok: [aio] 2026-08-18 12:59:21.569567 | aio | 2026-08-18 12:59:21.569802 | aio | TASK [vexxhost.ceph.osd : Set the admin mon config path] *********************** 2026-08-18 12:59:21.569848 | aio | Tuesday 18 August 2026 12:59:21 +0000 (0:00:00.035) 0:02:56.651 ******** 2026-08-18 12:59:21.609260 | aio | ok: [aio] 2026-08-18 12:59:21.609330 | aio | 2026-08-18 12:59:21.609435 | aio | TASK [Register this OSD host] ************************************************** 2026-08-18 12:59:21.609564 | aio | Tuesday 18 August 2026 12:59:21 +0000 (0:00:00.039) 0:02:56.691 ******** 2026-08-18 12:59:21.660183 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-08-18 12:59:21.660222 | aio | 2026-08-18 12:59:21.660474 | aio | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 12:59:21.660502 | aio | Tuesday 18 August 2026 12:59:21 +0000 (0:00:00.050) 0:02:56.742 ******** 2026-08-18 12:59:23.098732 | aio | ok: [aio] 2026-08-18 12:59:23.098798 | aio | 2026-08-18 12:59:23.099033 | aio | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 12:59:23.099076 | aio | Tuesday 18 August 2026 12:59:23 +0000 (0:00:01.438) 0:02:58.180 ******** 2026-08-18 12:59:23.137025 | aio | ok: [aio] 2026-08-18 12:59:23.137494 | aio | 2026-08-18 12:59:23.137545 | aio | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 12:59:23.137554 | aio | Tuesday 18 August 2026 12:59:23 +0000 (0:00:00.038) 0:02:58.218 ******** 2026-08-18 12:59:23.174778 | aio | ok: [aio] => { 2026-08-18 12:59:23.174877 | aio | "changed": false, 2026-08-18 12:59:23.175528 | aio | "msg": "All assertions passed" 2026-08-18 12:59:23.175553 | aio | } 2026-08-18 12:59:23.175561 | aio | 2026-08-18 12:59:23.175567 | aio | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 12:59:23.175573 | aio | Tuesday 18 August 2026 12:59:23 +0000 (0:00:00.038) 0:02:58.256 ******** 2026-08-18 12:59:23.435121 | aio | ok: [aio] 2026-08-18 12:59:23.435229 | aio | 2026-08-18 12:59:23.435540 | aio | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 12:59:23.435592 | aio | Tuesday 18 August 2026 12:59:23 +0000 (0:00:00.260) 0:02:58.516 ******** 2026-08-18 12:59:23.474013 | aio | ok: [aio] 2026-08-18 12:59:23.474529 | aio | 2026-08-18 12:59:23.474566 | aio | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 12:59:23.474574 | aio | Tuesday 18 August 2026 12:59:23 +0000 (0:00:00.038) 0:02:58.555 ******** 2026-08-18 12:59:23.541772 | aio | ok: [aio] 2026-08-18 12:59:23.541885 | aio | 2026-08-18 12:59:23.542214 | aio | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 12:59:23.542264 | aio | Tuesday 18 August 2026 12:59:23 +0000 (0:00:00.067) 0:02:58.623 ******** 2026-08-18 12:59:23.579772 | aio | ok: [aio] => { 2026-08-18 12:59:23.579881 | aio | "changed": false, 2026-08-18 12:59:23.580222 | aio | "msg": "All assertions passed" 2026-08-18 12:59:23.580260 | aio | } 2026-08-18 12:59:23.580272 | aio | 2026-08-18 12:59:23.580532 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 12:59:23.580569 | aio | Tuesday 18 August 2026 12:59:23 +0000 (0:00:00.038) 0:02:58.661 ******** 2026-08-18 12:59:25.089547 | aio | ok: [aio] 2026-08-18 12:59:25.089630 | aio | 2026-08-18 12:59:25.089924 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 12:59:25.089972 | aio | Tuesday 18 August 2026 12:59:25 +0000 (0:00:01.509) 0:03:00.171 ******** 2026-08-18 12:59:25.131016 | aio | skipping: [aio] 2026-08-18 12:59:25.131111 | aio | 2026-08-18 12:59:25.131338 | aio | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] ************** 2026-08-18 12:59:25.131385 | aio | Tuesday 18 August 2026 12:59:25 +0000 (0:00:00.041) 0:03:00.212 ******** 2026-08-18 12:59:25.153444 | aio | skipping: [aio] 2026-08-18 12:59:25.153507 | aio | 2026-08-18 12:59:25.153651 | aio | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] ********* 2026-08-18 12:59:25.153798 | aio | Tuesday 18 August 2026 12:59:25 +0000 (0:00:00.022) 0:03:00.235 ******** 2026-08-18 12:59:26.404988 | aio | ok: [aio] 2026-08-18 12:59:26.405086 | aio | 2026-08-18 12:59:26.405147 | aio | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ******** 2026-08-18 12:59:26.405277 | aio | Tuesday 18 August 2026 12:59:26 +0000 (0:00:01.251) 0:03:01.487 ******** 2026-08-18 13:02:08.732293 | aio | changed: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-08-18 13:02:08.733195 | aio | changed: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-08-18 13:02:08.733214 | aio | changed: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-08-18 13:02:08.733225 | aio | 2026-08-18 13:02:08.733236 | aio | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] *** 2026-08-18 13:02:08.733247 | aio | Tuesday 18 August 2026 13:02:08 +0000 (0:02:42.326) 0:05:43.814 ******** 2026-08-18 13:02:16.709242 | aio | FAILED - RETRYING: [aio]: Wait for explicitly requested OSD daemons to be running on this host (120 retries left). 2026-08-18 13:02:16.709415 | aio | ok: [aio] 2026-08-18 13:02:16.709430 | aio | 2026-08-18 13:02:16.709444 | aio | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] *** 2026-08-18 13:02:16.709605 | aio | Tuesday 18 August 2026 13:02:16 +0000 (0:00:07.977) 0:05:51.791 ******** 2026-08-18 13:02:16.765750 | aio | skipping: [aio] 2026-08-18 13:02:16.765810 | aio | 2026-08-18 13:02:16.765908 | aio | PLAY [Apply Ceph configuration] ************************************************ 2026-08-18 13:02:16.765995 | aio | 2026-08-18 13:02:16.766093 | aio | TASK [Gathering Facts] ********************************************************* 2026-08-18 13:02:16.766190 | aio | Tuesday 18 August 2026 13:02:16 +0000 (0:00:00.056) 0:05:51.847 ******** 2026-08-18 13:02:17.633349 | aio | ok: [aio] 2026-08-18 13:02:17.633408 | aio | 2026-08-18 13:02:17.633514 | aio | TASK [vexxhost.ceph.configure : Locate the cluster admin host] ***************** 2026-08-18 13:02:17.633617 | aio | Tuesday 18 August 2026 13:02:17 +0000 (0:00:00.867) 0:05:52.715 ******** 2026-08-18 13:02:17.850617 | aio | ok: [aio] => (item=aio) 2026-08-18 13:02:17.850681 | aio | 2026-08-18 13:02:17.851046 | aio | TASK [vexxhost.ceph.configure : Select the admin host] ************************* 2026-08-18 13:02:17.851116 | aio | Tuesday 18 August 2026 13:02:17 +0000 (0:00:00.216) 0:05:52.932 ******** 2026-08-18 13:02:17.907497 | aio | ok: [aio] 2026-08-18 13:02:17.907583 | aio | 2026-08-18 13:02:17.907693 | aio | TASK [vexxhost.ceph.configure : Set the admin mon config path] ***************** 2026-08-18 13:02:17.907792 | aio | Tuesday 18 August 2026 13:02:17 +0000 (0:00:00.057) 0:05:52.989 ******** 2026-08-18 13:02:17.946764 | aio | ok: [aio] 2026-08-18 13:02:17.946859 | aio | 2026-08-18 13:02:17.947005 | aio | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 13:02:17.947171 | aio | Tuesday 18 August 2026 13:02:17 +0000 (0:00:00.039) 0:05:53.028 ******** 2026-08-18 13:02:17.986220 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/config.yml for aio 2026-08-18 13:02:17.986265 | aio | 2026-08-18 13:02:17.986384 | aio | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 13:02:17.986478 | aio | Tuesday 18 August 2026 13:02:17 +0000 (0:00:00.039) 0:05:53.068 ******** 2026-08-18 13:02:35.192579 | aio | changed: [aio] => (item=mgr/mgr/dashboard/standby_behaviour) 2026-08-18 13:02:35.192688 | aio | changed: [aio] => (item=mgr/mgr/dashboard/RGW_API_SSL_VERIFY) 2026-08-18 13:02:35.192734 | aio | changed: [aio] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_CEPHFS) 2026-08-18 13:02:35.192849 | aio | changed: [aio] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_ISCSI) 2026-08-18 13:02:35.192947 | aio | changed: [aio] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_MIRRORING) 2026-08-18 13:02:35.193048 | aio | changed: [aio] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_NFS) 2026-08-18 13:02:35.193130 | aio | 2026-08-18 13:02:35.193231 | aio | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 13:02:35.193329 | aio | Tuesday 18 August 2026 13:02:35 +0000 (0:00:17.205) 0:06:10.274 ******** 2026-08-18 13:02:35.229517 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/ec_profiles.yml for aio 2026-08-18 13:02:35.229586 | aio | 2026-08-18 13:02:35.229684 | aio | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 13:02:35.229783 | aio | Tuesday 18 August 2026 13:02:35 +0000 (0:00:00.037) 0:06:10.311 ******** 2026-08-18 13:02:39.039849 | aio | changed: [aio] => (item=ec_hdd_s3) 2026-08-18 13:02:39.039933 | aio | 2026-08-18 13:02:39.040109 | aio | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 13:02:39.040125 | aio | Tuesday 18 August 2026 13:02:39 +0000 (0:00:03.809) 0:06:14.121 ******** 2026-08-18 13:02:39.072849 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/crush_rules.yml for aio 2026-08-18 13:02:39.072920 | aio | 2026-08-18 13:02:39.073030 | aio | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 13:02:39.073126 | aio | Tuesday 18 August 2026 13:02:39 +0000 (0:00:00.033) 0:06:14.155 ******** 2026-08-18 13:02:48.393731 | aio | changed: [aio] => (item=rep_hdd) 2026-08-18 13:02:48.394013 | aio | changed: [aio] => (item=rep_lab) 2026-08-18 13:02:48.394081 | aio | changed: [aio] => (item=ec_hdd_s3) 2026-08-18 13:02:48.394094 | aio | 2026-08-18 13:02:48.394148 | aio | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 13:02:48.394318 | aio | Tuesday 18 August 2026 13:02:48 +0000 (0:00:09.320) 0:06:23.475 ******** 2026-08-18 13:02:48.426544 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/pools.yml for aio 2026-08-18 13:02:48.426626 | aio | 2026-08-18 13:02:48.426875 | aio | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 13:02:48.426918 | aio | Tuesday 18 August 2026 13:02:48 +0000 (0:00:00.033) 0:06:23.508 ******** 2026-08-18 13:03:18.917863 | aio | changed: [aio] => (item=molecule-1.rgw.buckets.data) 2026-08-18 13:03:18.917929 | aio | changed: [aio] => (item=molecule-1.rgw.buckets.index) 2026-08-18 13:03:18.918622 | aio | changed: [aio] => (item=molecule-1.rgw.buckets.non-ec) 2026-08-18 13:03:18.918666 | aio | changed: [aio] => (item=molecule-1.rgw.control) 2026-08-18 13:03:18.918672 | aio | changed: [aio] => (item=molecule-1.rgw.log) 2026-08-18 13:03:18.918677 | aio | changed: [aio] => (item=molecule-1.rgw.meta) 2026-08-18 13:03:18.918682 | aio | 2026-08-18 13:03:18.918687 | aio | TASK [vexxhost.ceph.configure : Configure CephX keys] ************************** 2026-08-18 13:03:18.918691 | aio | Tuesday 18 August 2026 13:03:18 +0000 (0:00:30.491) 0:06:53.999 ******** 2026-08-18 13:03:18.946878 | aio | skipping: [aio] 2026-08-18 13:03:18.946961 | aio | 2026-08-18 13:03:18.947180 | aio | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] ********** 2026-08-18 13:03:18.947216 | aio | Tuesday 18 August 2026 13:03:18 +0000 (0:00:00.028) 0:06:54.028 ******** 2026-08-18 13:03:18.983312 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for aio 2026-08-18 13:03:18.983393 | aio | 2026-08-18 13:03:18.983506 | aio | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] *** 2026-08-18 13:03:18.983642 | aio | Tuesday 18 August 2026 13:03:18 +0000 (0:00:00.037) 0:06:54.065 ******** 2026-08-18 13:03:20.530335 | aio | ok: [aio] 2026-08-18 13:03:20.530448 | aio | 2026-08-18 13:03:20.530755 | aio | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] ********* 2026-08-18 13:03:20.530803 | aio | Tuesday 18 August 2026 13:03:20 +0000 (0:00:01.546) 0:06:55.612 ******** 2026-08-18 13:03:22.129461 | aio | ok: [aio] 2026-08-18 13:03:22.129542 | aio | 2026-08-18 13:03:22.129858 | aio | TASK [vexxhost.ceph.configure : Set the dashboard certificate] ***************** 2026-08-18 13:03:22.129907 | aio | Tuesday 18 August 2026 13:03:22 +0000 (0:00:01.598) 0:06:57.211 ******** 2026-08-18 13:03:22.164207 | aio | skipping: [aio] 2026-08-18 13:03:22.164258 | aio | 2026-08-18 13:03:22.164523 | aio | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] ************* 2026-08-18 13:03:22.164563 | aio | Tuesday 18 August 2026 13:03:22 +0000 (0:00:00.034) 0:06:57.245 ******** 2026-08-18 13:03:22.196807 | aio | skipping: [aio] 2026-08-18 13:03:22.197283 | aio | 2026-08-18 13:03:22.197332 | aio | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 13:03:22.197354 | aio | Tuesday 18 August 2026 13:03:22 +0000 (0:00:00.033) 0:06:57.278 ******** 2026-08-18 13:03:22.232295 | aio | skipping: [aio] 2026-08-18 13:03:22.232384 | aio | 2026-08-18 13:03:22.232395 | aio | TASK [vexxhost.ceph.configure : Create a self-signed certificate] ************** 2026-08-18 13:03:22.232413 | aio | Tuesday 18 August 2026 13:03:22 +0000 (0:00:00.035) 0:06:57.314 ******** 2026-08-18 13:03:24.019409 | aio | changed: [aio] 2026-08-18 13:03:24.019471 | aio | 2026-08-18 13:03:24.019648 | aio | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 13:03:24.019663 | aio | Tuesday 18 August 2026 13:03:24 +0000 (0:00:01.787) 0:06:59.101 ******** 2026-08-18 13:03:24.058766 | aio | ok: [aio] 2026-08-18 13:03:24.058836 | aio | 2026-08-18 13:03:24.058933 | aio | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] *** 2026-08-18 13:03:24.059026 | aio | Tuesday 18 August 2026 13:03:24 +0000 (0:00:00.039) 0:06:59.141 ******** 2026-08-18 13:03:31.174203 | aio | changed: [aio] => (item=ceph mgr module disable dashboard) 2026-08-18 13:03:31.174319 | aio | changed: [aio] => (item=ceph mgr module enable dashboard) 2026-08-18 13:03:31.174464 | aio | changed: [aio] => (item=ceph orch reconfig mgr) 2026-08-18 13:03:31.174596 | aio | 2026-08-18 13:03:31.174744 | aio | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 13:03:31.174887 | aio | Tuesday 18 August 2026 13:03:31 +0000 (0:00:07.114) 0:07:06.255 ******** 2026-08-18 13:03:31.209615 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard_users.yml for aio 2026-08-18 13:03:31.209694 | aio | 2026-08-18 13:03:31.209792 | aio | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 13:03:31.209897 | aio | Tuesday 18 August 2026 13:03:31 +0000 (0:00:00.035) 0:07:06.291 ******** 2026-08-18 13:03:40.090298 | aio | changed: [aio] => (item=None) 2026-08-18 13:03:40.090369 | aio | changed: [aio] => (item=None) 2026-08-18 13:03:40.090458 | aio | changed: [aio -> {{ ceph_configure_admin_host }}] 2026-08-18 13:03:40.090547 | aio | 2026-08-18 13:03:40.090648 | aio | PLAY [Deploy Ceph RADOS Gateways] ********************************************** 2026-08-18 13:03:40.090734 | aio | 2026-08-18 13:03:40.090821 | aio | TASK [Gathering Facts] ********************************************************* 2026-08-18 13:03:40.090917 | aio | Tuesday 18 August 2026 13:03:40 +0000 (0:00:08.880) 0:07:15.172 ******** 2026-08-18 13:03:40.957657 | aio | ok: [aio] 2026-08-18 13:03:40.957738 | aio | 2026-08-18 13:03:40.957805 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 13:03:40.957904 | aio | Tuesday 18 August 2026 13:03:40 +0000 (0:00:00.867) 0:07:16.039 ******** 2026-08-18 13:03:41.154510 | aio | ok: [aio] 2026-08-18 13:03:41.154581 | aio | 2026-08-18 13:03:41.154656 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 13:03:41.154749 | aio | Tuesday 18 August 2026 13:03:41 +0000 (0:00:00.196) 0:07:16.236 ******** 2026-08-18 13:03:41.185348 | aio | skipping: [aio] 2026-08-18 13:03:41.185410 | aio | 2026-08-18 13:03:41.185502 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 13:03:41.185595 | aio | Tuesday 18 August 2026 13:03:41 +0000 (0:00:00.031) 0:07:16.267 ******** 2026-08-18 13:03:41.388604 | aio | ok: [aio] 2026-08-18 13:03:41.388676 | aio | 2026-08-18 13:03:41.388763 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:03:41.388869 | aio | Tuesday 18 August 2026 13:03:41 +0000 (0:00:00.202) 0:07:16.470 ******** 2026-08-18 13:03:41.440739 | aio | ok: [aio] => { 2026-08-18 13:03:41.441410 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 13:03:41.441458 | aio | } 2026-08-18 13:03:41.441466 | aio | 2026-08-18 13:03:41.441472 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:03:41.441479 | aio | Tuesday 18 August 2026 13:03:41 +0000 (0:00:00.051) 0:07:16.522 ******** 2026-08-18 13:03:41.743520 | aio | ok: [aio] 2026-08-18 13:03:41.743617 | aio | 2026-08-18 13:03:41.743768 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:03:41.743904 | aio | Tuesday 18 August 2026 13:03:41 +0000 (0:00:00.302) 0:07:16.824 ******** 2026-08-18 13:03:41.781444 | aio | skipping: [aio] 2026-08-18 13:03:41.781526 | aio | 2026-08-18 13:03:41.781576 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 13:03:41.781675 | aio | Tuesday 18 August 2026 13:03:41 +0000 (0:00:00.038) 0:07:16.863 ******** 2026-08-18 13:03:41.817794 | aio | skipping: [aio] 2026-08-18 13:03:41.817848 | aio | 2026-08-18 13:03:41.817930 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 13:03:41.818022 | aio | Tuesday 18 August 2026 13:03:41 +0000 (0:00:00.036) 0:07:16.900 ******** 2026-08-18 13:03:42.017773 | aio | ok: [aio] 2026-08-18 13:03:42.017841 | aio | 2026-08-18 13:03:42.017943 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 13:03:42.018036 | aio | Tuesday 18 August 2026 13:03:42 +0000 (0:00:00.199) 0:07:17.099 ******** 2026-08-18 13:03:43.114014 | aio | ok: [aio] 2026-08-18 13:03:43.114085 | aio | 2026-08-18 13:03:43.114165 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:03:43.114299 | aio | Tuesday 18 August 2026 13:03:43 +0000 (0:00:01.096) 0:07:18.196 ******** 2026-08-18 13:03:43.174391 | aio | ok: [aio] => { 2026-08-18 13:03:43.174527 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 13:03:43.174665 | aio | } 2026-08-18 13:03:43.174800 | aio | 2026-08-18 13:03:43.174953 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:03:43.175109 | aio | Tuesday 18 August 2026 13:03:43 +0000 (0:00:00.059) 0:07:18.256 ******** 2026-08-18 13:03:43.503045 | aio | ok: [aio] 2026-08-18 13:03:43.503117 | aio | 2026-08-18 13:03:43.503190 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:03:43.503287 | aio | Tuesday 18 August 2026 13:03:43 +0000 (0:00:00.329) 0:07:18.585 ******** 2026-08-18 13:03:45.430587 | aio | ok: [aio] 2026-08-18 13:03:45.430641 | aio | 2026-08-18 13:03:45.430648 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 13:03:45.430655 | aio | Tuesday 18 August 2026 13:03:45 +0000 (0:00:01.926) 0:07:20.511 ******** 2026-08-18 13:03:45.456830 | aio | skipping: [aio] 2026-08-18 13:03:45.456878 | aio | 2026-08-18 13:03:45.456885 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 13:03:45.456891 | aio | Tuesday 18 August 2026 13:03:45 +0000 (0:00:00.026) 0:07:20.538 ******** 2026-08-18 13:03:45.483012 | aio | skipping: [aio] 2026-08-18 13:03:45.483057 | aio | 2026-08-18 13:03:45.483065 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 13:03:45.483072 | aio | Tuesday 18 August 2026 13:03:45 +0000 (0:00:00.026) 0:07:20.564 ******** 2026-08-18 13:03:45.510410 | aio | skipping: [aio] 2026-08-18 13:03:45.510454 | aio | 2026-08-18 13:03:45.510462 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 13:03:45.510469 | aio | Tuesday 18 August 2026 13:03:45 +0000 (0:00:00.027) 0:07:20.591 ******** 2026-08-18 13:03:46.603192 | aio | ok: [aio] 2026-08-18 13:03:46.603397 | aio | 2026-08-18 13:03:46.603404 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 13:03:46.603409 | aio | Tuesday 18 August 2026 13:03:46 +0000 (0:00:01.092) 0:07:21.684 ******** 2026-08-18 13:03:47.011771 | aio | ok: [aio] 2026-08-18 13:03:47.011840 | aio | 2026-08-18 13:03:47.011853 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 13:03:47.011865 | aio | Tuesday 18 August 2026 13:03:47 +0000 (0:00:00.408) 0:07:22.092 ******** 2026-08-18 13:03:47.918535 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-08-18 13:03:47.918608 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 13:03:47.918636 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 13:03:47.918646 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 13:03:47.918656 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 13:03:47.918665 | aio | 2026-08-18 13:03:47.918675 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 13:03:47.918684 | aio | Tuesday 18 August 2026 13:03:47 +0000 (0:00:00.905) 0:07:22.998 ******** 2026-08-18 13:03:48.387492 | aio | ok: [aio] 2026-08-18 13:03:48.387542 | aio | 2026-08-18 13:03:48.387550 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 13:03:48.387557 | aio | Tuesday 18 August 2026 13:03:48 +0000 (0:00:00.465) 0:07:23.463 ******** 2026-08-18 13:03:48.387563 | aio | 2026-08-18 13:03:48.387570 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 13:03:48.387575 | aio | Tuesday 18 August 2026 13:03:48 +0000 (0:00:00.005) 0:07:23.468 ******** 2026-08-18 13:03:48.732449 | aio | ok: [aio] 2026-08-18 13:03:48.732516 | aio | 2026-08-18 13:03:48.732527 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 13:03:48.732544 | aio | Tuesday 18 August 2026 13:03:48 +0000 (0:00:00.345) 0:07:23.813 ******** 2026-08-18 13:03:48.917506 | aio | ok: [aio] 2026-08-18 13:03:48.917665 | aio | 2026-08-18 13:03:48.917893 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:03:48.918116 | aio | Tuesday 18 August 2026 13:03:48 +0000 (0:00:00.185) 0:07:23.999 ******** 2026-08-18 13:03:48.965134 | aio | ok: [aio] => { 2026-08-18 13:03:48.965345 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 13:03:48.965541 | aio | } 2026-08-18 13:03:48.965729 | aio | 2026-08-18 13:03:48.965935 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:03:48.966141 | aio | Tuesday 18 August 2026 13:03:48 +0000 (0:00:00.047) 0:07:24.047 ******** 2026-08-18 13:03:49.286775 | aio | ok: [aio] 2026-08-18 13:03:49.286936 | aio | 2026-08-18 13:03:49.287159 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:03:49.287374 | aio | Tuesday 18 August 2026 13:03:49 +0000 (0:00:00.321) 0:07:24.368 ******** 2026-08-18 13:03:52.316435 | aio | ok: [aio] 2026-08-18 13:03:52.317015 | aio | 2026-08-18 13:03:52.317027 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 13:03:52.317034 | aio | Tuesday 18 August 2026 13:03:52 +0000 (0:00:03.029) 0:07:27.397 ******** 2026-08-18 13:03:53.395545 | aio | ok: [aio] 2026-08-18 13:03:53.395644 | aio | 2026-08-18 13:03:53.395970 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 13:03:53.396009 | aio | Tuesday 18 August 2026 13:03:53 +0000 (0:00:01.079) 0:07:28.477 ******** 2026-08-18 13:03:53.581106 | aio | ok: [aio] 2026-08-18 13:03:53.581168 | aio | 2026-08-18 13:03:53.581263 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 13:03:53.581350 | aio | Tuesday 18 August 2026 13:03:53 +0000 (0:00:00.185) 0:07:28.663 ******** 2026-08-18 13:03:54.006485 | aio | ok: [aio] 2026-08-18 13:03:54.006524 | aio | 2026-08-18 13:03:54.006530 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 13:03:54.006535 | aio | Tuesday 18 August 2026 13:03:54 +0000 (0:00:00.425) 0:07:29.088 ******** 2026-08-18 13:03:54.541672 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-08-18 13:03:54.541708 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 13:03:54.541714 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 13:03:54.541719 | aio | 2026-08-18 13:03:54.541723 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 13:03:54.541728 | aio | Tuesday 18 August 2026 13:03:54 +0000 (0:00:00.534) 0:07:29.623 ******** 2026-08-18 13:03:54.940432 | aio | ok: [aio] 2026-08-18 13:03:54.940490 | aio | 2026-08-18 13:03:54.940508 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 13:03:54.940595 | aio | Tuesday 18 August 2026 13:03:54 +0000 (0:00:00.398) 0:07:30.022 ******** 2026-08-18 13:03:55.350368 | aio | ok: [aio] 2026-08-18 13:03:55.350438 | aio | 2026-08-18 13:03:55.350498 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 13:03:55.350878 | aio | Tuesday 18 August 2026 13:03:55 +0000 (0:00:00.405) 0:07:30.427 ******** 2026-08-18 13:03:55.350918 | aio | 2026-08-18 13:03:55.350923 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 13:03:55.350928 | aio | Tuesday 18 August 2026 13:03:55 +0000 (0:00:00.005) 0:07:30.432 ******** 2026-08-18 13:03:55.713246 | aio | ok: [aio] 2026-08-18 13:03:55.713323 | aio | 2026-08-18 13:03:55.713524 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:03:55.713570 | aio | Tuesday 18 August 2026 13:03:55 +0000 (0:00:00.362) 0:07:30.795 ******** 2026-08-18 13:03:55.740260 | aio | ok: [aio] => { 2026-08-18 13:03:55.740388 | aio | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 13:03:55.740767 | aio | } 2026-08-18 13:03:55.740810 | aio | 2026-08-18 13:03:55.740816 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:03:55.740821 | aio | Tuesday 18 August 2026 13:03:55 +0000 (0:00:00.027) 0:07:30.822 ******** 2026-08-18 13:03:56.008450 | aio | ok: [aio] 2026-08-18 13:03:56.008512 | aio | 2026-08-18 13:03:56.008606 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:03:56.008705 | aio | Tuesday 18 August 2026 13:03:56 +0000 (0:00:00.268) 0:07:31.090 ******** 2026-08-18 13:03:56.038036 | aio | skipping: [aio] 2026-08-18 13:03:56.038113 | aio | 2026-08-18 13:03:56.038344 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 13:03:56.038388 | aio | Tuesday 18 August 2026 13:03:56 +0000 (0:00:00.029) 0:07:31.120 ******** 2026-08-18 13:03:56.077170 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 13:03:56.077227 | aio | 2026-08-18 13:03:56.077423 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 13:03:56.077446 | aio | Tuesday 18 August 2026 13:03:56 +0000 (0:00:00.039) 0:07:31.159 ******** 2026-08-18 13:03:57.110183 | aio | ok: [aio] 2026-08-18 13:03:57.110224 | aio | 2026-08-18 13:03:57.110230 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 13:03:57.110235 | aio | Tuesday 18 August 2026 13:03:57 +0000 (0:00:01.032) 0:07:32.192 ******** 2026-08-18 13:03:57.722753 | aio | ok: [aio] => (item=chronyd) 2026-08-18 13:03:57.722794 | aio | ok: [aio] => (item=sshd) 2026-08-18 13:03:57.722799 | aio | 2026-08-18 13:03:57.722804 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 13:03:57.722808 | aio | Tuesday 18 August 2026 13:03:57 +0000 (0:00:00.612) 0:07:32.804 ******** 2026-08-18 13:03:57.915554 | aio | ok: [aio] 2026-08-18 13:03:57.915614 | aio | 2026-08-18 13:03:57.915625 | aio | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 13:03:57.915634 | aio | Tuesday 18 August 2026 13:03:57 +0000 (0:00:00.191) 0:07:32.996 ******** 2026-08-18 13:03:58.141682 | aio | ok: [aio] 2026-08-18 13:03:58.141750 | aio | 2026-08-18 13:03:58.141763 | aio | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 13:03:58.141774 | aio | Tuesday 18 August 2026 13:03:58 +0000 (0:00:00.226) 0:07:33.222 ******** 2026-08-18 13:03:58.532435 | aio | ok: [aio] 2026-08-18 13:03:58.532498 | aio | 2026-08-18 13:03:58.532510 | aio | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 13:03:58.532585 | aio | Tuesday 18 August 2026 13:03:58 +0000 (0:00:00.391) 0:07:33.613 ******** 2026-08-18 13:03:58.555482 | aio | skipping: [aio] 2026-08-18 13:03:58.555636 | aio | 2026-08-18 13:03:58.555860 | aio | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 13:03:58.556032 | aio | Tuesday 18 August 2026 13:03:58 +0000 (0:00:00.023) 0:07:33.637 ******** 2026-08-18 13:03:58.899742 | aio | ok: [aio] 2026-08-18 13:03:58.899824 | aio | 2026-08-18 13:03:58.899979 | aio | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 13:03:58.900108 | aio | Tuesday 18 August 2026 13:03:58 +0000 (0:00:00.344) 0:07:33.981 ******** 2026-08-18 13:03:59.303153 | aio | ok: [aio] 2026-08-18 13:03:59.303217 | aio | 2026-08-18 13:03:59.303230 | aio | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] *********************** 2026-08-18 13:03:59.303241 | aio | Tuesday 18 August 2026 13:03:59 +0000 (0:00:00.402) 0:07:34.383 ******** 2026-08-18 13:03:59.525543 | aio | ok: [aio] => (item=aio) 2026-08-18 13:03:59.525647 | aio | 2026-08-18 13:03:59.525922 | aio | TASK [vexxhost.ceph.rgw : Select the admin host] ******************************* 2026-08-18 13:03:59.525943 | aio | Tuesday 18 August 2026 13:03:59 +0000 (0:00:00.223) 0:07:34.607 ******** 2026-08-18 13:03:59.569728 | aio | ok: [aio] 2026-08-18 13:03:59.569827 | aio | 2026-08-18 13:03:59.570082 | aio | TASK [vexxhost.ceph.rgw : Set the admin mon config path] *********************** 2026-08-18 13:03:59.570128 | aio | Tuesday 18 August 2026 13:03:59 +0000 (0:00:00.044) 0:07:34.651 ******** 2026-08-18 13:03:59.610097 | aio | ok: [aio] 2026-08-18 13:03:59.610163 | aio | 2026-08-18 13:03:59.610321 | aio | TASK [Register this RGW host] ************************************************** 2026-08-18 13:03:59.610337 | aio | Tuesday 18 August 2026 13:03:59 +0000 (0:00:00.040) 0:07:34.692 ******** 2026-08-18 13:03:59.666830 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-08-18 13:03:59.666885 | aio | 2026-08-18 13:03:59.667146 | aio | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 13:03:59.667185 | aio | Tuesday 18 August 2026 13:03:59 +0000 (0:00:00.056) 0:07:34.748 ******** 2026-08-18 13:04:01.123995 | aio | ok: [aio] 2026-08-18 13:04:01.124077 | aio | 2026-08-18 13:04:01.124277 | aio | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 13:04:01.124353 | aio | Tuesday 18 August 2026 13:04:01 +0000 (0:00:01.457) 0:07:36.206 ******** 2026-08-18 13:04:01.162873 | aio | ok: [aio] 2026-08-18 13:04:01.162978 | aio | 2026-08-18 13:04:01.163416 | aio | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 13:04:01.163448 | aio | Tuesday 18 August 2026 13:04:01 +0000 (0:00:00.038) 0:07:36.244 ******** 2026-08-18 13:04:01.204747 | aio | ok: [aio] => { 2026-08-18 13:04:01.205359 | aio | "changed": false, 2026-08-18 13:04:01.205387 | aio | "msg": "All assertions passed" 2026-08-18 13:04:01.205393 | aio | } 2026-08-18 13:04:01.205398 | aio | 2026-08-18 13:04:01.205403 | aio | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 13:04:01.205408 | aio | Tuesday 18 August 2026 13:04:01 +0000 (0:00:00.042) 0:07:36.286 ******** 2026-08-18 13:04:01.457626 | aio | ok: [aio] 2026-08-18 13:04:01.457686 | aio | 2026-08-18 13:04:01.457802 | aio | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 13:04:01.457946 | aio | Tuesday 18 August 2026 13:04:01 +0000 (0:00:00.252) 0:07:36.539 ******** 2026-08-18 13:04:01.499595 | aio | ok: [aio] 2026-08-18 13:04:01.499675 | aio | 2026-08-18 13:04:01.499912 | aio | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 13:04:01.499949 | aio | Tuesday 18 August 2026 13:04:01 +0000 (0:00:00.041) 0:07:36.581 ******** 2026-08-18 13:04:01.570381 | aio | ok: [aio] 2026-08-18 13:04:01.570434 | aio | 2026-08-18 13:04:01.570733 | aio | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 13:04:01.570786 | aio | Tuesday 18 August 2026 13:04:01 +0000 (0:00:00.070) 0:07:36.652 ******** 2026-08-18 13:04:01.610730 | aio | ok: [aio] => { 2026-08-18 13:04:01.610791 | aio | "changed": false, 2026-08-18 13:04:01.611264 | aio | "msg": "All assertions passed" 2026-08-18 13:04:01.611330 | aio | } 2026-08-18 13:04:01.611336 | aio | 2026-08-18 13:04:01.611341 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 13:04:01.611346 | aio | Tuesday 18 August 2026 13:04:01 +0000 (0:00:00.040) 0:07:36.692 ******** 2026-08-18 13:04:03.057842 | aio | ok: [aio] 2026-08-18 13:04:03.057936 | aio | 2026-08-18 13:04:03.057995 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 13:04:03.058108 | aio | Tuesday 18 August 2026 13:04:03 +0000 (0:00:01.447) 0:07:38.139 ******** 2026-08-18 13:04:03.104977 | aio | skipping: [aio] 2026-08-18 13:04:03.105036 | aio | 2026-08-18 13:04:03.105053 | aio | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] **** 2026-08-18 13:04:03.105145 | aio | Tuesday 18 August 2026 13:04:03 +0000 (0:00:00.046) 0:07:38.186 ******** 2026-08-18 13:04:03.153865 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/multisite.yml for aio 2026-08-18 13:04:03.153904 | aio | 2026-08-18 13:04:03.153910 | aio | TASK [vexxhost.ceph.rgw : Configure RGW realms] ******************************** 2026-08-18 13:04:03.153914 | aio | Tuesday 18 August 2026 13:04:03 +0000 (0:00:00.048) 0:07:38.235 ******** 2026-08-18 13:04:07.792861 | aio | changed: [aio] => (item=molecule) 2026-08-18 13:04:07.792936 | aio | 2026-08-18 13:04:07.793015 | aio | TASK [vexxhost.ceph.rgw : Configure RGW zonegroups] **************************** 2026-08-18 13:04:07.793144 | aio | Tuesday 18 August 2026 13:04:07 +0000 (0:00:04.639) 0:07:42.874 ******** 2026-08-18 13:04:09.873372 | aio | changed: [aio] => (item=molecule) 2026-08-18 13:04:09.873457 | aio | 2026-08-18 13:04:09.873749 | aio | TASK [vexxhost.ceph.rgw : Configure RGW zones] ********************************* 2026-08-18 13:04:09.873800 | aio | Tuesday 18 August 2026 13:04:09 +0000 (0:00:02.080) 0:07:44.955 ******** 2026-08-18 13:04:11.896831 | aio | changed: [aio] => (item=None) 2026-08-18 13:04:11.896904 | aio | changed: [aio -> {{ ceph_rgw_admin_host }}] 2026-08-18 13:04:11.896919 | aio | 2026-08-18 13:04:11.897152 | aio | TASK [vexxhost.ceph.rgw : Commit the RGW period] ******************************* 2026-08-18 13:04:11.897194 | aio | Tuesday 18 August 2026 13:04:11 +0000 (0:00:02.023) 0:07:46.978 ******** 2026-08-18 13:04:13.254972 | aio | changed: [aio] 2026-08-18 13:04:13.255046 | aio | 2026-08-18 13:04:13.255122 | aio | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 13:04:13.255256 | aio | Tuesday 18 August 2026 13:04:13 +0000 (0:00:01.358) 0:07:48.337 ******** 2026-08-18 13:04:13.302922 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/services.yml for aio 2026-08-18 13:04:13.302982 | aio | 2026-08-18 13:04:13.303086 | aio | TASK [vexxhost.ceph.rgw : Snapshot current RGW service specs] ****************** 2026-08-18 13:04:13.303169 | aio | Tuesday 18 August 2026 13:04:13 +0000 (0:00:00.047) 0:07:48.384 ******** 2026-08-18 13:04:14.719069 | aio | ok: [aio] 2026-08-18 13:04:14.719142 | aio | 2026-08-18 13:04:14.719245 | aio | TASK [vexxhost.ceph.rgw : Index current RGW specs by service name] ************* 2026-08-18 13:04:14.719349 | aio | Tuesday 18 August 2026 13:04:14 +0000 (0:00:01.416) 0:07:49.801 ******** 2026-08-18 13:04:14.758068 | aio | ok: [aio] 2026-08-18 13:04:14.758265 | aio | 2026-08-18 13:04:14.758501 | aio | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 13:04:14.758703 | aio | Tuesday 18 August 2026 13:04:14 +0000 (0:00:00.038) 0:07:49.840 ******** 2026-08-18 13:04:17.556714 | aio | changed: [aio] => (item=molecule) 2026-08-18 13:04:17.556788 | aio | 2026-08-18 13:04:17.556801 | aio | TASK [vexxhost.ceph.rgw : Redeploy RGW services whose redeploy-triggering keys changed] *** 2026-08-18 13:04:17.556812 | aio | Tuesday 18 August 2026 13:04:17 +0000 (0:00:02.797) 0:07:52.637 ******** 2026-08-18 13:04:19.085262 | aio | failed: [aio] (item=rgw.molecule) => {"ansible_loop_var": "item", "changed": true, "cmd": ["cephadm", "shell", "--fsid", "1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", "--config", "/var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config", "--", "ceph", "orch", "redeploy", "rgw.molecule"], "delta": "0:00:01.312325", "end": "2026-08-18 13:04:19.056872", "item": {"count_per_host": 1, "id": "molecule", "networks": ["0.0.0.0/0"], "spec": {"generate_cert": true, "rgw_frontend_port": 8080, "rgw_realm": "molecule", "rgw_zone": "molecule-1", "rgw_zonegroup": "molecule", "ssl": true}}, "msg": "non-zero return code", "rc": 22, "start": "2026-08-18 13:04:17.744547", "stderr": "Error EINVAL: No daemons exist under service name \"rgw.molecule\". View currently running services using \"ceph orch ls\"", "stderr_lines": ["Error EINVAL: No daemons exist under service name \"rgw.molecule\". View currently running services using \"ceph orch ls\""], "stdout": "", "stdout_lines": []} 2026-08-18 13:04:19.092441 | aio | 2026-08-18 13:04:19.092549 | aio | PLAY RECAP ********************************************************************* 2026-08-18 13:04:19.092667 | aio | aio : ok=204 changed=47 unreachable=0 failed=1 skipped=37 rescued=0 ignored=0 2026-08-18 13:04:19.092758 | aio | 2026-08-18 13:04:19.092835 | aio | 2026-08-18 13:04:19.092946 | aio | TASKS RECAP ******************************************************************** 2026-08-18 13:04:19.093036 | aio | Tuesday 18 August 2026 13:04:19 +0000 (0:00:01.536) 0:07:54.173 ******** 2026-08-18 13:04:19.093125 | aio | =============================================================================== 2026-08-18 13:04:19.093218 | aio | vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices ------ 162.33s 2026-08-18 13:04:19.093312 | aio | vexxhost.ceph.cephadm : Pre-pull the Ceph image ------------------------ 42.63s 2026-08-18 13:04:19.093405 | aio | vexxhost.ceph.mon : Bootstrap the cluster ------------------------------ 40.17s 2026-08-18 13:04:19.093503 | aio | vexxhost.ceph.configure : Configure pools ------------------------------ 30.49s 2026-08-18 13:04:19.093594 | aio | vexxhost.ceph.configure : Apply central Ceph configuration ------------- 17.21s 2026-08-18 13:04:19.093688 | aio | vexxhost.ceph.configure : Configure CRUSH rules ------------------------- 9.32s 2026-08-18 13:04:19.093781 | aio | vexxhost.ceph.mgr : Configure ceph-mgr modules -------------------------- 9.24s 2026-08-18 13:04:19.093890 | aio | vexxhost.ceph.configure : Configure dashboard users --------------------- 8.88s 2026-08-18 13:04:19.094004 | aio | vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host --- 7.98s 2026-08-18 13:04:19.094093 | aio | vexxhost.ceph.cephadm_host : Register the host (labels) ----------------- 7.71s 2026-08-18 13:04:19.094187 | aio | vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate --- 7.11s 2026-08-18 13:04:19.094289 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.54s 2026-08-18 13:04:19.094384 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.39s 2026-08-18 13:04:19.094488 | aio | vexxhost.ceph.rgw : Configure RGW realms -------------------------------- 4.64s 2026-08-18 13:04:19.095276 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.40s 2026-08-18 13:04:19.095396 | aio | vexxhost.ceph.configure : Configure erasure-code profiles --------------- 3.81s 2026-08-18 13:04:19.095492 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.05s 2026-08-18 13:04:19.095614 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.03s 2026-08-18 13:04:19.095713 | aio | vexxhost.ceph.mon : Apply the monitor service spec ---------------------- 2.96s 2026-08-18 13:04:19.095809 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.85s 2026-08-18 13:04:19.297656 | aio | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-08-18 13:04:19.297717 | aio | ERROR [default > converge] Executed: Failed 2026-08-18 13:04:19.297810 | aio | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-08-18 13:04:19.449432 | aio | ERROR 2026-08-18 13:04:19.450079 | aio | { 2026-08-18 13:04:19.450125 | aio | "delta": "0:09:07.452825", 2026-08-18 13:04:19.450156 | aio | "end": "2026-08-18 13:04:19.402234", 2026-08-18 13:04:19.450183 | aio | "msg": "non-zero return code", 2026-08-18 13:04:19.450208 | aio | "rc": 2, 2026-08-18 13:04:19.450233 | aio | "start": "2026-08-18 12:55:11.949409" 2026-08-18 13:04:19.450257 | aio | } failure 2026-08-18 13:04:19.461490 | 2026-08-18 13:04:19.461542 | PLAY RECAP 2026-08-18 13:04:19.461586 | aio | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-08-18 13:04:19.461607 | 2026-08-18 13:04:19.684043 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-18 13:04:19.694354 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-18 13:04:21.010694 | 2026-08-18 13:04:21.010818 | PLAY [all] 2026-08-18 13:04:21.078780 | 2026-08-18 13:04:21.078894 | TASK [fetch-output : Set log path for multiple nodes] 2026-08-18 13:04:21.123861 | aio | skipping: Conditional result was False 2026-08-18 13:04:21.133427 | 2026-08-18 13:04:21.133542 | TASK [fetch-output : Set log path for single node] 2026-08-18 13:04:21.176686 | aio | ok 2026-08-18 13:04:21.184549 | 2026-08-18 13:04:21.184644 | LOOP [fetch-output : Ensure local output dirs] 2026-08-18 13:04:22.313790 | aio -> localhost | ok: "/var/lib/zuul/builds/9476cba38dac465e96d4f69f81745cf6/work/logs" 2026-08-18 13:04:22.529044 | aio -> localhost | changed: "/var/lib/zuul/builds/9476cba38dac465e96d4f69f81745cf6/work/artifacts" 2026-08-18 13:04:22.736917 | aio -> localhost | changed: "/var/lib/zuul/builds/9476cba38dac465e96d4f69f81745cf6/work/docs" 2026-08-18 13:04:22.758325 | 2026-08-18 13:04:22.758470 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-08-18 13:04:23.410303 | aio | changed: .d..t...... ./ 2026-08-18 13:04:23.410500 | aio | changed: All items complete 2026-08-18 13:04:23.410528 | 2026-08-18 13:04:23.876272 | aio | changed: .d..t...... ./ 2026-08-18 13:04:24.321727 | aio | changed: .d..t...... ./ 2026-08-18 13:04:24.345998 | 2026-08-18 13:04:24.346097 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-08-18 13:04:24.750273 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.007150 2026-08-18 13:04:24.984060 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.008529 2026-08-18 13:04:25.005677 | 2026-08-18 13:04:25.005910 | PLAY [all] 2026-08-18 13:04:25.013439 | 2026-08-18 13:04:25.013508 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-08-18 13:04:25.429837 | aio | changed 2026-08-18 13:04:25.438709 | 2026-08-18 13:04:25.438764 | PLAY RECAP 2026-08-18 13:04:25.438812 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 13:04:25.438835 | 2026-08-18 13:04:25.626165 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-18 13:04:25.634119 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-08-18 13:04:26.269430 | 2026-08-18 13:04:26.269580 | PLAY [localhost] 2026-08-18 13:04:26.282138 | 2026-08-18 13:04:26.282247 | TASK [Generate Zuul manifest] 2026-08-18 13:04:26.302977 | localhost | ok 2026-08-18 13:04:26.328496 | 2026-08-18 13:04:26.328608 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-08-18 13:04:26.729001 | localhost | changed 2026-08-18 13:04:26.741771 | 2026-08-18 13:04:26.741864 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-08-18 13:04:26.775896 | localhost | ok 2026-08-18 13:04:26.785931 | 2026-08-18 13:04:26.786020 | TASK [Upload logs] 2026-08-18 13:04:26.808995 | localhost | ok 2026-08-18 13:04:26.960848 | 2026-08-18 13:04:26.961035 | TASK [Set zuul-log-path fact] 2026-08-18 13:04:26.980907 | localhost | ok 2026-08-18 13:04:26.995035 | 2026-08-18 13:04:26.995105 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-18 13:04:27.026199 | localhost | ok 2026-08-18 13:04:27.034251 | 2026-08-18 13:04:27.034319 | TASK [upload-logs : Create log directories] 2026-08-18 13:04:27.398672 | localhost | changed 2026-08-18 13:04:27.408243 | 2026-08-18 13:04:27.408370 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-08-18 13:04:27.774482 | localhost -> localhost | ok: Runtime: 0:00:00.005436 2026-08-18 13:04:27.782447 | 2026-08-18 13:04:27.782591 | TASK [upload-logs : Upload logs to log server] 2026-08-18 13:04:28.213670 | localhost | Output suppressed because no_log was given 2026-08-18 13:04:28.219072 | 2026-08-18 13:04:28.219140 | LOOP [upload-logs : Compress console log and json output] 2026-08-18 13:04:28.268099 | localhost | skipping: Conditional result was False 2026-08-18 13:04:28.275026 | localhost | skipping: Conditional result was False 2026-08-18 13:04:28.284686 | 2026-08-18 13:04:28.284802 | LOOP [upload-logs : Upload compressed console log and json output] 2026-08-18 13:04:28.331278 | localhost | skipping: Conditional result was False 2026-08-18 13:04:28.331698 | 2026-08-18 13:04:28.335907 | localhost | skipping: Conditional result was False 2026-08-18 13:04:28.350738 | 2026-08-18 13:04:28.350839 | LOOP [upload-logs : Upload console log and json output]