2026-09-17 15:13:56.122173 | Job console starting 2026-09-17 15:13:56.148656 | Updating git repos 2026-09-17 15:13:56.178152 | Cloning repos into workspace 2026-09-17 15:13:56.234409 | Restoring repo states 2026-09-17 15:13:56.243111 | Merging changes 2026-09-17 15:13:56.594315 | Checking out repos 2026-09-17 15:13:56.635282 | Preparing playbooks 2026-09-17 15:13:57.830271 | Running Ansible setup 2026-09-17 15:14:02.531850 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-09-17 15:14:03.057002 | 2026-09-17 15:14:03.057165 | PLAY [localhost] 2026-09-17 15:14:03.064564 | 2026-09-17 15:14:03.064671 | TASK [Gathering Facts] 2026-09-17 15:14:03.997460 | localhost | ok 2026-09-17 15:14:04.015384 | 2026-09-17 15:14:04.015775 | TASK [Setup log path fact] 2026-09-17 15:14:04.038283 | localhost | ok 2026-09-17 15:14:04.053471 | 2026-09-17 15:14:04.053633 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-09-17 15:14:04.092429 | localhost | ok 2026-09-17 15:14:04.101781 | 2026-09-17 15:14:04.102170 | TASK [emit-job-header : Print job information] 2026-09-17 15:14:04.142799 | # Job Information 2026-09-17 15:14:04.143038 | Ansible Version: 2.16.18 2026-09-17 15:14:04.143101 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-09-17 15:14:04.143143 | Pipeline: check 2026-09-17 15:14:04.143182 | Executor: 2d72f0692154 2026-09-17 15:14:04.143219 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/126 2026-09-17 15:14:04.143265 | Event ID: e58b8820-b2a9-11f1-88c6-4627b4dcbe39 2026-09-17 15:14:04.148135 | 2026-09-17 15:14:04.148198 | LOOP [emit-job-header : Print node information] 2026-09-17 15:14:04.256426 | localhost | ok: 2026-09-17 15:14:04.256692 | localhost | # Node Information 2026-09-17 15:14:04.256720 | localhost | Inventory Hostname: mon1 2026-09-17 15:14:04.256742 | localhost | Hostname: np0000193033 2026-09-17 15:14:04.256761 | localhost | Username: zuul 2026-09-17 15:14:04.256787 | localhost | Distro: Ubuntu 24.04 2026-09-17 15:14:04.256806 | localhost | Provider: yul1 2026-09-17 15:14:04.256822 | localhost | Region: ca-ymq-1 2026-09-17 15:14:04.256838 | localhost | Label: ubuntu-noble 2026-09-17 15:14:04.256948 | localhost | Product Name: OpenStack Nova 2026-09-17 15:14:04.256976 | localhost | Interface IP: 162.253.55.96 2026-09-17 15:14:04.306952 | localhost | ok: 2026-09-17 15:14:04.307127 | localhost | # Node Information 2026-09-17 15:14:04.307174 | localhost | Inventory Hostname: osd1 2026-09-17 15:14:04.307212 | localhost | Hostname: np0000193034 2026-09-17 15:14:04.307248 | localhost | Username: zuul 2026-09-17 15:14:04.307285 | localhost | Distro: Ubuntu 24.04 2026-09-17 15:14:04.307321 | localhost | Provider: yul1 2026-09-17 15:14:04.307354 | localhost | Region: ca-ymq-1 2026-09-17 15:14:04.307388 | localhost | Label: ubuntu-noble 2026-09-17 15:14:04.307422 | localhost | Product Name: OpenStack Nova 2026-09-17 15:14:04.307456 | localhost | Interface IP: 162.253.55.205 2026-09-17 15:14:04.326591 | 2026-09-17 15:14:04.326781 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-09-17 15:14:04.738345 | localhost -> localhost | changed 2026-09-17 15:14:04.747196 | 2026-09-17 15:14:04.747700 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-09-17 15:14:05.655648 | localhost -> localhost | changed 2026-09-17 15:14:05.664971 | 2026-09-17 15:14:05.665104 | PLAY [all] 2026-09-17 15:14:05.674444 | 2026-09-17 15:14:05.674601 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-09-17 15:14:05.956183 | mon1 -> localhost | ok 2026-09-17 15:14:05.970290 | 2026-09-17 15:14:05.970481 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-09-17 15:14:06.015291 | mon1 | ok 2026-09-17 15:14:06.021485 | osd1 | ok 2026-09-17 15:14:06.048565 | mon1 | included: /var/lib/zuul/builds/8ebfc567306f4c4089057466f539d96c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-09-17 15:14:06.048735 | osd1 | included: /var/lib/zuul/builds/8ebfc567306f4c4089057466f539d96c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-09-17 15:14:06.060173 | 2026-09-17 15:14:06.060326 | TASK [add-build-sshkey : Create Temp SSH key] 2026-09-17 15:14:06.678550 | mon1 -> localhost | Generating public/private rsa key pair. 2026-09-17 15:14:06.678759 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/8ebfc567306f4c4089057466f539d96c/work/8ebfc567306f4c4089057466f539d96c_id_rsa 2026-09-17 15:14:06.678799 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/8ebfc567306f4c4089057466f539d96c/work/8ebfc567306f4c4089057466f539d96c_id_rsa.pub 2026-09-17 15:14:06.678828 | mon1 -> localhost | The key fingerprint is: 2026-09-17 15:14:06.678855 | mon1 -> localhost | SHA256:8Qao0zvBtu7qsP1UIKzs2IX4UgkSUW3ziMxGdHiDtxU zuul-build-sshkey 2026-09-17 15:14:06.678880 | mon1 -> localhost | The key's randomart image is: 2026-09-17 15:14:06.678904 | mon1 -> localhost | +---[RSA 3072]----+ 2026-09-17 15:14:06.678927 | mon1 -> localhost | |o+o+. E. | 2026-09-17 15:14:06.678951 | mon1 -> localhost | | .+oB .. | 2026-09-17 15:14:06.678975 | mon1 -> localhost | |o+ =oBo o | 2026-09-17 15:14:06.678998 | mon1 -> localhost | |.+=+o=.. + | 2026-09-17 15:14:06.679022 | mon1 -> localhost | |..* + = S o | 2026-09-17 15:14:06.679046 | mon1 -> localhost | | * . o = . | 2026-09-17 15:14:06.679069 | mon1 -> localhost | |o = = | 2026-09-17 15:14:06.679092 | mon1 -> localhost | | . + o . | 2026-09-17 15:14:06.679114 | mon1 -> localhost | | ..+++ | 2026-09-17 15:14:06.679137 | mon1 -> localhost | +----[SHA256]-----+ 2026-09-17 15:14:06.679202 | mon1 -> localhost | ok: Runtime: 0:00:00.222327 2026-09-17 15:14:06.685482 | 2026-09-17 15:14:06.685543 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-09-17 15:14:06.714913 | mon1 | ok 2026-09-17 15:14:06.720043 | osd1 | ok 2026-09-17 15:14:06.732232 | mon1 | included: /var/lib/zuul/builds/8ebfc567306f4c4089057466f539d96c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-09-17 15:14:06.732274 | osd1 | included: /var/lib/zuul/builds/8ebfc567306f4c4089057466f539d96c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-09-17 15:14:06.742347 | 2026-09-17 15:14:06.742405 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-09-17 15:14:06.766553 | mon1 | skipping: Conditional result was False 2026-09-17 15:14:06.777470 | osd1 | skipping: Conditional result was False 2026-09-17 15:14:06.783542 | 2026-09-17 15:14:06.783620 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-09-17 15:14:07.326333 | osd1 | changed 2026-09-17 15:14:07.387148 | mon1 | changed 2026-09-17 15:14:07.400000 | 2026-09-17 15:14:07.400144 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-09-17 15:14:07.624679 | mon1 | ok 2026-09-17 15:14:07.665403 | osd1 | ok 2026-09-17 15:14:07.676662 | 2026-09-17 15:14:07.676897 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-09-17 15:14:08.281258 | mon1 | changed 2026-09-17 15:14:08.364269 | osd1 | changed 2026-09-17 15:14:08.376662 | 2026-09-17 15:14:08.376870 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-09-17 15:14:09.034236 | mon1 | changed 2026-09-17 15:14:09.079424 | osd1 | changed 2026-09-17 15:14:09.089906 | 2026-09-17 15:14:09.090032 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-09-17 15:14:09.121273 | mon1 | skipping: Conditional result was False 2026-09-17 15:14:09.132875 | osd1 | skipping: Conditional result was False 2026-09-17 15:14:09.144455 | 2026-09-17 15:14:09.144642 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-09-17 15:14:09.505385 | mon1 -> localhost | changed 2026-09-17 15:14:09.541872 | 2026-09-17 15:14:09.542064 | TASK [add-build-sshkey : Add back temp key] 2026-09-17 15:14:09.869620 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/8ebfc567306f4c4089057466f539d96c/work/8ebfc567306f4c4089057466f539d96c_id_rsa (zuul-build-sshkey) 2026-09-17 15:14:09.869870 | mon1 -> localhost | ok: Runtime: 0:00:00.017497 2026-09-17 15:14:09.874922 | 2026-09-17 15:14:09.874981 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-09-17 15:14:10.227450 | osd1 | ok 2026-09-17 15:14:10.240277 | mon1 | ok 2026-09-17 15:14:10.250671 | 2026-09-17 15:14:10.250763 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-09-17 15:14:10.286243 | mon1 | skipping: Conditional result was False 2026-09-17 15:14:10.307455 | osd1 | skipping: Conditional result was False 2026-09-17 15:14:10.335816 | 2026-09-17 15:14:10.335912 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-09-17 15:14:10.718997 | mon1 | ok 2026-09-17 15:14:10.727743 | osd1 | ok 2026-09-17 15:14:10.738606 | 2026-09-17 15:14:10.738726 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-09-17 15:14:11.667040 | osd1 | Output suppressed because no_log was given 2026-09-17 15:14:11.679213 | mon1 | Output suppressed because no_log was given 2026-09-17 15:14:11.706657 | 2026-09-17 15:14:11.706857 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-09-17 15:14:11.993214 | osd1 | ok: "logs" 2026-09-17 15:14:11.993647 | osd1 | ok: All items complete 2026-09-17 15:14:11.993817 | 2026-09-17 15:14:12.007271 | mon1 | ok: "logs" 2026-09-17 15:14:12.193332 | osd1 | ok: "artifacts" 2026-09-17 15:14:12.209657 | mon1 | ok: "artifacts" 2026-09-17 15:14:12.385441 | osd1 | ok: "docs" 2026-09-17 15:14:12.404063 | mon1 | ok: "docs" 2026-09-17 15:14:12.422373 | 2026-09-17 15:14:12.422536 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-09-17 15:14:12.657403 | osd1 | changed: "logs" 2026-09-17 15:14:12.657801 | osd1 | ok: All items complete 2026-09-17 15:14:12.657838 | 2026-09-17 15:14:12.690872 | mon1 | changed: "logs" 2026-09-17 15:14:12.852601 | osd1 | changed: "artifacts" 2026-09-17 15:14:12.907216 | mon1 | changed: "artifacts" 2026-09-17 15:14:13.040807 | osd1 | changed: "docs" 2026-09-17 15:14:13.101266 | mon1 | changed: "docs" 2026-09-17 15:14:13.131595 | 2026-09-17 15:14:13.131702 | PLAY RECAP 2026-09-17 15:14:13.131785 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-09-17 15:14:13.131844 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-09-17 15:14:13.131892 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-09-17 15:14:13.131927 | 2026-09-17 15:14:13.302761 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-09-17 15:14:13.307701 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-09-17 15:14:13.919947 | 2026-09-17 15:14:13.920104 | PLAY [all] 2026-09-17 15:14:13.931478 | 2026-09-17 15:14:13.931591 | TASK [setup-uv : Extract archive] 2026-09-17 15:14:16.551778 | osd1 | changed 2026-09-17 15:14:16.624459 | mon1 | changed 2026-09-17 15:14:16.635868 | 2026-09-17 15:14:16.636021 | TASK [setup-uv : Print version] 2026-09-17 15:14:17.078967 | osd1 | uv 0.8.13 2026-09-17 15:14:17.083134 | mon1 | uv 0.8.13 2026-09-17 15:14:17.213855 | mon1 | ok: Runtime: 0:00:00.009383 2026-09-17 15:14:17.232812 | osd1 | ok: Runtime: 0:00:00.019582 2026-09-17 15:14:17.257139 | 2026-09-17 15:14:17.257330 | TASK [Install Ansible collection siblings] 2026-09-17 15:14:17.709103 | mon1 | ok: 2026-09-17 15:14:17.709414 | mon1 | Skipping community.general: no checked-out sibling 2026-09-17 15:14:17.709469 | mon1 | Skipping ansible.utils: no checked-out sibling 2026-09-17 15:14:17.709510 | mon1 | Skipping vexxhost.containers: no checked-out sibling 2026-09-17 15:14:17.712631 | 2026-09-17 15:14:17.712721 | PLAY RECAP 2026-09-17 15:14:17.712802 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-09-17 15:14:17.712874 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-09-17 15:14:17.712929 | 2026-09-17 15:14:17.855298 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-09-17 15:14:17.857620 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-09-17 15:14:18.465487 | 2026-09-17 15:14:18.465711 | PLAY [all] 2026-09-17 15:14:18.480697 | 2026-09-17 15:14:18.480981 | LOOP [Check inventory directories] 2026-09-17 15:14:18.919086 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-09-17 15:14:19.099259 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-09-17 15:14:19.270868 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-09-17 15:14:19.286915 | 2026-09-17 15:14:19.287229 | LOOP [Copy inventory file for Zuul] 2026-09-17 15:14:20.324261 | mon1 | changed: 2026-09-17 15:14:20.324653 | mon1 | { 2026-09-17 15:14:20.324723 | mon1 | "ansible_loop_var": "item", 2026-09-17 15:14:20.324778 | mon1 | "changed": false, 2026-09-17 15:14:20.324824 | mon1 | "failed": false, 2026-09-17 15:14:20.324894 | mon1 | "invocation": { 2026-09-17 15:14:20.324940 | mon1 | "module_args": { 2026-09-17 15:14:20.324983 | mon1 | "checksum_algorithm": "sha1", 2026-09-17 15:14:20.325025 | mon1 | "follow": true, 2026-09-17 15:14:20.325066 | mon1 | "get_attributes": true, 2026-09-17 15:14:20.325109 | mon1 | "get_checksum": true, 2026-09-17 15:14:20.325149 | mon1 | "get_mime": true, 2026-09-17 15:14:20.325190 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-09-17 15:14:20.325231 | mon1 | } 2026-09-17 15:14:20.325271 | mon1 | }, 2026-09-17 15:14:20.325311 | mon1 | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-09-17 15:14:20.325352 | mon1 | "stat": { 2026-09-17 15:14:20.325392 | mon1 | "atime": 1789658051.5478241, 2026-09-17 15:14:20.325433 | mon1 | "attr_flags": "e", 2026-09-17 15:14:20.325473 | mon1 | "attributes": [ 2026-09-17 15:14:20.325514 | mon1 | "extents" 2026-09-17 15:14:20.325553 | mon1 | ], 2026-09-17 15:14:20.325615 | mon1 | "block_size": 4096, 2026-09-17 15:14:20.325656 | mon1 | "blocks": 8, 2026-09-17 15:14:20.325696 | mon1 | "charset": "unknown", 2026-09-17 15:14:20.325738 | mon1 | "ctime": 1789658051.567828, 2026-09-17 15:14:20.325773 | mon1 | "dev": 64769, 2026-09-17 15:14:20.325834 | mon1 | "device_type": 0, 2026-09-17 15:14:20.325877 | mon1 | "executable": true, 2026-09-17 15:14:20.325916 | mon1 | "exists": true, 2026-09-17 15:14:20.325955 | mon1 | "gid": 1000, 2026-09-17 15:14:20.325993 | mon1 | "gr_name": "zuul", 2026-09-17 15:14:20.326030 | mon1 | "inode": 1034784, 2026-09-17 15:14:20.326068 | mon1 | "isblk": false, 2026-09-17 15:14:20.326108 | mon1 | "ischr": false, 2026-09-17 15:14:20.326147 | mon1 | "isdir": true, 2026-09-17 15:14:20.326185 | mon1 | "isfifo": false, 2026-09-17 15:14:20.326239 | mon1 | "isgid": false, 2026-09-17 15:14:20.326301 | mon1 | "islnk": false, 2026-09-17 15:14:20.326348 | mon1 | "isreg": false, 2026-09-17 15:14:20.326387 | mon1 | "issock": false, 2026-09-17 15:14:20.326425 | mon1 | "isuid": false, 2026-09-17 15:14:20.326483 | mon1 | "mimetype": "unknown", 2026-09-17 15:14:20.326525 | mon1 | "mode": "0755", 2026-09-17 15:14:20.326589 | mon1 | "mtime": 1789658036.2669172, 2026-09-17 15:14:20.326633 | mon1 | "nlink": 10, 2026-09-17 15:14:20.326673 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-09-17 15:14:20.326713 | mon1 | "pw_name": "zuul", 2026-09-17 15:14:20.326763 | mon1 | "readable": true, 2026-09-17 15:14:20.326825 | mon1 | "rgrp": true, 2026-09-17 15:14:20.326874 | mon1 | "roth": true, 2026-09-17 15:14:20.326914 | mon1 | "rusr": true, 2026-09-17 15:14:20.326954 | mon1 | "size": 4096, 2026-09-17 15:14:20.327193 | mon1 | "uid": 1000, 2026-09-17 15:14:20.327260 | mon1 | "version": "3932528543", 2026-09-17 15:14:20.327299 | mon1 | "wgrp": false, 2026-09-17 15:14:20.327338 | mon1 | "woth": false, 2026-09-17 15:14:20.327372 | mon1 | "writeable": true, 2026-09-17 15:14:20.327406 | mon1 | "wusr": true, 2026-09-17 15:14:20.327439 | mon1 | "xgrp": true, 2026-09-17 15:14:20.327472 | mon1 | "xoth": true, 2026-09-17 15:14:20.327504 | mon1 | "xusr": true 2026-09-17 15:14:20.327537 | mon1 | } 2026-09-17 15:14:20.327599 | mon1 | } 2026-09-17 15:14:20.327674 | mon1 | ok: All items complete 2026-09-17 15:14:20.327716 | 2026-09-17 15:14:20.330042 | mon1 | skipping: Conditional result was False 2026-09-17 15:14:20.331253 | mon1 | skipping: Conditional result was False 2026-09-17 15:14:20.349670 | 2026-09-17 15:14:20.350232 | LOOP [Switch "ansible_host" to private IP] 2026-09-17 15:14:20.754785 | mon1 | changed: 2 replacements made 2026-09-17 15:14:20.756363 | mon1 | skipping: Conditional result was False 2026-09-17 15:14:20.757145 | mon1 | skipping: Conditional result was False 2026-09-17 15:14:20.773601 | 2026-09-17 15:14:20.773792 | TASK [Run Molecule scenario] 2026-09-17 15:14:21.310067 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-09-17 15:14:21.310272 | mon1 | Creating virtual environment at: .venv 2026-09-17 15:14:21.590634 | mon1 | Downloading pygments (1.2MiB) 2026-09-17 15:14:21.591595 | mon1 | Downloading netaddr (2.2MiB) 2026-09-17 15:14:21.592093 | mon1 | Downloading cryptography (4.3MiB) 2026-09-17 15:14:21.595635 | mon1 | Downloading ansible-core (2.1MiB) 2026-09-17 15:14:24.934346 | mon1 | Downloading cryptography (4.3MiB) 2026-09-17 15:14:24.934459 | mon1 | Downloading ansible-core (2.1MiB) 2026-09-17 15:14:24.934869 | mon1 | Downloading netaddr (2.2MiB) 2026-09-17 15:14:24.949119 | mon1 | Downloading pygments (1.2MiB) 2026-09-17 15:14:25.066287 | mon1 | Downloading netaddr 2026-09-17 15:14:25.165000 | mon1 | Downloading cryptography 2026-09-17 15:14:25.183276 | mon1 | Downloading pygments 2026-09-17 15:14:25.380233 | mon1 | Downloading ansible-core 2026-09-17 15:14:25.446912 | mon1 | Installed 37 packages in 65ms 2026-09-17 15:14:26.193934 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-09-17 15:14:26.194007 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-09-17 15:14:26.864820 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-09-17 15:14:26.864892 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-09-17 15:23:22.310485 | mon1 | INFO [default > dependency] Executing 2026-09-17 15:23:22.310725 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-09-17 15:23:22.310968 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-09-17 15:23:22.311108 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-09-17 15:23:22.317401 | mon1 | INFO [default > cleanup] Executing 2026-09-17 15:23:22.317743 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-09-17 15:23:22.323806 | mon1 | INFO [default > destroy] Executing 2026-09-17 15:23:22.323856 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-09-17 15:23:22.323928 | mon1 | INFO [default > destroy] Executed: Successful 2026-09-17 15:23:22.331789 | mon1 | INFO [default > syntax] Executing 2026-09-17 15:23:23.434518 | mon1 | 2026-09-17 15:23:23.434891 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-09-17 15:23:23.515470 | mon1 | INFO [default > syntax] Executed: Successful 2026-09-17 15:23:23.530343 | mon1 | INFO [default > create] Executing 2026-09-17 15:23:23.533919 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-09-17 15:23:23.546340 | mon1 | INFO [default > prepare] Executing 2026-09-17 15:23:24.382333 | mon1 | 2026-09-17 15:23:24.382456 | mon1 | PLAY [Prepare] ***************************************************************** 2026-09-17 15:23:24.382570 | mon1 | 2026-09-17 15:23:24.382706 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-09-17 15:23:24.382837 | mon1 | Thursday 17 September 2026 15:23:24 +0000 (0:00:00.036) 0:00:00.036 **** 2026-09-17 15:23:26.719069 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-09-17 15:23:26.719181 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-09-17 15:23:26.719302 | mon1 | interpreter could change the meaning of that path. See 2026-09-17 15:23:26.719440 | mon1 | https://docs.ansible.com/ansible- 2026-09-17 15:23:26.719567 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-09-17 15:23:27.752751 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-09-17 15:23:27.752831 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-09-17 15:23:27.752948 | mon1 | interpreter could change the meaning of that path. See 2026-09-17 15:23:27.753172 | mon1 | https://docs.ansible.com/ansible- 2026-09-17 15:23:27.753261 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-09-17 15:23:27.759341 | mon1 | ok: [mon1] 2026-09-17 15:23:27.759419 | mon1 | ok: [osd1] 2026-09-17 15:23:27.759523 | mon1 | 2026-09-17 15:23:27.759649 | mon1 | TASK [Configure short hostname] ************************************************ 2026-09-17 15:23:27.759756 | mon1 | Thursday 17 September 2026 15:23:27 +0000 (0:00:03.378) 0:00:03.414 **** 2026-09-17 15:23:29.582866 | mon1 | changed: [osd1] 2026-09-17 15:23:29.582945 | mon1 | changed: [mon1] 2026-09-17 15:23:29.583045 | mon1 | 2026-09-17 15:23:29.583219 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-09-17 15:23:29.583403 | mon1 | Thursday 17 September 2026 15:23:29 +0000 (0:00:01.822) 0:00:05.237 **** 2026-09-17 15:23:29.902746 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-09-17 15:23:29.902935 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-09-17 15:23:29.903149 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-09-17 15:23:29.933958 | mon1 | changed: [mon1] 2026-09-17 15:23:29.934134 | mon1 | changed: [osd1] 2026-09-17 15:23:29.934406 | mon1 | 2026-09-17 15:23:29.934668 | mon1 | TASK [Update apt cache] ******************************************************** 2026-09-17 15:23:29.934929 | mon1 | Thursday 17 September 2026 15:23:29 +0000 (0:00:00.351) 0:00:05.588 **** 2026-09-17 15:23:35.668919 | mon1 | changed: [mon1] 2026-09-17 15:23:35.669200 | mon1 | changed: [osd1] 2026-09-17 15:23:35.669524 | mon1 | 2026-09-17 15:23:35.669814 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-09-17 15:23:35.670080 | mon1 | 2026-09-17 15:23:35.670402 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-09-17 15:23:35.670713 | mon1 | Thursday 17 September 2026 15:23:35 +0000 (0:00:05.734) 0:00:11.323 **** 2026-09-17 15:23:36.460283 | mon1 | ok: [osd1] 2026-09-17 15:23:36.460523 | mon1 | 2026-09-17 15:23:36.460760 | mon1 | TASK [Install depedencies] ***************************************************** 2026-09-17 15:23:36.460990 | mon1 | Thursday 17 September 2026 15:23:36 +0000 (0:00:00.790) 0:00:12.114 **** 2026-09-17 15:23:55.828584 | mon1 | changed: [osd1] 2026-09-17 15:23:55.828663 | mon1 | 2026-09-17 15:23:55.828799 | mon1 | TASK [Start up service] ******************************************************** 2026-09-17 15:23:55.828917 | mon1 | Thursday 17 September 2026 15:23:55 +0000 (0:00:19.368) 0:00:31.482 **** 2026-09-17 15:23:56.507346 | mon1 | ok: [osd1] 2026-09-17 15:23:56.507568 | mon1 | 2026-09-17 15:23:56.507877 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-09-17 15:23:56.508236 | mon1 | Thursday 17 September 2026 15:23:56 +0000 (0:00:00.678) 0:00:32.161 **** 2026-09-17 15:23:56.876752 | mon1 | ok: [osd1] 2026-09-17 15:23:56.876806 | mon1 | 2026-09-17 15:23:56.876862 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-09-17 15:23:56.877007 | mon1 | Thursday 17 September 2026 15:23:56 +0000 (0:00:00.369) 0:00:32.530 **** 2026-09-17 15:23:57.713781 | mon1 | changed: [osd1] 2026-09-17 15:23:57.713925 | mon1 | 2026-09-17 15:23:57.714227 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-09-17 15:23:57.714553 | mon1 | Thursday 17 September 2026 15:23:57 +0000 (0:00:00.836) 0:00:33.367 **** 2026-09-17 15:23:57.997720 | mon1 | ok: [osd1] 2026-09-17 15:23:57.997849 | mon1 | 2026-09-17 15:23:57.998096 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-09-17 15:23:57.998425 | mon1 | Thursday 17 September 2026 15:23:57 +0000 (0:00:00.283) 0:00:33.651 **** 2026-09-17 15:23:58.037927 | mon1 | skipping: [osd1] 2026-09-17 15:23:58.038166 | mon1 | 2026-09-17 15:23:58.038452 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-09-17 15:23:58.038672 | mon1 | Thursday 17 September 2026 15:23:58 +0000 (0:00:00.040) 0:00:33.692 **** 2026-09-17 15:23:58.761562 | mon1 | changed: [osd1] => (item=osd0) 2026-09-17 15:23:58.761624 | mon1 | changed: [osd1] => (item=osd1) 2026-09-17 15:23:58.761740 | mon1 | changed: [osd1] => (item=osd2) 2026-09-17 15:23:58.761854 | mon1 | 2026-09-17 15:23:58.762034 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-09-17 15:23:58.762138 | mon1 | Thursday 17 September 2026 15:23:58 +0000 (0:00:00.723) 0:00:34.415 **** 2026-09-17 15:23:59.612693 | mon1 | changed: [osd1] => (item=osd0) 2026-09-17 15:23:59.612868 | mon1 | changed: [osd1] => (item=osd1) 2026-09-17 15:23:59.613122 | mon1 | changed: [osd1] => (item=osd2) 2026-09-17 15:23:59.613351 | mon1 | 2026-09-17 15:23:59.613579 | mon1 | TASK [Start loop devices] ****************************************************** 2026-09-17 15:23:59.613807 | mon1 | Thursday 17 September 2026 15:23:59 +0000 (0:00:00.851) 0:00:35.266 **** 2026-09-17 15:24:00.523609 | mon1 | changed: [osd1] => (item=osd0) 2026-09-17 15:24:00.523828 | mon1 | changed: [osd1] => (item=osd1) 2026-09-17 15:24:00.524140 | mon1 | changed: [osd1] => (item=osd2) 2026-09-17 15:24:00.524428 | mon1 | 2026-09-17 15:24:00.524699 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-09-17 15:24:00.525000 | mon1 | Thursday 17 September 2026 15:24:00 +0000 (0:00:00.910) 0:00:36.177 **** 2026-09-17 15:24:02.121119 | mon1 | changed: [osd1] => (item=osd0) 2026-09-17 15:24:02.121388 | mon1 | changed: [osd1] => (item=osd1) 2026-09-17 15:24:02.121621 | mon1 | changed: [osd1] => (item=osd2) 2026-09-17 15:24:02.121831 | mon1 | 2026-09-17 15:24:02.122090 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-09-17 15:24:02.122344 | mon1 | Thursday 17 September 2026 15:24:02 +0000 (0:00:01.598) 0:00:37.775 **** 2026-09-17 15:24:03.713441 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-09-17 15:24:03.713510 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-09-17 15:24:03.713516 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-09-17 15:24:03.713522 | mon1 | 2026-09-17 15:24:03.713527 | mon1 | PLAY RECAP ********************************************************************* 2026-09-17 15:24:03.713533 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-09-17 15:24:03.713539 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-09-17 15:24:03.713544 | mon1 | 2026-09-17 15:24:03.713549 | mon1 | 2026-09-17 15:24:03.713554 | mon1 | TASKS RECAP ******************************************************************** 2026-09-17 15:24:03.713563 | mon1 | Thursday 17 September 2026 15:24:03 +0000 (0:00:01.591) 0:00:39.367 **** 2026-09-17 15:24:03.713643 | mon1 | =============================================================================== 2026-09-17 15:24:03.713758 | mon1 | Install depedencies ---------------------------------------------------- 19.37s 2026-09-17 15:24:03.713875 | mon1 | Update apt cache -------------------------------------------------------- 5.73s 2026-09-17 15:24:03.714011 | mon1 | Gathering Facts --------------------------------------------------------- 3.38s 2026-09-17 15:24:03.714146 | mon1 | Configure short hostname ------------------------------------------------ 1.82s 2026-09-17 15:24:03.714256 | mon1 | Create a volume group for each loop device ------------------------------ 1.60s 2026-09-17 15:24:03.714410 | mon1 | Create a logical volume for each loop device ---------------------------- 1.59s 2026-09-17 15:24:03.714526 | mon1 | Start loop devices ------------------------------------------------------ 0.91s 2026-09-17 15:24:03.714643 | mon1 | Set permissions on loopback devices ------------------------------------- 0.85s 2026-09-17 15:24:03.714760 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.84s 2026-09-17 15:24:03.714873 | mon1 | Gathering Facts --------------------------------------------------------- 0.79s 2026-09-17 15:24:03.715005 | mon1 | Create devices for Ceph ------------------------------------------------- 0.72s 2026-09-17 15:24:03.715121 | mon1 | Start up service -------------------------------------------------------- 0.68s 2026-09-17 15:24:03.715233 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.37s 2026-09-17 15:24:03.715374 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.35s 2026-09-17 15:24:03.715495 | mon1 | Get list of all loopback devices ---------------------------------------- 0.28s 2026-09-17 15:24:03.715613 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.04s 2026-09-17 15:24:03.800289 | mon1 | INFO [default > prepare] Executed: Successful 2026-09-17 15:24:03.807342 | mon1 | INFO [default > converge] Executing 2026-09-17 15:24:04.812827 | mon1 | 2026-09-17 15:24:04.813024 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-09-17 15:24:04.813228 | mon1 | 2026-09-17 15:24:04.813552 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-09-17 15:24:04.813722 | mon1 | Thursday 17 September 2026 15:24:04 +0000 (0:00:00.047) 0:00:00.047 **** 2026-09-17 15:24:06.995742 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-09-17 15:24:06.995978 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-09-17 15:24:06.996224 | mon1 | interpreter could change the meaning of that path. See 2026-09-17 15:24:06.996506 | mon1 | https://docs.ansible.com/ansible- 2026-09-17 15:24:06.996717 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-09-17 15:24:07.018351 | mon1 | ok: [mon1] 2026-09-17 15:24:07.018560 | mon1 | 2026-09-17 15:24:07.018791 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:24:07.019078 | mon1 | Thursday 17 September 2026 15:24:07 +0000 (0:00:02.204) 0:00:02.252 **** 2026-09-17 15:24:07.444047 | mon1 | ok: [mon1] 2026-09-17 15:24:07.444347 | mon1 | 2026-09-17 15:24:07.444752 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:24:07.445033 | mon1 | Thursday 17 September 2026 15:24:07 +0000 (0:00:00.426) 0:00:02.678 **** 2026-09-17 15:24:07.487281 | mon1 | skipping: [mon1] 2026-09-17 15:24:07.487465 | mon1 | 2026-09-17 15:24:07.487683 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-09-17 15:24:07.487914 | mon1 | Thursday 17 September 2026 15:24:07 +0000 (0:00:00.043) 0:00:02.722 **** 2026-09-17 15:24:07.875813 | mon1 | changed: [mon1] 2026-09-17 15:24:07.875994 | mon1 | 2026-09-17 15:24:07.876263 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:24:07.876625 | mon1 | Thursday 17 September 2026 15:24:07 +0000 (0:00:00.387) 0:00:03.110 **** 2026-09-17 15:24:07.999444 | mon1 | ok: [mon1] => { 2026-09-17 15:24:07.999535 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-09-17 15:24:08.000475 | mon1 | } 2026-09-17 15:24:08.000565 | mon1 | 2026-09-17 15:24:08.000576 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:24:08.000586 | mon1 | Thursday 17 September 2026 15:24:07 +0000 (0:00:00.123) 0:00:03.233 **** 2026-09-17 15:24:09.058443 | mon1 | changed: [mon1] 2026-09-17 15:24:09.058480 | mon1 | 2026-09-17 15:24:09.058487 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:24:09.058494 | mon1 | Thursday 17 September 2026 15:24:09 +0000 (0:00:01.058) 0:00:04.291 **** 2026-09-17 15:24:09.113373 | mon1 | skipping: [mon1] 2026-09-17 15:24:09.113413 | mon1 | 2026-09-17 15:24:09.113420 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:24:09.113486 | mon1 | Thursday 17 September 2026 15:24:09 +0000 (0:00:00.055) 0:00:04.347 **** 2026-09-17 15:24:09.160930 | mon1 | skipping: [mon1] 2026-09-17 15:24:09.161151 | mon1 | 2026-09-17 15:24:09.161374 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:24:09.161575 | mon1 | Thursday 17 September 2026 15:24:09 +0000 (0:00:00.047) 0:00:04.395 **** 2026-09-17 15:24:09.421889 | mon1 | ok: [mon1] 2026-09-17 15:24:09.422138 | mon1 | 2026-09-17 15:24:09.422361 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:24:09.422557 | mon1 | Thursday 17 September 2026 15:24:09 +0000 (0:00:00.261) 0:00:04.656 **** 2026-09-17 15:24:10.607292 | mon1 | ok: [mon1] 2026-09-17 15:24:10.607381 | mon1 | 2026-09-17 15:24:10.607387 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:24:10.607417 | mon1 | Thursday 17 September 2026 15:24:10 +0000 (0:00:01.184) 0:00:05.841 **** 2026-09-17 15:24:10.836231 | mon1 | ok: [mon1] => { 2026-09-17 15:24:10.836281 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-09-17 15:24:10.836291 | mon1 | } 2026-09-17 15:24:10.836300 | mon1 | 2026-09-17 15:24:10.836346 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:24:10.836355 | mon1 | Thursday 17 September 2026 15:24:10 +0000 (0:00:00.228) 0:00:06.069 **** 2026-09-17 15:24:12.884435 | mon1 | changed: [mon1] 2026-09-17 15:24:12.885066 | mon1 | 2026-09-17 15:24:12.885085 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:24:12.885094 | mon1 | Thursday 17 September 2026 15:24:12 +0000 (0:00:02.049) 0:00:08.119 **** 2026-09-17 15:24:16.158427 | mon1 | changed: [mon1] 2026-09-17 15:24:16.159365 | mon1 | 2026-09-17 15:24:16.159397 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-09-17 15:24:16.159407 | mon1 | Thursday 17 September 2026 15:24:16 +0000 (0:00:03.272) 0:00:11.391 **** 2026-09-17 15:24:16.196429 | mon1 | skipping: [mon1] 2026-09-17 15:24:16.196463 | mon1 | 2026-09-17 15:24:16.196988 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-09-17 15:24:16.197036 | mon1 | Thursday 17 September 2026 15:24:16 +0000 (0:00:00.038) 0:00:11.430 **** 2026-09-17 15:24:16.235435 | mon1 | skipping: [mon1] 2026-09-17 15:24:16.235466 | mon1 | 2026-09-17 15:24:16.235475 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-09-17 15:24:16.235695 | mon1 | Thursday 17 September 2026 15:24:16 +0000 (0:00:00.038) 0:00:11.469 **** 2026-09-17 15:24:16.278573 | mon1 | skipping: [mon1] 2026-09-17 15:24:16.278602 | mon1 | 2026-09-17 15:24:16.278612 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-09-17 15:24:16.278621 | mon1 | Thursday 17 September 2026 15:24:16 +0000 (0:00:00.042) 0:00:11.511 **** 2026-09-17 15:24:24.250854 | mon1 | changed: [mon1] 2026-09-17 15:24:24.250940 | mon1 | 2026-09-17 15:24:24.250953 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-09-17 15:24:24.250966 | mon1 | Thursday 17 September 2026 15:24:24 +0000 (0:00:07.972) 0:00:19.484 **** 2026-09-17 15:24:24.934691 | mon1 | changed: [mon1] 2026-09-17 15:24:24.934772 | mon1 | 2026-09-17 15:24:24.934782 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-09-17 15:24:24.934791 | mon1 | Thursday 17 September 2026 15:24:24 +0000 (0:00:00.683) 0:00:20.167 **** 2026-09-17 15:24:26.234933 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-09-17 15:24:26.234997 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-09-17 15:24:26.235011 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-09-17 15:24:26.235024 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-09-17 15:24:26.235037 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-09-17 15:24:26.235051 | mon1 | 2026-09-17 15:24:26.235064 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-09-17 15:24:26.235076 | mon1 | Thursday 17 September 2026 15:24:26 +0000 (0:00:01.299) 0:00:21.466 **** 2026-09-17 15:24:27.094514 | mon1 | changed: [mon1] 2026-09-17 15:24:27.094603 | mon1 | 2026-09-17 15:24:27.094617 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-09-17 15:24:27.094629 | mon1 | Thursday 17 September 2026 15:24:27 +0000 (0:00:00.841) 0:00:22.308 **** 2026-09-17 15:24:27.094641 | mon1 | 2026-09-17 15:24:27.094652 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-09-17 15:24:27.094664 | mon1 | Thursday 17 September 2026 15:24:27 +0000 (0:00:00.017) 0:00:22.326 **** 2026-09-17 15:24:28.260468 | mon1 | ok: [mon1] 2026-09-17 15:24:28.260510 | mon1 | 2026-09-17 15:24:28.260519 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-09-17 15:24:28.260543 | mon1 | Thursday 17 September 2026 15:24:28 +0000 (0:00:01.167) 0:00:23.494 **** 2026-09-17 15:24:29.902991 | mon1 | changed: [mon1] 2026-09-17 15:24:29.903068 | mon1 | 2026-09-17 15:24:29.903078 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-09-17 15:24:29.903087 | mon1 | Thursday 17 September 2026 15:24:29 +0000 (0:00:01.642) 0:00:25.136 **** 2026-09-17 15:24:30.665781 | mon1 | changed: [mon1] 2026-09-17 15:24:30.665823 | mon1 | 2026-09-17 15:24:30.665833 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:24:30.665842 | mon1 | Thursday 17 September 2026 15:24:30 +0000 (0:00:00.763) 0:00:25.899 **** 2026-09-17 15:24:30.956843 | mon1 | ok: [mon1] 2026-09-17 15:24:30.957008 | mon1 | 2026-09-17 15:24:30.957205 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:24:30.957446 | mon1 | Thursday 17 September 2026 15:24:30 +0000 (0:00:00.291) 0:00:26.190 **** 2026-09-17 15:24:31.044381 | mon1 | ok: [mon1] => { 2026-09-17 15:24:31.044457 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-09-17 15:24:31.044462 | mon1 | } 2026-09-17 15:24:31.044467 | mon1 | 2026-09-17 15:24:31.044472 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:24:31.044478 | mon1 | Thursday 17 September 2026 15:24:31 +0000 (0:00:00.086) 0:00:26.277 **** 2026-09-17 15:24:33.064478 | mon1 | changed: [mon1] 2026-09-17 15:24:33.064570 | mon1 | 2026-09-17 15:24:33.064575 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:24:33.064580 | mon1 | Thursday 17 September 2026 15:24:33 +0000 (0:00:02.020) 0:00:28.298 **** 2026-09-17 15:24:37.911122 | mon1 | changed: [mon1] 2026-09-17 15:24:37.911203 | mon1 | 2026-09-17 15:24:37.911213 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-09-17 15:24:37.911223 | mon1 | Thursday 17 September 2026 15:24:37 +0000 (0:00:04.845) 0:00:33.143 **** 2026-09-17 15:24:39.100939 | mon1 | ok: [mon1] 2026-09-17 15:24:39.101015 | mon1 | 2026-09-17 15:24:39.101205 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-09-17 15:24:39.101408 | mon1 | Thursday 17 September 2026 15:24:39 +0000 (0:00:01.190) 0:00:34.334 **** 2026-09-17 15:24:39.590108 | mon1 | changed: [mon1] 2026-09-17 15:24:39.590174 | mon1 | 2026-09-17 15:24:39.590187 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-09-17 15:24:39.590199 | mon1 | Thursday 17 September 2026 15:24:39 +0000 (0:00:00.487) 0:00:34.822 **** 2026-09-17 15:24:40.258019 | mon1 | changed: [mon1] 2026-09-17 15:24:40.258091 | mon1 | 2026-09-17 15:24:40.258104 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-09-17 15:24:40.258117 | mon1 | Thursday 17 September 2026 15:24:40 +0000 (0:00:00.667) 0:00:35.490 **** 2026-09-17 15:24:41.075933 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-09-17 15:24:41.076024 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-09-17 15:24:41.076038 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-09-17 15:24:41.076050 | mon1 | 2026-09-17 15:24:41.076062 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-09-17 15:24:41.076074 | mon1 | Thursday 17 September 2026 15:24:41 +0000 (0:00:00.818) 0:00:36.308 **** 2026-09-17 15:24:41.649409 | mon1 | changed: [mon1] 2026-09-17 15:24:41.649483 | mon1 | 2026-09-17 15:24:41.649490 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-09-17 15:24:41.649657 | mon1 | Thursday 17 September 2026 15:24:41 +0000 (0:00:00.573) 0:00:36.881 **** 2026-09-17 15:24:42.295208 | mon1 | changed: [mon1] 2026-09-17 15:24:42.295429 | mon1 | 2026-09-17 15:24:42.295671 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-09-17 15:24:42.296674 | mon1 | Thursday 17 September 2026 15:24:42 +0000 (0:00:00.632) 0:00:37.513 **** 2026-09-17 15:24:42.296744 | mon1 | 2026-09-17 15:24:42.296782 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-09-17 15:24:42.296791 | mon1 | Thursday 17 September 2026 15:24:42 +0000 (0:00:00.014) 0:00:37.528 **** 2026-09-17 15:24:43.254344 | mon1 | ok: [mon1] 2026-09-17 15:24:43.254406 | mon1 | 2026-09-17 15:24:43.254411 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-09-17 15:24:43.254416 | mon1 | Thursday 17 September 2026 15:24:43 +0000 (0:00:00.959) 0:00:38.488 **** 2026-09-17 15:24:44.369497 | mon1 | changed: [mon1] 2026-09-17 15:24:44.369566 | mon1 | 2026-09-17 15:24:44.370004 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-09-17 15:24:44.370071 | mon1 | Thursday 17 September 2026 15:24:44 +0000 (0:00:01.114) 0:00:39.602 **** 2026-09-17 15:24:45.206531 | mon1 | changed: [mon1] 2026-09-17 15:24:45.206638 | mon1 | 2026-09-17 15:24:45.206651 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-09-17 15:24:45.206664 | mon1 | Thursday 17 September 2026 15:24:45 +0000 (0:00:00.836) 0:00:40.439 **** 2026-09-17 15:24:45.296983 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-09-17 15:24:45.297025 | mon1 | 2026-09-17 15:24:45.297034 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-09-17 15:24:45.297042 | mon1 | Thursday 17 September 2026 15:24:45 +0000 (0:00:00.090) 0:00:40.530 **** 2026-09-17 15:25:05.337017 | mon1 | changed: [mon1] 2026-09-17 15:25:05.337116 | mon1 | 2026-09-17 15:25:05.337129 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-09-17 15:25:05.337141 | mon1 | Thursday 17 September 2026 15:25:05 +0000 (0:00:20.039) 0:01:00.569 **** 2026-09-17 15:25:06.201422 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-09-17 15:25:06.201499 | mon1 | ok: [mon1] => (item=ssh) 2026-09-17 15:25:06.201513 | mon1 | 2026-09-17 15:25:06.201526 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-09-17 15:25:06.201538 | mon1 | Thursday 17 September 2026 15:25:06 +0000 (0:00:00.864) 0:01:01.434 **** 2026-09-17 15:25:11.922075 | mon1 | changed: [mon1] 2026-09-17 15:25:11.922144 | mon1 | 2026-09-17 15:25:11.922158 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-09-17 15:25:11.922170 | mon1 | Thursday 17 September 2026 15:25:11 +0000 (0:00:05.721) 0:01:07.155 **** 2026-09-17 15:25:12.193181 | mon1 | ok: [mon1] 2026-09-17 15:25:12.193227 | mon1 | 2026-09-17 15:25:12.193233 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-09-17 15:25:12.193239 | mon1 | Thursday 17 September 2026 15:25:12 +0000 (0:00:00.270) 0:01:07.426 **** 2026-09-17 15:25:12.820534 | mon1 | changed: [mon1] 2026-09-17 15:25:12.820622 | mon1 | 2026-09-17 15:25:12.820636 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-09-17 15:25:12.820913 | mon1 | Thursday 17 September 2026 15:25:12 +0000 (0:00:00.627) 0:01:08.053 **** 2026-09-17 15:25:13.225432 | mon1 | changed: [mon1] 2026-09-17 15:25:13.225498 | mon1 | 2026-09-17 15:25:13.225506 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-09-17 15:25:13.225515 | mon1 | Thursday 17 September 2026 15:25:13 +0000 (0:00:00.405) 0:01:08.459 **** 2026-09-17 15:25:13.353856 | mon1 | ok: [mon1] 2026-09-17 15:25:13.353938 | mon1 | 2026-09-17 15:25:13.353952 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-09-17 15:25:13.353964 | mon1 | Thursday 17 September 2026 15:25:13 +0000 (0:00:00.127) 0:01:08.587 **** 2026-09-17 15:25:13.664405 | mon1 | ok: [mon1] => (item=mon1) 2026-09-17 15:25:13.664462 | mon1 | 2026-09-17 15:25:13.664782 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-09-17 15:25:13.664842 | mon1 | Thursday 17 September 2026 15:25:13 +0000 (0:00:00.310) 0:01:08.898 **** 2026-09-17 15:25:13.729750 | mon1 | ok: [mon1] 2026-09-17 15:25:13.729812 | mon1 | 2026-09-17 15:25:13.729902 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-09-17 15:25:13.730002 | mon1 | Thursday 17 September 2026 15:25:13 +0000 (0:00:00.065) 0:01:08.963 **** 2026-09-17 15:25:13.822963 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-09-17 15:25:13.823024 | mon1 | 2026-09-17 15:25:13.823035 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-09-17 15:25:13.823045 | mon1 | Thursday 17 September 2026 15:25:13 +0000 (0:00:00.092) 0:01:09.056 **** 2026-09-17 15:25:14.165173 | mon1 | changed: [mon1] 2026-09-17 15:25:14.165240 | mon1 | 2026-09-17 15:25:14.165253 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-09-17 15:25:14.165266 | mon1 | Thursday 17 September 2026 15:25:14 +0000 (0:00:00.340) 0:01:09.397 **** 2026-09-17 15:25:15.018593 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-09-17 15:25:15.018633 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-09-17 15:25:15.018638 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-09-17 15:25:15.018643 | mon1 | 2026-09-17 15:25:15.018648 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-09-17 15:25:15.018652 | mon1 | Thursday 17 September 2026 15:25:15 +0000 (0:00:00.854) 0:01:10.251 **** 2026-09-17 15:26:59.126426 | mon1 | ok: [mon1] 2026-09-17 15:26:59.126681 | mon1 | 2026-09-17 15:26:59.126976 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-09-17 15:26:59.127268 | mon1 | Thursday 17 September 2026 15:26:59 +0000 (0:01:44.107) 0:02:54.359 **** 2026-09-17 15:26:59.426381 | mon1 | changed: [mon1] 2026-09-17 15:26:59.426444 | mon1 | 2026-09-17 15:26:59.426584 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-09-17 15:26:59.426896 | mon1 | Thursday 17 September 2026 15:26:59 +0000 (0:00:00.300) 0:02:54.660 **** 2026-09-17 15:26:59.477515 | mon1 | ok: [mon1] 2026-09-17 15:26:59.477799 | mon1 | 2026-09-17 15:26:59.478106 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-09-17 15:26:59.479363 | mon1 | Thursday 17 September 2026 15:26:59 +0000 (0:00:00.051) 0:02:54.711 **** 2026-09-17 15:26:59.569241 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-09-17 15:26:59.569384 | mon1 | 2026-09-17 15:26:59.569530 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-09-17 15:26:59.569666 | mon1 | Thursday 17 September 2026 15:26:59 +0000 (0:00:00.092) 0:02:54.804 **** 2026-09-17 15:27:01.357926 | mon1 | ok: [mon1] 2026-09-17 15:27:01.358082 | mon1 | 2026-09-17 15:27:01.358390 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-09-17 15:27:01.358657 | mon1 | Thursday 17 September 2026 15:27:01 +0000 (0:00:01.788) 0:02:56.592 **** 2026-09-17 15:27:01.419203 | mon1 | ok: [mon1] => (item=mon1) 2026-09-17 15:27:01.419507 | mon1 | 2026-09-17 15:27:01.419778 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-09-17 15:27:01.420096 | mon1 | Thursday 17 September 2026 15:27:01 +0000 (0:00:00.060) 0:02:56.653 **** 2026-09-17 15:27:01.811135 | mon1 | ok: [mon1] 2026-09-17 15:27:01.811398 | mon1 | 2026-09-17 15:27:01.811675 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-09-17 15:27:01.811966 | mon1 | Thursday 17 September 2026 15:27:01 +0000 (0:00:00.391) 0:02:57.045 **** 2026-09-17 15:27:04.508180 | mon1 | ok: [mon1] 2026-09-17 15:27:04.508265 | mon1 | 2026-09-17 15:27:04.508370 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-09-17 15:27:04.508476 | mon1 | Thursday 17 September 2026 15:27:04 +0000 (0:00:02.697) 0:02:59.742 **** 2026-09-17 15:27:07.788417 | mon1 | changed: [mon1] 2026-09-17 15:27:07.788513 | mon1 | 2026-09-17 15:27:07.788524 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-09-17 15:27:07.788653 | mon1 | Thursday 17 September 2026 15:27:07 +0000 (0:00:03.280) 0:03:03.023 **** 2026-09-17 15:27:09.705133 | mon1 | ok: [mon1] 2026-09-17 15:27:09.705194 | mon1 | 2026-09-17 15:27:09.705208 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-09-17 15:27:09.705220 | mon1 | Thursday 17 September 2026 15:27:09 +0000 (0:00:01.915) 0:03:04.939 **** 2026-09-17 15:27:09.768928 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-09-17 15:27:09.768999 | mon1 | 2026-09-17 15:27:09.769251 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-09-17 15:27:09.769327 | mon1 | Thursday 17 September 2026 15:27:09 +0000 (0:00:00.062) 0:03:05.001 **** 2026-09-17 15:27:09.841366 | mon1 | skipping: [mon1] 2026-09-17 15:27:09.841412 | mon1 | 2026-09-17 15:27:09.841428 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-09-17 15:27:09.841713 | mon1 | Thursday 17 September 2026 15:27:09 +0000 (0:00:00.073) 0:03:05.075 **** 2026-09-17 15:27:09.889811 | mon1 | skipping: [mon1] => (item=mon1) 2026-09-17 15:27:09.889880 | mon1 | skipping: [mon1] 2026-09-17 15:27:09.889988 | mon1 | 2026-09-17 15:27:09.890218 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-09-17 15:27:09.890250 | mon1 | Thursday 17 September 2026 15:27:09 +0000 (0:00:00.048) 0:03:05.124 **** 2026-09-17 15:27:10.202054 | mon1 | ok: [mon1] 2026-09-17 15:27:10.202106 | mon1 | 2026-09-17 15:27:10.202120 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-09-17 15:27:10.202138 | mon1 | Thursday 17 September 2026 15:27:10 +0000 (0:00:00.311) 0:03:05.435 **** 2026-09-17 15:27:12.781105 | mon1 | ok: [mon1] 2026-09-17 15:27:12.781218 | mon1 | 2026-09-17 15:27:12.781370 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-09-17 15:27:12.781562 | mon1 | Thursday 17 September 2026 15:27:12 +0000 (0:00:02.580) 0:03:08.016 **** 2026-09-17 15:27:15.993998 | mon1 | changed: [mon1] 2026-09-17 15:27:15.994066 | mon1 | 2026-09-17 15:27:15.994221 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-09-17 15:27:15.994421 | mon1 | Thursday 17 September 2026 15:27:15 +0000 (0:00:03.212) 0:03:11.228 **** 2026-09-17 15:27:17.746833 | mon1 | ok: [mon1] 2026-09-17 15:27:17.746897 | mon1 | 2026-09-17 15:27:17.746910 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-09-17 15:27:17.746924 | mon1 | Thursday 17 September 2026 15:27:17 +0000 (0:00:01.751) 0:03:12.980 **** 2026-09-17 15:27:25.280889 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-09-17 15:27:25.280958 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-09-17 15:27:25.280970 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-09-17 15:27:25.280982 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-09-17 15:27:25.280994 | mon1 | 2026-09-17 15:27:25.281006 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-09-17 15:27:25.281017 | mon1 | 2026-09-17 15:27:25.281029 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-09-17 15:27:25.281040 | mon1 | Thursday 17 September 2026 15:27:25 +0000 (0:00:07.533) 0:03:20.513 **** 2026-09-17 15:27:26.606336 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-09-17 15:27:26.606377 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-09-17 15:27:26.606383 | mon1 | interpreter could change the meaning of that path. See 2026-09-17 15:27:26.606388 | mon1 | https://docs.ansible.com/ansible- 2026-09-17 15:27:26.606403 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-09-17 15:27:26.614465 | mon1 | ok: [osd1] 2026-09-17 15:27:26.614501 | mon1 | 2026-09-17 15:27:26.614515 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:27:26.614526 | mon1 | Thursday 17 September 2026 15:27:26 +0000 (0:00:01.334) 0:03:21.848 **** 2026-09-17 15:27:26.912861 | mon1 | ok: [osd1] 2026-09-17 15:27:26.913067 | mon1 | 2026-09-17 15:27:26.913338 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:27:26.913591 | mon1 | Thursday 17 September 2026 15:27:26 +0000 (0:00:00.299) 0:03:22.147 **** 2026-09-17 15:27:26.949149 | mon1 | skipping: [osd1] 2026-09-17 15:27:26.949369 | mon1 | 2026-09-17 15:27:26.949634 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-09-17 15:27:26.949878 | mon1 | Thursday 17 September 2026 15:27:26 +0000 (0:00:00.036) 0:03:22.184 **** 2026-09-17 15:27:27.251210 | mon1 | changed: [osd1] 2026-09-17 15:27:27.251262 | mon1 | 2026-09-17 15:27:27.251431 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:27:27.251519 | mon1 | Thursday 17 September 2026 15:27:27 +0000 (0:00:00.301) 0:03:22.486 **** 2026-09-17 15:27:27.331946 | mon1 | ok: [osd1] => { 2026-09-17 15:27:27.332228 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-09-17 15:27:27.332529 | mon1 | } 2026-09-17 15:27:27.332827 | mon1 | 2026-09-17 15:27:27.333152 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:27:27.333550 | mon1 | Thursday 17 September 2026 15:27:27 +0000 (0:00:00.080) 0:03:22.566 **** 2026-09-17 15:27:28.071099 | mon1 | changed: [osd1] 2026-09-17 15:27:28.071277 | mon1 | 2026-09-17 15:27:28.071584 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:27:28.071814 | mon1 | Thursday 17 September 2026 15:27:28 +0000 (0:00:00.738) 0:03:23.305 **** 2026-09-17 15:27:28.136472 | mon1 | skipping: [osd1] 2026-09-17 15:27:28.136679 | mon1 | 2026-09-17 15:27:28.136922 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:27:28.137143 | mon1 | Thursday 17 September 2026 15:27:28 +0000 (0:00:00.065) 0:03:23.371 **** 2026-09-17 15:27:28.188023 | mon1 | skipping: [osd1] 2026-09-17 15:27:28.188348 | mon1 | 2026-09-17 15:27:28.188710 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:27:28.189517 | mon1 | Thursday 17 September 2026 15:27:28 +0000 (0:00:00.051) 0:03:23.422 **** 2026-09-17 15:27:28.499426 | mon1 | ok: [osd1] 2026-09-17 15:27:28.499480 | mon1 | 2026-09-17 15:27:28.499491 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:27:28.499502 | mon1 | Thursday 17 September 2026 15:27:28 +0000 (0:00:00.310) 0:03:23.732 **** 2026-09-17 15:27:29.711538 | mon1 | ok: [osd1] 2026-09-17 15:27:29.711603 | mon1 | 2026-09-17 15:27:29.711801 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:27:29.712021 | mon1 | Thursday 17 September 2026 15:27:29 +0000 (0:00:01.212) 0:03:24.945 **** 2026-09-17 15:27:29.822360 | mon1 | ok: [osd1] => { 2026-09-17 15:27:29.822663 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-09-17 15:27:29.822906 | mon1 | } 2026-09-17 15:27:29.823109 | mon1 | 2026-09-17 15:27:29.823436 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:27:29.823642 | mon1 | Thursday 17 September 2026 15:27:29 +0000 (0:00:00.111) 0:03:25.056 **** 2026-09-17 15:27:30.678758 | mon1 | changed: [osd1] 2026-09-17 15:27:30.678851 | mon1 | 2026-09-17 15:27:30.678936 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:27:30.679058 | mon1 | Thursday 17 September 2026 15:27:30 +0000 (0:00:00.856) 0:03:25.913 **** 2026-09-17 15:27:33.662491 | mon1 | changed: [osd1] 2026-09-17 15:27:33.663404 | mon1 | 2026-09-17 15:27:33.663475 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-09-17 15:27:33.663493 | mon1 | Thursday 17 September 2026 15:27:33 +0000 (0:00:02.982) 0:03:28.895 **** 2026-09-17 15:27:33.712524 | mon1 | skipping: [osd1] 2026-09-17 15:27:33.712599 | mon1 | 2026-09-17 15:27:33.712639 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-09-17 15:27:33.712940 | mon1 | Thursday 17 September 2026 15:27:33 +0000 (0:00:00.050) 0:03:28.946 **** 2026-09-17 15:27:33.764958 | mon1 | skipping: [osd1] 2026-09-17 15:27:33.765087 | mon1 | 2026-09-17 15:27:33.765514 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-09-17 15:27:33.765644 | mon1 | Thursday 17 September 2026 15:27:33 +0000 (0:00:00.050) 0:03:28.996 **** 2026-09-17 15:27:33.818982 | mon1 | skipping: [osd1] 2026-09-17 15:27:33.819020 | mon1 | 2026-09-17 15:27:33.819025 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-09-17 15:27:33.819029 | mon1 | Thursday 17 September 2026 15:27:33 +0000 (0:00:00.055) 0:03:29.052 **** 2026-09-17 15:27:41.872821 | mon1 | changed: [osd1] 2026-09-17 15:27:41.872882 | mon1 | 2026-09-17 15:27:41.873133 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-09-17 15:27:41.873151 | mon1 | Thursday 17 September 2026 15:27:41 +0000 (0:00:08.055) 0:03:37.107 **** 2026-09-17 15:27:42.542742 | mon1 | changed: [osd1] 2026-09-17 15:27:42.542825 | mon1 | 2026-09-17 15:27:42.542833 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-09-17 15:27:42.542842 | mon1 | Thursday 17 September 2026 15:27:42 +0000 (0:00:00.668) 0:03:37.775 **** 2026-09-17 15:27:43.821562 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-09-17 15:27:43.821670 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-09-17 15:27:43.821686 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-09-17 15:27:43.821698 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-09-17 15:27:43.821710 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-09-17 15:27:43.821722 | mon1 | 2026-09-17 15:27:43.821735 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-09-17 15:27:43.821756 | mon1 | Thursday 17 September 2026 15:27:43 +0000 (0:00:01.277) 0:03:39.052 **** 2026-09-17 15:27:44.655279 | mon1 | changed: [osd1] 2026-09-17 15:27:44.655549 | mon1 | 2026-09-17 15:27:44.655795 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-09-17 15:27:44.656031 | mon1 | Thursday 17 September 2026 15:27:44 +0000 (0:00:00.824) 0:03:39.876 **** 2026-09-17 15:27:44.656241 | mon1 | 2026-09-17 15:27:44.656606 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-09-17 15:27:44.656824 | mon1 | Thursday 17 September 2026 15:27:44 +0000 (0:00:00.012) 0:03:39.889 **** 2026-09-17 15:27:45.657266 | mon1 | ok: [osd1] 2026-09-17 15:27:45.657565 | mon1 | 2026-09-17 15:27:45.657833 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-09-17 15:27:45.658135 | mon1 | Thursday 17 September 2026 15:27:45 +0000 (0:00:01.001) 0:03:40.890 **** 2026-09-17 15:27:46.348893 | mon1 | changed: [osd1] 2026-09-17 15:27:46.349268 | mon1 | 2026-09-17 15:27:46.349598 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-09-17 15:27:46.349843 | mon1 | Thursday 17 September 2026 15:27:46 +0000 (0:00:00.692) 0:03:41.583 **** 2026-09-17 15:27:47.176259 | mon1 | changed: [osd1] 2026-09-17 15:27:47.176383 | mon1 | 2026-09-17 15:27:47.176401 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:27:47.176414 | mon1 | Thursday 17 September 2026 15:27:47 +0000 (0:00:00.825) 0:03:42.408 **** 2026-09-17 15:27:47.443141 | mon1 | ok: [osd1] 2026-09-17 15:27:47.443232 | mon1 | 2026-09-17 15:27:47.443246 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:27:47.443259 | mon1 | Thursday 17 September 2026 15:27:47 +0000 (0:00:00.267) 0:03:42.676 **** 2026-09-17 15:27:47.540468 | mon1 | ok: [osd1] => { 2026-09-17 15:27:47.541582 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-09-17 15:27:47.541655 | mon1 | } 2026-09-17 15:27:47.541666 | mon1 | 2026-09-17 15:27:47.541689 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:27:47.541700 | mon1 | Thursday 17 September 2026 15:27:47 +0000 (0:00:00.097) 0:03:42.774 **** 2026-09-17 15:27:49.626480 | mon1 | changed: [osd1] 2026-09-17 15:27:49.626616 | mon1 | 2026-09-17 15:27:49.626630 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:27:49.626681 | mon1 | Thursday 17 September 2026 15:27:49 +0000 (0:00:02.085) 0:03:44.859 **** 2026-09-17 15:27:54.383194 | mon1 | changed: [osd1] 2026-09-17 15:27:54.383293 | mon1 | 2026-09-17 15:27:54.383362 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-09-17 15:27:54.383379 | mon1 | Thursday 17 September 2026 15:27:54 +0000 (0:00:04.755) 0:03:49.615 **** 2026-09-17 15:27:55.360210 | mon1 | ok: [osd1] 2026-09-17 15:27:55.360338 | mon1 | 2026-09-17 15:27:55.360394 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-09-17 15:27:55.360530 | mon1 | Thursday 17 September 2026 15:27:55 +0000 (0:00:00.977) 0:03:50.593 **** 2026-09-17 15:27:55.706871 | mon1 | changed: [osd1] 2026-09-17 15:27:55.706974 | mon1 | 2026-09-17 15:27:55.706989 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-09-17 15:27:55.707138 | mon1 | Thursday 17 September 2026 15:27:55 +0000 (0:00:00.347) 0:03:50.940 **** 2026-09-17 15:27:56.375179 | mon1 | changed: [osd1] 2026-09-17 15:27:56.375346 | mon1 | 2026-09-17 15:27:56.375516 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-09-17 15:27:56.375665 | mon1 | Thursday 17 September 2026 15:27:56 +0000 (0:00:00.667) 0:03:51.608 **** 2026-09-17 15:27:57.118509 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-09-17 15:27:57.119547 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-09-17 15:27:57.119689 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-09-17 15:27:57.119710 | mon1 | 2026-09-17 15:27:57.119726 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-09-17 15:27:57.119749 | mon1 | Thursday 17 September 2026 15:27:57 +0000 (0:00:00.743) 0:03:52.352 **** 2026-09-17 15:27:57.784877 | mon1 | changed: [osd1] 2026-09-17 15:27:57.784938 | mon1 | 2026-09-17 15:27:57.784951 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-09-17 15:27:57.784964 | mon1 | Thursday 17 September 2026 15:27:57 +0000 (0:00:00.665) 0:03:53.017 **** 2026-09-17 15:27:58.483270 | mon1 | changed: [osd1] 2026-09-17 15:27:58.483474 | mon1 | 2026-09-17 15:27:58.484463 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-09-17 15:27:58.484556 | mon1 | Thursday 17 September 2026 15:27:58 +0000 (0:00:00.683) 0:03:53.701 **** 2026-09-17 15:27:58.484570 | mon1 | 2026-09-17 15:27:58.484606 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-09-17 15:27:58.484745 | mon1 | Thursday 17 September 2026 15:27:58 +0000 (0:00:00.013) 0:03:53.714 **** 2026-09-17 15:27:59.530539 | mon1 | ok: [osd1] 2026-09-17 15:27:59.530629 | mon1 | 2026-09-17 15:27:59.530637 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-09-17 15:27:59.530644 | mon1 | Thursday 17 September 2026 15:27:59 +0000 (0:00:01.048) 0:03:54.762 **** 2026-09-17 15:28:00.763167 | mon1 | changed: [osd1] 2026-09-17 15:28:00.763258 | mon1 | 2026-09-17 15:28:00.763273 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-09-17 15:28:00.763287 | mon1 | Thursday 17 September 2026 15:28:00 +0000 (0:00:01.232) 0:03:55.995 **** 2026-09-17 15:28:01.579213 | mon1 | changed: [osd1] 2026-09-17 15:28:01.579298 | mon1 | 2026-09-17 15:28:01.579352 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-09-17 15:28:01.579370 | mon1 | Thursday 17 September 2026 15:28:01 +0000 (0:00:00.815) 0:03:56.811 **** 2026-09-17 15:28:01.646853 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-09-17 15:28:01.646911 | mon1 | 2026-09-17 15:28:01.646924 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-09-17 15:28:01.646937 | mon1 | Thursday 17 September 2026 15:28:01 +0000 (0:00:00.068) 0:03:56.879 **** 2026-09-17 15:28:02.642187 | mon1 | ok: [osd1] 2026-09-17 15:28:02.642276 | mon1 | 2026-09-17 15:28:02.642290 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-09-17 15:28:02.642402 | mon1 | Thursday 17 September 2026 15:28:02 +0000 (0:00:00.994) 0:03:57.874 **** 2026-09-17 15:28:03.504745 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-09-17 15:28:03.504821 | mon1 | ok: [osd1] => (item=ssh) 2026-09-17 15:28:03.504827 | mon1 | 2026-09-17 15:28:03.504832 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-09-17 15:28:03.504838 | mon1 | Thursday 17 September 2026 15:28:03 +0000 (0:00:00.863) 0:03:58.737 **** 2026-09-17 15:28:04.363286 | mon1 | changed: [osd1] 2026-09-17 15:28:04.363447 | mon1 | 2026-09-17 15:28:04.363822 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-09-17 15:28:04.364247 | mon1 | Thursday 17 September 2026 15:28:04 +0000 (0:00:00.858) 0:03:59.596 **** 2026-09-17 15:28:04.662172 | mon1 | ok: [osd1] 2026-09-17 15:28:04.662333 | mon1 | 2026-09-17 15:28:04.662704 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-09-17 15:28:04.663055 | mon1 | Thursday 17 September 2026 15:28:04 +0000 (0:00:00.298) 0:03:59.895 **** 2026-09-17 15:28:05.123717 | mon1 | changed: [osd1] 2026-09-17 15:28:05.123789 | mon1 | 2026-09-17 15:28:05.123797 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-09-17 15:28:05.123823 | mon1 | Thursday 17 September 2026 15:28:05 +0000 (0:00:00.460) 0:04:00.355 **** 2026-09-17 15:28:05.449421 | mon1 | changed: [osd1] 2026-09-17 15:28:05.450421 | mon1 | 2026-09-17 15:28:05.450452 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-09-17 15:28:05.450463 | mon1 | Thursday 17 September 2026 15:28:05 +0000 (0:00:00.326) 0:04:00.682 **** 2026-09-17 15:28:05.783491 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-09-17 15:28:05.783582 | mon1 | 2026-09-17 15:28:05.783594 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-09-17 15:28:05.783861 | mon1 | Thursday 17 September 2026 15:28:05 +0000 (0:00:00.334) 0:04:01.017 **** 2026-09-17 15:28:05.854928 | mon1 | ok: [osd1] 2026-09-17 15:28:05.855086 | mon1 | 2026-09-17 15:28:05.855378 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-09-17 15:28:05.855708 | mon1 | Thursday 17 September 2026 15:28:05 +0000 (0:00:00.071) 0:04:01.089 **** 2026-09-17 15:28:05.984914 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-09-17 15:28:05.985041 | mon1 | 2026-09-17 15:28:05.985283 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-09-17 15:28:05.985549 | mon1 | Thursday 17 September 2026 15:28:05 +0000 (0:00:00.130) 0:04:01.219 **** 2026-09-17 15:28:07.784107 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-09-17 15:28:07.784273 | mon1 | 2026-09-17 15:28:07.784577 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-09-17 15:28:07.784882 | mon1 | Thursday 17 September 2026 15:28:07 +0000 (0:00:01.797) 0:04:03.017 **** 2026-09-17 15:28:07.868159 | mon1 | ok: [osd1] => (item=osd1) 2026-09-17 15:28:07.868435 | mon1 | 2026-09-17 15:28:07.868767 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-09-17 15:28:07.869148 | mon1 | Thursday 17 September 2026 15:28:07 +0000 (0:00:00.084) 0:04:03.102 **** 2026-09-17 15:28:08.231934 | mon1 | changed: [osd1] 2026-09-17 15:28:08.232117 | mon1 | 2026-09-17 15:28:08.232430 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-09-17 15:28:08.232705 | mon1 | Thursday 17 September 2026 15:28:08 +0000 (0:00:00.363) 0:04:03.465 **** 2026-09-17 15:28:14.260540 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-09-17 15:28:14.260640 | mon1 | 2026-09-17 15:28:14.260654 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-09-17 15:28:14.260700 | mon1 | Thursday 17 September 2026 15:28:14 +0000 (0:00:06.028) 0:04:09.494 **** 2026-09-17 15:28:15.241273 | mon1 | ok: [osd1] 2026-09-17 15:28:15.241418 | mon1 | 2026-09-17 15:28:15.241676 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-09-17 15:28:15.241929 | mon1 | Thursday 17 September 2026 15:28:15 +0000 (0:00:00.980) 0:04:10.474 **** 2026-09-17 15:29:09.343877 | mon1 | ok: [osd1] 2026-09-17 15:29:09.343961 | mon1 | 2026-09-17 15:29:09.343969 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-09-17 15:29:09.343975 | mon1 | Thursday 17 September 2026 15:29:09 +0000 (0:00:54.102) 0:05:04.577 **** 2026-09-17 15:29:57.274660 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-09-17 15:29:57.274735 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-09-17 15:29:57.274748 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-09-17 15:29:57.274760 | mon1 | 2026-09-17 15:29:57.274772 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-09-17 15:29:57.274784 | mon1 | Thursday 17 September 2026 15:29:57 +0000 (0:00:47.929) 0:05:52.507 **** 2026-09-17 15:29:59.154037 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-09-17 15:29:59.154100 | mon1 | 2026-09-17 15:29:59.154113 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-09-17 15:29:59.154126 | mon1 | Thursday 17 September 2026 15:29:59 +0000 (0:00:01.880) 0:05:54.387 **** 2026-09-17 15:30:01.038460 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-09-17 15:30:01.038578 | mon1 | 2026-09-17 15:30:01.038599 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-09-17 15:30:01.038615 | mon1 | Thursday 17 September 2026 15:30:01 +0000 (0:00:01.883) 0:05:56.270 **** 2026-09-17 15:30:01.127523 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-09-17 15:30:01.127595 | mon1 | 2026-09-17 15:30:01.127622 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-09-17 15:30:01.127920 | mon1 | Thursday 17 September 2026 15:30:01 +0000 (0:00:00.090) 0:05:56.360 **** 2026-09-17 15:30:01.197343 | mon1 | ok: [osd1] 2026-09-17 15:30:01.197405 | mon1 | 2026-09-17 15:30:01.197415 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-09-17 15:30:01.197423 | mon1 | Thursday 17 September 2026 15:30:01 +0000 (0:00:00.069) 0:05:56.430 **** 2026-09-17 15:30:03.006356 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-09-17 15:30:03.006420 | mon1 | 2026-09-17 15:30:03.006429 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-09-17 15:30:03.006436 | mon1 | Thursday 17 September 2026 15:30:03 +0000 (0:00:01.809) 0:05:58.240 **** 2026-09-17 15:30:03.074148 | mon1 | ok: [osd1] 2026-09-17 15:30:03.074229 | mon1 | 2026-09-17 15:30:03.074243 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-09-17 15:30:03.074256 | mon1 | Thursday 17 September 2026 15:30:03 +0000 (0:00:00.067) 0:05:58.307 **** 2026-09-17 15:30:03.129364 | mon1 | failed: [osd1] (item=2) => {"ansible_loop_var": "item", "changed": false, "item": 2, "msg": "Failed as requested from task"} 2026-09-17 15:30:03.152862 | mon1 | skipping: [osd1] => (item=1) 2026-09-17 15:30:03.152927 | mon1 | skipping: [osd1] => (item=1) 2026-09-17 15:30:03.152940 | mon1 | 2026-09-17 15:30:03.152952 | mon1 | TASK [vexxhost.ceph.osd : Failed after retry] ********************************** 2026-09-17 15:30:03.152965 | mon1 | Thursday 17 September 2026 15:30:03 +0000 (0:00:00.078) 0:05:58.385 **** 2026-09-17 15:30:03.213475 | mon1 | skipping: [osd1] 2026-09-17 15:30:03.214290 | mon1 | 2026-09-17 15:30:03.214451 | mon1 | TASK [vexxhost.ceph.osd : Give 5 seconds pause before retry] ******************* 2026-09-17 15:30:03.214467 | mon1 | Thursday 17 September 2026 15:30:03 +0000 (0:00:00.061) 0:05:58.446 **** 2026-09-17 15:30:08.272054 | mon1 | Pausing for 5 seconds 2026-09-17 15:30:08.272110 | mon1 | ok: [osd1] 2026-09-17 15:30:08.272123 | mon1 | 2026-09-17 15:30:08.272135 | mon1 | TASK [vexxhost.ceph.osd : Recheck OSDs] **************************************** 2026-09-17 15:30:08.272148 | mon1 | Thursday 17 September 2026 15:30:08 +0000 (0:00:05.057) 0:06:03.504 **** 2026-09-17 15:30:08.345954 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-09-17 15:30:08.345999 | mon1 | 2026-09-17 15:30:08.346009 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-09-17 15:30:08.346019 | mon1 | Thursday 17 September 2026 15:30:08 +0000 (0:00:00.074) 0:06:03.578 **** 2026-09-17 15:30:08.409596 | mon1 | ok: [osd1] 2026-09-17 15:30:08.409665 | mon1 | 2026-09-17 15:30:08.409673 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-09-17 15:30:08.409682 | mon1 | Thursday 17 September 2026 15:30:08 +0000 (0:00:00.064) 0:06:03.643 **** 2026-09-17 15:30:10.193394 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-09-17 15:30:10.193480 | mon1 | 2026-09-17 15:30:10.193524 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-09-17 15:30:10.193789 | mon1 | Thursday 17 September 2026 15:30:10 +0000 (0:00:01.784) 0:06:05.427 **** 2026-09-17 15:30:10.262448 | mon1 | ok: [osd1] 2026-09-17 15:30:10.262547 | mon1 | 2026-09-17 15:30:10.262795 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-09-17 15:30:10.262853 | mon1 | Thursday 17 September 2026 15:30:10 +0000 (0:00:00.069) 0:06:05.496 **** 2026-09-17 15:30:10.323954 | mon1 | skipping: [osd1] => (item=1) 2026-09-17 15:30:10.324151 | mon1 | skipping: [osd1] => (item=1) 2026-09-17 15:30:10.324419 | mon1 | skipping: [osd1] => (item=1) 2026-09-17 15:30:10.324650 | mon1 | skipping: [osd1] 2026-09-17 15:30:10.324851 | mon1 | 2026-09-17 15:30:10.325079 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-09-17 15:30:10.325289 | mon1 | Thursday 17 September 2026 15:30:10 +0000 (0:00:00.061) 0:06:05.557 **** 2026-09-17 15:30:10.417449 | mon1 | skipping: [osd1] 2026-09-17 15:30:10.417530 | mon1 | 2026-09-17 15:30:10.417544 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-09-17 15:30:10.417556 | mon1 | 2026-09-17 15:30:10.417567 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-09-17 15:30:10.417578 | mon1 | Thursday 17 September 2026 15:30:10 +0000 (0:00:00.093) 0:06:05.651 **** 2026-09-17 15:30:11.328774 | mon1 | ok: [mon1] 2026-09-17 15:30:11.328892 | mon1 | 2026-09-17 15:30:11.329256 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:30:11.329292 | mon1 | Thursday 17 September 2026 15:30:11 +0000 (0:00:00.912) 0:06:06.563 **** 2026-09-17 15:30:11.558691 | mon1 | ok: [mon1] 2026-09-17 15:30:11.558752 | mon1 | 2026-09-17 15:30:11.558873 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:30:11.558979 | mon1 | Thursday 17 September 2026 15:30:11 +0000 (0:00:00.229) 0:06:06.793 **** 2026-09-17 15:30:11.602751 | mon1 | skipping: [mon1] 2026-09-17 15:30:11.602810 | mon1 | 2026-09-17 15:30:11.602901 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-09-17 15:30:11.603033 | mon1 | Thursday 17 September 2026 15:30:11 +0000 (0:00:00.043) 0:06:06.837 **** 2026-09-17 15:30:11.831697 | mon1 | ok: [mon1] 2026-09-17 15:30:11.831753 | mon1 | 2026-09-17 15:30:11.831770 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:30:11.831786 | mon1 | Thursday 17 September 2026 15:30:11 +0000 (0:00:00.227) 0:06:07.065 **** 2026-09-17 15:30:11.919373 | mon1 | ok: [mon1] => { 2026-09-17 15:30:11.919426 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-09-17 15:30:11.919439 | mon1 | } 2026-09-17 15:30:11.919452 | mon1 | 2026-09-17 15:30:11.919486 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:30:11.919498 | mon1 | Thursday 17 September 2026 15:30:11 +0000 (0:00:00.086) 0:06:07.151 **** 2026-09-17 15:30:12.333774 | mon1 | ok: [mon1] 2026-09-17 15:30:12.335521 | mon1 | 2026-09-17 15:30:12.335580 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:30:12.335594 | mon1 | Thursday 17 September 2026 15:30:12 +0000 (0:00:00.414) 0:06:07.566 **** 2026-09-17 15:30:12.377801 | mon1 | skipping: [mon1] 2026-09-17 15:30:12.377928 | mon1 | 2026-09-17 15:30:12.378257 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:30:12.378286 | mon1 | Thursday 17 September 2026 15:30:12 +0000 (0:00:00.045) 0:06:07.612 **** 2026-09-17 15:30:12.437804 | mon1 | skipping: [mon1] 2026-09-17 15:30:12.437964 | mon1 | 2026-09-17 15:30:12.438134 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:30:12.438294 | mon1 | Thursday 17 September 2026 15:30:12 +0000 (0:00:00.059) 0:06:07.671 **** 2026-09-17 15:30:12.692218 | mon1 | ok: [mon1] 2026-09-17 15:30:12.692297 | mon1 | 2026-09-17 15:30:12.692344 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:30:12.692359 | mon1 | Thursday 17 September 2026 15:30:12 +0000 (0:00:00.253) 0:06:07.925 **** 2026-09-17 15:30:13.654995 | mon1 | ok: [mon1] 2026-09-17 15:30:13.655062 | mon1 | 2026-09-17 15:30:13.655230 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:30:13.655442 | mon1 | Thursday 17 September 2026 15:30:13 +0000 (0:00:00.962) 0:06:08.887 **** 2026-09-17 15:30:13.736690 | mon1 | ok: [mon1] => { 2026-09-17 15:30:13.736753 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-09-17 15:30:13.736762 | mon1 | } 2026-09-17 15:30:13.736771 | mon1 | 2026-09-17 15:30:13.736781 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:30:13.736792 | mon1 | Thursday 17 September 2026 15:30:13 +0000 (0:00:00.081) 0:06:08.968 **** 2026-09-17 15:30:14.220359 | mon1 | ok: [mon1] 2026-09-17 15:30:14.220413 | mon1 | 2026-09-17 15:30:14.220423 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:30:14.220433 | mon1 | Thursday 17 September 2026 15:30:14 +0000 (0:00:00.484) 0:06:09.453 **** 2026-09-17 15:30:17.436048 | mon1 | ok: [mon1] 2026-09-17 15:30:17.436149 | mon1 | 2026-09-17 15:30:17.436167 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-09-17 15:30:17.436183 | mon1 | Thursday 17 September 2026 15:30:17 +0000 (0:00:03.215) 0:06:12.669 **** 2026-09-17 15:30:17.484547 | mon1 | skipping: [mon1] 2026-09-17 15:30:17.484641 | mon1 | 2026-09-17 15:30:17.484907 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-09-17 15:30:17.485131 | mon1 | Thursday 17 September 2026 15:30:17 +0000 (0:00:00.049) 0:06:12.718 **** 2026-09-17 15:30:17.533786 | mon1 | skipping: [mon1] 2026-09-17 15:30:17.533949 | mon1 | 2026-09-17 15:30:17.534178 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-09-17 15:30:17.534464 | mon1 | Thursday 17 September 2026 15:30:17 +0000 (0:00:00.049) 0:06:12.768 **** 2026-09-17 15:30:17.576206 | mon1 | skipping: [mon1] 2026-09-17 15:30:17.576343 | mon1 | 2026-09-17 15:30:17.576608 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-09-17 15:30:17.576846 | mon1 | Thursday 17 September 2026 15:30:17 +0000 (0:00:00.042) 0:06:12.811 **** 2026-09-17 15:30:18.585181 | mon1 | ok: [mon1] 2026-09-17 15:30:18.585410 | mon1 | 2026-09-17 15:30:18.586016 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-09-17 15:30:18.586081 | mon1 | Thursday 17 September 2026 15:30:18 +0000 (0:00:01.007) 0:06:13.818 **** 2026-09-17 15:30:19.216492 | mon1 | ok: [mon1] 2026-09-17 15:30:19.216586 | mon1 | 2026-09-17 15:30:19.216608 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-09-17 15:30:19.216886 | mon1 | Thursday 17 September 2026 15:30:19 +0000 (0:00:00.630) 0:06:14.449 **** 2026-09-17 15:30:20.504791 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-09-17 15:30:20.504897 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-09-17 15:30:20.504977 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-09-17 15:30:20.505095 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-09-17 15:30:20.505212 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-09-17 15:30:20.505339 | mon1 | 2026-09-17 15:30:20.505462 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-09-17 15:30:20.505610 | mon1 | Thursday 17 September 2026 15:30:20 +0000 (0:00:01.289) 0:06:15.739 **** 2026-09-17 15:30:21.218431 | mon1 | ok: [mon1] 2026-09-17 15:30:21.218518 | mon1 | 2026-09-17 15:30:21.218525 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-09-17 15:30:21.218547 | mon1 | Thursday 17 September 2026 15:30:21 +0000 (0:00:00.704) 0:06:16.443 **** 2026-09-17 15:30:21.218576 | mon1 | 2026-09-17 15:30:21.218884 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-09-17 15:30:21.218936 | mon1 | Thursday 17 September 2026 15:30:21 +0000 (0:00:00.007) 0:06:16.450 **** 2026-09-17 15:30:22.713166 | mon1 | ok: [mon1] 2026-09-17 15:30:22.713249 | mon1 | 2026-09-17 15:30:22.713260 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:30:22.713271 | mon1 | Thursday 17 September 2026 15:30:22 +0000 (0:00:01.495) 0:06:17.946 **** 2026-09-17 15:30:22.971867 | mon1 | ok: [mon1] 2026-09-17 15:30:22.971959 | mon1 | 2026-09-17 15:30:22.971970 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:30:22.971978 | mon1 | Thursday 17 September 2026 15:30:22 +0000 (0:00:00.258) 0:06:18.204 **** 2026-09-17 15:30:23.068730 | mon1 | ok: [mon1] => { 2026-09-17 15:30:23.068812 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-09-17 15:30:23.068830 | mon1 | } 2026-09-17 15:30:23.068846 | mon1 | 2026-09-17 15:30:23.068860 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:30:23.068875 | mon1 | Thursday 17 September 2026 15:30:23 +0000 (0:00:00.095) 0:06:18.300 **** 2026-09-17 15:30:23.537632 | mon1 | ok: [mon1] 2026-09-17 15:30:23.537703 | mon1 | 2026-09-17 15:30:23.537710 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:30:23.537718 | mon1 | Thursday 17 September 2026 15:30:23 +0000 (0:00:00.469) 0:06:18.770 **** 2026-09-17 15:30:26.924982 | mon1 | ok: [mon1] 2026-09-17 15:30:26.925696 | mon1 | 2026-09-17 15:30:26.925746 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-09-17 15:30:26.925760 | mon1 | Thursday 17 September 2026 15:30:26 +0000 (0:00:03.387) 0:06:22.158 **** 2026-09-17 15:30:27.952024 | mon1 | ok: [mon1] 2026-09-17 15:30:27.952095 | mon1 | 2026-09-17 15:30:27.952112 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-09-17 15:30:27.952128 | mon1 | Thursday 17 September 2026 15:30:27 +0000 (0:00:01.026) 0:06:23.185 **** 2026-09-17 15:30:28.252000 | mon1 | ok: [mon1] 2026-09-17 15:30:28.252061 | mon1 | 2026-09-17 15:30:28.252075 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-09-17 15:30:28.252088 | mon1 | Thursday 17 September 2026 15:30:28 +0000 (0:00:00.299) 0:06:23.485 **** 2026-09-17 15:30:28.876077 | mon1 | ok: [mon1] 2026-09-17 15:30:28.876170 | mon1 | 2026-09-17 15:30:28.876192 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-09-17 15:30:28.876206 | mon1 | Thursday 17 September 2026 15:30:28 +0000 (0:00:00.623) 0:06:24.108 **** 2026-09-17 15:30:29.657479 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-09-17 15:30:29.657610 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-09-17 15:30:29.658651 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-09-17 15:30:29.658687 | mon1 | 2026-09-17 15:30:29.658701 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-09-17 15:30:29.658713 | mon1 | Thursday 17 September 2026 15:30:29 +0000 (0:00:00.782) 0:06:24.891 **** 2026-09-17 15:30:30.239079 | mon1 | ok: [mon1] 2026-09-17 15:30:30.239146 | mon1 | 2026-09-17 15:30:30.239159 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-09-17 15:30:30.239172 | mon1 | Thursday 17 September 2026 15:30:30 +0000 (0:00:00.581) 0:06:25.472 **** 2026-09-17 15:30:30.894466 | mon1 | ok: [mon1] 2026-09-17 15:30:30.894539 | mon1 | 2026-09-17 15:30:30.894553 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-09-17 15:30:30.894565 | mon1 | Thursday 17 September 2026 15:30:30 +0000 (0:00:00.637) 0:06:26.109 **** 2026-09-17 15:30:30.894576 | mon1 | 2026-09-17 15:30:30.894594 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-09-17 15:30:30.894728 | mon1 | Thursday 17 September 2026 15:30:30 +0000 (0:00:00.017) 0:06:26.126 **** 2026-09-17 15:30:31.396508 | mon1 | ok: [mon1] 2026-09-17 15:30:31.396699 | mon1 | 2026-09-17 15:30:31.396995 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-09-17 15:30:31.397251 | mon1 | Thursday 17 September 2026 15:30:31 +0000 (0:00:00.504) 0:06:26.630 **** 2026-09-17 15:30:31.478792 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-09-17 15:30:31.478985 | mon1 | 2026-09-17 15:30:31.479221 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-09-17 15:30:31.479488 | mon1 | Thursday 17 September 2026 15:30:31 +0000 (0:00:00.082) 0:06:26.713 **** 2026-09-17 15:30:32.611903 | mon1 | ok: [mon1] 2026-09-17 15:30:32.611997 | mon1 | 2026-09-17 15:30:32.612251 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-09-17 15:30:32.612523 | mon1 | Thursday 17 September 2026 15:30:32 +0000 (0:00:01.132) 0:06:27.845 **** 2026-09-17 15:30:33.491811 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-09-17 15:30:33.491908 | mon1 | ok: [mon1] => (item=ssh) 2026-09-17 15:30:33.492010 | mon1 | 2026-09-17 15:30:33.492153 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-09-17 15:30:33.492295 | mon1 | Thursday 17 September 2026 15:30:33 +0000 (0:00:00.880) 0:06:28.725 **** 2026-09-17 15:30:37.152000 | mon1 | ok: [mon1] 2026-09-17 15:30:37.152110 | mon1 | 2026-09-17 15:30:37.152125 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-09-17 15:30:37.152138 | mon1 | Thursday 17 September 2026 15:30:37 +0000 (0:00:03.659) 0:06:32.385 **** 2026-09-17 15:30:37.434726 | mon1 | ok: [mon1] 2026-09-17 15:30:37.434799 | mon1 | 2026-09-17 15:30:37.434806 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-09-17 15:30:37.434813 | mon1 | Thursday 17 September 2026 15:30:37 +0000 (0:00:00.283) 0:06:32.668 **** 2026-09-17 15:30:37.752447 | mon1 | ok: [mon1] 2026-09-17 15:30:37.752505 | mon1 | 2026-09-17 15:30:37.752512 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-09-17 15:30:37.752528 | mon1 | Thursday 17 September 2026 15:30:37 +0000 (0:00:00.318) 0:06:32.986 **** 2026-09-17 15:30:38.020107 | mon1 | ok: [mon1] 2026-09-17 15:30:38.020137 | mon1 | 2026-09-17 15:30:38.020143 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-09-17 15:30:38.020149 | mon1 | Thursday 17 September 2026 15:30:38 +0000 (0:00:00.268) 0:06:33.254 **** 2026-09-17 15:30:41.387770 | mon1 | changed: [mon1] 2026-09-17 15:30:41.387883 | mon1 | 2026-09-17 15:30:41.387898 | mon1 | PLAY RECAP ********************************************************************* 2026-09-17 15:30:41.387994 | mon1 | mon1 : ok=93 changed=30 unreachable=0 failed=0 skipped=14 rescued=0 ignored=0 2026-09-17 15:30:41.388098 | mon1 | osd1 : ok=58 changed=23 unreachable=0 failed=0 skipped=9 rescued=1 ignored=0 2026-09-17 15:30:41.388194 | mon1 | 2026-09-17 15:30:41.388276 | mon1 | 2026-09-17 15:30:41.388403 | mon1 | TASKS RECAP ******************************************************************** 2026-09-17 15:30:41.388498 | mon1 | Thursday 17 September 2026 15:30:41 +0000 (0:00:03.366) 0:06:36.620 **** 2026-09-17 15:30:41.388595 | mon1 | =============================================================================== 2026-09-17 15:30:41.388707 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 104.11s 2026-09-17 15:30:41.388823 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 54.10s 2026-09-17 15:30:41.388907 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 47.93s 2026-09-17 15:30:41.389006 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 20.04s 2026-09-17 15:30:41.389107 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.06s 2026-09-17 15:30:41.389208 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.97s 2026-09-17 15:30:41.389339 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.53s 2026-09-17 15:30:41.389435 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.03s 2026-09-17 15:30:41.389535 | mon1 | vexxhost.ceph.cephadm : Download "cephadm" ------------------------------ 5.72s 2026-09-17 15:30:41.389644 | mon1 | vexxhost.ceph.osd : Give 5 seconds pause before retry ------------------- 5.06s 2026-09-17 15:30:41.389787 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.85s 2026-09-17 15:30:41.389871 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.76s 2026-09-17 15:30:41.389971 | mon1 | vexxhost.ceph.cephadm : Download "cephadm" ------------------------------ 3.66s 2026-09-17 15:30:41.390069 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.39s 2026-09-17 15:30:41.390168 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 3.37s 2026-09-17 15:30:41.390268 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 3.28s 2026-09-17 15:30:41.393431 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.27s 2026-09-17 15:30:41.393503 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.22s 2026-09-17 15:30:41.393604 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 3.21s 2026-09-17 15:30:41.393719 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.98s 2026-09-17 15:30:41.478348 | mon1 | INFO [default > converge] Executed: Successful 2026-09-17 15:30:41.481435 | mon1 | INFO [default > idempotence] Executing 2026-09-17 15:30:42.535881 | mon1 | 2026-09-17 15:30:42.536243 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-09-17 15:30:42.536541 | mon1 | 2026-09-17 15:30:42.536856 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-09-17 15:30:42.537144 | mon1 | Thursday 17 September 2026 15:30:42 +0000 (0:00:00.049) 0:00:00.049 **** 2026-09-17 15:30:43.834454 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-09-17 15:30:43.834867 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-09-17 15:30:43.835160 | mon1 | interpreter could change the meaning of that path. See 2026-09-17 15:30:43.835546 | mon1 | https://docs.ansible.com/ansible- 2026-09-17 15:30:43.835871 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-09-17 15:30:43.847568 | mon1 | ok: [mon1] 2026-09-17 15:30:43.847942 | mon1 | 2026-09-17 15:30:43.848279 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:30:43.848613 | mon1 | Thursday 17 September 2026 15:30:43 +0000 (0:00:01.311) 0:00:01.361 **** 2026-09-17 15:30:44.207555 | mon1 | ok: [mon1] 2026-09-17 15:30:44.207934 | mon1 | 2026-09-17 15:30:44.208241 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:30:44.208574 | mon1 | Thursday 17 September 2026 15:30:44 +0000 (0:00:00.360) 0:00:01.721 **** 2026-09-17 15:30:44.252228 | mon1 | skipping: [mon1] 2026-09-17 15:30:44.252568 | mon1 | 2026-09-17 15:30:44.252908 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-09-17 15:30:44.253204 | mon1 | Thursday 17 September 2026 15:30:44 +0000 (0:00:00.044) 0:00:01.766 **** 2026-09-17 15:30:44.619542 | mon1 | ok: [mon1] 2026-09-17 15:30:44.619729 | mon1 | 2026-09-17 15:30:44.619864 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:30:44.620009 | mon1 | Thursday 17 September 2026 15:30:44 +0000 (0:00:00.367) 0:00:02.133 **** 2026-09-17 15:30:44.701035 | mon1 | ok: [mon1] => { 2026-09-17 15:30:44.701440 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-09-17 15:30:44.701785 | mon1 | } 2026-09-17 15:30:44.702114 | mon1 | 2026-09-17 15:30:44.702532 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:30:44.702959 | mon1 | Thursday 17 September 2026 15:30:44 +0000 (0:00:00.081) 0:00:02.214 **** 2026-09-17 15:30:45.192720 | mon1 | ok: [mon1] 2026-09-17 15:30:45.193121 | mon1 | 2026-09-17 15:30:45.193546 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:30:45.193966 | mon1 | Thursday 17 September 2026 15:30:45 +0000 (0:00:00.490) 0:00:02.705 **** 2026-09-17 15:30:45.254778 | mon1 | skipping: [mon1] 2026-09-17 15:30:45.254862 | mon1 | 2026-09-17 15:30:45.255023 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:30:45.255165 | mon1 | Thursday 17 September 2026 15:30:45 +0000 (0:00:00.062) 0:00:02.768 **** 2026-09-17 15:30:45.326155 | mon1 | skipping: [mon1] 2026-09-17 15:30:45.326178 | mon1 | 2026-09-17 15:30:45.326184 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:30:45.326190 | mon1 | Thursday 17 September 2026 15:30:45 +0000 (0:00:00.070) 0:00:02.838 **** 2026-09-17 15:30:45.619800 | mon1 | ok: [mon1] 2026-09-17 15:30:45.619845 | mon1 | 2026-09-17 15:30:45.619855 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:30:45.619865 | mon1 | Thursday 17 September 2026 15:30:45 +0000 (0:00:00.293) 0:00:03.132 **** 2026-09-17 15:30:47.075787 | mon1 | ok: [mon1] 2026-09-17 15:30:47.075849 | mon1 | 2026-09-17 15:30:47.075862 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:30:47.075875 | mon1 | Thursday 17 September 2026 15:30:47 +0000 (0:00:01.455) 0:00:04.587 **** 2026-09-17 15:30:47.282328 | mon1 | ok: [mon1] => { 2026-09-17 15:30:47.282365 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-09-17 15:30:47.282371 | mon1 | } 2026-09-17 15:30:47.282376 | mon1 | 2026-09-17 15:30:47.282382 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:30:47.282387 | mon1 | Thursday 17 September 2026 15:30:47 +0000 (0:00:00.207) 0:00:04.795 **** 2026-09-17 15:30:47.881047 | mon1 | ok: [mon1] 2026-09-17 15:30:47.881189 | mon1 | 2026-09-17 15:30:47.881480 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:30:47.881739 | mon1 | Thursday 17 September 2026 15:30:47 +0000 (0:00:00.596) 0:00:05.391 **** 2026-09-17 15:30:50.447809 | mon1 | ok: [mon1] 2026-09-17 15:30:50.447872 | mon1 | 2026-09-17 15:30:50.447885 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-09-17 15:30:50.447898 | mon1 | Thursday 17 September 2026 15:30:50 +0000 (0:00:02.565) 0:00:07.957 **** 2026-09-17 15:30:50.489848 | mon1 | skipping: [mon1] 2026-09-17 15:30:50.490013 | mon1 | 2026-09-17 15:30:50.490157 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-09-17 15:30:50.490326 | mon1 | Thursday 17 September 2026 15:30:50 +0000 (0:00:00.045) 0:00:08.002 **** 2026-09-17 15:30:50.535104 | mon1 | skipping: [mon1] 2026-09-17 15:30:50.535494 | mon1 | 2026-09-17 15:30:50.535873 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-09-17 15:30:50.536202 | mon1 | Thursday 17 September 2026 15:30:50 +0000 (0:00:00.044) 0:00:08.047 **** 2026-09-17 15:30:50.573753 | mon1 | skipping: [mon1] 2026-09-17 15:30:50.573970 | mon1 | 2026-09-17 15:30:50.574209 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-09-17 15:30:50.574448 | mon1 | Thursday 17 September 2026 15:30:50 +0000 (0:00:00.039) 0:00:08.086 **** 2026-09-17 15:30:51.535204 | mon1 | ok: [mon1] 2026-09-17 15:30:51.535565 | mon1 | 2026-09-17 15:30:51.535917 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-09-17 15:30:51.536244 | mon1 | Thursday 17 September 2026 15:30:51 +0000 (0:00:00.960) 0:00:09.047 **** 2026-09-17 15:30:52.177505 | mon1 | ok: [mon1] 2026-09-17 15:30:52.177968 | mon1 | 2026-09-17 15:30:52.178346 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-09-17 15:30:52.178704 | mon1 | Thursday 17 September 2026 15:30:52 +0000 (0:00:00.641) 0:00:09.688 **** 2026-09-17 15:30:53.429021 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-09-17 15:30:53.430658 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-09-17 15:30:53.430705 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-09-17 15:30:53.430715 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-09-17 15:30:53.430723 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-09-17 15:30:53.430732 | mon1 | 2026-09-17 15:30:53.430741 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-09-17 15:30:53.430750 | mon1 | Thursday 17 September 2026 15:30:53 +0000 (0:00:01.253) 0:00:10.941 **** 2026-09-17 15:30:54.145718 | mon1 | ok: [mon1] 2026-09-17 15:30:54.145780 | mon1 | 2026-09-17 15:30:54.145791 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-09-17 15:30:54.145801 | mon1 | Thursday 17 September 2026 15:30:54 +0000 (0:00:00.696) 0:00:11.637 **** 2026-09-17 15:30:54.145811 | mon1 | 2026-09-17 15:30:54.145820 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-09-17 15:30:54.145829 | mon1 | Thursday 17 September 2026 15:30:54 +0000 (0:00:00.018) 0:00:11.656 **** 2026-09-17 15:30:54.852786 | mon1 | ok: [mon1] 2026-09-17 15:30:54.852832 | mon1 | 2026-09-17 15:30:54.852842 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:30:54.852851 | mon1 | Thursday 17 September 2026 15:30:54 +0000 (0:00:00.708) 0:00:12.365 **** 2026-09-17 15:30:55.147922 | mon1 | ok: [mon1] 2026-09-17 15:30:55.147971 | mon1 | 2026-09-17 15:30:55.147981 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:30:55.147991 | mon1 | Thursday 17 September 2026 15:30:55 +0000 (0:00:00.294) 0:00:12.659 **** 2026-09-17 15:30:55.248211 | mon1 | ok: [mon1] => { 2026-09-17 15:30:55.248251 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-09-17 15:30:55.248260 | mon1 | } 2026-09-17 15:30:55.248269 | mon1 | 2026-09-17 15:30:55.248278 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:30:55.248287 | mon1 | Thursday 17 September 2026 15:30:55 +0000 (0:00:00.100) 0:00:12.760 **** 2026-09-17 15:30:55.720114 | mon1 | ok: [mon1] 2026-09-17 15:30:55.720143 | mon1 | 2026-09-17 15:30:55.720148 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:30:55.720153 | mon1 | Thursday 17 September 2026 15:30:55 +0000 (0:00:00.472) 0:00:13.232 **** 2026-09-17 15:31:00.092251 | mon1 | ok: [mon1] 2026-09-17 15:31:00.092284 | mon1 | 2026-09-17 15:31:00.092289 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-09-17 15:31:00.092294 | mon1 | Thursday 17 September 2026 15:31:00 +0000 (0:00:04.372) 0:00:17.605 **** 2026-09-17 15:31:01.101054 | mon1 | ok: [mon1] 2026-09-17 15:31:01.101101 | mon1 | 2026-09-17 15:31:01.101107 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-09-17 15:31:01.101113 | mon1 | Thursday 17 September 2026 15:31:01 +0000 (0:00:01.008) 0:00:18.614 **** 2026-09-17 15:31:01.501357 | mon1 | ok: [mon1] 2026-09-17 15:31:01.501401 | mon1 | 2026-09-17 15:31:01.501411 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-09-17 15:31:01.501419 | mon1 | Thursday 17 September 2026 15:31:01 +0000 (0:00:00.399) 0:00:19.013 **** 2026-09-17 15:31:02.116420 | mon1 | ok: [mon1] 2026-09-17 15:31:02.116470 | mon1 | 2026-09-17 15:31:02.116484 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-09-17 15:31:02.116518 | mon1 | Thursday 17 September 2026 15:31:02 +0000 (0:00:00.612) 0:00:19.626 **** 2026-09-17 15:31:02.913324 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-09-17 15:31:02.913360 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-09-17 15:31:02.913364 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-09-17 15:31:02.913369 | mon1 | 2026-09-17 15:31:02.913373 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-09-17 15:31:02.913377 | mon1 | Thursday 17 September 2026 15:31:02 +0000 (0:00:00.798) 0:00:20.425 **** 2026-09-17 15:31:03.507759 | mon1 | ok: [mon1] 2026-09-17 15:31:03.507805 | mon1 | 2026-09-17 15:31:03.507815 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-09-17 15:31:03.507824 | mon1 | Thursday 17 September 2026 15:31:03 +0000 (0:00:00.594) 0:00:21.019 **** 2026-09-17 15:31:04.167475 | mon1 | ok: [mon1] 2026-09-17 15:31:04.167555 | mon1 | 2026-09-17 15:31:04.167566 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-09-17 15:31:04.167582 | mon1 | Thursday 17 September 2026 15:31:04 +0000 (0:00:00.646) 0:00:21.666 **** 2026-09-17 15:31:04.168022 | mon1 | 2026-09-17 15:31:04.168058 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-09-17 15:31:04.168065 | mon1 | Thursday 17 September 2026 15:31:04 +0000 (0:00:00.013) 0:00:21.679 **** 2026-09-17 15:31:04.647320 | mon1 | ok: [mon1] 2026-09-17 15:31:04.647348 | mon1 | 2026-09-17 15:31:04.647352 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-09-17 15:31:04.647357 | mon1 | Thursday 17 September 2026 15:31:04 +0000 (0:00:00.478) 0:00:22.158 **** 2026-09-17 15:31:04.728864 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-09-17 15:31:04.728916 | mon1 | 2026-09-17 15:31:04.728926 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-09-17 15:31:04.728936 | mon1 | Thursday 17 September 2026 15:31:04 +0000 (0:00:00.082) 0:00:22.241 **** 2026-09-17 15:31:05.760423 | mon1 | ok: [mon1] 2026-09-17 15:31:05.760506 | mon1 | 2026-09-17 15:31:05.760979 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-09-17 15:31:05.761029 | mon1 | Thursday 17 September 2026 15:31:05 +0000 (0:00:01.031) 0:00:23.272 **** 2026-09-17 15:31:07.679410 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-09-17 15:31:07.679480 | mon1 | ok: [mon1] => (item=ssh) 2026-09-17 15:31:07.679494 | mon1 | 2026-09-17 15:31:07.679507 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-09-17 15:31:07.679543 | mon1 | Thursday 17 September 2026 15:31:07 +0000 (0:00:01.917) 0:00:25.190 **** 2026-09-17 15:31:08.617147 | mon1 | ok: [mon1] 2026-09-17 15:31:08.617199 | mon1 | 2026-09-17 15:31:08.617213 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-09-17 15:31:08.617225 | mon1 | Thursday 17 September 2026 15:31:08 +0000 (0:00:00.938) 0:00:26.128 **** 2026-09-17 15:31:08.905802 | mon1 | ok: [mon1] 2026-09-17 15:31:08.905960 | mon1 | 2026-09-17 15:31:08.906167 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-09-17 15:31:08.906359 | mon1 | Thursday 17 September 2026 15:31:08 +0000 (0:00:00.289) 0:00:26.417 **** 2026-09-17 15:31:09.487395 | mon1 | ok: [mon1] 2026-09-17 15:31:09.487445 | mon1 | 2026-09-17 15:31:09.487782 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-09-17 15:31:09.487813 | mon1 | Thursday 17 September 2026 15:31:09 +0000 (0:00:00.581) 0:00:26.999 **** 2026-09-17 15:31:09.890865 | mon1 | ok: [mon1] 2026-09-17 15:31:09.890921 | mon1 | 2026-09-17 15:31:09.890934 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-09-17 15:31:09.890946 | mon1 | Thursday 17 September 2026 15:31:09 +0000 (0:00:00.402) 0:00:27.402 **** 2026-09-17 15:31:09.990430 | mon1 | ok: [mon1] 2026-09-17 15:31:09.990500 | mon1 | 2026-09-17 15:31:09.990968 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-09-17 15:31:09.991027 | mon1 | Thursday 17 September 2026 15:31:09 +0000 (0:00:00.100) 0:00:27.503 **** 2026-09-17 15:31:10.315896 | mon1 | ok: [mon1] => (item=mon1) 2026-09-17 15:31:10.315952 | mon1 | 2026-09-17 15:31:10.315962 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-09-17 15:31:10.315971 | mon1 | Thursday 17 September 2026 15:31:10 +0000 (0:00:00.324) 0:00:27.827 **** 2026-09-17 15:31:10.403201 | mon1 | ok: [mon1] 2026-09-17 15:31:10.403250 | mon1 | 2026-09-17 15:31:10.403256 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-09-17 15:31:10.403262 | mon1 | Thursday 17 September 2026 15:31:10 +0000 (0:00:00.088) 0:00:27.915 **** 2026-09-17 15:31:10.466828 | mon1 | skipping: [mon1] 2026-09-17 15:31:10.466880 | mon1 | 2026-09-17 15:31:10.466890 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-09-17 15:31:10.466900 | mon1 | Thursday 17 September 2026 15:31:10 +0000 (0:00:00.063) 0:00:27.979 **** 2026-09-17 15:31:10.562698 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-09-17 15:31:10.562736 | mon1 | 2026-09-17 15:31:10.562746 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-09-17 15:31:10.562772 | mon1 | Thursday 17 September 2026 15:31:10 +0000 (0:00:00.095) 0:00:28.074 **** 2026-09-17 15:31:12.521844 | mon1 | ok: [mon1] 2026-09-17 15:31:12.521950 | mon1 | 2026-09-17 15:31:12.521965 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-09-17 15:31:12.521977 | mon1 | Thursday 17 September 2026 15:31:12 +0000 (0:00:01.958) 0:00:30.033 **** 2026-09-17 15:31:12.616515 | mon1 | ok: [mon1] => (item=mon1) 2026-09-17 15:31:12.616569 | mon1 | 2026-09-17 15:31:12.616995 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-09-17 15:31:12.617045 | mon1 | Thursday 17 September 2026 15:31:12 +0000 (0:00:00.094) 0:00:30.128 **** 2026-09-17 15:31:13.115688 | mon1 | ok: [mon1] 2026-09-17 15:31:13.115761 | mon1 | 2026-09-17 15:31:13.115869 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-09-17 15:31:13.115976 | mon1 | Thursday 17 September 2026 15:31:13 +0000 (0:00:00.500) 0:00:30.628 **** 2026-09-17 15:31:15.780558 | mon1 | ok: [mon1] 2026-09-17 15:31:15.780625 | mon1 | 2026-09-17 15:31:15.780797 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-09-17 15:31:15.780948 | mon1 | Thursday 17 September 2026 15:31:15 +0000 (0:00:02.664) 0:00:33.293 **** 2026-09-17 15:31:17.699454 | mon1 | ok: [mon1] 2026-09-17 15:31:17.699559 | mon1 | 2026-09-17 15:31:17.699567 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-09-17 15:31:17.699575 | mon1 | Thursday 17 September 2026 15:31:17 +0000 (0:00:01.917) 0:00:35.211 **** 2026-09-17 15:31:19.547721 | mon1 | ok: [mon1] 2026-09-17 15:31:19.547809 | mon1 | 2026-09-17 15:31:19.547942 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-09-17 15:31:19.548073 | mon1 | Thursday 17 September 2026 15:31:19 +0000 (0:00:01.849) 0:00:37.061 **** 2026-09-17 15:31:19.605863 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-09-17 15:31:19.605924 | mon1 | 2026-09-17 15:31:19.605951 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-09-17 15:31:19.605963 | mon1 | Thursday 17 September 2026 15:31:19 +0000 (0:00:00.057) 0:00:37.118 **** 2026-09-17 15:31:19.670659 | mon1 | skipping: [mon1] 2026-09-17 15:31:19.670692 | mon1 | 2026-09-17 15:31:19.670705 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-09-17 15:31:19.670717 | mon1 | Thursday 17 September 2026 15:31:19 +0000 (0:00:00.064) 0:00:37.183 **** 2026-09-17 15:31:19.723902 | mon1 | skipping: [mon1] => (item=mon1) 2026-09-17 15:31:19.723935 | mon1 | skipping: [mon1] 2026-09-17 15:31:19.723950 | mon1 | 2026-09-17 15:31:19.723964 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-09-17 15:31:19.723976 | mon1 | Thursday 17 September 2026 15:31:19 +0000 (0:00:00.052) 0:00:37.236 **** 2026-09-17 15:31:20.086527 | mon1 | ok: [mon1] 2026-09-17 15:31:20.086618 | mon1 | 2026-09-17 15:31:20.086638 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-09-17 15:31:20.086879 | mon1 | Thursday 17 September 2026 15:31:20 +0000 (0:00:00.361) 0:00:37.598 **** 2026-09-17 15:31:22.686127 | mon1 | ok: [mon1] 2026-09-17 15:31:22.686212 | mon1 | 2026-09-17 15:31:22.686221 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-09-17 15:31:22.686228 | mon1 | Thursday 17 September 2026 15:31:22 +0000 (0:00:02.600) 0:00:40.198 **** 2026-09-17 15:31:24.482084 | mon1 | ok: [mon1] 2026-09-17 15:31:24.482161 | mon1 | 2026-09-17 15:31:24.482175 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-09-17 15:31:24.482189 | mon1 | Thursday 17 September 2026 15:31:24 +0000 (0:00:01.795) 0:00:41.993 **** 2026-09-17 15:31:26.285008 | mon1 | ok: [mon1] 2026-09-17 15:31:26.285094 | mon1 | 2026-09-17 15:31:26.285107 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-09-17 15:31:26.285120 | mon1 | Thursday 17 September 2026 15:31:26 +0000 (0:00:01.802) 0:00:43.795 **** 2026-09-17 15:31:33.886513 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-09-17 15:31:33.886610 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-09-17 15:31:33.886624 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-09-17 15:31:33.886644 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-09-17 15:31:33.887285 | mon1 | 2026-09-17 15:31:33.887376 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-09-17 15:31:33.887387 | mon1 | 2026-09-17 15:31:33.887396 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-09-17 15:31:33.887421 | mon1 | Thursday 17 September 2026 15:31:33 +0000 (0:00:07.602) 0:00:51.398 **** 2026-09-17 15:31:35.171644 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-09-17 15:31:35.171695 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-09-17 15:31:35.171704 | mon1 | interpreter could change the meaning of that path. See 2026-09-17 15:31:35.171712 | mon1 | https://docs.ansible.com/ansible- 2026-09-17 15:31:35.171721 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-09-17 15:31:35.190604 | mon1 | ok: [osd1] 2026-09-17 15:31:35.190639 | mon1 | 2026-09-17 15:31:35.190652 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:31:35.190663 | mon1 | Thursday 17 September 2026 15:31:35 +0000 (0:00:01.303) 0:00:52.702 **** 2026-09-17 15:31:35.483264 | mon1 | ok: [osd1] 2026-09-17 15:31:35.483334 | mon1 | 2026-09-17 15:31:35.483342 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:31:35.483348 | mon1 | Thursday 17 September 2026 15:31:35 +0000 (0:00:00.293) 0:00:52.995 **** 2026-09-17 15:31:35.539002 | mon1 | skipping: [osd1] 2026-09-17 15:31:35.539065 | mon1 | 2026-09-17 15:31:35.539083 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-09-17 15:31:35.539099 | mon1 | Thursday 17 September 2026 15:31:35 +0000 (0:00:00.055) 0:00:53.050 **** 2026-09-17 15:31:35.851765 | mon1 | ok: [osd1] 2026-09-17 15:31:35.851814 | mon1 | 2026-09-17 15:31:35.851828 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:31:35.851840 | mon1 | Thursday 17 September 2026 15:31:35 +0000 (0:00:00.310) 0:00:53.360 **** 2026-09-17 15:31:35.952200 | mon1 | ok: [osd1] => { 2026-09-17 15:31:35.952246 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-09-17 15:31:35.952259 | mon1 | } 2026-09-17 15:31:35.952271 | mon1 | 2026-09-17 15:31:35.952282 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:31:35.952294 | mon1 | Thursday 17 September 2026 15:31:35 +0000 (0:00:00.103) 0:00:53.463 **** 2026-09-17 15:31:36.389840 | mon1 | ok: [osd1] 2026-09-17 15:31:36.389896 | mon1 | 2026-09-17 15:31:36.389909 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:31:36.389942 | mon1 | Thursday 17 September 2026 15:31:36 +0000 (0:00:00.437) 0:00:53.901 **** 2026-09-17 15:31:36.449634 | mon1 | skipping: [osd1] 2026-09-17 15:31:36.449672 | mon1 | 2026-09-17 15:31:36.449680 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:31:36.449688 | mon1 | Thursday 17 September 2026 15:31:36 +0000 (0:00:00.060) 0:00:53.962 **** 2026-09-17 15:31:36.498582 | mon1 | skipping: [osd1] 2026-09-17 15:31:36.498615 | mon1 | 2026-09-17 15:31:36.498625 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:31:36.498634 | mon1 | Thursday 17 September 2026 15:31:36 +0000 (0:00:00.048) 0:00:54.010 **** 2026-09-17 15:31:36.759796 | mon1 | ok: [osd1] 2026-09-17 15:31:36.759841 | mon1 | 2026-09-17 15:31:36.759851 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:31:36.759861 | mon1 | Thursday 17 September 2026 15:31:36 +0000 (0:00:00.260) 0:00:54.271 **** 2026-09-17 15:31:37.776669 | mon1 | ok: [osd1] 2026-09-17 15:31:37.776741 | mon1 | 2026-09-17 15:31:37.776746 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:31:37.776752 | mon1 | Thursday 17 September 2026 15:31:37 +0000 (0:00:01.016) 0:00:55.288 **** 2026-09-17 15:31:38.000446 | mon1 | ok: [osd1] => { 2026-09-17 15:31:38.000479 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-09-17 15:31:38.000487 | mon1 | } 2026-09-17 15:31:38.000849 | mon1 | 2026-09-17 15:31:38.000904 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:31:38.000911 | mon1 | Thursday 17 September 2026 15:31:37 +0000 (0:00:00.223) 0:00:55.512 **** 2026-09-17 15:31:38.615467 | mon1 | ok: [osd1] 2026-09-17 15:31:38.615571 | mon1 | 2026-09-17 15:31:38.616190 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:31:38.616246 | mon1 | Thursday 17 September 2026 15:31:38 +0000 (0:00:00.614) 0:00:56.127 **** 2026-09-17 15:31:40.996494 | mon1 | ok: [osd1] 2026-09-17 15:31:40.996608 | mon1 | 2026-09-17 15:31:40.997207 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-09-17 15:31:40.997268 | mon1 | Thursday 17 September 2026 15:31:40 +0000 (0:00:02.380) 0:00:58.508 **** 2026-09-17 15:31:41.033637 | mon1 | skipping: [osd1] 2026-09-17 15:31:41.033698 | mon1 | 2026-09-17 15:31:41.033706 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-09-17 15:31:41.033715 | mon1 | Thursday 17 September 2026 15:31:41 +0000 (0:00:00.038) 0:00:58.546 **** 2026-09-17 15:31:41.079874 | mon1 | skipping: [osd1] 2026-09-17 15:31:41.079938 | mon1 | 2026-09-17 15:31:41.079950 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-09-17 15:31:41.079962 | mon1 | Thursday 17 September 2026 15:31:41 +0000 (0:00:00.045) 0:00:58.592 **** 2026-09-17 15:31:41.128442 | mon1 | skipping: [osd1] 2026-09-17 15:31:41.128496 | mon1 | 2026-09-17 15:31:41.128505 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-09-17 15:31:41.128515 | mon1 | Thursday 17 September 2026 15:31:41 +0000 (0:00:00.048) 0:00:58.640 **** 2026-09-17 15:31:42.210425 | mon1 | ok: [osd1] 2026-09-17 15:31:42.210502 | mon1 | 2026-09-17 15:31:42.210512 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-09-17 15:31:42.210522 | mon1 | Thursday 17 September 2026 15:31:42 +0000 (0:00:01.080) 0:00:59.721 **** 2026-09-17 15:31:42.825286 | mon1 | ok: [osd1] 2026-09-17 15:31:42.825581 | mon1 | 2026-09-17 15:31:42.825844 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-09-17 15:31:42.826085 | mon1 | Thursday 17 September 2026 15:31:42 +0000 (0:00:00.616) 0:01:00.337 **** 2026-09-17 15:31:44.089963 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-09-17 15:31:44.090404 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-09-17 15:31:44.090728 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-09-17 15:31:44.091034 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-09-17 15:31:44.091618 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-09-17 15:31:44.091903 | mon1 | 2026-09-17 15:31:44.092194 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-09-17 15:31:44.092568 | mon1 | Thursday 17 September 2026 15:31:44 +0000 (0:00:01.265) 0:01:01.602 **** 2026-09-17 15:31:44.830985 | mon1 | ok: [osd1] 2026-09-17 15:31:44.831198 | mon1 | 2026-09-17 15:31:44.831409 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-09-17 15:31:44.831967 | mon1 | Thursday 17 September 2026 15:31:44 +0000 (0:00:00.733) 0:01:02.336 **** 2026-09-17 15:31:44.831978 | mon1 | 2026-09-17 15:31:44.831983 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-09-17 15:31:44.831987 | mon1 | Thursday 17 September 2026 15:31:44 +0000 (0:00:00.006) 0:01:02.343 **** 2026-09-17 15:31:45.333942 | mon1 | ok: [osd1] 2026-09-17 15:31:45.334014 | mon1 | 2026-09-17 15:31:45.334025 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:31:45.334035 | mon1 | Thursday 17 September 2026 15:31:45 +0000 (0:00:00.501) 0:01:02.845 **** 2026-09-17 15:31:45.632941 | mon1 | ok: [osd1] 2026-09-17 15:31:45.633002 | mon1 | 2026-09-17 15:31:45.633011 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:31:45.633021 | mon1 | Thursday 17 September 2026 15:31:45 +0000 (0:00:00.299) 0:01:03.144 **** 2026-09-17 15:31:45.738212 | mon1 | ok: [osd1] => { 2026-09-17 15:31:45.738264 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-09-17 15:31:45.738273 | mon1 | } 2026-09-17 15:31:45.738283 | mon1 | 2026-09-17 15:31:45.738292 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:31:45.738301 | mon1 | Thursday 17 September 2026 15:31:45 +0000 (0:00:00.105) 0:01:03.249 **** 2026-09-17 15:31:46.171511 | mon1 | ok: [osd1] 2026-09-17 15:31:46.171573 | mon1 | 2026-09-17 15:31:46.172103 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:31:46.172146 | mon1 | Thursday 17 September 2026 15:31:46 +0000 (0:00:00.433) 0:01:03.683 **** 2026-09-17 15:31:49.558535 | mon1 | ok: [osd1] 2026-09-17 15:31:49.558622 | mon1 | 2026-09-17 15:31:49.559053 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-09-17 15:31:49.559108 | mon1 | Thursday 17 September 2026 15:31:49 +0000 (0:00:03.386) 0:01:07.070 **** 2026-09-17 15:31:50.551997 | mon1 | ok: [osd1] 2026-09-17 15:31:50.552061 | mon1 | 2026-09-17 15:31:50.552072 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-09-17 15:31:50.552081 | mon1 | Thursday 17 September 2026 15:31:50 +0000 (0:00:00.993) 0:01:08.063 **** 2026-09-17 15:31:50.816507 | mon1 | ok: [osd1] 2026-09-17 15:31:50.816610 | mon1 | 2026-09-17 15:31:50.816639 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-09-17 15:31:50.816651 | mon1 | Thursday 17 September 2026 15:31:50 +0000 (0:00:00.263) 0:01:08.327 **** 2026-09-17 15:31:51.441633 | mon1 | ok: [osd1] 2026-09-17 15:31:51.441693 | mon1 | 2026-09-17 15:31:51.441709 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-09-17 15:31:51.441963 | mon1 | Thursday 17 September 2026 15:31:51 +0000 (0:00:00.625) 0:01:08.953 **** 2026-09-17 15:31:52.172244 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-09-17 15:31:52.172357 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-09-17 15:31:52.172373 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-09-17 15:31:52.172381 | mon1 | 2026-09-17 15:31:52.172388 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-09-17 15:31:52.172396 | mon1 | Thursday 17 September 2026 15:31:52 +0000 (0:00:00.730) 0:01:09.684 **** 2026-09-17 15:31:52.779421 | mon1 | ok: [osd1] 2026-09-17 15:31:52.779477 | mon1 | 2026-09-17 15:31:52.779724 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-09-17 15:31:52.779827 | mon1 | Thursday 17 September 2026 15:31:52 +0000 (0:00:00.607) 0:01:10.291 **** 2026-09-17 15:31:53.355873 | mon1 | ok: [osd1] 2026-09-17 15:31:53.355960 | mon1 | 2026-09-17 15:31:53.355970 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-09-17 15:31:53.355980 | mon1 | Thursday 17 September 2026 15:31:53 +0000 (0:00:00.562) 0:01:10.853 **** 2026-09-17 15:31:53.355989 | mon1 | 2026-09-17 15:31:53.355997 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-09-17 15:31:53.356006 | mon1 | Thursday 17 September 2026 15:31:53 +0000 (0:00:00.012) 0:01:10.866 **** 2026-09-17 15:31:53.858478 | mon1 | ok: [osd1] 2026-09-17 15:31:53.858559 | mon1 | 2026-09-17 15:31:53.858571 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-09-17 15:31:53.858871 | mon1 | Thursday 17 September 2026 15:31:53 +0000 (0:00:00.504) 0:01:11.370 **** 2026-09-17 15:31:53.936706 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-09-17 15:31:53.936751 | mon1 | 2026-09-17 15:31:53.936761 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-09-17 15:31:53.936771 | mon1 | Thursday 17 September 2026 15:31:53 +0000 (0:00:00.077) 0:01:11.448 **** 2026-09-17 15:31:54.947905 | mon1 | ok: [osd1] 2026-09-17 15:31:54.947959 | mon1 | 2026-09-17 15:31:54.947971 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-09-17 15:31:54.947982 | mon1 | Thursday 17 September 2026 15:31:54 +0000 (0:00:01.011) 0:01:12.460 **** 2026-09-17 15:31:56.825528 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-09-17 15:31:56.827362 | mon1 | ok: [osd1] => (item=ssh) 2026-09-17 15:31:56.827379 | mon1 | 2026-09-17 15:31:56.828292 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-09-17 15:31:56.828370 | mon1 | Thursday 17 September 2026 15:31:56 +0000 (0:00:01.875) 0:01:14.336 **** 2026-09-17 15:31:57.679499 | mon1 | ok: [osd1] 2026-09-17 15:31:57.680219 | mon1 | 2026-09-17 15:31:57.680242 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-09-17 15:31:57.680253 | mon1 | Thursday 17 September 2026 15:31:57 +0000 (0:00:00.854) 0:01:15.191 **** 2026-09-17 15:31:57.954786 | mon1 | ok: [osd1] 2026-09-17 15:31:57.954885 | mon1 | 2026-09-17 15:31:57.954891 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-09-17 15:31:57.955005 | mon1 | Thursday 17 September 2026 15:31:57 +0000 (0:00:00.276) 0:01:15.468 **** 2026-09-17 15:31:58.261419 | mon1 | ok: [osd1] 2026-09-17 15:31:58.261482 | mon1 | 2026-09-17 15:31:58.261801 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-09-17 15:31:58.261846 | mon1 | Thursday 17 September 2026 15:31:58 +0000 (0:00:00.305) 0:01:15.773 **** 2026-09-17 15:31:58.553851 | mon1 | ok: [osd1] 2026-09-17 15:31:58.553915 | mon1 | 2026-09-17 15:31:58.553925 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-09-17 15:31:58.553935 | mon1 | Thursday 17 September 2026 15:31:58 +0000 (0:00:00.291) 0:01:16.065 **** 2026-09-17 15:31:58.868880 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-09-17 15:31:58.868930 | mon1 | 2026-09-17 15:31:58.868942 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-09-17 15:31:58.868952 | mon1 | Thursday 17 September 2026 15:31:58 +0000 (0:00:00.315) 0:01:16.381 **** 2026-09-17 15:31:58.950129 | mon1 | ok: [osd1] 2026-09-17 15:31:58.950196 | mon1 | 2026-09-17 15:31:58.950207 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-09-17 15:31:58.950217 | mon1 | Thursday 17 September 2026 15:31:58 +0000 (0:00:00.080) 0:01:16.461 **** 2026-09-17 15:31:59.033514 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-09-17 15:31:59.033565 | mon1 | 2026-09-17 15:31:59.033583 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-09-17 15:31:59.033825 | mon1 | Thursday 17 September 2026 15:31:59 +0000 (0:00:00.085) 0:01:16.546 **** 2026-09-17 15:32:00.846257 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-09-17 15:32:00.846366 | mon1 | 2026-09-17 15:32:00.846477 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-09-17 15:32:00.846741 | mon1 | Thursday 17 September 2026 15:32:00 +0000 (0:00:01.812) 0:01:18.358 **** 2026-09-17 15:32:00.908354 | mon1 | ok: [osd1] => (item=osd1) 2026-09-17 15:32:00.908404 | mon1 | 2026-09-17 15:32:00.908411 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-09-17 15:32:00.908418 | mon1 | Thursday 17 September 2026 15:32:00 +0000 (0:00:00.061) 0:01:18.420 **** 2026-09-17 15:32:01.257300 | mon1 | ok: [osd1] 2026-09-17 15:32:01.257374 | mon1 | 2026-09-17 15:32:01.257380 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-09-17 15:32:01.257387 | mon1 | Thursday 17 September 2026 15:32:01 +0000 (0:00:00.349) 0:01:18.769 **** 2026-09-17 15:32:03.875243 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-09-17 15:32:03.875383 | mon1 | 2026-09-17 15:32:03.875490 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-09-17 15:32:03.875631 | mon1 | Thursday 17 September 2026 15:32:03 +0000 (0:00:02.617) 0:01:21.387 **** 2026-09-17 15:32:10.031500 | mon1 | ok: [osd1] 2026-09-17 15:32:10.031592 | mon1 | 2026-09-17 15:32:10.031611 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-09-17 15:32:10.031635 | mon1 | Thursday 17 September 2026 15:32:10 +0000 (0:00:06.156) 0:01:27.543 **** 2026-09-17 15:32:11.590085 | mon1 | ok: [osd1] 2026-09-17 15:32:11.590182 | mon1 | 2026-09-17 15:32:11.590196 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-09-17 15:32:11.590209 | mon1 | Thursday 17 September 2026 15:32:11 +0000 (0:00:01.557) 0:01:29.101 **** 2026-09-17 15:32:11.676671 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-09-17 15:32:11.676749 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-09-17 15:32:11.676756 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-09-17 15:32:11.676762 | mon1 | skipping: [osd1] 2026-09-17 15:32:11.676767 | mon1 | 2026-09-17 15:32:11.676773 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-09-17 15:32:11.676779 | mon1 | Thursday 17 September 2026 15:32:11 +0000 (0:00:00.088) 0:01:29.189 **** 2026-09-17 15:32:13.629877 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-09-17 15:32:13.629950 | mon1 | 2026-09-17 15:32:13.629965 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-09-17 15:32:13.629978 | mon1 | Thursday 17 September 2026 15:32:13 +0000 (0:00:01.952) 0:01:31.142 **** 2026-09-17 15:32:15.398358 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-09-17 15:32:15.398655 | mon1 | 2026-09-17 15:32:15.398945 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-09-17 15:32:15.399193 | mon1 | Thursday 17 September 2026 15:32:15 +0000 (0:00:01.768) 0:01:32.910 **** 2026-09-17 15:32:15.486435 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-09-17 15:32:15.486535 | mon1 | 2026-09-17 15:32:15.486878 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-09-17 15:32:15.486915 | mon1 | Thursday 17 September 2026 15:32:15 +0000 (0:00:00.089) 0:01:32.999 **** 2026-09-17 15:32:15.553458 | mon1 | ok: [osd1] 2026-09-17 15:32:15.553516 | mon1 | 2026-09-17 15:32:15.553526 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-09-17 15:32:15.553540 | mon1 | Thursday 17 September 2026 15:32:15 +0000 (0:00:00.067) 0:01:33.066 **** 2026-09-17 15:32:17.355837 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-09-17 15:32:17.355928 | mon1 | 2026-09-17 15:32:17.356054 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-09-17 15:32:17.356202 | mon1 | Thursday 17 September 2026 15:32:17 +0000 (0:00:01.801) 0:01:34.868 **** 2026-09-17 15:32:17.432203 | mon1 | ok: [osd1] 2026-09-17 15:32:17.432283 | mon1 | 2026-09-17 15:32:17.432837 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-09-17 15:32:17.432949 | mon1 | Thursday 17 September 2026 15:32:17 +0000 (0:00:00.076) 0:01:34.945 **** 2026-09-17 15:32:17.492163 | mon1 | skipping: [osd1] => (item=1) 2026-09-17 15:32:17.492246 | mon1 | skipping: [osd1] => (item=1) 2026-09-17 15:32:17.492258 | mon1 | skipping: [osd1] => (item=1) 2026-09-17 15:32:17.492299 | mon1 | skipping: [osd1] 2026-09-17 15:32:17.492349 | mon1 | 2026-09-17 15:32:17.492360 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-09-17 15:32:17.492372 | mon1 | Thursday 17 September 2026 15:32:17 +0000 (0:00:00.059) 0:01:35.004 **** 2026-09-17 15:32:17.575778 | mon1 | skipping: [osd1] 2026-09-17 15:32:17.575857 | mon1 | 2026-09-17 15:32:17.575867 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-09-17 15:32:17.575877 | mon1 | 2026-09-17 15:32:17.575885 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-09-17 15:32:17.575894 | mon1 | Thursday 17 September 2026 15:32:17 +0000 (0:00:00.083) 0:01:35.087 **** 2026-09-17 15:32:18.560495 | mon1 | ok: [mon1] 2026-09-17 15:32:18.560554 | mon1 | 2026-09-17 15:32:18.560565 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:32:18.560580 | mon1 | Thursday 17 September 2026 15:32:18 +0000 (0:00:00.985) 0:01:36.072 **** 2026-09-17 15:32:18.854543 | mon1 | ok: [mon1] 2026-09-17 15:32:18.854613 | mon1 | 2026-09-17 15:32:18.854623 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:32:18.854790 | mon1 | Thursday 17 September 2026 15:32:18 +0000 (0:00:00.294) 0:01:36.367 **** 2026-09-17 15:32:18.946739 | mon1 | skipping: [mon1] 2026-09-17 15:32:18.946904 | mon1 | 2026-09-17 15:32:18.947138 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-09-17 15:32:18.947436 | mon1 | Thursday 17 September 2026 15:32:18 +0000 (0:00:00.093) 0:01:36.460 **** 2026-09-17 15:32:19.208787 | mon1 | ok: [mon1] 2026-09-17 15:32:19.208940 | mon1 | 2026-09-17 15:32:19.209169 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:32:19.209578 | mon1 | Thursday 17 September 2026 15:32:19 +0000 (0:00:00.261) 0:01:36.722 **** 2026-09-17 15:32:19.318543 | mon1 | ok: [mon1] => { 2026-09-17 15:32:19.318825 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-09-17 15:32:19.319058 | mon1 | } 2026-09-17 15:32:19.319239 | mon1 | 2026-09-17 15:32:19.319626 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:32:19.319858 | mon1 | Thursday 17 September 2026 15:32:19 +0000 (0:00:00.109) 0:01:36.831 **** 2026-09-17 15:32:19.704461 | mon1 | ok: [mon1] 2026-09-17 15:32:19.704504 | mon1 | 2026-09-17 15:32:19.704821 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:32:19.704850 | mon1 | Thursday 17 September 2026 15:32:19 +0000 (0:00:00.386) 0:01:37.217 **** 2026-09-17 15:32:19.757667 | mon1 | skipping: [mon1] 2026-09-17 15:32:19.757771 | mon1 | 2026-09-17 15:32:19.757918 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:32:19.758058 | mon1 | Thursday 17 September 2026 15:32:19 +0000 (0:00:00.053) 0:01:37.271 **** 2026-09-17 15:32:19.812647 | mon1 | skipping: [mon1] 2026-09-17 15:32:19.812887 | mon1 | 2026-09-17 15:32:19.812932 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:32:19.812942 | mon1 | Thursday 17 September 2026 15:32:19 +0000 (0:00:00.053) 0:01:37.325 **** 2026-09-17 15:32:20.112399 | mon1 | ok: [mon1] 2026-09-17 15:32:20.112467 | mon1 | 2026-09-17 15:32:20.112772 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-17 15:32:20.113058 | mon1 | Thursday 17 September 2026 15:32:20 +0000 (0:00:00.299) 0:01:37.624 **** 2026-09-17 15:32:21.176359 | mon1 | ok: [mon1] 2026-09-17 15:32:21.177218 | mon1 | 2026-09-17 15:32:21.177236 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:32:21.177340 | mon1 | Thursday 17 September 2026 15:32:21 +0000 (0:00:01.064) 0:01:38.689 **** 2026-09-17 15:32:21.369370 | mon1 | ok: [mon1] => { 2026-09-17 15:32:21.369404 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-09-17 15:32:21.369408 | mon1 | } 2026-09-17 15:32:21.369412 | mon1 | 2026-09-17 15:32:21.369416 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:32:21.369420 | mon1 | Thursday 17 September 2026 15:32:21 +0000 (0:00:00.191) 0:01:38.880 **** 2026-09-17 15:32:21.945229 | mon1 | ok: [mon1] 2026-09-17 15:32:21.945536 | mon1 | 2026-09-17 15:32:21.945805 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:32:21.946054 | mon1 | Thursday 17 September 2026 15:32:21 +0000 (0:00:00.577) 0:01:39.458 **** 2026-09-17 15:32:24.276467 | mon1 | ok: [mon1] 2026-09-17 15:32:24.276517 | mon1 | 2026-09-17 15:32:24.276524 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-09-17 15:32:24.276542 | mon1 | Thursday 17 September 2026 15:32:24 +0000 (0:00:02.328) 0:01:41.786 **** 2026-09-17 15:32:24.308007 | mon1 | skipping: [mon1] 2026-09-17 15:32:24.308214 | mon1 | 2026-09-17 15:32:24.308551 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-09-17 15:32:24.308778 | mon1 | Thursday 17 September 2026 15:32:24 +0000 (0:00:00.035) 0:01:41.821 **** 2026-09-17 15:32:24.340967 | mon1 | skipping: [mon1] 2026-09-17 15:32:24.341177 | mon1 | 2026-09-17 15:32:24.341494 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-09-17 15:32:24.341719 | mon1 | Thursday 17 September 2026 15:32:24 +0000 (0:00:00.032) 0:01:41.854 **** 2026-09-17 15:32:24.385130 | mon1 | skipping: [mon1] 2026-09-17 15:32:24.385369 | mon1 | 2026-09-17 15:32:24.385613 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-09-17 15:32:24.385841 | mon1 | Thursday 17 September 2026 15:32:24 +0000 (0:00:00.044) 0:01:41.898 **** 2026-09-17 15:32:25.319878 | mon1 | ok: [mon1] 2026-09-17 15:32:25.319954 | mon1 | 2026-09-17 15:32:25.319964 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-09-17 15:32:25.320085 | mon1 | Thursday 17 September 2026 15:32:25 +0000 (0:00:00.934) 0:01:42.832 **** 2026-09-17 15:32:25.941971 | mon1 | ok: [mon1] 2026-09-17 15:32:25.942158 | mon1 | 2026-09-17 15:32:25.942459 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-09-17 15:32:25.942700 | mon1 | Thursday 17 September 2026 15:32:25 +0000 (0:00:00.622) 0:01:43.455 **** 2026-09-17 15:32:27.195492 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-09-17 15:32:27.195551 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-09-17 15:32:27.195557 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-09-17 15:32:27.196392 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-09-17 15:32:27.196447 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-09-17 15:32:27.196458 | mon1 | 2026-09-17 15:32:27.196467 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-09-17 15:32:27.196565 | mon1 | Thursday 17 September 2026 15:32:27 +0000 (0:00:01.252) 0:01:44.708 **** 2026-09-17 15:32:27.875509 | mon1 | ok: [mon1] 2026-09-17 15:32:27.875559 | mon1 | 2026-09-17 15:32:27.875569 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-09-17 15:32:27.875579 | mon1 | Thursday 17 September 2026 15:32:27 +0000 (0:00:00.668) 0:01:45.376 **** 2026-09-17 15:32:27.875587 | mon1 | 2026-09-17 15:32:27.875596 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-09-17 15:32:27.875604 | mon1 | Thursday 17 September 2026 15:32:27 +0000 (0:00:00.011) 0:01:45.387 **** 2026-09-17 15:32:28.357207 | mon1 | ok: [mon1] 2026-09-17 15:32:28.357285 | mon1 | 2026-09-17 15:32:28.357296 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-17 15:32:28.357363 | mon1 | Thursday 17 September 2026 15:32:28 +0000 (0:00:00.480) 0:01:45.868 **** 2026-09-17 15:32:28.630335 | mon1 | ok: [mon1] 2026-09-17 15:32:28.630385 | mon1 | 2026-09-17 15:32:28.630392 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-17 15:32:28.630398 | mon1 | Thursday 17 September 2026 15:32:28 +0000 (0:00:00.274) 0:01:46.142 **** 2026-09-17 15:32:28.727910 | mon1 | ok: [mon1] => { 2026-09-17 15:32:28.728083 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-09-17 15:32:28.728329 | mon1 | } 2026-09-17 15:32:28.728553 | mon1 | 2026-09-17 15:32:28.728722 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-17 15:32:28.728904 | mon1 | Thursday 17 September 2026 15:32:28 +0000 (0:00:00.098) 0:01:46.240 **** 2026-09-17 15:32:29.211009 | mon1 | ok: [mon1] 2026-09-17 15:32:29.211088 | mon1 | 2026-09-17 15:32:29.211099 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-17 15:32:29.211108 | mon1 | Thursday 17 September 2026 15:32:29 +0000 (0:00:00.481) 0:01:46.721 **** 2026-09-17 15:32:32.645497 | mon1 | ok: [mon1] 2026-09-17 15:32:32.645549 | mon1 | 2026-09-17 15:32:32.645556 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-09-17 15:32:32.645562 | mon1 | Thursday 17 September 2026 15:32:32 +0000 (0:00:03.435) 0:01:50.157 **** 2026-09-17 15:32:33.691424 | mon1 | ok: [mon1] 2026-09-17 15:32:33.691492 | mon1 | 2026-09-17 15:32:33.691876 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-09-17 15:32:33.691899 | mon1 | Thursday 17 September 2026 15:32:33 +0000 (0:00:01.045) 0:01:51.203 **** 2026-09-17 15:32:33.978257 | mon1 | ok: [mon1] 2026-09-17 15:32:33.978324 | mon1 | 2026-09-17 15:32:33.978332 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-09-17 15:32:33.978337 | mon1 | Thursday 17 September 2026 15:32:33 +0000 (0:00:00.288) 0:01:51.491 **** 2026-09-17 15:32:34.575969 | mon1 | ok: [mon1] 2026-09-17 15:32:34.576001 | mon1 | 2026-09-17 15:32:34.576005 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-09-17 15:32:34.576010 | mon1 | Thursday 17 September 2026 15:32:34 +0000 (0:00:00.597) 0:01:52.088 **** 2026-09-17 15:32:35.345400 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-09-17 15:32:35.345460 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-09-17 15:32:35.346473 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-09-17 15:32:35.346506 | mon1 | 2026-09-17 15:32:35.346518 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-09-17 15:32:35.346527 | mon1 | Thursday 17 September 2026 15:32:35 +0000 (0:00:00.768) 0:01:52.857 **** 2026-09-17 15:32:35.947784 | mon1 | ok: [mon1] 2026-09-17 15:32:35.947834 | mon1 | 2026-09-17 15:32:35.947844 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-09-17 15:32:35.947854 | mon1 | Thursday 17 September 2026 15:32:35 +0000 (0:00:00.603) 0:01:53.460 **** 2026-09-17 15:32:36.552985 | mon1 | ok: [mon1] 2026-09-17 15:32:36.553064 | mon1 | 2026-09-17 15:32:36.553075 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-09-17 15:32:36.553085 | mon1 | Thursday 17 September 2026 15:32:36 +0000 (0:00:00.590) 0:01:54.051 **** 2026-09-17 15:32:36.553094 | mon1 | 2026-09-17 15:32:36.553102 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-09-17 15:32:36.553111 | mon1 | Thursday 17 September 2026 15:32:36 +0000 (0:00:00.013) 0:01:54.064 **** 2026-09-17 15:32:38.073481 | mon1 | ok: [mon1] 2026-09-17 15:32:38.073582 | mon1 | 2026-09-17 15:32:38.073602 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-09-17 15:32:38.073797 | mon1 | Thursday 17 September 2026 15:32:38 +0000 (0:00:01.521) 0:01:55.585 **** 2026-09-17 15:32:38.152801 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-09-17 15:32:38.152997 | mon1 | 2026-09-17 15:32:38.153240 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-09-17 15:32:38.153588 | mon1 | Thursday 17 September 2026 15:32:38 +0000 (0:00:00.079) 0:01:55.665 **** 2026-09-17 15:32:39.077698 | mon1 | ok: [mon1] 2026-09-17 15:32:39.077751 | mon1 | 2026-09-17 15:32:39.077888 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-09-17 15:32:39.077997 | mon1 | Thursday 17 September 2026 15:32:39 +0000 (0:00:00.926) 0:01:56.591 **** 2026-09-17 15:32:40.994526 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-09-17 15:32:40.994632 | mon1 | ok: [mon1] => (item=ssh) 2026-09-17 15:32:40.994648 | mon1 | 2026-09-17 15:32:40.994660 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-09-17 15:32:40.994673 | mon1 | Thursday 17 September 2026 15:32:40 +0000 (0:00:01.914) 0:01:58.506 **** 2026-09-17 15:32:41.523463 | mon1 | ok: [mon1] 2026-09-17 15:32:41.523529 | mon1 | 2026-09-17 15:32:41.523551 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-09-17 15:32:41.523813 | mon1 | Thursday 17 September 2026 15:32:41 +0000 (0:00:00.530) 0:01:59.036 **** 2026-09-17 15:32:41.793100 | mon1 | ok: [mon1] 2026-09-17 15:32:41.793140 | mon1 | 2026-09-17 15:32:41.793145 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-09-17 15:32:41.793150 | mon1 | Thursday 17 September 2026 15:32:41 +0000 (0:00:00.269) 0:01:59.306 **** 2026-09-17 15:32:42.127803 | mon1 | ok: [mon1] 2026-09-17 15:32:42.127863 | mon1 | 2026-09-17 15:32:42.127999 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-09-17 15:32:42.128122 | mon1 | Thursday 17 September 2026 15:32:42 +0000 (0:00:00.334) 0:01:59.641 **** 2026-09-17 15:32:42.395076 | mon1 | ok: [mon1] 2026-09-17 15:32:42.395149 | mon1 | 2026-09-17 15:32:42.395159 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-09-17 15:32:42.395169 | mon1 | Thursday 17 September 2026 15:32:42 +0000 (0:00:00.265) 0:01:59.906 **** 2026-09-17 15:32:44.216438 | mon1 | ok: [mon1] 2026-09-17 15:32:44.216494 | mon1 | 2026-09-17 15:32:44.216506 | mon1 | PLAY RECAP ********************************************************************* 2026-09-17 15:32:44.218364 | mon1 | mon1 : ok=83 changed=0 unreachable=0 failed=0 skipped=15 rescued=0 ignored=0 2026-09-17 15:32:44.218413 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-09-17 15:32:44.218426 | mon1 | 2026-09-17 15:32:44.218440 | mon1 | 2026-09-17 15:32:44.218455 | mon1 | TASKS RECAP ******************************************************************** 2026-09-17 15:32:44.218470 | mon1 | Thursday 17 September 2026 15:32:44 +0000 (0:00:01.822) 0:02:01.728 **** 2026-09-17 15:32:44.218485 | mon1 | =============================================================================== 2026-09-17 15:32:44.218554 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.60s 2026-09-17 15:32:44.218859 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 6.16s 2026-09-17 15:32:44.219147 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.37s 2026-09-17 15:32:44.219519 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.44s 2026-09-17 15:32:44.219835 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.39s 2026-09-17 15:32:44.220120 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.66s 2026-09-17 15:32:44.220471 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.62s 2026-09-17 15:32:44.220805 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.60s 2026-09-17 15:32:44.221100 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.57s 2026-09-17 15:32:44.221440 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.38s 2026-09-17 15:32:44.221777 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.33s 2026-09-17 15:32:44.222096 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.96s 2026-09-17 15:32:44.222436 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 1.95s 2026-09-17 15:32:44.222756 | mon1 | vexxhost.ceph.cephadm : Ensure services are started --------------------- 1.92s 2026-09-17 15:32:44.223043 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 1.92s 2026-09-17 15:32:44.223398 | mon1 | vexxhost.ceph.cephadm : Ensure services are started --------------------- 1.91s 2026-09-17 15:32:44.223712 | mon1 | vexxhost.ceph.cephadm : Ensure services are started --------------------- 1.88s 2026-09-17 15:32:44.224002 | mon1 | vexxhost.ceph.mon : Validate monitor exist ------------------------------ 1.85s 2026-09-17 15:32:44.224344 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 1.82s 2026-09-17 15:32:44.224651 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.81s 2026-09-17 15:32:44.388853 | mon1 | INFO [default > idempotence] Executed: Successful 2026-09-17 15:32:44.402243 | mon1 | INFO [default > side_effect] Executing 2026-09-17 15:32:44.402954 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-09-17 15:32:44.415411 | mon1 | INFO [default > verify] Executing 2026-09-17 15:32:45.089627 | mon1 | 2026-09-17 15:32:45.090030 | mon1 | PLAY [Verify] ****************************************************************** 2026-09-17 15:32:45.091024 | mon1 | 2026-09-17 15:32:45.091092 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-09-17 15:32:45.091102 | mon1 | Thursday 17 September 2026 15:32:45 +0000 (0:00:00.007) 0:00:00.007 **** 2026-09-17 15:32:46.372449 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-09-17 15:32:46.372522 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-09-17 15:32:46.372653 | mon1 | interpreter could change the meaning of that path. See 2026-09-17 15:32:46.372888 | mon1 | https://docs.ansible.com/ansible- 2026-09-17 15:32:46.373120 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-09-17 15:32:46.383751 | mon1 | ok: [mon1] 2026-09-17 15:32:46.383955 | mon1 | 2026-09-17 15:32:46.384189 | mon1 | TASK [List locally deployed Ceph daemons] ************************************** 2026-09-17 15:32:46.384507 | mon1 | Thursday 17 September 2026 15:32:46 +0000 (0:00:01.293) 0:00:01.301 **** 2026-09-17 15:32:52.491546 | mon1 | ok: [mon1] 2026-09-17 15:32:52.491623 | mon1 | 2026-09-17 15:32:52.491747 | mon1 | TASK [Collect deployed Ceph container images] ********************************** 2026-09-17 15:32:52.491885 | mon1 | Thursday 17 September 2026 15:32:52 +0000 (0:00:06.107) 0:00:07.408 **** 2026-09-17 15:32:52.558160 | mon1 | ok: [mon1] 2026-09-17 15:32:52.558224 | mon1 | 2026-09-17 15:32:52.558376 | mon1 | TASK [Assert that a deployed Ceph container image was found] ******************* 2026-09-17 15:32:52.558496 | mon1 | Thursday 17 September 2026 15:32:52 +0000 (0:00:00.067) 0:00:07.476 **** 2026-09-17 15:32:52.618378 | mon1 | ok: [mon1] => { 2026-09-17 15:32:52.618459 | mon1 | "changed": false, 2026-09-17 15:32:52.618585 | mon1 | "msg": "All assertions passed" 2026-09-17 15:32:52.618700 | mon1 | } 2026-09-17 15:32:52.618808 | mon1 | 2026-09-17 15:32:52.618947 | mon1 | TASK [Get cluster health status] *********************************************** 2026-09-17 15:32:52.619059 | mon1 | Thursday 17 September 2026 15:32:52 +0000 (0:00:00.060) 0:00:07.536 **** 2026-09-17 15:32:54.524178 | mon1 | ok: [mon1] 2026-09-17 15:32:54.524253 | mon1 | 2026-09-17 15:32:54.524268 | mon1 | TASK [Print cluster health status] ********************************************* 2026-09-17 15:32:54.524281 | mon1 | Thursday 17 September 2026 15:32:54 +0000 (0:00:01.903) 0:00:09.439 **** 2026-09-17 15:32:54.572840 | mon1 | ok: [mon1] => { 2026-09-17 15:32:54.573078 | mon1 | "_ceph_health": { 2026-09-17 15:32:54.573397 | mon1 | "changed": false, 2026-09-17 15:32:54.573635 | mon1 | "cmd": [ 2026-09-17 15:32:54.573846 | mon1 | "cephadm", 2026-09-17 15:32:54.574066 | mon1 | "shell", 2026-09-17 15:32:54.574334 | mon1 | "--", 2026-09-17 15:32:54.574550 | mon1 | "ceph", 2026-09-17 15:32:54.574756 | mon1 | "health" 2026-09-17 15:32:54.574997 | mon1 | ], 2026-09-17 15:32:54.575264 | mon1 | "delta": "0:00:01.610041", 2026-09-17 15:32:54.575500 | mon1 | "end": "2026-09-17 15:32:54.467233", 2026-09-17 15:32:54.575861 | mon1 | "failed": false, 2026-09-17 15:32:54.576173 | mon1 | "msg": "", 2026-09-17 15:32:54.576543 | mon1 | "rc": 0, 2026-09-17 15:32:54.576845 | mon1 | "start": "2026-09-17 15:32:52.857192", 2026-09-17 15:32:54.577272 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-09-17 15:32:54.577533 | mon1 | "stderr_lines": [ 2026-09-17 15:32:54.577814 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-09-17 15:32:54.578037 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-09-17 15:32:54.578268 | mon1 | ], 2026-09-17 15:32:54.578532 | mon1 | "stdout": "HEALTH_OK", 2026-09-17 15:32:54.578763 | mon1 | "stdout_lines": [ 2026-09-17 15:32:54.578985 | mon1 | "HEALTH_OK" 2026-09-17 15:32:54.579184 | mon1 | ] 2026-09-17 15:32:54.579746 | mon1 | } 2026-09-17 15:32:54.580140 | mon1 | } 2026-09-17 15:32:54.580407 | mon1 | 2026-09-17 15:32:54.580670 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-09-17 15:32:54.580902 | mon1 | Thursday 17 September 2026 15:32:54 +0000 (0:00:00.051) 0:00:09.490 **** 2026-09-17 15:32:54.617507 | mon1 | ok: [mon1] => { 2026-09-17 15:32:54.617581 | mon1 | "changed": false, 2026-09-17 15:32:54.617592 | mon1 | "msg": "All assertions passed" 2026-09-17 15:32:54.617601 | mon1 | } 2026-09-17 15:32:54.617610 | mon1 | 2026-09-17 15:32:54.617626 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-09-17 15:32:54.617864 | mon1 | Thursday 17 September 2026 15:32:54 +0000 (0:00:00.043) 0:00:09.534 **** 2026-09-17 15:33:01.190834 | mon1 | changed: [mon1] 2026-09-17 15:33:01.190903 | mon1 | 2026-09-17 15:33:01.190918 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-09-17 15:33:01.190933 | mon1 | Thursday 17 September 2026 15:33:01 +0000 (0:00:06.572) 0:00:16.106 **** 2026-09-17 15:33:04.045792 | mon1 | changed: [mon1] 2026-09-17 15:33:04.045865 | mon1 | 2026-09-17 15:33:04.045879 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-09-17 15:33:04.045891 | mon1 | Thursday 17 September 2026 15:33:04 +0000 (0:00:02.853) 0:00:18.960 **** 2026-09-17 15:33:05.374854 | mon1 | ok: [mon1] 2026-09-17 15:33:05.374911 | mon1 | 2026-09-17 15:33:05.374925 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-09-17 15:33:05.374937 | mon1 | Thursday 17 September 2026 15:33:05 +0000 (0:00:01.330) 0:00:20.290 **** 2026-09-17 15:33:05.451526 | mon1 | ok: [mon1] => { 2026-09-17 15:33:05.451582 | mon1 | "changed": false, 2026-09-17 15:33:05.451596 | mon1 | "msg": "All assertions passed" 2026-09-17 15:33:05.451609 | mon1 | } 2026-09-17 15:33:05.451622 | mon1 | 2026-09-17 15:33:05.451635 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] ********* 2026-09-17 15:33:05.451647 | mon1 | Thursday 17 September 2026 15:33:05 +0000 (0:00:00.076) 0:00:20.367 **** 2026-09-17 15:33:06.693901 | mon1 | ok: [mon1] 2026-09-17 15:33:06.694009 | mon1 | 2026-09-17 15:33:06.694153 | mon1 | TASK [Assert that the legacy key module info state returns the correct key] **** 2026-09-17 15:33:06.694343 | mon1 | Thursday 17 September 2026 15:33:06 +0000 (0:00:01.244) 0:00:21.611 **** 2026-09-17 15:33:06.745814 | mon1 | ok: [mon1] => { 2026-09-17 15:33:06.746005 | mon1 | "changed": false, 2026-09-17 15:33:06.746257 | mon1 | "msg": "All assertions passed" 2026-09-17 15:33:06.746575 | mon1 | } 2026-09-17 15:33:06.746701 | mon1 | 2026-09-17 15:33:06.746920 | mon1 | PLAY RECAP ********************************************************************* 2026-09-17 15:33:06.747156 | mon1 | mon1 : ok=13 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-09-17 15:33:06.747402 | mon1 | 2026-09-17 15:33:06.747607 | mon1 | 2026-09-17 15:33:06.747826 | mon1 | TASKS RECAP ******************************************************************** 2026-09-17 15:33:06.748035 | mon1 | Thursday 17 September 2026 15:33:06 +0000 (0:00:00.052) 0:00:21.664 **** 2026-09-17 15:33:06.748253 | mon1 | =============================================================================== 2026-09-17 15:33:06.748510 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.57s 2026-09-17 15:33:06.748706 | mon1 | List locally deployed Ceph daemons -------------------------------------- 6.11s 2026-09-17 15:33:06.748915 | mon1 | Create a test Ceph key -------------------------------------------------- 2.85s 2026-09-17 15:33:06.749125 | mon1 | Get cluster health status ----------------------------------------------- 1.90s 2026-09-17 15:33:06.749390 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.33s 2026-09-17 15:33:06.749602 | mon1 | Gathering Facts --------------------------------------------------------- 1.29s 2026-09-17 15:33:06.749816 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 1.24s 2026-09-17 15:33:06.750027 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.08s 2026-09-17 15:33:06.750281 | mon1 | Collect deployed Ceph container images ---------------------------------- 0.07s 2026-09-17 15:33:06.750531 | mon1 | Assert that a deployed Ceph container image was found ------------------- 0.06s 2026-09-17 15:33:06.750725 | mon1 | Assert that the legacy key module info state returns the correct key ---- 0.05s 2026-09-17 15:33:06.750933 | mon1 | Print cluster health status --------------------------------------------- 0.05s 2026-09-17 15:33:06.751141 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.04s 2026-09-17 15:33:06.853651 | mon1 | INFO [default > verify] Executed: Successful 2026-09-17 15:33:06.884867 | mon1 | INFO [default > cleanup] Executing 2026-09-17 15:33:06.885448 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-09-17 15:33:06.897257 | mon1 | INFO [default > destroy] Executing 2026-09-17 15:33:06.897296 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-09-17 15:33:06.897415 | mon1 | INFO [default > destroy] Executed: Successful 2026-09-17 15:33:06.897703 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-09-17 15:33:07.048149 | mon1 | ok: Runtime: 0:18:45.767607 2026-09-17 15:33:07.073573 | 2026-09-17 15:33:07.073663 | PLAY RECAP 2026-09-17 15:33:07.073724 | mon1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-09-17 15:33:07.073767 | 2026-09-17 15:33:07.196164 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-09-17 15:33:07.202060 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-09-17 15:33:07.822017 | 2026-09-17 15:33:07.822129 | PLAY [all] 2026-09-17 15:33:07.833259 | 2026-09-17 15:33:07.833329 | TASK [fetch-output : Set log path for multiple nodes] 2026-09-17 15:33:07.901700 | mon1 | ok 2026-09-17 15:33:07.908357 | osd1 | ok 2026-09-17 15:33:07.914267 | 2026-09-17 15:33:07.914368 | TASK [fetch-output : Set log path for single node] 2026-09-17 15:33:07.949155 | mon1 | skipping: Conditional result was False 2026-09-17 15:33:07.960160 | osd1 | skipping: Conditional result was False 2026-09-17 15:33:07.968329 | 2026-09-17 15:33:07.968418 | LOOP [fetch-output : Ensure local output dirs] 2026-09-17 15:33:08.364772 | mon1 -> localhost | changed: "/var/lib/zuul/builds/8ebfc567306f4c4089057466f539d96c/work/logs/mon1" 2026-09-17 15:33:08.379888 | osd1 -> localhost | changed: "/var/lib/zuul/builds/8ebfc567306f4c4089057466f539d96c/work/logs/osd1" 2026-09-17 15:33:08.605899 | mon1 -> localhost | changed: "/var/lib/zuul/builds/8ebfc567306f4c4089057466f539d96c/work/artifacts" 2026-09-17 15:33:08.662146 | osd1 -> localhost | ok: "/var/lib/zuul/builds/8ebfc567306f4c4089057466f539d96c/work/artifacts" 2026-09-17 15:33:08.846694 | mon1 -> localhost | changed: "/var/lib/zuul/builds/8ebfc567306f4c4089057466f539d96c/work/docs" 2026-09-17 15:33:08.897971 | osd1 -> localhost | ok: "/var/lib/zuul/builds/8ebfc567306f4c4089057466f539d96c/work/docs" 2026-09-17 15:33:08.898096 | osd1 -> localhost | changed: All items complete 2026-09-17 15:33:08.898120 | 2026-09-17 15:33:08.916876 | 2026-09-17 15:33:08.917074 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-09-17 15:33:09.623945 | osd1 | changed: .d..t...... ./ 2026-09-17 15:33:09.633328 | mon1 | changed: .d..t...... ./ 2026-09-17 15:33:10.140434 | osd1 | changed: .d..t...... ./ 2026-09-17 15:33:10.162715 | mon1 | ok 2026-09-17 15:33:10.658080 | mon1 | changed: .d..t...... ./ 2026-09-17 15:33:10.689551 | osd1 | ok 2026-09-17 15:33:10.689779 | osd1 | changed: All items complete 2026-09-17 15:33:10.689828 | 2026-09-17 15:33:10.726863 | 2026-09-17 15:33:10.727087 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-09-17 15:33:11.157049 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007216 2026-09-17 15:33:11.384962 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.005243 2026-09-17 15:33:11.415349 | 2026-09-17 15:33:11.415463 | PLAY [all] 2026-09-17 15:33:11.427785 | 2026-09-17 15:33:11.427915 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-09-17 15:33:11.933811 | mon1 | changed 2026-09-17 15:33:12.148143 | osd1 | changed 2026-09-17 15:33:12.167546 | 2026-09-17 15:33:12.167718 | PLAY RECAP 2026-09-17 15:33:12.167853 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-09-17 15:33:12.167953 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-09-17 15:33:12.168019 | 2026-09-17 15:33:12.295632 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-09-17 15:33:12.301051 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-09-17 15:33:12.836757 | 2026-09-17 15:33:12.837299 | PLAY [localhost] 2026-09-17 15:33:12.846047 | 2026-09-17 15:33:12.846113 | TASK [Generate Zuul manifest] 2026-09-17 15:33:12.862451 | localhost | ok 2026-09-17 15:33:12.876180 | 2026-09-17 15:33:12.876254 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-09-17 15:33:13.250788 | localhost | changed 2026-09-17 15:33:13.271293 | 2026-09-17 15:33:13.271498 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-09-17 15:33:13.303465 | localhost | ok 2026-09-17 15:33:13.315822 | 2026-09-17 15:33:13.315945 | TASK [Upload logs] 2026-09-17 15:33:13.336330 | localhost | ok 2026-09-17 15:33:13.400586 | 2026-09-17 15:33:13.400699 | TASK [Set zuul-log-path fact] 2026-09-17 15:33:13.417616 | localhost | ok 2026-09-17 15:33:13.430631 | 2026-09-17 15:33:13.430732 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-09-17 15:33:13.458338 | localhost | ok 2026-09-17 15:33:13.466598 | 2026-09-17 15:33:13.466699 | TASK [upload-logs : Create log directories] 2026-09-17 15:33:13.892360 | localhost | changed 2026-09-17 15:33:13.901489 | 2026-09-17 15:33:13.901619 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-09-17 15:33:14.319050 | localhost -> localhost | ok: Runtime: 0:00:00.005381 2026-09-17 15:33:14.328404 | 2026-09-17 15:33:14.328586 | TASK [upload-logs : Upload logs to log server] 2026-09-17 15:33:14.773475 | localhost | Output suppressed because no_log was given 2026-09-17 15:33:14.777926 | 2026-09-17 15:33:14.778001 | LOOP [upload-logs : Compress console log and json output] 2026-09-17 15:33:14.870881 | localhost | skipping: Conditional result was False 2026-09-17 15:33:14.877143 | localhost | skipping: Conditional result was False 2026-09-17 15:33:14.889634 | 2026-09-17 15:33:14.889734 | LOOP [upload-logs : Upload compressed console log and json output] 2026-09-17 15:33:14.955687 | localhost | skipping: Conditional result was False 2026-09-17 15:33:14.956005 | 2026-09-17 15:33:14.959850 | localhost | skipping: Conditional result was False 2026-09-17 15:33:14.994998 | 2026-09-17 15:33:14.995118 | LOOP [upload-logs : Upload console log and json output]