2026-07-09 14:32:06.776992 | Job console starting
2026-07-09 14:32:06.800552 | Updating git repos
2026-07-09 14:32:06.832744 | Cloning repos into workspace
2026-07-09 14:32:23.396804 | Restoring repo states
2026-07-09 14:32:23.405909 | Merging changes
2026-07-09 14:32:23.711635 | Checking out repos
2026-07-09 14:32:25.707921 | Preparing playbooks
2026-07-09 14:32:35.029944 | Running Ansible setup
2026-07-09 14:32:40.261013 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-07-09 14:32:41.002124 | 
2026-07-09 14:32:41.002340 | PLAY [localhost]
2026-07-09 14:32:41.013366 | 
2026-07-09 14:32:41.013571 | TASK [Gathering Facts]
2026-07-09 14:32:41.988893 | localhost | ok
2026-07-09 14:32:41.998168 | 
2026-07-09 14:32:41.998286 | TASK [Setup log path fact]
2026-07-09 14:32:42.018647 | localhost | ok
2026-07-09 14:32:42.035024 | 
2026-07-09 14:32:42.035188 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-07-09 14:32:42.065746 | localhost | ok
2026-07-09 14:32:42.075790 | 
2026-07-09 14:32:42.075976 | TASK [emit-job-header : Print job information]
2026-07-09 14:32:42.116185 | # Job Information
2026-07-09 14:32:42.116400 | Ansible Version: 2.16.18
2026-07-09 14:32:42.116444 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy
2026-07-09 14:32:42.116474 | Pipeline: check
2026-07-09 14:32:42.116501 | Executor: 2d72f0692154
2026-07-09 14:32:42.116528 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/115
2026-07-09 14:32:42.116558 | Event ID: af1e4130-7ba2-11f1-913f-77f924fc758f
2026-07-09 14:32:42.120864 | 
2026-07-09 14:32:42.121006 | LOOP [emit-job-header : Print node information]
2026-07-09 14:32:42.255935 | localhost | ok:
2026-07-09 14:32:42.256175 | localhost | # Node Information
2026-07-09 14:32:42.256206 | localhost | Inventory Hostname: mon1
2026-07-09 14:32:42.256230 | localhost | Hostname: np0000184656
2026-07-09 14:32:42.256251 | localhost | Username: zuul
2026-07-09 14:32:42.256276 | localhost | Distro: Ubuntu 22.04
2026-07-09 14:32:42.256298 | localhost | Provider: yul1
2026-07-09 14:32:42.256318 | localhost | Region: ca-ymq-1
2026-07-09 14:32:42.256339 | localhost | Label: ubuntu-jammy
2026-07-09 14:32:42.256359 | localhost | Product Name: OpenStack Nova
2026-07-09 14:32:42.256380 | localhost | Interface IP: 199.19.213.212
2026-07-09 14:32:42.313965 | localhost | ok:
2026-07-09 14:32:42.314326 | localhost | # Node Information
2026-07-09 14:32:42.314378 | localhost | Inventory Hostname: osd1
2026-07-09 14:32:42.314413 | localhost | Hostname: np0000184657
2026-07-09 14:32:42.314445 | localhost | Username: zuul
2026-07-09 14:32:42.314474 | localhost | Distro: Ubuntu 22.04
2026-07-09 14:32:42.314502 | localhost | Provider: yul1
2026-07-09 14:32:42.314532 | localhost | Region: ca-ymq-1
2026-07-09 14:32:42.314559 | localhost | Label: ubuntu-jammy
2026-07-09 14:32:42.314585 | localhost | Product Name: OpenStack Nova
2026-07-09 14:32:42.314614 | localhost | Interface IP: 199.19.213.193
2026-07-09 14:32:42.334210 | 
2026-07-09 14:32:42.334385 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-07-09 14:32:42.767701 | localhost -> localhost | changed
2026-07-09 14:32:42.779085 | 
2026-07-09 14:32:42.779521 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-07-09 14:32:43.790709 | localhost -> localhost | changed
2026-07-09 14:32:43.802929 | 
2026-07-09 14:32:43.803046 | PLAY [all]
2026-07-09 14:32:43.811460 | 
2026-07-09 14:32:43.811540 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-07-09 14:32:44.077583 | mon1 -> localhost | ok
2026-07-09 14:32:44.087478 | 
2026-07-09 14:32:44.087641 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-07-09 14:32:44.122974 | mon1 | ok
2026-07-09 14:32:44.130114 | osd1 | ok
2026-07-09 14:32:44.153159 | mon1 | included: /var/lib/zuul/builds/d7677849ead14426b574f811d7facec1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-07-09 14:32:44.153302 | osd1 | included: /var/lib/zuul/builds/d7677849ead14426b574f811d7facec1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-07-09 14:32:44.161731 | 
2026-07-09 14:32:44.161813 | TASK [add-build-sshkey : Create Temp SSH key]
2026-07-09 14:32:44.973872 | mon1 -> localhost | Generating public/private rsa key pair.
2026-07-09 14:32:44.974115 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/d7677849ead14426b574f811d7facec1/work/d7677849ead14426b574f811d7facec1_id_rsa
2026-07-09 14:32:44.974163 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/d7677849ead14426b574f811d7facec1/work/d7677849ead14426b574f811d7facec1_id_rsa.pub
2026-07-09 14:32:44.974199 | mon1 -> localhost | The key fingerprint is:
2026-07-09 14:32:44.974232 | mon1 -> localhost | SHA256:IHiQhGOSy0xk2D/q8+AdBTO5ooMbQPIDqit6yABIvXs zuul-build-sshkey
2026-07-09 14:32:44.974264 | mon1 -> localhost | The key's randomart image is:
2026-07-09 14:32:44.974295 | mon1 -> localhost | +---[RSA 3072]----+
2026-07-09 14:32:44.974326 | mon1 -> localhost | |oB+.             |
2026-07-09 14:32:44.974357 | mon1 -> localhost | |B+o+ .           |
2026-07-09 14:32:44.974388 | mon1 -> localhost | |@+..O .          |
2026-07-09 14:32:44.974418 | mon1 -> localhost | |B= oo* .         |
2026-07-09 14:32:44.974448 | mon1 -> localhost | |+ +.o.. S        |
2026-07-09 14:32:44.974477 | mon1 -> localhost | |=..+ E           |
2026-07-09 14:32:44.974506 | mon1 -> localhost | |Oo. o            |
2026-07-09 14:32:44.974535 | mon1 -> localhost | |oB+o .           |
2026-07-09 14:32:44.974588 | mon1 -> localhost | |*..oo            |
2026-07-09 14:32:44.974620 | mon1 -> localhost | +----[SHA256]-----+
2026-07-09 14:32:44.974705 | mon1 -> localhost | ok: Runtime: 0:00:00.307334
2026-07-09 14:32:44.981567 | 
2026-07-09 14:32:44.981634 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-07-09 14:32:45.022042 | mon1 | ok
2026-07-09 14:32:45.028031 | osd1 | ok
2026-07-09 14:32:45.041832 | mon1 | included: /var/lib/zuul/builds/d7677849ead14426b574f811d7facec1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-07-09 14:32:45.041948 | osd1 | included: /var/lib/zuul/builds/d7677849ead14426b574f811d7facec1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-07-09 14:32:45.055466 | 
2026-07-09 14:32:45.055563 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-07-09 14:32:45.083032 | mon1 | skipping: Conditional result was False
2026-07-09 14:32:45.094201 | osd1 | skipping: Conditional result was False
2026-07-09 14:32:45.105946 | 
2026-07-09 14:32:45.106063 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-07-09 14:32:45.600792 | osd1 | changed
2026-07-09 14:32:45.761740 | mon1 | changed
2026-07-09 14:32:45.769654 | 
2026-07-09 14:32:45.769793 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-07-09 14:32:45.954248 | mon1 | ok
2026-07-09 14:32:45.997944 | osd1 | ok
2026-07-09 14:32:46.004096 | 
2026-07-09 14:32:46.004185 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-07-09 14:32:46.536027 | osd1 | changed
2026-07-09 14:32:46.830684 | mon1 | changed
2026-07-09 14:32:46.836364 | 
2026-07-09 14:32:46.836464 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-07-09 14:32:47.423235 | mon1 | changed
2026-07-09 14:32:47.431741 | osd1 | changed
2026-07-09 14:32:47.442664 | 
2026-07-09 14:32:47.442853 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-07-09 14:32:47.473378 | mon1 | skipping: Conditional result was False
2026-07-09 14:32:47.485073 | osd1 | skipping: Conditional result was False
2026-07-09 14:32:47.494379 | 
2026-07-09 14:32:47.494566 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-07-09 14:32:47.855938 | mon1 -> localhost | changed
2026-07-09 14:32:47.879037 | 
2026-07-09 14:32:47.879181 | TASK [add-build-sshkey : Add back temp key]
2026-07-09 14:32:48.166132 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/d7677849ead14426b574f811d7facec1/work/d7677849ead14426b574f811d7facec1_id_rsa (zuul-build-sshkey)
2026-07-09 14:32:48.166438 | mon1 -> localhost | ok: Runtime: 0:00:00.011188
2026-07-09 14:32:48.173996 | 
2026-07-09 14:32:48.174132 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-07-09 14:32:48.464164 | osd1 | ok
2026-07-09 14:32:48.585554 | mon1 | ok
2026-07-09 14:32:48.590429 | 
2026-07-09 14:32:48.590544 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-07-09 14:32:48.618294 | mon1 | skipping: Conditional result was False
2026-07-09 14:32:48.650138 | osd1 | skipping: Conditional result was False
2026-07-09 14:32:48.669536 | 
2026-07-09 14:32:48.669714 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-07-09 14:32:48.981180 | mon1 | ok
2026-07-09 14:32:48.999122 | osd1 | ok
2026-07-09 14:32:49.007340 | 
2026-07-09 14:32:49.007476 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-07-09 14:32:49.775167 | osd1 | Output suppressed because no_log was given
2026-07-09 14:32:49.884771 | mon1 | Output suppressed because no_log was given
2026-07-09 14:32:49.905568 | 
2026-07-09 14:32:49.905753 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-07-09 14:32:50.107976 | mon1 | ok: "logs"
2026-07-09 14:32:50.108458 | mon1 | ok: All items complete
2026-07-09 14:32:50.108517 | 
2026-07-09 14:32:50.145993 | osd1 | ok: "logs"
2026-07-09 14:32:50.266994 | mon1 | ok: "artifacts"
2026-07-09 14:32:50.340198 | osd1 | ok: "artifacts"
2026-07-09 14:32:50.468546 | mon1 | ok: "docs"
2026-07-09 14:32:50.507923 | osd1 | ok: "docs"
2026-07-09 14:32:50.533170 | 
2026-07-09 14:32:50.533350 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-07-09 14:32:50.724949 | mon1 | changed: "logs"
2026-07-09 14:32:50.725234 | mon1 | ok: All items complete
2026-07-09 14:32:50.725264 | 
2026-07-09 14:32:50.749516 | osd1 | changed: "logs"
2026-07-09 14:32:50.906489 | mon1 | changed: "artifacts"
2026-07-09 14:32:50.911519 | osd1 | changed: "artifacts"
2026-07-09 14:32:51.079825 | osd1 | changed: "docs"
2026-07-09 14:32:51.118517 | mon1 | changed: "docs"
2026-07-09 14:32:51.138846 | 
2026-07-09 14:32:51.138980 | PLAY RECAP
2026-07-09 14:32:51.139032 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-09 14:32:51.139063 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-07-09 14:32:51.139091 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-07-09 14:32:51.139126 | 
2026-07-09 14:32:51.331535 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-07-09 14:32:51.334432 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-07-09 14:32:52.047457 | 
2026-07-09 14:32:52.047650 | PLAY [all]
2026-07-09 14:32:52.060205 | 
2026-07-09 14:32:52.060386 | TASK [setup-uv : Extract archive]
2026-07-09 14:32:55.682150 | mon1 | changed
2026-07-09 14:32:57.613058 | osd1 | changed
2026-07-09 14:32:57.625155 | 
2026-07-09 14:32:57.625330 | TASK [setup-uv : Print version]
2026-07-09 14:32:58.046261 | osd1 | uv 0.8.13
2026-07-09 14:32:58.151840 | mon1 | uv 0.8.13
2026-07-09 14:32:58.188472 | osd1 | ok: Runtime: 0:00:00.013893
2026-07-09 14:32:58.201063 | mon1 | ok: Runtime: 0:00:00.125509
2026-07-09 14:32:58.222025 | 
2026-07-09 14:32:58.222217 | TASK [Install Ansible collection siblings]
2026-07-09 14:32:58.644689 | mon1 | ok:
2026-07-09 14:32:58.644879 | mon1 | Skipping community.general: no checked-out sibling
2026-07-09 14:32:58.644910 | mon1 | Skipping ansible.utils: no checked-out sibling
2026-07-09 14:32:58.644931 | mon1 | Skipping vexxhost.containers: no checked-out sibling
2026-07-09 14:32:58.647241 | 
2026-07-09 14:32:58.647320 | PLAY RECAP
2026-07-09 14:32:58.647377 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-09 14:32:58.647436 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-09 14:32:58.647463 | 
2026-07-09 14:32:58.835612 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-07-09 14:32:58.838289 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-07-09 14:32:59.616898 | 
2026-07-09 14:32:59.617187 | PLAY [all]
2026-07-09 14:32:59.632132 | 
2026-07-09 14:32:59.632326 | LOOP [Check inventory directories]
2026-07-09 14:32:59.989277 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph"
2026-07-09 14:33:00.148842 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory"
2026-07-09 14:33:02.033217 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory"
2026-07-09 14:33:02.045823 | 
2026-07-09 14:33:02.046062 | LOOP [Copy inventory file for Zuul]
2026-07-09 14:33:02.918919 | mon1 | changed:
2026-07-09 14:33:02.919193 | mon1 | {
2026-07-09 14:33:02.919245 | mon1 |   "ansible_loop_var": "item",
2026-07-09 14:33:02.919289 | mon1 |   "changed": false,
2026-07-09 14:33:02.919449 | mon1 |   "failed": false,
2026-07-09 14:33:02.919496 | mon1 |   "invocation": {
2026-07-09 14:33:02.919527 | mon1 |     "module_args": {
2026-07-09 14:33:02.919555 | mon1 |       "checksum_algorithm": "sha1",
2026-07-09 14:33:02.919582 | mon1 |       "follow": true,
2026-07-09 14:33:02.919608 | mon1 |       "get_attributes": true,
2026-07-09 14:33:02.919635 | mon1 |       "get_checksum": true,
2026-07-09 14:33:02.919659 | mon1 |       "get_mime": true,
2026-07-09 14:33:02.919682 | mon1 |       "path": "src/github.com/vexxhost/ansible-collection-ceph"
2026-07-09 14:33:02.919706 | mon1 |     }
2026-07-09 14:33:02.919728 | mon1 |   },
2026-07-09 14:33:02.919750 | mon1 |   "item": "src/github.com/vexxhost/ansible-collection-ceph",
2026-07-09 14:33:02.919774 | mon1 |   "stat": {
2026-07-09 14:33:02.919802 | mon1 |     "atime": 1783607569.763671,
2026-07-09 14:33:02.919830 | mon1 |     "attr_flags": "e",
2026-07-09 14:33:02.919856 | mon1 |     "attributes": [
2026-07-09 14:33:02.919882 | mon1 |       "extents"
2026-07-09 14:33:02.919908 | mon1 |     ],
2026-07-09 14:33:02.919933 | mon1 |     "block_size": 4096,
2026-07-09 14:33:02.919957 | mon1 |     "blocks": 8,
2026-07-09 14:33:02.919980 | mon1 |     "charset": "unknown",
2026-07-09 14:33:02.920004 | mon1 |     "ctime": 1783607569.771671,
2026-07-09 14:33:02.920027 | mon1 |     "dev": 64513,
2026-07-09 14:33:02.920049 | mon1 |     "device_type": 0,
2026-07-09 14:33:02.920133 | mon1 |     "executable": true,
2026-07-09 14:33:02.920164 | mon1 |     "exists": true,
2026-07-09 14:33:02.920191 | mon1 |     "gid": 1000,
2026-07-09 14:33:02.920217 | mon1 |     "gr_name": "zuul",
2026-07-09 14:33:02.920242 | mon1 |     "inode": 1041949,
2026-07-09 14:33:02.920265 | mon1 |     "isblk": false,
2026-07-09 14:33:02.920289 | mon1 |     "ischr": false,
2026-07-09 14:33:02.920312 | mon1 |     "isdir": true,
2026-07-09 14:33:02.920338 | mon1 |     "isfifo": false,
2026-07-09 14:33:02.920361 | mon1 |     "isgid": false,
2026-07-09 14:33:02.920382 | mon1 |     "islnk": false,
2026-07-09 14:33:02.920404 | mon1 |     "isreg": false,
2026-07-09 14:33:02.920428 | mon1 |     "issock": false,
2026-07-09 14:33:02.920455 | mon1 |     "isuid": false,
2026-07-09 14:33:02.920481 | mon1 |     "mimetype": "unknown",
2026-07-09 14:33:02.920507 | mon1 |     "mode": "0755",
2026-07-09 14:33:02.920532 | mon1 |     "mtime": 1783607543.6549342,
2026-07-09 14:33:02.920557 | mon1 |     "nlink": 10,
2026-07-09 14:33:02.920581 | mon1 |     "path": "src/github.com/vexxhost/ansible-collection-ceph",
2026-07-09 14:33:02.920604 | mon1 |     "pw_name": "zuul",
2026-07-09 14:33:02.920628 | mon1 |     "readable": true,
2026-07-09 14:33:02.920650 | mon1 |     "rgrp": true,
2026-07-09 14:33:02.920672 | mon1 |     "roth": true,
2026-07-09 14:33:02.920697 | mon1 |     "rusr": true,
2026-07-09 14:33:02.920722 | mon1 |     "size": 4096,
2026-07-09 14:33:02.920766 | mon1 |     "uid": 1000,
2026-07-09 14:33:02.920795 | mon1 |     "version": "2231408108",
2026-07-09 14:33:02.920823 | mon1 |     "wgrp": false,
2026-07-09 14:33:02.920853 | mon1 |     "woth": false,
2026-07-09 14:33:02.920879 | mon1 |     "writeable": true,
2026-07-09 14:33:02.920903 | mon1 |     "wusr": true,
2026-07-09 14:33:02.920926 | mon1 |     "xgrp": true,
2026-07-09 14:33:02.920948 | mon1 |     "xoth": true,
2026-07-09 14:33:02.920994 | mon1 |     "xusr": true
2026-07-09 14:33:02.921018 | mon1 |   }
2026-07-09 14:33:02.921045 | mon1 | }
2026-07-09 14:33:02.921097 | mon1 | ok: All items complete
2026-07-09 14:33:02.921130 | 
2026-07-09 14:33:02.923222 | mon1 | skipping: Conditional result was False
2026-07-09 14:33:02.924059 | mon1 | skipping: Conditional result was False
2026-07-09 14:33:02.943775 | 
2026-07-09 14:33:02.943932 | LOOP [Switch "ansible_host" to private IP]
2026-07-09 14:33:03.317207 | mon1 | changed: 2 replacements made
2026-07-09 14:33:03.319500 | mon1 | skipping: Conditional result was False
2026-07-09 14:33:03.320531 | mon1 | skipping: Conditional result was False
2026-07-09 14:33:03.335675 | 
2026-07-09 14:33:03.335856 | TASK [Run Molecule scenario]
2026-07-09 14:33:04.294618 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-07-09 14:33:05.293054 | mon1 |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-07-09 14:33:05.785231 | mon1 | Using CPython 3.13.7
2026-07-09 14:33:05.785290 | mon1 | Creating virtual environment at: .venv
2026-07-09 14:33:06.018854 | mon1 | Downloading pygments (1.2MiB)
2026-07-09 14:33:06.019119 | mon1 | Downloading netaddr (2.2MiB)
2026-07-09 14:33:06.019512 | mon1 | Downloading ansible-core (2.1MiB)
2026-07-09 14:33:06.081262 | mon1 | Downloading cryptography (4.3MiB)
2026-07-09 14:33:06.194661 | mon1 |  Downloading netaddr
2026-07-09 14:33:06.204041 | mon1 |  Downloading cryptography
2026-07-09 14:33:06.243000 | mon1 |  Downloading pygments
2026-07-09 14:33:06.381312 | mon1 |  Downloading ansible-core
2026-07-09 14:33:06.423161 | mon1 | Installed 36 packages in 41ms
2026-07-09 14:33:07.605736 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-07-09 14:33:07.605855 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-07-09 14:33:08.434393 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-07-09 14:33:08.434566 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-07-09 14:33:23.901612 | mon1 | INFO     [default > dependency] Executing
2026-07-09 14:33:23.901903 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-07-09 14:33:23.902120 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-07-09 14:33:23.902259 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-07-09 14:33:23.907470 | mon1 | INFO     [default > cleanup] Executing
2026-07-09 14:33:23.907797 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-07-09 14:33:23.913049 | mon1 | INFO     [default > destroy] Executing
2026-07-09 14:33:23.913153 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-07-09 14:33:23.913240 | mon1 | INFO     [default > destroy] Executed: Successful
2026-07-09 14:33:23.920411 | mon1 | INFO     [default > syntax] Executing
2026-07-09 14:33:25.060096 | mon1 |
2026-07-09 14:33:25.060518 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-07-09 14:33:25.132408 | mon1 | INFO     [default > syntax] Executed: Successful
2026-07-09 14:33:25.142749 | mon1 | INFO     [default > create] Executing
2026-07-09 14:33:25.145012 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-07-09 14:33:25.152602 | mon1 | INFO     [default > prepare] Executing
2026-07-09 14:33:25.900009 | mon1 |
2026-07-09 14:33:25.900334 | mon1 | PLAY [Prepare] *****************************************************************
2026-07-09 14:33:25.900693 | mon1 |
2026-07-09 14:33:25.900923 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-09 14:33:25.901142 | mon1 | Thursday 09 July 2026  14:33:25 +0000 (0:00:00.036)       0:00:00.036 *********
2026-07-09 14:33:27.163907 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-07-09 14:33:27.163960 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-07-09 14:33:27.163965 | mon1 | interpreter could change the meaning of that path. See
2026-07-09 14:33:27.163970 | mon1 | https://docs.ansible.com/ansible-
2026-07-09 14:33:27.163975 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-09 14:33:27.191156 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-07-09 14:33:27.191294 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-07-09 14:33:27.191358 | mon1 | interpreter could change the meaning of that path. See
2026-07-09 14:33:27.191574 | mon1 | https://docs.ansible.com/ansible-
2026-07-09 14:33:27.191813 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-09 14:33:27.198017 | mon1 | ok: [osd1]
2026-07-09 14:33:27.198279 | mon1 | ok: [mon1]
2026-07-09 14:33:27.198528 | mon1 |
2026-07-09 14:33:27.198801 | mon1 | TASK [Configure short hostname] ************************************************
2026-07-09 14:33:27.199051 | mon1 | Thursday 09 July 2026  14:33:27 +0000 (0:00:01.298)       0:00:01.335 *********
2026-07-09 14:33:27.913068 | mon1 | changed: [mon1]
2026-07-09 14:33:27.913211 | mon1 | changed: [osd1]
2026-07-09 14:33:27.913393 | mon1 |
2026-07-09 14:33:27.913585 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-07-09 14:33:27.913824 | mon1 | Thursday 09 July 2026  14:33:27 +0000 (0:00:00.714)       0:00:02.049 *********
2026-07-09 14:33:28.209958 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-07-09 14:33:28.210020 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-07-09 14:33:28.210106 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-07-09 14:33:28.222017 | mon1 | changed: [osd1]
2026-07-09 14:33:28.222328 | mon1 | changed: [mon1]
2026-07-09 14:33:28.222590 | mon1 |
2026-07-09 14:33:28.222816 | mon1 | TASK [Update apt cache] ********************************************************
2026-07-09 14:33:28.223164 | mon1 | Thursday 09 July 2026  14:33:28 +0000 (0:00:00.309)       0:00:02.359 *********
2026-07-09 14:33:36.572257 | mon1 | changed: [mon1]
2026-07-09 14:33:36.580302 | mon1 | changed: [osd1]
2026-07-09 14:33:36.580348 | mon1 |
2026-07-09 14:33:36.580368 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-07-09 14:33:36.580388 | mon1 |
2026-07-09 14:33:36.580404 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-09 14:33:36.580424 | mon1 | Thursday 09 July 2026  14:33:36 +0000 (0:00:08.350)       0:00:10.709 *********
2026-07-09 14:33:37.287620 | mon1 | ok: [osd1]
2026-07-09 14:33:37.287841 | mon1 |
2026-07-09 14:33:37.288126 | mon1 | TASK [Install depedencies] *****************************************************
2026-07-09 14:33:37.288342 | mon1 | Thursday 09 July 2026  14:33:37 +0000 (0:00:00.715)       0:00:11.424 *********
2026-07-09 14:33:58.626849 | mon1 | changed: [osd1]
2026-07-09 14:33:58.627028 | mon1 |
2026-07-09 14:33:58.627310 | mon1 | TASK [Start up service] ********************************************************
2026-07-09 14:33:58.627543 | mon1 | Thursday 09 July 2026  14:33:58 +0000 (0:00:21.339)       0:00:32.763 *********
2026-07-09 14:33:59.235560 | mon1 | ok: [osd1]
2026-07-09 14:33:59.235819 | mon1 |
2026-07-09 14:33:59.236101 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-07-09 14:33:59.236334 | mon1 | Thursday 09 July 2026  14:33:59 +0000 (0:00:00.608)       0:00:33.372 *********
2026-07-09 14:33:59.578622 | mon1 | ok: [osd1]
2026-07-09 14:33:59.578886 | mon1 |
2026-07-09 14:33:59.579165 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-07-09 14:33:59.579403 | mon1 | Thursday 09 July 2026  14:33:59 +0000 (0:00:00.343)       0:00:33.715 *********
2026-07-09 14:34:00.276105 | mon1 | changed: [osd1]
2026-07-09 14:34:00.276308 | mon1 |
2026-07-09 14:34:00.276600 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-07-09 14:34:00.276898 | mon1 | Thursday 09 July 2026  14:34:00 +0000 (0:00:00.697)       0:00:34.412 *********
2026-07-09 14:34:00.462596 | mon1 | ok: [osd1]
2026-07-09 14:34:00.462758 | mon1 |
2026-07-09 14:34:00.462949 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-07-09 14:34:00.463163 | mon1 | Thursday 09 July 2026  14:34:00 +0000 (0:00:00.187)       0:00:34.599 *********
2026-07-09 14:34:00.480097 | mon1 | skipping: [osd1]
2026-07-09 14:34:00.480333 | mon1 |
2026-07-09 14:34:00.480697 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-07-09 14:34:00.481016 | mon1 | Thursday 09 July 2026  14:34:00 +0000 (0:00:00.017)       0:00:34.617 *********
2026-07-09 14:34:01.052953 | mon1 | changed: [osd1] => (item=osd0)
2026-07-09 14:34:01.053126 | mon1 | changed: [osd1] => (item=osd1)
2026-07-09 14:34:01.053323 | mon1 | changed: [osd1] => (item=osd2)
2026-07-09 14:34:01.053472 | mon1 |
2026-07-09 14:34:01.053628 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-07-09 14:34:01.053793 | mon1 | Thursday 09 July 2026  14:34:01 +0000 (0:00:00.572)       0:00:35.189 *********
2026-07-09 14:34:01.693264 | mon1 | changed: [osd1] => (item=osd0)
2026-07-09 14:34:01.693459 | mon1 | changed: [osd1] => (item=osd1)
2026-07-09 14:34:01.693634 | mon1 | changed: [osd1] => (item=osd2)
2026-07-09 14:34:01.693780 | mon1 |
2026-07-09 14:34:01.693948 | mon1 | TASK [Start loop devices] ******************************************************
2026-07-09 14:34:01.694712 | mon1 | Thursday 09 July 2026  14:34:01 +0000 (0:00:00.640)       0:00:35.830 *********
2026-07-09 14:34:02.441118 | mon1 | changed: [osd1] => (item=osd0)
2026-07-09 14:34:02.441363 | mon1 | changed: [osd1] => (item=osd1)
2026-07-09 14:34:02.441609 | mon1 | changed: [osd1] => (item=osd2)
2026-07-09 14:34:02.441835 | mon1 |
2026-07-09 14:34:02.442136 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-07-09 14:34:02.442378 | mon1 | Thursday 09 July 2026  14:34:02 +0000 (0:00:00.747)       0:00:36.577 *********
2026-07-09 14:34:05.340115 | mon1 | changed: [osd1] => (item=osd0)
2026-07-09 14:34:05.340176 | mon1 | changed: [osd1] => (item=osd1)
2026-07-09 14:34:05.340285 | mon1 | changed: [osd1] => (item=osd2)
2026-07-09 14:34:05.340379 | mon1 |
2026-07-09 14:34:05.340532 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-07-09 14:34:05.340758 | mon1 | Thursday 09 July 2026  14:34:05 +0000 (0:00:02.899)       0:00:39.477 *********
2026-07-09 14:34:07.274445 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-07-09 14:34:07.274515 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-07-09 14:34:07.274625 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-07-09 14:34:07.274723 | mon1 |
2026-07-09 14:34:07.274813 | mon1 | PLAY RECAP *********************************************************************
2026-07-09 14:34:07.274925 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-07-09 14:34:07.275044 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-07-09 14:34:07.275137 | mon1 |
2026-07-09 14:34:07.275222 | mon1 |
2026-07-09 14:34:07.275318 | mon1 | TASKS RECAP ********************************************************************
2026-07-09 14:34:07.275415 | mon1 | Thursday 09 July 2026  14:34:07 +0000 (0:00:01.935)       0:00:41.412 *********
2026-07-09 14:34:07.275505 | mon1 | ===============================================================================
2026-07-09 14:34:07.275588 | mon1 | Install depedencies ---------------------------------------------------- 21.34s
2026-07-09 14:34:07.275725 | mon1 | Update apt cache -------------------------------------------------------- 8.35s
2026-07-09 14:34:07.275837 | mon1 | Create a volume group for each loop device ------------------------------ 2.90s
2026-07-09 14:34:07.276005 | mon1 | Create a logical volume for each loop device ---------------------------- 1.94s
2026-07-09 14:34:07.276161 | mon1 | Gathering Facts --------------------------------------------------------- 1.30s
2026-07-09 14:34:07.276301 | mon1 | Start loop devices ------------------------------------------------------ 0.75s
2026-07-09 14:34:07.276407 | mon1 | Gathering Facts --------------------------------------------------------- 0.72s
2026-07-09 14:34:07.276539 | mon1 | Configure short hostname ------------------------------------------------ 0.71s
2026-07-09 14:34:07.276673 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.70s
2026-07-09 14:34:07.276840 | mon1 | Set permissions on loopback devices ------------------------------------- 0.64s
2026-07-09 14:34:07.277023 | mon1 | Start up service -------------------------------------------------------- 0.61s
2026-07-09 14:34:07.277206 | mon1 | Create devices for Ceph ------------------------------------------------- 0.57s
2026-07-09 14:34:07.277435 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.34s
2026-07-09 14:34:07.277635 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.31s
2026-07-09 14:34:07.277855 | mon1 | Get list of all loopback devices ---------------------------------------- 0.19s
2026-07-09 14:34:07.278055 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-07-09 14:34:07.366750 | mon1 | INFO     [default > prepare] Executed: Successful
2026-07-09 14:34:07.376637 | mon1 | INFO     [default > converge] Executing
2026-07-09 14:34:08.393326 | mon1 |
2026-07-09 14:34:08.393468 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-07-09 14:34:08.393510 | mon1 |
2026-07-09 14:34:08.393802 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-09 14:34:08.394024 | mon1 | Thursday 09 July 2026  14:34:08 +0000 (0:00:00.053)       0:00:00.053 *********
2026-07-09 14:34:09.490468 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-07-09 14:34:09.490654 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-07-09 14:34:09.490842 | mon1 | interpreter could change the meaning of that path. See
2026-07-09 14:34:09.491036 | mon1 | https://docs.ansible.com/ansible-
2026-07-09 14:34:09.491286 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-09 14:34:09.502735 | mon1 | ok: [mon1]
2026-07-09 14:34:09.502893 | mon1 |
2026-07-09 14:34:09.503114 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:34:09.503328 | mon1 | Thursday 09 July 2026  14:34:09 +0000 (0:00:01.109)       0:00:01.163 *********
2026-07-09 14:34:09.831739 | mon1 | ok: [mon1]
2026-07-09 14:34:09.831896 | mon1 |
2026-07-09 14:34:09.832113 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:34:09.832402 | mon1 | Thursday 09 July 2026  14:34:09 +0000 (0:00:00.329)       0:00:01.492 *********
2026-07-09 14:34:09.863664 | mon1 | skipping: [mon1]
2026-07-09 14:34:09.863932 | mon1 |
2026-07-09 14:34:09.864118 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-09 14:34:09.864319 | mon1 | Thursday 09 July 2026  14:34:09 +0000 (0:00:00.031)       0:00:01.524 *********
2026-07-09 14:34:10.226192 | mon1 | changed: [mon1]
2026-07-09 14:34:10.226364 | mon1 |
2026-07-09 14:34:10.226579 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:34:10.226712 | mon1 | Thursday 09 July 2026  14:34:10 +0000 (0:00:00.362)       0:00:01.886 *********
2026-07-09 14:34:10.325203 | mon1 | ok: [mon1] => {
2026-07-09 14:34:10.325281 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-09 14:34:10.325440 | mon1 | }
2026-07-09 14:34:10.325571 | mon1 |
2026-07-09 14:34:10.325818 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:34:10.325968 | mon1 | Thursday 09 July 2026  14:34:10 +0000 (0:00:00.099)       0:00:01.986 *********
2026-07-09 14:34:11.176918 | mon1 | changed: [mon1]
2026-07-09 14:34:11.177026 | mon1 |
2026-07-09 14:34:11.177039 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:34:11.177051 | mon1 | Thursday 09 July 2026  14:34:11 +0000 (0:00:00.850)       0:00:02.836 *********
2026-07-09 14:34:11.217544 | mon1 | skipping: [mon1]
2026-07-09 14:34:11.217607 | mon1 |
2026-07-09 14:34:11.217913 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:34:11.217963 | mon1 | Thursday 09 July 2026  14:34:11 +0000 (0:00:00.041)       0:00:02.878 *********
2026-07-09 14:34:11.258269 | mon1 | skipping: [mon1]
2026-07-09 14:34:11.258345 | mon1 |
2026-07-09 14:34:11.258410 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:34:11.258521 | mon1 | Thursday 09 July 2026  14:34:11 +0000 (0:00:00.040)       0:00:02.919 *********
2026-07-09 14:34:11.552362 | mon1 | ok: [mon1]
2026-07-09 14:34:11.552439 | mon1 |
2026-07-09 14:34:11.552641 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:34:11.552662 | mon1 | Thursday 09 July 2026  14:34:11 +0000 (0:00:00.293)       0:00:03.213 *********
2026-07-09 14:34:13.016194 | mon1 | ok: [mon1]
2026-07-09 14:34:13.016278 | mon1 |
2026-07-09 14:34:13.016289 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:34:13.016409 | mon1 | Thursday 09 July 2026  14:34:13 +0000 (0:00:01.463)       0:00:04.677 *********
2026-07-09 14:34:13.115121 | mon1 | ok: [mon1] => {
2026-07-09 14:34:13.115382 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-09 14:34:13.115401 | mon1 | }
2026-07-09 14:34:13.115528 | mon1 |
2026-07-09 14:34:13.115717 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:34:13.115886 | mon1 | Thursday 09 July 2026  14:34:13 +0000 (0:00:00.099)       0:00:04.776 *********
2026-07-09 14:34:13.994045 | mon1 | changed: [mon1]
2026-07-09 14:34:13.994121 | mon1 |
2026-07-09 14:34:13.994305 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:34:13.994523 | mon1 | Thursday 09 July 2026  14:34:13 +0000 (0:00:00.878)       0:00:05.654 *********
2026-07-09 14:34:17.160896 | mon1 | changed: [mon1]
2026-07-09 14:34:17.160988 | mon1 |
2026-07-09 14:34:17.161130 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-09 14:34:17.161425 | mon1 | Thursday 09 July 2026  14:34:17 +0000 (0:00:03.167)       0:00:08.821 *********
2026-07-09 14:34:17.183919 | mon1 | skipping: [mon1]
2026-07-09 14:34:17.184000 | mon1 |
2026-07-09 14:34:17.184038 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-09 14:34:17.184155 | mon1 | Thursday 09 July 2026  14:34:17 +0000 (0:00:00.022)       0:00:08.844 *********
2026-07-09 14:34:17.215555 | mon1 | skipping: [mon1]
2026-07-09 14:34:17.215633 | mon1 |
2026-07-09 14:34:17.215692 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-09 14:34:17.215816 | mon1 | Thursday 09 July 2026  14:34:17 +0000 (0:00:00.029)       0:00:08.874 *********
2026-07-09 14:34:17.242290 | mon1 | skipping: [mon1]
2026-07-09 14:34:17.242467 | mon1 |
2026-07-09 14:34:17.242644 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-09 14:34:17.242785 | mon1 | Thursday 09 July 2026  14:34:17 +0000 (0:00:00.027)       0:00:08.902 *********
2026-07-09 14:34:29.632057 | mon1 | changed: [mon1]
2026-07-09 14:34:29.632707 | mon1 |
2026-07-09 14:34:29.632728 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-09 14:34:29.632737 | mon1 | Thursday 09 July 2026  14:34:29 +0000 (0:00:12.390)       0:00:21.292 *********
2026-07-09 14:34:30.245893 | mon1 | changed: [mon1]
2026-07-09 14:34:30.245936 | mon1 |
2026-07-09 14:34:30.245947 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-09 14:34:30.245952 | mon1 | Thursday 09 July 2026  14:34:30 +0000 (0:00:00.614)       0:00:21.906 *********
2026-07-09 14:34:31.155214 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-07-09 14:34:31.156261 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-09 14:34:31.156317 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-09 14:34:31.156326 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-09 14:34:31.156333 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-09 14:34:31.156340 | mon1 |
2026-07-09 14:34:31.156347 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-09 14:34:31.156354 | mon1 | Thursday 09 July 2026  14:34:31 +0000 (0:00:00.909)       0:00:22.816 *********
2026-07-09 14:34:31.829347 | mon1 | changed: [mon1]
2026-07-09 14:34:31.829419 | mon1 |
2026-07-09 14:34:31.830050 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-09 14:34:31.830099 | mon1 | Thursday 09 July 2026  14:34:31 +0000 (0:00:00.665)       0:00:23.481 *********
2026-07-09 14:34:31.830105 | mon1 |
2026-07-09 14:34:31.830111 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-07-09 14:34:31.830116 | mon1 | Thursday 09 July 2026  14:34:31 +0000 (0:00:00.008)       0:00:23.490 *********
2026-07-09 14:34:32.776594 | mon1 | ok: [mon1]
2026-07-09 14:34:32.776650 | mon1 |
2026-07-09 14:34:32.776661 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-07-09 14:34:32.776670 | mon1 | Thursday 09 July 2026  14:34:32 +0000 (0:00:00.946)       0:00:24.436 *********
2026-07-09 14:34:33.204123 | mon1 | changed: [mon1]
2026-07-09 14:34:33.204228 | mon1 |
2026-07-09 14:34:33.204249 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-09 14:34:33.204437 | mon1 | Thursday 09 July 2026  14:34:33 +0000 (0:00:00.427)       0:00:24.864 *********
2026-07-09 14:34:33.751155 | mon1 | changed: [mon1]
2026-07-09 14:34:33.751224 | mon1 |
2026-07-09 14:34:33.751344 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:34:33.751476 | mon1 | Thursday 09 July 2026  14:34:33 +0000 (0:00:00.547)       0:00:25.412 *********
2026-07-09 14:34:33.953859 | mon1 | ok: [mon1]
2026-07-09 14:34:33.953907 | mon1 |
2026-07-09 14:34:33.953913 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:34:33.953918 | mon1 | Thursday 09 July 2026  14:34:33 +0000 (0:00:00.202)       0:00:25.614 *********
2026-07-09 14:34:34.032428 | mon1 | ok: [mon1] => {
2026-07-09 14:34:34.032532 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-09 14:34:34.032542 | mon1 | }
2026-07-09 14:34:34.032548 | mon1 |
2026-07-09 14:34:34.032555 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:34:34.032561 | mon1 | Thursday 09 July 2026  14:34:34 +0000 (0:00:00.077)       0:00:25.692 *********
2026-07-09 14:34:34.952211 | mon1 | changed: [mon1]
2026-07-09 14:34:34.952365 | mon1 |
2026-07-09 14:34:34.952375 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:34:34.952380 | mon1 | Thursday 09 July 2026  14:34:34 +0000 (0:00:00.920)       0:00:26.612 *********
2026-07-09 14:34:39.666018 | mon1 | changed: [mon1]
2026-07-09 14:34:39.666104 | mon1 |
2026-07-09 14:34:39.666418 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-09 14:34:39.666469 | mon1 | Thursday 09 July 2026  14:34:39 +0000 (0:00:04.713)       0:00:31.326 *********
2026-07-09 14:34:40.841995 | mon1 | ok: [mon1]
2026-07-09 14:34:40.842057 | mon1 |
2026-07-09 14:34:40.842316 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-09 14:34:40.842471 | mon1 | Thursday 09 July 2026  14:34:40 +0000 (0:00:01.176)       0:00:32.503 *********
2026-07-09 14:34:41.647064 | mon1 | changed: [mon1]
2026-07-09 14:34:41.647166 | mon1 |
2026-07-09 14:34:41.647312 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-09 14:34:41.647449 | mon1 | Thursday 09 July 2026  14:34:41 +0000 (0:00:00.804)       0:00:33.307 *********
2026-07-09 14:34:42.129126 | mon1 | changed: [mon1]
2026-07-09 14:34:42.129168 | mon1 |
2026-07-09 14:34:42.129174 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-09 14:34:42.129178 | mon1 | Thursday 09 July 2026  14:34:42 +0000 (0:00:00.481)       0:00:33.789 *********
2026-07-09 14:34:42.739465 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-07-09 14:34:42.739516 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-09 14:34:42.739522 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-09 14:34:42.739527 | mon1 |
2026-07-09 14:34:42.739531 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-09 14:34:42.739536 | mon1 | Thursday 09 July 2026  14:34:42 +0000 (0:00:00.610)       0:00:34.400 *********
2026-07-09 14:34:43.193666 | mon1 | changed: [mon1]
2026-07-09 14:34:43.193767 | mon1 |
2026-07-09 14:34:43.194090 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-09 14:34:43.194138 | mon1 | Thursday 09 July 2026  14:34:43 +0000 (0:00:00.454)       0:00:34.854 *********
2026-07-09 14:34:43.762902 | mon1 | changed: [mon1]
2026-07-09 14:34:43.763021 | mon1 |
2026-07-09 14:34:43.763033 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-09 14:34:43.763175 | mon1 | Thursday 09 July 2026  14:34:43 +0000 (0:00:00.562)       0:00:35.416 *********
2026-07-09 14:34:43.763569 | mon1 |
2026-07-09 14:34:43.763642 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-07-09 14:34:43.763666 | mon1 | Thursday 09 July 2026  14:34:43 +0000 (0:00:00.006)       0:00:35.423 *********
2026-07-09 14:34:44.504592 | mon1 | ok: [mon1]
2026-07-09 14:34:44.504681 | mon1 |
2026-07-09 14:34:44.504700 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-07-09 14:34:44.504836 | mon1 | Thursday 09 July 2026  14:34:44 +0000 (0:00:00.741)       0:00:36.165 *********
2026-07-09 14:34:47.792315 | mon1 | changed: [mon1]
2026-07-09 14:34:47.792401 | mon1 |
2026-07-09 14:34:47.792413 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-09 14:34:47.792548 | mon1 | Thursday 09 July 2026  14:34:47 +0000 (0:00:03.287)       0:00:39.453 *********
2026-07-09 14:34:48.332865 | mon1 | changed: [mon1]
2026-07-09 14:34:48.332933 | mon1 |
2026-07-09 14:34:48.333210 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-09 14:34:48.333250 | mon1 | Thursday 09 July 2026  14:34:48 +0000 (0:00:00.540)       0:00:39.993 *********
2026-07-09 14:34:48.378119 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-07-09 14:34:48.378218 | mon1 |
2026-07-09 14:34:48.378248 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-09 14:34:48.378357 | mon1 | Thursday 09 July 2026  14:34:48 +0000 (0:00:00.045)       0:00:40.039 *********
2026-07-09 14:35:24.517027 | mon1 | changed: [mon1]
2026-07-09 14:35:24.517157 | mon1 |
2026-07-09 14:35:24.517167 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-09 14:35:24.517326 | mon1 | Thursday 09 July 2026  14:35:24 +0000 (0:00:36.138)       0:01:16.177 *********
2026-07-09 14:35:25.336959 | mon1 | ok: [mon1] => (item=chronyd)
2026-07-09 14:35:25.337018 | mon1 | ok: [mon1] => (item=sshd)
2026-07-09 14:35:25.337500 | mon1 |
2026-07-09 14:35:25.337549 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-09 14:35:25.337557 | mon1 | Thursday 09 July 2026  14:35:25 +0000 (0:00:00.820)       0:01:16.997 *********
2026-07-09 14:35:25.666920 | mon1 | changed: [mon1]
2026-07-09 14:35:25.667027 | mon1 |
2026-07-09 14:35:25.667370 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-09 14:35:25.667526 | mon1 | Thursday 09 July 2026  14:35:25 +0000 (0:00:00.329)       0:01:17.327 *********
2026-07-09 14:35:25.881183 | mon1 | ok: [mon1]
2026-07-09 14:35:25.881230 | mon1 |
2026-07-09 14:35:25.881235 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-09 14:35:25.881240 | mon1 | Thursday 09 July 2026  14:35:25 +0000 (0:00:00.214)       0:01:17.541 *********
2026-07-09 14:35:26.395832 | mon1 | changed: [mon1]
2026-07-09 14:35:26.395903 | mon1 |
2026-07-09 14:35:26.396163 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-09 14:35:26.396207 | mon1 | Thursday 09 July 2026  14:35:26 +0000 (0:00:00.514)       0:01:18.056 *********
2026-07-09 14:35:26.779321 | mon1 | changed: [mon1]
2026-07-09 14:35:26.779392 | mon1 |
2026-07-09 14:35:26.779629 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-07-09 14:35:26.779670 | mon1 | Thursday 09 July 2026  14:35:26 +0000 (0:00:00.383)       0:01:18.440 *********
2026-07-09 14:35:26.908376 | mon1 | ok: [mon1]
2026-07-09 14:35:26.908438 | mon1 |
2026-07-09 14:35:26.908691 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-07-09 14:35:26.908709 | mon1 | Thursday 09 July 2026  14:35:26 +0000 (0:00:00.129)       0:01:18.569 *********
2026-07-09 14:35:27.136979 | mon1 | ok: [mon1] => (item=mon1)
2026-07-09 14:35:27.137059 | mon1 |
2026-07-09 14:35:27.137239 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-07-09 14:35:27.137255 | mon1 | Thursday 09 July 2026  14:35:27 +0000 (0:00:00.228)       0:01:18.798 *********
2026-07-09 14:35:27.186054 | mon1 | ok: [mon1]
2026-07-09 14:35:27.186123 | mon1 |
2026-07-09 14:35:27.186310 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-07-09 14:35:27.186354 | mon1 | Thursday 09 July 2026  14:35:27 +0000 (0:00:00.048)       0:01:18.847 *********
2026-07-09 14:35:27.270622 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1
2026-07-09 14:35:27.270704 | mon1 |
2026-07-09 14:35:27.270951 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-07-09 14:35:27.271001 | mon1 | Thursday 09 July 2026  14:35:27 +0000 (0:00:00.084)       0:01:18.931 *********
2026-07-09 14:35:27.614488 | mon1 | changed: [mon1]
2026-07-09 14:35:27.614608 | mon1 |
2026-07-09 14:35:27.614623 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-07-09 14:35:27.614794 | mon1 | Thursday 09 July 2026  14:35:27 +0000 (0:00:00.343)       0:01:19.275 *********
2026-07-09 14:35:28.378869 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-07-09 14:35:28.378912 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-07-09 14:35:28.378917 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-07-09 14:35:28.378922 | mon1 |
2026-07-09 14:35:28.378927 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-07-09 14:35:28.378931 | mon1 | Thursday 09 July 2026  14:35:28 +0000 (0:00:00.764)       0:01:20.039 *********
2026-07-09 14:39:22.953046 | mon1 | ok: [mon1]
2026-07-09 14:39:22.953112 | mon1 |
2026-07-09 14:39:22.953119 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-07-09 14:39:22.953127 | mon1 | Thursday 09 July 2026  14:39:22 +0000 (0:03:54.573)       0:05:14.613 *********
2026-07-09 14:39:23.171603 | mon1 | changed: [mon1]
2026-07-09 14:39:23.171749 | mon1 |
2026-07-09 14:39:23.172226 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-07-09 14:39:23.172312 | mon1 | Thursday 09 July 2026  14:39:23 +0000 (0:00:00.218)       0:05:14.832 *********
2026-07-09 14:39:23.216207 | mon1 | ok: [mon1]
2026-07-09 14:39:23.223031 | mon1 |
2026-07-09 14:39:23.223196 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-09 14:39:23.223209 | mon1 | Thursday 09 July 2026  14:39:23 +0000 (0:00:00.043)       0:05:14.876 *********
2026-07-09 14:39:23.290805 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-07-09 14:39:23.291244 | mon1 |
2026-07-09 14:39:23.291351 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-09 14:39:23.291376 | mon1 | Thursday 09 July 2026  14:39:23 +0000 (0:00:00.075)       0:05:14.951 *********
2026-07-09 14:39:31.775392 | mon1 | ok: [mon1]
2026-07-09 14:39:31.775497 | mon1 |
2026-07-09 14:39:31.775527 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-09 14:39:31.775543 | mon1 | Thursday 09 July 2026  14:39:31 +0000 (0:00:08.484)       0:05:23.436 *********
2026-07-09 14:39:31.828091 | mon1 | ok: [mon1] => (item=mon1)
2026-07-09 14:39:31.828200 | mon1 |
2026-07-09 14:39:31.828340 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-09 14:39:31.828477 | mon1 | Thursday 09 July 2026  14:39:31 +0000 (0:00:00.051)       0:05:23.488 *********
2026-07-09 14:39:32.233017 | mon1 | ok: [mon1]
2026-07-09 14:39:32.242298 | mon1 |
2026-07-09 14:39:32.242346 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-09 14:39:32.242357 | mon1 | Thursday 09 July 2026  14:39:32 +0000 (0:00:00.405)       0:05:23.893 *********
2026-07-09 14:39:41.722919 | mon1 | ok: [mon1]
2026-07-09 14:39:41.723130 | mon1 |
2026-07-09 14:39:41.723489 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-07-09 14:39:41.723752 | mon1 | Thursday 09 July 2026  14:39:41 +0000 (0:00:09.489)       0:05:33.383 *********
2026-07-09 14:39:56.827206 | mon1 | changed: [mon1]
2026-07-09 14:39:56.827271 | mon1 |
2026-07-09 14:39:56.827757 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-07-09 14:39:56.827866 | mon1 | Thursday 09 July 2026  14:39:56 +0000 (0:00:15.103)       0:05:48.487 *********
2026-07-09 14:40:11.930243 | mon1 | ok: [mon1]
2026-07-09 14:40:11.930337 | mon1 |
2026-07-09 14:40:11.930372 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-09 14:40:11.930439 | mon1 | Thursday 09 July 2026  14:40:11 +0000 (0:00:15.103)       0:06:03.590 *********
2026-07-09 14:40:11.995145 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-07-09 14:40:11.995190 | mon1 |
2026-07-09 14:40:11.995196 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-09 14:40:11.995201 | mon1 | Thursday 09 July 2026  14:40:11 +0000 (0:00:00.065)       0:06:03.655 *********
2026-07-09 14:40:12.041387 | mon1 | skipping: [mon1]
2026-07-09 14:40:12.041459 | mon1 |
2026-07-09 14:40:12.041877 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-09 14:40:12.041929 | mon1 | Thursday 09 July 2026  14:40:12 +0000 (0:00:00.046)       0:06:03.702 *********
2026-07-09 14:40:12.081330 | mon1 | skipping: [mon1] => (item=mon1)
2026-07-09 14:40:12.081396 | mon1 | skipping: [mon1]
2026-07-09 14:40:12.081762 | mon1 |
2026-07-09 14:40:12.081814 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-09 14:40:12.081822 | mon1 | Thursday 09 July 2026  14:40:12 +0000 (0:00:00.039)       0:06:03.742 *********
2026-07-09 14:40:12.363969 | mon1 | ok: [mon1]
2026-07-09 14:40:12.364485 | mon1 |
2026-07-09 14:40:12.364536 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-09 14:40:12.364551 | mon1 | Thursday 09 July 2026  14:40:12 +0000 (0:00:00.282)       0:06:04.024 *********
2026-07-09 14:40:20.218171 | mon1 | ok: [mon1]
2026-07-09 14:40:20.218216 | mon1 |
2026-07-09 14:40:20.218221 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-07-09 14:40:20.218226 | mon1 | Thursday 09 July 2026  14:40:20 +0000 (0:00:07.854)       0:06:11.879 *********
2026-07-09 14:40:32.192820 | mon1 | changed: [mon1]
2026-07-09 14:40:32.192898 | mon1 |
2026-07-09 14:40:32.193089 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-07-09 14:40:32.193135 | mon1 | Thursday 09 July 2026  14:40:32 +0000 (0:00:11.974)       0:06:23.853 *********
2026-07-09 14:40:38.517760 | mon1 | ok: [mon1]
2026-07-09 14:40:38.517812 | mon1 |
2026-07-09 14:40:38.517818 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-07-09 14:40:38.517823 | mon1 | Thursday 09 July 2026  14:40:38 +0000 (0:00:06.324)       0:06:30.178 *********
2026-07-09 14:40:45.659232 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'})
2026-07-09 14:40:45.659297 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-07-09 14:40:45.659436 | mon1 | changed: [mon1] => (item={'name': 'prometheus'})
2026-07-09 14:40:45.659554 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-07-09 14:40:45.659681 | mon1 |
2026-07-09 14:40:45.659843 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-07-09 14:40:45.659950 | mon1 |
2026-07-09 14:40:45.660080 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-09 14:40:45.660201 | mon1 | Thursday 09 July 2026  14:40:45 +0000 (0:00:07.141)       0:06:37.320 *********
2026-07-09 14:40:46.791988 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-07-09 14:40:46.792114 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-07-09 14:40:46.792199 | mon1 | interpreter could change the meaning of that path. See
2026-07-09 14:40:46.792345 | mon1 | https://docs.ansible.com/ansible-
2026-07-09 14:40:46.792504 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-09 14:40:46.803116 | mon1 | ok: [osd1]
2026-07-09 14:40:46.803275 | mon1 |
2026-07-09 14:40:46.803461 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:40:46.803646 | mon1 | Thursday 09 July 2026  14:40:46 +0000 (0:00:01.143)       0:06:38.464 *********
2026-07-09 14:40:47.023046 | mon1 | ok: [osd1]
2026-07-09 14:40:47.023230 | mon1 |
2026-07-09 14:40:47.023256 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:40:47.023267 | mon1 | Thursday 09 July 2026  14:40:47 +0000 (0:00:00.219)       0:06:38.683 *********
2026-07-09 14:40:47.057351 | mon1 | skipping: [osd1]
2026-07-09 14:40:47.057449 | mon1 |
2026-07-09 14:40:47.057457 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-09 14:40:47.057559 | mon1 | Thursday 09 July 2026  14:40:47 +0000 (0:00:00.034)       0:06:38.718 *********
2026-07-09 14:40:47.274092 | mon1 | changed: [osd1]
2026-07-09 14:40:47.274228 | mon1 |
2026-07-09 14:40:47.274259 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:40:47.274384 | mon1 | Thursday 09 July 2026  14:40:47 +0000 (0:00:00.216)       0:06:38.935 *********
2026-07-09 14:40:47.329143 | mon1 | ok: [osd1] => {
2026-07-09 14:40:47.329263 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-09 14:40:47.329276 | mon1 | }
2026-07-09 14:40:47.329318 | mon1 |
2026-07-09 14:40:47.329425 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:40:47.329520 | mon1 | Thursday 09 July 2026  14:40:47 +0000 (0:00:00.055)       0:06:38.990 *********
2026-07-09 14:40:47.943333 | mon1 | changed: [osd1]
2026-07-09 14:40:47.943459 | mon1 |
2026-07-09 14:40:47.943551 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:40:47.943648 | mon1 | Thursday 09 July 2026  14:40:47 +0000 (0:00:00.613)       0:06:39.604 *********
2026-07-09 14:40:47.986746 | mon1 | skipping: [osd1]
2026-07-09 14:40:47.986840 | mon1 |
2026-07-09 14:40:47.986850 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:40:47.986967 | mon1 | Thursday 09 July 2026  14:40:47 +0000 (0:00:00.043)       0:06:39.647 *********
2026-07-09 14:40:48.026432 | mon1 | skipping: [osd1]
2026-07-09 14:40:48.026547 | mon1 |
2026-07-09 14:40:48.026635 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:40:48.026653 | mon1 | Thursday 09 July 2026  14:40:48 +0000 (0:00:00.039)       0:06:39.687 *********
2026-07-09 14:40:48.228098 | mon1 | ok: [osd1]
2026-07-09 14:40:48.228211 | mon1 |
2026-07-09 14:40:48.228219 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:40:48.228308 | mon1 | Thursday 09 July 2026  14:40:48 +0000 (0:00:00.201)       0:06:39.889 *********
2026-07-09 14:40:49.329334 | mon1 | ok: [osd1]
2026-07-09 14:40:49.329409 | mon1 |
2026-07-09 14:40:49.329523 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:40:49.329706 | mon1 | Thursday 09 July 2026  14:40:49 +0000 (0:00:01.101)       0:06:40.990 *********
2026-07-09 14:40:49.393910 | mon1 | ok: [osd1] => {
2026-07-09 14:40:49.394020 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-09 14:40:49.394105 | mon1 | }
2026-07-09 14:40:49.394187 | mon1 |
2026-07-09 14:40:49.394316 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:40:49.394374 | mon1 | Thursday 09 July 2026  14:40:49 +0000 (0:00:00.064)       0:06:41.055 *********
2026-07-09 14:40:50.238997 | mon1 | changed: [osd1]
2026-07-09 14:40:50.239073 | mon1 |
2026-07-09 14:40:50.239141 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:40:50.239281 | mon1 | Thursday 09 July 2026  14:40:50 +0000 (0:00:00.845)       0:06:41.900 *********
2026-07-09 14:40:52.946747 | mon1 | changed: [osd1]
2026-07-09 14:40:52.946797 | mon1 |
2026-07-09 14:40:52.946803 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-09 14:40:52.946808 | mon1 | Thursday 09 July 2026  14:40:52 +0000 (0:00:02.707)       0:06:44.607 *********
2026-07-09 14:40:52.972023 | mon1 | skipping: [osd1]
2026-07-09 14:40:52.972070 | mon1 |
2026-07-09 14:40:52.972078 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-09 14:40:52.972084 | mon1 | Thursday 09 July 2026  14:40:52 +0000 (0:00:00.024)       0:06:44.632 *********
2026-07-09 14:40:52.996766 | mon1 | skipping: [osd1]
2026-07-09 14:40:52.996824 | mon1 |
2026-07-09 14:40:52.996833 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-09 14:40:52.996840 | mon1 | Thursday 09 July 2026  14:40:52 +0000 (0:00:00.024)       0:06:44.657 *********
2026-07-09 14:40:53.021007 | mon1 | skipping: [osd1]
2026-07-09 14:40:53.021057 | mon1 |
2026-07-09 14:40:53.021065 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-09 14:40:53.021072 | mon1 | Thursday 09 July 2026  14:40:53 +0000 (0:00:00.024)       0:06:44.681 *********
2026-07-09 14:40:58.513522 | mon1 | changed: [osd1]
2026-07-09 14:40:58.513575 | mon1 |
2026-07-09 14:40:58.513582 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-09 14:40:58.513589 | mon1 | Thursday 09 July 2026  14:40:58 +0000 (0:00:05.492)       0:06:50.174 *********
2026-07-09 14:40:59.009513 | mon1 | changed: [osd1]
2026-07-09 14:40:59.009672 | mon1 |
2026-07-09 14:40:59.009846 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-09 14:40:59.009988 | mon1 | Thursday 09 July 2026  14:40:59 +0000 (0:00:00.496)       0:06:50.670 *********
2026-07-09 14:40:59.955047 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'})
2026-07-09 14:40:59.955114 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-09 14:40:59.955305 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-09 14:40:59.955443 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-09 14:40:59.955576 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-09 14:40:59.955688 | mon1 |
2026-07-09 14:40:59.955813 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-09 14:40:59.955927 | mon1 | Thursday 09 July 2026  14:40:59 +0000 (0:00:00.945)       0:06:51.616 *********
2026-07-09 14:41:00.517697 | mon1 | changed: [osd1]
2026-07-09 14:41:00.517797 | mon1 |
2026-07-09 14:41:00.517940 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-09 14:41:00.518142 | mon1 | Thursday 09 July 2026  14:41:00 +0000 (0:00:00.555)       0:06:52.171 *********
2026-07-09 14:41:00.518262 | mon1 |
2026-07-09 14:41:00.518406 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-07-09 14:41:00.518533 | mon1 | Thursday 09 July 2026  14:41:00 +0000 (0:00:00.006)       0:06:52.178 *********
2026-07-09 14:41:01.188286 | mon1 | ok: [osd1]
2026-07-09 14:41:01.188428 | mon1 |
2026-07-09 14:41:01.188626 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-07-09 14:41:01.188835 | mon1 | Thursday 09 July 2026  14:41:01 +0000 (0:00:00.670)       0:06:52.848 *********
2026-07-09 14:41:01.598298 | mon1 | changed: [osd1]
2026-07-09 14:41:01.598353 | mon1 |
2026-07-09 14:41:01.598477 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-09 14:41:01.598575 | mon1 | Thursday 09 July 2026  14:41:01 +0000 (0:00:00.410)       0:06:53.259 *********
2026-07-09 14:41:02.147144 | mon1 | changed: [osd1]
2026-07-09 14:41:02.147237 | mon1 |
2026-07-09 14:41:02.147459 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:41:02.147654 | mon1 | Thursday 09 July 2026  14:41:02 +0000 (0:00:00.548)       0:06:53.807 *********
2026-07-09 14:41:02.349463 | mon1 | ok: [osd1]
2026-07-09 14:41:02.349567 | mon1 |
2026-07-09 14:41:02.349580 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:41:02.349592 | mon1 | Thursday 09 July 2026  14:41:02 +0000 (0:00:00.201)       0:06:54.009 *********
2026-07-09 14:41:02.412705 | mon1 | ok: [osd1] => {
2026-07-09 14:41:02.412760 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-09 14:41:02.412768 | mon1 | }
2026-07-09 14:41:02.412774 | mon1 |
2026-07-09 14:41:02.412781 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:41:02.412788 | mon1 | Thursday 09 July 2026  14:41:02 +0000 (0:00:00.063)       0:06:54.072 *********
2026-07-09 14:41:03.368893 | mon1 | changed: [osd1]
2026-07-09 14:41:03.368978 | mon1 |
2026-07-09 14:41:03.369055 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:41:03.369205 | mon1 | Thursday 09 July 2026  14:41:03 +0000 (0:00:00.957)       0:06:55.030 *********
2026-07-09 14:41:07.776956 | mon1 | changed: [osd1]
2026-07-09 14:41:07.777094 | mon1 |
2026-07-09 14:41:07.777376 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-09 14:41:07.777424 | mon1 | Thursday 09 July 2026  14:41:07 +0000 (0:00:04.408)       0:06:59.438 *********
2026-07-09 14:41:08.857179 | mon1 | ok: [osd1]
2026-07-09 14:41:08.857260 | mon1 |
2026-07-09 14:41:08.857527 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-09 14:41:08.857578 | mon1 | Thursday 09 July 2026  14:41:08 +0000 (0:00:01.080)       0:07:00.518 *********
2026-07-09 14:41:09.078470 | mon1 | changed: [osd1]
2026-07-09 14:41:09.078540 | mon1 |
2026-07-09 14:41:09.078736 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-09 14:41:09.078776 | mon1 | Thursday 09 July 2026  14:41:09 +0000 (0:00:00.221)       0:07:00.739 *********
2026-07-09 14:41:09.540535 | mon1 | changed: [osd1]
2026-07-09 14:41:09.540619 | mon1 |
2026-07-09 14:41:09.540890 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-09 14:41:09.540909 | mon1 | Thursday 09 July 2026  14:41:09 +0000 (0:00:00.461)       0:07:01.201 *********
2026-07-09 14:41:10.113538 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'})
2026-07-09 14:41:10.113624 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-09 14:41:10.114080 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-09 14:41:10.114131 | mon1 |
2026-07-09 14:41:10.114138 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-09 14:41:10.114145 | mon1 | Thursday 09 July 2026  14:41:10 +0000 (0:00:00.573)       0:07:01.774 *********
2026-07-09 14:41:10.589015 | mon1 | changed: [osd1]
2026-07-09 14:41:10.589111 | mon1 |
2026-07-09 14:41:10.589386 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-09 14:41:10.589468 | mon1 | Thursday 09 July 2026  14:41:10 +0000 (0:00:00.474)       0:07:02.249 *********
2026-07-09 14:41:11.052003 | mon1 | changed: [osd1]
2026-07-09 14:41:11.052055 | mon1 |
2026-07-09 14:41:11.052061 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-09 14:41:11.052066 | mon1 | Thursday 09 July 2026  14:41:11 +0000 (0:00:00.456)       0:07:02.706 *********
2026-07-09 14:41:11.052070 | mon1 |
2026-07-09 14:41:11.052074 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-07-09 14:41:11.052078 | mon1 | Thursday 09 July 2026  14:41:11 +0000 (0:00:00.006)       0:07:02.712 *********
2026-07-09 14:41:11.757381 | mon1 | ok: [osd1]
2026-07-09 14:41:11.757458 | mon1 |
2026-07-09 14:41:11.757472 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-07-09 14:41:11.757626 | mon1 | Thursday 09 July 2026  14:41:11 +0000 (0:00:00.706)       0:07:03.418 *********
2026-07-09 14:41:12.517328 | mon1 | changed: [osd1]
2026-07-09 14:41:12.517410 | mon1 |
2026-07-09 14:41:12.517640 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-09 14:41:12.517689 | mon1 | Thursday 09 July 2026  14:41:12 +0000 (0:00:00.759)       0:07:04.178 *********
2026-07-09 14:41:13.088358 | mon1 | changed: [osd1]
2026-07-09 14:41:13.088433 | mon1 |
2026-07-09 14:41:13.088680 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-09 14:41:13.088732 | mon1 | Thursday 09 July 2026  14:41:13 +0000 (0:00:00.570)       0:07:04.749 *********
2026-07-09 14:41:13.142715 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-07-09 14:41:13.142784 | mon1 |
2026-07-09 14:41:13.143173 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-09 14:41:13.143255 | mon1 | Thursday 09 July 2026  14:41:13 +0000 (0:00:00.054)       0:07:04.803 *********
2026-07-09 14:41:18.091128 | mon1 | changed: [osd1]
2026-07-09 14:41:18.091193 | mon1 |
2026-07-09 14:41:18.091211 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-09 14:41:18.091221 | mon1 | Thursday 09 July 2026  14:41:18 +0000 (0:00:04.948)       0:07:09.751 *********
2026-07-09 14:41:18.781196 | mon1 | ok: [osd1] => (item=chronyd)
2026-07-09 14:41:18.781272 | mon1 | ok: [osd1] => (item=sshd)
2026-07-09 14:41:18.781322 | mon1 |
2026-07-09 14:41:18.781593 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-09 14:41:18.781667 | mon1 | Thursday 09 July 2026  14:41:18 +0000 (0:00:00.690)       0:07:10.441 *********
2026-07-09 14:41:19.096932 | mon1 | changed: [osd1]
2026-07-09 14:41:19.097042 | mon1 |
2026-07-09 14:41:19.097051 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-09 14:41:19.097080 | mon1 | Thursday 09 July 2026  14:41:19 +0000 (0:00:00.316)       0:07:10.757 *********
2026-07-09 14:41:19.302366 | mon1 | ok: [osd1]
2026-07-09 14:41:19.302490 | mon1 |
2026-07-09 14:41:19.303232 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-09 14:41:19.303547 | mon1 | Thursday 09 July 2026  14:41:19 +0000 (0:00:00.205)       0:07:10.962 *********
2026-07-09 14:41:19.606011 | mon1 | changed: [osd1]
2026-07-09 14:41:19.606106 | mon1 |
2026-07-09 14:41:19.606122 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-09 14:41:19.606258 | mon1 | Thursday 09 July 2026  14:41:19 +0000 (0:00:00.303)       0:07:11.266 *********
2026-07-09 14:41:19.817096 | mon1 | changed: [osd1]
2026-07-09 14:41:19.817225 | mon1 |
2026-07-09 14:41:19.817238 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-07-09 14:41:19.817263 | mon1 | Thursday 09 July 2026  14:41:19 +0000 (0:00:00.211)       0:07:11.478 *********
2026-07-09 14:41:20.083527 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-07-09 14:41:20.083591 | mon1 |
2026-07-09 14:41:20.083816 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-07-09 14:41:20.083832 | mon1 | Thursday 09 July 2026  14:41:20 +0000 (0:00:00.266)       0:07:11.744 *********
2026-07-09 14:41:20.136638 | mon1 | ok: [osd1]
2026-07-09 14:41:20.136734 | mon1 |
2026-07-09 14:41:20.137072 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-09 14:41:20.137151 | mon1 | Thursday 09 July 2026  14:41:20 +0000 (0:00:00.052)       0:07:11.797 *********
2026-07-09 14:41:20.188645 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-07-09 14:41:20.188804 | mon1 |
2026-07-09 14:41:20.188824 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-09 14:41:20.188844 | mon1 | Thursday 09 July 2026  14:41:20 +0000 (0:00:00.052)       0:07:11.849 *********
2026-07-09 14:41:26.900224 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-09 14:41:26.900332 | mon1 |
2026-07-09 14:41:26.900734 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-09 14:41:26.900782 | mon1 | Thursday 09 July 2026  14:41:26 +0000 (0:00:06.711)       0:07:18.560 *********
2026-07-09 14:41:26.945661 | mon1 | ok: [osd1] => (item=osd1)
2026-07-09 14:41:26.945737 | mon1 |
2026-07-09 14:41:26.945931 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-09 14:41:26.945975 | mon1 | Thursday 09 July 2026  14:41:26 +0000 (0:00:00.046)       0:07:18.606 *********
2026-07-09 14:41:27.214975 | mon1 | changed: [osd1]
2026-07-09 14:41:27.215110 | mon1 |
2026-07-09 14:41:27.215155 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-09 14:41:27.215300 | mon1 | Thursday 09 July 2026  14:41:27 +0000 (0:00:00.268)       0:07:18.875 *********
2026-07-09 14:41:36.443165 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-09 14:41:36.443305 | mon1 |
2026-07-09 14:41:36.443323 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-07-09 14:41:36.443449 | mon1 | Thursday 09 July 2026  14:41:36 +0000 (0:00:09.228)       0:07:28.104 *********
2026-07-09 14:41:37.970383 | mon1 | ok: [osd1]
2026-07-09 14:41:37.970516 | mon1 |
2026-07-09 14:41:37.970701 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-07-09 14:41:37.970880 | mon1 | Thursday 09 July 2026  14:41:37 +0000 (0:00:01.526)       0:07:29.630 *********
2026-07-09 14:42:19.842587 | mon1 | ok: [osd1]
2026-07-09 14:42:19.842638 | mon1 |
2026-07-09 14:42:19.842661 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-07-09 14:42:19.842890 | mon1 | Thursday 09 July 2026  14:42:19 +0000 (0:00:41.871)       0:08:11.502 *********
2026-07-09 14:43:58.594520 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data)
2026-07-09 14:43:58.594615 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data)
2026-07-09 14:43:58.594624 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data)
2026-07-09 14:43:58.594630 | mon1 |
2026-07-09 14:43:58.594636 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-07-09 14:43:58.594642 | mon1 | Thursday 09 July 2026  14:43:58 +0000 (0:01:38.751)       0:09:50.253 *********
2026-07-09 14:44:08.061745 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-09 14:44:08.061828 | mon1 |
2026-07-09 14:44:08.062066 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-07-09 14:44:08.062141 | mon1 | Thursday 09 July 2026  14:44:08 +0000 (0:00:09.468)       0:09:59.722 *********
2026-07-09 14:44:17.797115 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-09 14:44:17.797642 | mon1 |
2026-07-09 14:44:17.797691 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-07-09 14:44:17.797699 | mon1 | Thursday 09 July 2026  14:44:17 +0000 (0:00:09.735)       0:10:09.457 *********
2026-07-09 14:44:17.853180 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-07-09 14:44:17.853262 | mon1 |
2026-07-09 14:44:17.853537 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-07-09 14:44:17.853586 | mon1 | Thursday 09 July 2026  14:44:17 +0000 (0:00:00.056)       0:10:09.514 *********
2026-07-09 14:44:17.898081 | mon1 | ok: [osd1]
2026-07-09 14:44:17.898157 | mon1 |
2026-07-09 14:44:17.898438 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-07-09 14:44:17.898482 | mon1 | Thursday 09 July 2026  14:44:17 +0000 (0:00:00.044)       0:10:09.559 *********
2026-07-09 14:44:29.225114 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-09 14:44:29.225237 | mon1 |
2026-07-09 14:44:29.225246 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-07-09 14:44:29.225371 | mon1 | Thursday 09 July 2026  14:44:29 +0000 (0:00:11.326)       0:10:20.886 *********
2026-07-09 14:44:29.266922 | mon1 | ok: [osd1]
2026-07-09 14:44:29.267015 | mon1 |
2026-07-09 14:44:29.267147 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-07-09 14:44:29.267181 | mon1 | Thursday 09 July 2026  14:44:29 +0000 (0:00:00.041)       0:10:20.927 *********
2026-07-09 14:44:29.304828 | mon1 | skipping: [osd1] => (item=1)
2026-07-09 14:44:29.304873 | mon1 | skipping: [osd1] => (item=1)
2026-07-09 14:44:29.304878 | mon1 | skipping: [osd1] => (item=1)
2026-07-09 14:44:29.304883 | mon1 | skipping: [osd1]
2026-07-09 14:44:29.304889 | mon1 |
2026-07-09 14:44:29.304894 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-07-09 14:44:29.304899 | mon1 | Thursday 09 July 2026  14:44:29 +0000 (0:00:00.037)       0:10:20.965 *********
2026-07-09 14:44:29.373143 | mon1 | skipping: [osd1]
2026-07-09 14:44:29.373228 | mon1 |
2026-07-09 14:44:29.373611 | mon1 | PLAY [Deploy Ceph exporters] ***************************************************
2026-07-09 14:44:29.373660 | mon1 |
2026-07-09 14:44:29.373666 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-09 14:44:29.373671 | mon1 | Thursday 09 July 2026  14:44:29 +0000 (0:00:00.069)       0:10:21.034 *********
2026-07-09 14:44:30.374273 | mon1 | ok: [mon1]
2026-07-09 14:44:30.374348 | mon1 |
2026-07-09 14:44:30.374735 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:44:30.374781 | mon1 | Thursday 09 July 2026  14:44:30 +0000 (0:00:01.000)       0:10:22.035 *********
2026-07-09 14:44:30.594234 | mon1 | ok: [mon1]
2026-07-09 14:44:30.594317 | mon1 |
2026-07-09 14:44:30.594666 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:44:30.594715 | mon1 | Thursday 09 July 2026  14:44:30 +0000 (0:00:00.219)       0:10:22.255 *********
2026-07-09 14:44:30.631457 | mon1 | skipping: [mon1]
2026-07-09 14:44:30.631528 | mon1 |
2026-07-09 14:44:30.631618 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-09 14:44:30.631719 | mon1 | Thursday 09 July 2026  14:44:30 +0000 (0:00:00.037)       0:10:22.292 *********
2026-07-09 14:44:30.850626 | mon1 | ok: [mon1]
2026-07-09 14:44:30.850780 | mon1 |
2026-07-09 14:44:30.851044 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:44:30.851363 | mon1 | Thursday 09 July 2026  14:44:30 +0000 (0:00:00.218)       0:10:22.511 *********
2026-07-09 14:44:30.900742 | mon1 | ok: [mon1] => {
2026-07-09 14:44:30.901036 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-09 14:44:30.901271 | mon1 | }
2026-07-09 14:44:30.901471 | mon1 |
2026-07-09 14:44:30.901755 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:44:30.901981 | mon1 | Thursday 09 July 2026  14:44:30 +0000 (0:00:00.050)       0:10:22.561 *********
2026-07-09 14:44:31.225135 | mon1 | ok: [mon1]
2026-07-09 14:44:31.225291 | mon1 |
2026-07-09 14:44:31.225558 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:44:31.225768 | mon1 | Thursday 09 July 2026  14:44:31 +0000 (0:00:00.324)       0:10:22.885 *********
2026-07-09 14:44:31.264707 | mon1 | skipping: [mon1]
2026-07-09 14:44:31.264894 | mon1 |
2026-07-09 14:44:31.265124 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:44:31.265335 | mon1 | Thursday 09 July 2026  14:44:31 +0000 (0:00:00.039)       0:10:22.925 *********
2026-07-09 14:44:31.303000 | mon1 | skipping: [mon1]
2026-07-09 14:44:31.303140 | mon1 |
2026-07-09 14:44:31.303314 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:44:31.303469 | mon1 | Thursday 09 July 2026  14:44:31 +0000 (0:00:00.038)       0:10:22.964 *********
2026-07-09 14:44:31.513441 | mon1 | ok: [mon1]
2026-07-09 14:44:31.513683 | mon1 |
2026-07-09 14:44:31.514285 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:44:31.514526 | mon1 | Thursday 09 July 2026  14:44:31 +0000 (0:00:00.210)       0:10:23.174 *********
2026-07-09 14:44:32.708327 | mon1 | ok: [mon1]
2026-07-09 14:44:32.708419 | mon1 |
2026-07-09 14:44:32.708429 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:44:32.708437 | mon1 | Thursday 09 July 2026  14:44:32 +0000 (0:00:01.194)       0:10:24.368 *********
2026-07-09 14:44:32.777901 | mon1 | ok: [mon1] => {
2026-07-09 14:44:32.778276 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-09 14:44:32.778344 | mon1 | }
2026-07-09 14:44:32.778368 | mon1 |
2026-07-09 14:44:32.778439 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:44:32.778611 | mon1 | Thursday 09 July 2026  14:44:32 +0000 (0:00:00.070)       0:10:24.438 *********
2026-07-09 14:44:33.139533 | mon1 | ok: [mon1]
2026-07-09 14:44:33.139599 | mon1 |
2026-07-09 14:44:33.139724 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:44:33.139862 | mon1 | Thursday 09 July 2026  14:44:33 +0000 (0:00:00.362)       0:10:24.800 *********
2026-07-09 14:44:35.195912 | mon1 | ok: [mon1]
2026-07-09 14:44:35.195991 | mon1 |
2026-07-09 14:44:35.196253 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-09 14:44:35.196300 | mon1 | Thursday 09 July 2026  14:44:35 +0000 (0:00:02.056)       0:10:26.857 *********
2026-07-09 14:44:35.219654 | mon1 | skipping: [mon1]
2026-07-09 14:44:35.219793 | mon1 |
2026-07-09 14:44:35.220159 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-09 14:44:35.220212 | mon1 | Thursday 09 July 2026  14:44:35 +0000 (0:00:00.023)       0:10:26.880 *********
2026-07-09 14:44:35.247239 | mon1 | skipping: [mon1]
2026-07-09 14:44:35.247780 | mon1 |
2026-07-09 14:44:35.247829 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-09 14:44:35.247835 | mon1 | Thursday 09 July 2026  14:44:35 +0000 (0:00:00.027)       0:10:26.908 *********
2026-07-09 14:44:35.269996 | mon1 | skipping: [mon1]
2026-07-09 14:44:35.270069 | mon1 |
2026-07-09 14:44:35.270297 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-09 14:44:35.270338 | mon1 | Thursday 09 July 2026  14:44:35 +0000 (0:00:00.022)       0:10:26.931 *********
2026-07-09 14:44:36.520871 | mon1 | ok: [mon1]
2026-07-09 14:44:36.520970 | mon1 |
2026-07-09 14:44:36.520989 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-09 14:44:36.521132 | mon1 | Thursday 09 July 2026  14:44:36 +0000 (0:00:01.250)       0:10:28.182 *********
2026-07-09 14:44:36.985113 | mon1 | ok: [mon1]
2026-07-09 14:44:36.985192 | mon1 |
2026-07-09 14:44:36.985268 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-09 14:44:36.985397 | mon1 | Thursday 09 July 2026  14:44:36 +0000 (0:00:00.464)       0:10:28.646 *********
2026-07-09 14:44:37.944490 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-07-09 14:44:37.944592 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-09 14:44:37.945581 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-09 14:44:37.945628 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-09 14:44:37.945637 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-09 14:44:37.945645 | mon1 |
2026-07-09 14:44:37.945651 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-09 14:44:37.945658 | mon1 | Thursday 09 July 2026  14:44:37 +0000 (0:00:00.959)       0:10:29.605 *********
2026-07-09 14:44:38.446272 | mon1 | ok: [mon1]
2026-07-09 14:44:38.446340 | mon1 |
2026-07-09 14:44:38.446891 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-09 14:44:38.446907 | mon1 | Thursday 09 July 2026  14:44:38 +0000 (0:00:00.497)       0:10:30.102 *********
2026-07-09 14:44:38.446914 | mon1 |
2026-07-09 14:44:38.446920 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-09 14:44:38.446925 | mon1 | Thursday 09 July 2026  14:44:38 +0000 (0:00:00.004)       0:10:30.107 *********
2026-07-09 14:44:38.851026 | mon1 | ok: [mon1]
2026-07-09 14:44:38.851084 | mon1 |
2026-07-09 14:44:38.851198 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:44:38.851308 | mon1 | Thursday 09 July 2026  14:44:38 +0000 (0:00:00.404)       0:10:30.512 *********
2026-07-09 14:44:39.054442 | mon1 | ok: [mon1]
2026-07-09 14:44:39.054544 | mon1 |
2026-07-09 14:44:39.054566 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:44:39.054722 | mon1 | Thursday 09 July 2026  14:44:39 +0000 (0:00:00.203)       0:10:30.715 *********
2026-07-09 14:44:39.110277 | mon1 | ok: [mon1] => {
2026-07-09 14:44:39.110337 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-09 14:44:39.110445 | mon1 | }
2026-07-09 14:44:39.110764 | mon1 |
2026-07-09 14:44:39.110807 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:44:39.110812 | mon1 | Thursday 09 July 2026  14:44:39 +0000 (0:00:00.055)       0:10:30.771 *********
2026-07-09 14:44:39.471138 | mon1 | ok: [mon1]
2026-07-09 14:44:39.471273 | mon1 |
2026-07-09 14:44:39.471559 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:44:39.471578 | mon1 | Thursday 09 July 2026  14:44:39 +0000 (0:00:00.360)       0:10:31.132 *********
2026-07-09 14:44:42.737903 | mon1 | ok: [mon1]
2026-07-09 14:44:42.737973 | mon1 |
2026-07-09 14:44:42.738193 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-09 14:44:42.738237 | mon1 | Thursday 09 July 2026  14:44:42 +0000 (0:00:03.266)       0:10:34.399 *********
2026-07-09 14:44:43.885229 | mon1 | ok: [mon1]
2026-07-09 14:44:43.885316 | mon1 |
2026-07-09 14:44:43.885600 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-09 14:44:43.885656 | mon1 | Thursday 09 July 2026  14:44:43 +0000 (0:00:01.147)       0:10:35.546 *********
2026-07-09 14:44:44.094662 | mon1 | ok: [mon1]
2026-07-09 14:44:44.094715 | mon1 |
2026-07-09 14:44:44.094858 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-09 14:44:44.094969 | mon1 | Thursday 09 July 2026  14:44:44 +0000 (0:00:00.209)       0:10:35.755 *********
2026-07-09 14:44:44.532392 | mon1 | ok: [mon1]
2026-07-09 14:44:44.532471 | mon1 |
2026-07-09 14:44:44.532803 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-09 14:44:44.532852 | mon1 | Thursday 09 July 2026  14:44:44 +0000 (0:00:00.437)       0:10:36.193 *********
2026-07-09 14:44:45.117609 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-07-09 14:44:45.117690 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-09 14:44:45.117713 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-09 14:44:45.117773 | mon1 |
2026-07-09 14:44:45.117996 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-09 14:44:45.118041 | mon1 | Thursday 09 July 2026  14:44:45 +0000 (0:00:00.585)       0:10:36.778 *********
2026-07-09 14:44:45.534123 | mon1 | ok: [mon1]
2026-07-09 14:44:45.534200 | mon1 |
2026-07-09 14:44:45.534573 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-09 14:44:45.534596 | mon1 | Thursday 09 July 2026  14:44:45 +0000 (0:00:00.416)       0:10:37.195 *********
2026-07-09 14:44:46.003629 | mon1 | ok: [mon1]
2026-07-09 14:44:46.003700 | mon1 |
2026-07-09 14:44:46.004197 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-09 14:44:46.004243 | mon1 | Thursday 09 July 2026  14:44:45 +0000 (0:00:00.462)       0:10:37.657 *********
2026-07-09 14:44:46.004249 | mon1 |
2026-07-09 14:44:46.004254 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-09 14:44:46.004259 | mon1 | Thursday 09 July 2026  14:44:46 +0000 (0:00:00.006)       0:10:37.664 *********
2026-07-09 14:44:46.406428 | mon1 | ok: [mon1]
2026-07-09 14:44:46.406521 | mon1 |
2026-07-09 14:44:46.406551 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-09 14:44:46.406733 | mon1 | Thursday 09 July 2026  14:44:46 +0000 (0:00:00.402)       0:10:38.067 *********
2026-07-09 14:44:46.453400 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-07-09 14:44:46.453521 | mon1 |
2026-07-09 14:44:46.453555 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-09 14:44:46.453739 | mon1 | Thursday 09 July 2026  14:44:46 +0000 (0:00:00.047)       0:10:38.114 *********
2026-07-09 14:44:47.672753 | mon1 | ok: [mon1]
2026-07-09 14:44:47.672798 | mon1 |
2026-07-09 14:44:47.672803 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-09 14:44:47.672808 | mon1 | Thursday 09 July 2026  14:44:47 +0000 (0:00:01.219)       0:10:39.333 *********
2026-07-09 14:44:48.358542 | mon1 | ok: [mon1] => (item=chronyd)
2026-07-09 14:44:48.358673 | mon1 | ok: [mon1] => (item=sshd)
2026-07-09 14:44:48.358692 | mon1 |
2026-07-09 14:44:48.359008 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-09 14:44:48.359073 | mon1 | Thursday 09 July 2026  14:44:48 +0000 (0:00:00.685)       0:10:40.019 *********
2026-07-09 14:44:48.676183 | mon1 | ok: [mon1]
2026-07-09 14:44:48.676251 | mon1 |
2026-07-09 14:44:48.676521 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-09 14:44:48.676563 | mon1 | Thursday 09 July 2026  14:44:48 +0000 (0:00:00.317)       0:10:40.337 *********
2026-07-09 14:44:48.869963 | mon1 | ok: [mon1]
2026-07-09 14:44:48.870033 | mon1 |
2026-07-09 14:44:48.870159 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-09 14:44:48.870291 | mon1 | Thursday 09 July 2026  14:44:48 +0000 (0:00:00.193)       0:10:40.531 *********
2026-07-09 14:44:49.114166 | mon1 | ok: [mon1]
2026-07-09 14:44:49.114246 | mon1 |
2026-07-09 14:44:49.114357 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-09 14:44:49.114479 | mon1 | Thursday 09 July 2026  14:44:49 +0000 (0:00:00.244)       0:10:40.775 *********
2026-07-09 14:44:49.313769 | mon1 | ok: [mon1]
2026-07-09 14:44:49.313844 | mon1 |
2026-07-09 14:44:49.314147 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] ***********
2026-07-09 14:44:49.314198 | mon1 | Thursday 09 July 2026  14:44:49 +0000 (0:00:00.199)       0:10:40.974 *********
2026-07-09 14:45:14.812034 | mon1 | changed: [mon1]
2026-07-09 14:45:14.812111 | mon1 |
2026-07-09 14:45:14.814728 | mon1 | PLAY RECAP *********************************************************************
2026-07-09 14:45:14.814776 | mon1 | mon1                       : ok=93   changed=30   unreachable=0    failed=0    skipped=14   rescued=0    ignored=0
2026-07-09 14:45:14.814782 | mon1 | osd1                       : ok=53   changed=24   unreachable=0    failed=0    skipped=8    rescued=0    ignored=0
2026-07-09 14:45:14.814786 | mon1 |
2026-07-09 14:45:14.814791 | mon1 |
2026-07-09 14:45:14.814795 | mon1 | TASKS RECAP ********************************************************************
2026-07-09 14:45:14.814799 | mon1 | Thursday 09 July 2026  14:45:14 +0000 (0:00:25.498)       0:11:06.473 *********
2026-07-09 14:45:14.814803 | mon1 | ===============================================================================
2026-07-09 14:45:14.814807 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 234.57s
2026-07-09 14:45:14.814811 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 98.75s
2026-07-09 14:45:14.814815 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 41.87s
2026-07-09 14:45:14.814819 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 36.14s
2026-07-09 14:45:14.814823 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ---------- 25.50s
2026-07-09 14:45:14.814826 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 15.10s
2026-07-09 14:45:14.814830 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 15.10s
2026-07-09 14:45:14.814834 | mon1 | vexxhost.containers.containerd : Install AppArmor packages ------------- 12.39s
2026-07-09 14:45:14.814838 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 11.97s
2026-07-09 14:45:14.814842 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` --------------------------------- 11.33s
2026-07-09 14:45:14.814846 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 9.74s
2026-07-09 14:45:14.814849 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 9.49s
2026-07-09 14:45:14.814853 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 9.47s
2026-07-09 14:45:14.814857 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 9.23s
2026-07-09 14:45:14.814861 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 8.48s
2026-07-09 14:45:14.814865 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.85s
2026-07-09 14:45:14.814869 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.14s
2026-07-09 14:45:14.814873 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.71s
2026-07-09 14:45:14.814877 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.32s
2026-07-09 14:45:14.814880 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.49s
2026-07-09 14:45:14.921723 | mon1 | INFO     [default > converge] Executed: Successful
2026-07-09 14:45:14.928285 | mon1 | INFO     [default > idempotence] Executing
2026-07-09 14:45:15.870966 | mon1 |
2026-07-09 14:45:15.871557 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-07-09 14:45:15.871871 | mon1 |
2026-07-09 14:45:15.872216 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-09 14:45:15.872537 | mon1 | Thursday 09 July 2026  14:45:15 +0000 (0:00:00.047)       0:00:00.047 *********
2026-07-09 14:45:17.110180 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-07-09 14:45:17.110270 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-07-09 14:45:17.110288 | mon1 | interpreter could change the meaning of that path. See
2026-07-09 14:45:17.110303 | mon1 | https://docs.ansible.com/ansible-
2026-07-09 14:45:17.110316 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-09 14:45:17.121460 | mon1 | ok: [mon1]
2026-07-09 14:45:17.121486 | mon1 |
2026-07-09 14:45:17.121491 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:45:17.121495 | mon1 | Thursday 09 July 2026  14:45:17 +0000 (0:00:01.251)       0:00:01.298 *********
2026-07-09 14:45:17.417795 | mon1 | ok: [mon1]
2026-07-09 14:45:17.417842 | mon1 |
2026-07-09 14:45:17.417847 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:45:17.417852 | mon1 | Thursday 09 July 2026  14:45:17 +0000 (0:00:00.296)       0:00:01.595 *********
2026-07-09 14:45:17.451312 | mon1 | skipping: [mon1]
2026-07-09 14:45:17.451408 | mon1 |
2026-07-09 14:45:17.451424 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-09 14:45:17.451528 | mon1 | Thursday 09 July 2026  14:45:17 +0000 (0:00:00.033)       0:00:01.628 *********
2026-07-09 14:45:17.809677 | mon1 | ok: [mon1]
2026-07-09 14:45:17.809789 | mon1 |
2026-07-09 14:45:17.809946 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:45:17.810096 | mon1 | Thursday 09 July 2026  14:45:17 +0000 (0:00:00.357)       0:00:01.986 *********
2026-07-09 14:45:17.884538 | mon1 | ok: [mon1] => {
2026-07-09 14:45:17.884757 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-09 14:45:17.885171 | mon1 | }
2026-07-09 14:45:17.885389 | mon1 |
2026-07-09 14:45:17.885613 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:45:17.885824 | mon1 | Thursday 09 July 2026  14:45:17 +0000 (0:00:00.074)       0:00:02.061 *********
2026-07-09 14:45:18.337986 | mon1 | ok: [mon1]
2026-07-09 14:45:18.338060 | mon1 |
2026-07-09 14:45:18.338215 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:45:18.338352 | mon1 | Thursday 09 July 2026  14:45:18 +0000 (0:00:00.453)       0:00:02.514 *********
2026-07-09 14:45:18.381580 | mon1 | skipping: [mon1]
2026-07-09 14:45:18.381657 | mon1 |
2026-07-09 14:45:18.381843 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:45:18.382024 | mon1 | Thursday 09 July 2026  14:45:18 +0000 (0:00:00.043)       0:00:02.558 *********
2026-07-09 14:45:18.425828 | mon1 | skipping: [mon1]
2026-07-09 14:45:18.425899 | mon1 |
2026-07-09 14:45:18.426025 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:45:18.426126 | mon1 | Thursday 09 July 2026  14:45:18 +0000 (0:00:00.044)       0:00:02.602 *********
2026-07-09 14:45:18.669118 | mon1 | ok: [mon1]
2026-07-09 14:45:18.669177 | mon1 |
2026-07-09 14:45:18.669339 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:45:18.669449 | mon1 | Thursday 09 July 2026  14:45:18 +0000 (0:00:00.243)       0:00:02.846 *********
2026-07-09 14:45:19.989625 | mon1 | ok: [mon1]
2026-07-09 14:45:19.989683 | mon1 |
2026-07-09 14:45:19.989690 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:45:19.989697 | mon1 | Thursday 09 July 2026  14:45:19 +0000 (0:00:01.320)       0:00:04.166 *********
2026-07-09 14:45:20.063615 | mon1 | ok: [mon1] => {
2026-07-09 14:45:20.063727 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-09 14:45:20.064267 | mon1 | }
2026-07-09 14:45:20.064318 | mon1 |
2026-07-09 14:45:20.064326 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:45:20.064333 | mon1 | Thursday 09 July 2026  14:45:20 +0000 (0:00:00.074)       0:00:04.241 *********
2026-07-09 14:45:20.428070 | mon1 | ok: [mon1]
2026-07-09 14:45:20.428180 | mon1 |
2026-07-09 14:45:20.428215 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:45:20.428329 | mon1 | Thursday 09 July 2026  14:45:20 +0000 (0:00:00.364)       0:00:04.605 *********
2026-07-09 14:45:22.757957 | mon1 | ok: [mon1]
2026-07-09 14:45:22.758030 | mon1 |
2026-07-09 14:45:22.758122 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-09 14:45:22.758292 | mon1 | Thursday 09 July 2026  14:45:22 +0000 (0:00:02.329)       0:00:06.935 *********
2026-07-09 14:45:22.782727 | mon1 | skipping: [mon1]
2026-07-09 14:45:22.782835 | mon1 |
2026-07-09 14:45:22.783173 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-09 14:45:22.783227 | mon1 | Thursday 09 July 2026  14:45:22 +0000 (0:00:00.024)       0:00:06.960 *********
2026-07-09 14:45:22.808285 | mon1 | skipping: [mon1]
2026-07-09 14:45:22.830758 | mon1 |
2026-07-09 14:45:22.830806 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-09 14:45:22.830833 | mon1 | Thursday 09 July 2026  14:45:22 +0000 (0:00:00.024)       0:00:06.985 *********
2026-07-09 14:45:22.830853 | mon1 | skipping: [mon1]
2026-07-09 14:45:22.830863 | mon1 |
2026-07-09 14:45:22.830872 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-09 14:45:22.830881 | mon1 | Thursday 09 July 2026  14:45:22 +0000 (0:00:00.021)       0:00:07.006 *********
2026-07-09 14:45:24.010118 | mon1 | ok: [mon1]
2026-07-09 14:45:24.010189 | mon1 |
2026-07-09 14:45:24.010195 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-09 14:45:24.010201 | mon1 | Thursday 09 July 2026  14:45:24 +0000 (0:00:01.180)       0:00:08.187 *********
2026-07-09 14:45:24.447051 | mon1 | ok: [mon1]
2026-07-09 14:45:24.447161 | mon1 |
2026-07-09 14:45:24.447179 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-09 14:45:24.447192 | mon1 | Thursday 09 July 2026  14:45:24 +0000 (0:00:00.435)       0:00:08.623 *********
2026-07-09 14:45:25.471244 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-07-09 14:45:25.471316 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-09 14:45:25.471326 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-09 14:45:25.471347 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-09 14:45:25.471355 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-09 14:45:25.471364 | mon1 |
2026-07-09 14:45:25.471379 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-09 14:45:25.471509 | mon1 | Thursday 09 July 2026  14:45:25 +0000 (0:00:01.024)       0:00:09.647 *********
2026-07-09 14:45:26.054572 | mon1 | ok: [mon1]
2026-07-09 14:45:26.054618 | mon1 |
2026-07-09 14:45:26.054623 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-09 14:45:26.054628 | mon1 | Thursday 09 July 2026  14:45:26 +0000 (0:00:00.577)       0:00:10.224 *********
2026-07-09 14:45:26.054639 | mon1 |
2026-07-09 14:45:26.054643 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-09 14:45:26.054647 | mon1 | Thursday 09 July 2026  14:45:26 +0000 (0:00:00.007)       0:00:10.231 *********
2026-07-09 14:45:26.653739 | mon1 | ok: [mon1]
2026-07-09 14:45:26.653782 | mon1 |
2026-07-09 14:45:26.653788 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:45:26.653792 | mon1 | Thursday 09 July 2026  14:45:26 +0000 (0:00:00.599)       0:00:10.831 *********
2026-07-09 14:45:26.886500 | mon1 | ok: [mon1]
2026-07-09 14:45:26.886592 | mon1 |
2026-07-09 14:45:26.886905 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:45:26.886982 | mon1 | Thursday 09 July 2026  14:45:26 +0000 (0:00:00.232)       0:00:11.063 *********
2026-07-09 14:45:26.956562 | mon1 | ok: [mon1] => {
2026-07-09 14:45:26.956654 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-09 14:45:26.956685 | mon1 | }
2026-07-09 14:45:26.956992 | mon1 |
2026-07-09 14:45:26.957053 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:45:26.957059 | mon1 | Thursday 09 July 2026  14:45:26 +0000 (0:00:00.070)       0:00:11.134 *********
2026-07-09 14:45:27.383123 | mon1 | ok: [mon1]
2026-07-09 14:45:27.383192 | mon1 |
2026-07-09 14:45:27.383460 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:45:27.383537 | mon1 | Thursday 09 July 2026  14:45:27 +0000 (0:00:00.426)       0:00:11.560 *********
2026-07-09 14:45:30.807905 | mon1 | ok: [mon1]
2026-07-09 14:45:30.807941 | mon1 |
2026-07-09 14:45:30.807947 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-09 14:45:30.807951 | mon1 | Thursday 09 July 2026  14:45:30 +0000 (0:00:03.425)       0:00:14.985 *********
2026-07-09 14:45:32.116712 | mon1 | ok: [mon1]
2026-07-09 14:45:32.116911 | mon1 |
2026-07-09 14:45:32.116918 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-09 14:45:32.117000 | mon1 | Thursday 09 July 2026  14:45:32 +0000 (0:00:01.308)       0:00:16.294 *********
2026-07-09 14:45:32.551549 | mon1 | ok: [mon1]
2026-07-09 14:45:32.552088 | mon1 |
2026-07-09 14:45:32.552146 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-09 14:45:32.552156 | mon1 | Thursday 09 July 2026  14:45:32 +0000 (0:00:00.434)       0:00:16.728 *********
2026-07-09 14:45:33.031974 | mon1 | ok: [mon1]
2026-07-09 14:45:33.032019 | mon1 |
2026-07-09 14:45:33.032025 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-09 14:45:33.032031 | mon1 | Thursday 09 July 2026  14:45:33 +0000 (0:00:00.480)       0:00:17.209 *********
2026-07-09 14:45:33.619441 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-07-09 14:45:33.619522 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-09 14:45:33.619916 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-09 14:45:33.619932 | mon1 |
2026-07-09 14:45:33.619938 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-09 14:45:33.619942 | mon1 | Thursday 09 July 2026  14:45:33 +0000 (0:00:00.588)       0:00:17.797 *********
2026-07-09 14:45:34.077116 | mon1 | ok: [mon1]
2026-07-09 14:45:34.077189 | mon1 |
2026-07-09 14:45:34.077389 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-09 14:45:34.077435 | mon1 | Thursday 09 July 2026  14:45:34 +0000 (0:00:00.457)       0:00:18.254 *********
2026-07-09 14:45:34.527100 | mon1 | ok: [mon1]
2026-07-09 14:45:34.527144 | mon1 |
2026-07-09 14:45:34.527150 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-09 14:45:34.527155 | mon1 | Thursday 09 July 2026  14:45:34 +0000 (0:00:00.441)       0:00:18.696 *********
2026-07-09 14:45:34.527159 | mon1 |
2026-07-09 14:45:34.527163 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-09 14:45:34.527167 | mon1 | Thursday 09 July 2026  14:45:34 +0000 (0:00:00.007)       0:00:18.704 *********
2026-07-09 14:45:34.951930 | mon1 | ok: [mon1]
2026-07-09 14:45:34.951991 | mon1 |
2026-07-09 14:45:34.952093 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-09 14:45:34.952165 | mon1 | Thursday 09 July 2026  14:45:34 +0000 (0:00:00.425)       0:00:19.129 *********
2026-07-09 14:45:34.990420 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-07-09 14:45:34.990486 | mon1 |
2026-07-09 14:45:34.990571 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-09 14:45:34.990661 | mon1 | Thursday 09 July 2026  14:45:34 +0000 (0:00:00.038)       0:00:19.168 *********
2026-07-09 14:45:36.240938 | mon1 | ok: [mon1]
2026-07-09 14:45:36.241511 | mon1 |
2026-07-09 14:45:36.241563 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-09 14:45:36.241569 | mon1 | Thursday 09 July 2026  14:45:36 +0000 (0:00:01.250)       0:00:20.418 *********
2026-07-09 14:45:36.938350 | mon1 | ok: [mon1] => (item=chronyd)
2026-07-09 14:45:36.938438 | mon1 | ok: [mon1] => (item=sshd)
2026-07-09 14:45:36.938896 | mon1 |
2026-07-09 14:45:36.938945 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-09 14:45:36.938953 | mon1 | Thursday 09 July 2026  14:45:36 +0000 (0:00:00.697)       0:00:21.115 *********
2026-07-09 14:45:37.225521 | mon1 | ok: [mon1]
2026-07-09 14:45:37.225593 | mon1 |
2026-07-09 14:45:37.225898 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-09 14:45:37.225970 | mon1 | Thursday 09 July 2026  14:45:37 +0000 (0:00:00.286)       0:00:21.402 *********
2026-07-09 14:45:37.427589 | mon1 | ok: [mon1]
2026-07-09 14:45:37.427730 | mon1 |
2026-07-09 14:45:37.427754 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-09 14:45:37.427770 | mon1 | Thursday 09 July 2026  14:45:37 +0000 (0:00:00.202)       0:00:21.605 *********
2026-07-09 14:45:37.832116 | mon1 | ok: [mon1]
2026-07-09 14:45:37.832162 | mon1 |
2026-07-09 14:45:37.832177 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-09 14:45:37.832185 | mon1 | Thursday 09 July 2026  14:45:37 +0000 (0:00:00.404)       0:00:22.009 *********
2026-07-09 14:45:38.215783 | mon1 | ok: [mon1]
2026-07-09 14:45:38.215860 | mon1 |
2026-07-09 14:45:38.215876 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-07-09 14:45:38.216016 | mon1 | Thursday 09 July 2026  14:45:38 +0000 (0:00:00.384)       0:00:22.393 *********
2026-07-09 14:45:38.342528 | mon1 | ok: [mon1]
2026-07-09 14:45:38.344979 | mon1 |
2026-07-09 14:45:38.345023 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-07-09 14:45:38.345044 | mon1 | Thursday 09 July 2026  14:45:38 +0000 (0:00:00.126)       0:00:22.519 *********
2026-07-09 14:45:38.674598 | mon1 | ok: [mon1] => (item=mon1)
2026-07-09 14:45:38.674657 | mon1 |
2026-07-09 14:45:38.674739 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-07-09 14:45:38.674881 | mon1 | Thursday 09 July 2026  14:45:38 +0000 (0:00:00.332)       0:00:22.852 *********
2026-07-09 14:45:38.722806 | mon1 | ok: [mon1]
2026-07-09 14:45:38.752796 | mon1 |
2026-07-09 14:45:38.752835 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-07-09 14:45:38.752841 | mon1 | Thursday 09 July 2026  14:45:38 +0000 (0:00:00.047)       0:00:22.900 *********
2026-07-09 14:45:38.756096 | mon1 | skipping: [mon1]
2026-07-09 14:45:38.756216 | mon1 |
2026-07-09 14:45:38.756531 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-09 14:45:38.756583 | mon1 | Thursday 09 July 2026  14:45:38 +0000 (0:00:00.033)       0:00:22.933 *********
2026-07-09 14:45:38.821727 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-07-09 14:45:38.821793 | mon1 |
2026-07-09 14:45:38.822000 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-09 14:45:38.822050 | mon1 | Thursday 09 July 2026  14:45:38 +0000 (0:00:00.065)       0:00:22.999 *********
2026-07-09 14:45:50.746034 | mon1 | ok: [mon1]
2026-07-09 14:45:50.746111 | mon1 |
2026-07-09 14:45:50.746484 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-09 14:45:50.746572 | mon1 | Thursday 09 July 2026  14:45:50 +0000 (0:00:11.923)       0:00:34.923 *********
2026-07-09 14:45:50.811929 | mon1 | ok: [mon1] => (item=mon1)
2026-07-09 14:45:50.812041 | mon1 |
2026-07-09 14:45:50.812048 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-09 14:45:50.812234 | mon1 | Thursday 09 July 2026  14:45:50 +0000 (0:00:00.066)       0:00:34.989 *********
2026-07-09 14:45:51.257956 | mon1 | ok: [mon1]
2026-07-09 14:45:51.258021 | mon1 |
2026-07-09 14:45:51.258369 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-09 14:45:51.258469 | mon1 | Thursday 09 July 2026  14:45:51 +0000 (0:00:00.445)       0:00:35.435 *********
2026-07-09 14:46:00.586685 | mon1 | ok: [mon1]
2026-07-09 14:46:00.586820 | mon1 |
2026-07-09 14:46:00.586834 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-07-09 14:46:00.586850 | mon1 | Thursday 09 July 2026  14:46:00 +0000 (0:00:09.329)       0:00:44.764 *********
2026-07-09 14:46:07.895074 | mon1 | ok: [mon1]
2026-07-09 14:46:07.895158 | mon1 |
2026-07-09 14:46:07.895405 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-07-09 14:46:07.895483 | mon1 | Thursday 09 July 2026  14:46:07 +0000 (0:00:07.308)       0:00:52.072 *********
2026-07-09 14:46:29.605297 | mon1 | ok: [mon1]
2026-07-09 14:46:29.605403 | mon1 |
2026-07-09 14:46:29.605899 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-09 14:46:29.605974 | mon1 | Thursday 09 July 2026  14:46:29 +0000 (0:00:21.709)       0:01:13.781 *********
2026-07-09 14:46:29.674805 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-07-09 14:46:29.674903 | mon1 |
2026-07-09 14:46:29.674921 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-09 14:46:29.675022 | mon1 | Thursday 09 July 2026  14:46:29 +0000 (0:00:00.070)       0:01:13.852 *********
2026-07-09 14:46:29.716811 | mon1 | skipping: [mon1]
2026-07-09 14:46:29.716903 | mon1 |
2026-07-09 14:46:29.717208 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-09 14:46:29.717269 | mon1 | Thursday 09 July 2026  14:46:29 +0000 (0:00:00.042)       0:01:13.894 *********
2026-07-09 14:46:29.771682 | mon1 | skipping: [mon1] => (item=mon1)
2026-07-09 14:46:29.771751 | mon1 | skipping: [mon1]
2026-07-09 14:46:29.771757 | mon1 |
2026-07-09 14:46:29.771762 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-09 14:46:29.771767 | mon1 | Thursday 09 July 2026  14:46:29 +0000 (0:00:00.054)       0:01:13.948 *********
2026-07-09 14:46:30.047912 | mon1 | ok: [mon1]
2026-07-09 14:46:30.048024 | mon1 |
2026-07-09 14:46:30.048096 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-09 14:46:30.048278 | mon1 | Thursday 09 July 2026  14:46:30 +0000 (0:00:00.276)       0:01:14.224 *********
2026-07-09 14:46:43.690749 | mon1 | ok: [mon1]
2026-07-09 14:46:43.690824 | mon1 |
2026-07-09 14:46:43.690839 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-07-09 14:46:43.690977 | mon1 | Thursday 09 July 2026  14:46:43 +0000 (0:00:13.643)       0:01:27.868 *********
2026-07-09 14:46:53.767198 | mon1 | ok: [mon1]
2026-07-09 14:46:53.767319 | mon1 |
2026-07-09 14:46:53.767331 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-07-09 14:46:53.767485 | mon1 | Thursday 09 July 2026  14:46:53 +0000 (0:00:10.076)       0:01:37.944 *********
2026-07-09 14:47:01.945289 | mon1 | ok: [mon1]
2026-07-09 14:47:01.945377 | mon1 |
2026-07-09 14:47:01.945434 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-07-09 14:47:01.945567 | mon1 | Thursday 09 July 2026  14:47:01 +0000 (0:00:08.178)       0:01:46.122 *********
2026-07-09 14:47:15.520232 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'})
2026-07-09 14:47:15.520321 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-07-09 14:47:15.520336 | mon1 | ok: [mon1] => (item={'name': 'prometheus'})
2026-07-09 14:47:15.520918 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-07-09 14:47:15.520966 | mon1 |
2026-07-09 14:47:15.520972 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-07-09 14:47:15.520976 | mon1 |
2026-07-09 14:47:15.520981 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-09 14:47:15.520990 | mon1 | Thursday 09 July 2026  14:47:15 +0000 (0:00:13.575)       0:01:59.697 *********
2026-07-09 14:47:16.648521 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-07-09 14:47:16.648876 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-07-09 14:47:16.648952 | mon1 | interpreter could change the meaning of that path. See
2026-07-09 14:47:16.649390 | mon1 | https://docs.ansible.com/ansible-
2026-07-09 14:47:16.649459 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-09 14:47:16.662025 | mon1 | ok: [osd1]
2026-07-09 14:47:16.662124 | mon1 |
2026-07-09 14:47:16.662143 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:47:16.662317 | mon1 | Thursday 09 July 2026  14:47:16 +0000 (0:00:01.141)       0:02:00.839 *********
2026-07-09 14:47:16.865734 | mon1 | ok: [osd1]
2026-07-09 14:47:16.865814 | mon1 |
2026-07-09 14:47:16.866062 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:47:16.866101 | mon1 | Thursday 09 July 2026  14:47:16 +0000 (0:00:00.204)       0:02:01.043 *********
2026-07-09 14:47:16.904109 | mon1 | skipping: [osd1]
2026-07-09 14:47:16.904213 | mon1 |
2026-07-09 14:47:16.904517 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-09 14:47:16.904540 | mon1 | Thursday 09 July 2026  14:47:16 +0000 (0:00:00.038)       0:02:01.081 *********
2026-07-09 14:47:17.104955 | mon1 | ok: [osd1]
2026-07-09 14:47:17.105033 | mon1 |
2026-07-09 14:47:17.105261 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:47:17.105278 | mon1 | Thursday 09 July 2026  14:47:17 +0000 (0:00:00.200)       0:02:01.282 *********
2026-07-09 14:47:17.178237 | mon1 | ok: [osd1] => {
2026-07-09 14:47:17.178788 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-09 14:47:17.178806 | mon1 | }
2026-07-09 14:47:17.178812 | mon1 |
2026-07-09 14:47:17.178818 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:47:17.178824 | mon1 | Thursday 09 July 2026  14:47:17 +0000 (0:00:00.073)       0:02:01.355 *********
2026-07-09 14:47:17.499680 | mon1 | ok: [osd1]
2026-07-09 14:47:17.499747 | mon1 |
2026-07-09 14:47:17.499849 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:47:17.500069 | mon1 | Thursday 09 July 2026  14:47:17 +0000 (0:00:00.321)       0:02:01.676 *********
2026-07-09 14:47:17.548883 | mon1 | skipping: [osd1]
2026-07-09 14:47:17.548957 | mon1 |
2026-07-09 14:47:17.549150 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:47:17.549403 | mon1 | Thursday 09 July 2026  14:47:17 +0000 (0:00:00.049)       0:02:01.726 *********
2026-07-09 14:47:17.586540 | mon1 | skipping: [osd1]
2026-07-09 14:47:17.586655 | mon1 |
2026-07-09 14:47:17.586942 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:47:17.587119 | mon1 | Thursday 09 July 2026  14:47:17 +0000 (0:00:00.037)       0:02:01.763 *********
2026-07-09 14:47:17.801942 | mon1 | ok: [osd1]
2026-07-09 14:47:17.802364 | mon1 |
2026-07-09 14:47:17.802757 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:47:17.803309 | mon1 | Thursday 09 July 2026  14:47:17 +0000 (0:00:00.215)       0:02:01.979 *********
2026-07-09 14:47:18.860181 | mon1 | ok: [osd1]
2026-07-09 14:47:18.860621 | mon1 |
2026-07-09 14:47:18.861008 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:47:18.861390 | mon1 | Thursday 09 July 2026  14:47:18 +0000 (0:00:01.055)       0:02:03.034 *********
2026-07-09 14:47:18.939670 | mon1 | ok: [osd1] => {
2026-07-09 14:47:18.939774 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-09 14:47:18.939825 | mon1 | }
2026-07-09 14:47:18.939948 | mon1 |
2026-07-09 14:47:18.940145 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:47:18.940302 | mon1 | Thursday 09 July 2026  14:47:18 +0000 (0:00:00.078)       0:02:03.113 *********
2026-07-09 14:47:19.292536 | mon1 | ok: [osd1]
2026-07-09 14:47:19.292968 | mon1 |
2026-07-09 14:47:19.293370 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:47:19.293695 | mon1 | Thursday 09 July 2026  14:47:19 +0000 (0:00:00.354)       0:02:03.468 *********
2026-07-09 14:47:21.349946 | mon1 | ok: [osd1]
2026-07-09 14:47:21.350008 | mon1 |
2026-07-09 14:47:21.350302 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-09 14:47:21.350321 | mon1 | Thursday 09 July 2026  14:47:21 +0000 (0:00:02.058)       0:02:05.527 *********
2026-07-09 14:47:21.381748 | mon1 | skipping: [osd1]
2026-07-09 14:47:21.381820 | mon1 |
2026-07-09 14:47:21.381903 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-09 14:47:21.382034 | mon1 | Thursday 09 July 2026  14:47:21 +0000 (0:00:00.032)       0:02:05.559 *********
2026-07-09 14:47:21.406569 | mon1 | skipping: [osd1]
2026-07-09 14:47:21.406644 | mon1 |
2026-07-09 14:47:21.406859 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-09 14:47:21.406905 | mon1 | Thursday 09 July 2026  14:47:21 +0000 (0:00:00.024)       0:02:05.584 *********
2026-07-09 14:47:21.435468 | mon1 | skipping: [osd1]
2026-07-09 14:47:21.435580 | mon1 |
2026-07-09 14:47:21.435909 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-09 14:47:21.436025 | mon1 | Thursday 09 July 2026  14:47:21 +0000 (0:00:00.028)       0:02:05.612 *********
2026-07-09 14:47:22.558157 | mon1 | ok: [osd1]
2026-07-09 14:47:22.558255 | mon1 |
2026-07-09 14:47:22.558573 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-09 14:47:22.558595 | mon1 | Thursday 09 July 2026  14:47:22 +0000 (0:00:01.122)       0:02:06.735 *********
2026-07-09 14:47:22.984400 | mon1 | ok: [osd1]
2026-07-09 14:47:22.984514 | mon1 |
2026-07-09 14:47:22.984527 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-09 14:47:22.984590 | mon1 | Thursday 09 July 2026  14:47:22 +0000 (0:00:00.426)       0:02:07.162 *********
2026-07-09 14:47:23.882926 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'})
2026-07-09 14:47:23.882979 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-09 14:47:23.882987 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-09 14:47:23.882993 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-09 14:47:23.882999 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-09 14:47:23.883005 | mon1 |
2026-07-09 14:47:23.883011 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-09 14:47:23.883023 | mon1 | Thursday 09 July 2026  14:47:23 +0000 (0:00:00.897)       0:02:08.059 *********
2026-07-09 14:47:24.426062 | mon1 | ok: [osd1]
2026-07-09 14:47:24.426112 | mon1 |
2026-07-09 14:47:24.426117 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-09 14:47:24.426122 | mon1 | Thursday 09 July 2026  14:47:24 +0000 (0:00:00.537)       0:02:08.597 *********
2026-07-09 14:47:24.426126 | mon1 |
2026-07-09 14:47:24.426130 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-09 14:47:24.426134 | mon1 | Thursday 09 July 2026  14:47:24 +0000 (0:00:00.005)       0:02:08.603 *********
2026-07-09 14:47:24.764194 | mon1 | ok: [osd1]
2026-07-09 14:47:24.764240 | mon1 |
2026-07-09 14:47:24.764246 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:47:24.764251 | mon1 | Thursday 09 July 2026  14:47:24 +0000 (0:00:00.338)       0:02:08.941 *********
2026-07-09 14:47:24.968660 | mon1 | ok: [osd1]
2026-07-09 14:47:24.968733 | mon1 |
2026-07-09 14:47:24.969042 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:47:24.969113 | mon1 | Thursday 09 July 2026  14:47:24 +0000 (0:00:00.204)       0:02:09.145 *********
2026-07-09 14:47:25.038934 | mon1 | ok: [osd1] => {
2026-07-09 14:47:25.039047 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-09 14:47:25.039060 | mon1 | }
2026-07-09 14:47:25.039182 | mon1 |
2026-07-09 14:47:25.039395 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:47:25.039458 | mon1 | Thursday 09 July 2026  14:47:25 +0000 (0:00:00.070)       0:02:09.216 *********
2026-07-09 14:47:25.397139 | mon1 | ok: [osd1]
2026-07-09 14:47:25.397246 | mon1 |
2026-07-09 14:47:25.397317 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:47:25.397553 | mon1 | Thursday 09 July 2026  14:47:25 +0000 (0:00:00.357)       0:02:09.574 *********
2026-07-09 14:47:29.513676 | mon1 | ok: [osd1]
2026-07-09 14:47:29.513766 | mon1 |
2026-07-09 14:47:29.513820 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-09 14:47:29.513936 | mon1 | Thursday 09 July 2026  14:47:29 +0000 (0:00:04.116)       0:02:13.691 *********
2026-07-09 14:47:30.574828 | mon1 | ok: [osd1]
2026-07-09 14:47:30.574910 | mon1 |
2026-07-09 14:47:30.574971 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-09 14:47:30.575091 | mon1 | Thursday 09 July 2026  14:47:30 +0000 (0:00:01.061)       0:02:14.752 *********
2026-07-09 14:47:30.789101 | mon1 | ok: [osd1]
2026-07-09 14:47:30.789176 | mon1 |
2026-07-09 14:47:30.789376 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-09 14:47:30.789416 | mon1 | Thursday 09 July 2026  14:47:30 +0000 (0:00:00.214)       0:02:14.966 *********
2026-07-09 14:47:31.231876 | mon1 | ok: [osd1]
2026-07-09 14:47:31.231961 | mon1 |
2026-07-09 14:47:31.231996 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-09 14:47:31.232134 | mon1 | Thursday 09 July 2026  14:47:31 +0000 (0:00:00.442)       0:02:15.409 *********
2026-07-09 14:47:31.793680 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'})
2026-07-09 14:47:31.793762 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-09 14:47:31.794185 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-09 14:47:31.794203 | mon1 |
2026-07-09 14:47:31.794210 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-09 14:47:31.794217 | mon1 | Thursday 09 July 2026  14:47:31 +0000 (0:00:00.561)       0:02:15.970 *********
2026-07-09 14:47:32.248709 | mon1 | ok: [osd1]
2026-07-09 14:47:32.248820 | mon1 |
2026-07-09 14:47:32.248832 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-09 14:47:32.249049 | mon1 | Thursday 09 July 2026  14:47:32 +0000 (0:00:00.454)       0:02:16.425 *********
2026-07-09 14:47:32.694900 | mon1 | ok: [osd1]
2026-07-09 14:47:32.694963 | mon1 |
2026-07-09 14:47:32.694980 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-09 14:47:32.695496 | mon1 | Thursday 09 July 2026  14:47:32 +0000 (0:00:00.440)       0:02:16.865 *********
2026-07-09 14:47:32.695515 | mon1 |
2026-07-09 14:47:32.695522 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-09 14:47:32.695567 | mon1 | Thursday 09 July 2026  14:47:32 +0000 (0:00:00.006)       0:02:16.872 *********
2026-07-09 14:47:33.054537 | mon1 | ok: [osd1]
2026-07-09 14:47:33.054606 | mon1 |
2026-07-09 14:47:33.054793 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-09 14:47:33.054810 | mon1 | Thursday 09 July 2026  14:47:33 +0000 (0:00:00.359)       0:02:17.232 *********
2026-07-09 14:47:33.097775 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-07-09 14:47:33.097817 | mon1 |
2026-07-09 14:47:33.097935 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-09 14:47:33.098026 | mon1 | Thursday 09 July 2026  14:47:33 +0000 (0:00:00.043)       0:02:17.275 *********
2026-07-09 14:47:34.125367 | mon1 | ok: [osd1]
2026-07-09 14:47:34.125449 | mon1 |
2026-07-09 14:47:34.125466 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-09 14:47:34.125591 | mon1 | Thursday 09 July 2026  14:47:34 +0000 (0:00:01.027)       0:02:18.302 *********
2026-07-09 14:47:34.769450 | mon1 | ok: [osd1] => (item=chronyd)
2026-07-09 14:47:34.769575 | mon1 | ok: [osd1] => (item=sshd)
2026-07-09 14:47:34.769587 | mon1 |
2026-07-09 14:47:34.769668 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-09 14:47:34.769842 | mon1 | Thursday 09 July 2026  14:47:34 +0000 (0:00:00.644)       0:02:18.947 *********
2026-07-09 14:47:35.057987 | mon1 | ok: [osd1]
2026-07-09 14:47:35.058105 | mon1 |
2026-07-09 14:47:35.058119 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-09 14:47:35.058289 | mon1 | Thursday 09 July 2026  14:47:35 +0000 (0:00:00.288)       0:02:19.235 *********
2026-07-09 14:47:35.257966 | mon1 | ok: [osd1]
2026-07-09 14:47:35.258033 | mon1 |
2026-07-09 14:47:35.258302 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-09 14:47:35.258370 | mon1 | Thursday 09 July 2026  14:47:35 +0000 (0:00:00.200)       0:02:19.435 *********
2026-07-09 14:47:35.514091 | mon1 | ok: [osd1]
2026-07-09 14:47:35.514161 | mon1 |
2026-07-09 14:47:35.514380 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-09 14:47:35.514427 | mon1 | Thursday 09 July 2026  14:47:35 +0000 (0:00:00.256)       0:02:19.691 *********
2026-07-09 14:47:35.723822 | mon1 | ok: [osd1]
2026-07-09 14:47:35.723900 | mon1 |
2026-07-09 14:47:35.724156 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-07-09 14:47:35.724243 | mon1 | Thursday 09 July 2026  14:47:35 +0000 (0:00:00.209)       0:02:19.901 *********
2026-07-09 14:47:35.969836 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-07-09 14:47:35.970093 | mon1 |
2026-07-09 14:47:35.970373 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-07-09 14:47:35.970425 | mon1 | Thursday 09 July 2026  14:47:35 +0000 (0:00:00.245)       0:02:20.147 *********
2026-07-09 14:47:36.013293 | mon1 | ok: [osd1]
2026-07-09 14:47:36.013360 | mon1 |
2026-07-09 14:47:36.013651 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-09 14:47:36.013721 | mon1 | Thursday 09 July 2026  14:47:36 +0000 (0:00:00.043)       0:02:20.190 *********
2026-07-09 14:47:36.074254 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-07-09 14:47:36.074389 | mon1 |
2026-07-09 14:47:36.074409 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-09 14:47:36.074607 | mon1 | Thursday 09 July 2026  14:47:36 +0000 (0:00:00.061)       0:02:20.251 *********
2026-07-09 14:47:44.232953 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-09 14:47:44.233040 | mon1 |
2026-07-09 14:47:44.233333 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-09 14:47:44.233415 | mon1 | Thursday 09 July 2026  14:47:44 +0000 (0:00:08.158)       0:02:28.410 *********
2026-07-09 14:47:44.283667 | mon1 | ok: [osd1] => (item=osd1)
2026-07-09 14:47:44.283789 | mon1 |
2026-07-09 14:47:44.283802 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-09 14:47:44.283875 | mon1 | Thursday 09 July 2026  14:47:44 +0000 (0:00:00.050)       0:02:28.460 *********
2026-07-09 14:47:44.522668 | mon1 | ok: [osd1]
2026-07-09 14:47:44.522715 | mon1 |
2026-07-09 14:47:44.522722 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-09 14:47:44.522729 | mon1 | Thursday 09 July 2026  14:47:44 +0000 (0:00:00.238)       0:02:28.699 *********
2026-07-09 14:47:52.432965 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-09 14:47:52.433056 | mon1 |
2026-07-09 14:47:52.433071 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-07-09 14:47:52.433218 | mon1 | Thursday 09 July 2026  14:47:52 +0000 (0:00:07.910)       0:02:36.610 *********
2026-07-09 14:47:57.791818 | mon1 | ok: [osd1]
2026-07-09 14:47:57.791896 | mon1 |
2026-07-09 14:47:57.792112 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-07-09 14:47:57.792154 | mon1 | Thursday 09 July 2026  14:47:57 +0000 (0:00:05.358)       0:02:41.969 *********
2026-07-09 14:48:19.910943 | mon1 | ok: [osd1]
2026-07-09 14:48:19.911068 | mon1 |
2026-07-09 14:48:19.911076 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-07-09 14:48:19.911105 | mon1 | Thursday 09 July 2026  14:48:19 +0000 (0:00:22.119)       0:03:04.088 *********
2026-07-09 14:48:19.968571 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data)
2026-07-09 14:48:19.968692 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data)
2026-07-09 14:48:19.968772 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data)
2026-07-09 14:48:19.969372 | mon1 | skipping: [osd1]
2026-07-09 14:48:19.969428 | mon1 |
2026-07-09 14:48:19.969433 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-07-09 14:48:19.969439 | mon1 | Thursday 09 July 2026  14:48:19 +0000 (0:00:00.057)       0:03:04.145 *********
2026-07-09 14:48:28.847581 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-09 14:48:28.847710 | mon1 |
2026-07-09 14:48:28.847848 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-07-09 14:48:28.848004 | mon1 | Thursday 09 July 2026  14:48:28 +0000 (0:00:08.878)       0:03:13.024 *********
2026-07-09 14:48:37.062978 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-09 14:48:37.063266 | mon1 |
2026-07-09 14:48:37.063575 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-07-09 14:48:37.063877 | mon1 | Thursday 09 July 2026  14:48:37 +0000 (0:00:08.215)       0:03:21.240 *********
2026-07-09 14:48:37.116524 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-07-09 14:48:37.116624 | mon1 |
2026-07-09 14:48:37.116789 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-07-09 14:48:37.116936 | mon1 | Thursday 09 July 2026  14:48:37 +0000 (0:00:00.053)       0:03:21.293 *********
2026-07-09 14:48:37.155496 | mon1 | ok: [osd1]
2026-07-09 14:48:37.155735 | mon1 |
2026-07-09 14:48:37.156118 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-07-09 14:48:37.156501 | mon1 | Thursday 09 July 2026  14:48:37 +0000 (0:00:00.038)       0:03:21.332 *********
2026-07-09 14:48:47.315736 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-09 14:48:47.315801 | mon1 |
2026-07-09 14:48:47.315809 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-07-09 14:48:47.315816 | mon1 | Thursday 09 July 2026  14:48:47 +0000 (0:00:10.159)       0:03:31.492 *********
2026-07-09 14:48:47.357141 | mon1 | ok: [osd1]
2026-07-09 14:48:47.357219 | mon1 |
2026-07-09 14:48:47.357231 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-07-09 14:48:47.357386 | mon1 | Thursday 09 July 2026  14:48:47 +0000 (0:00:00.042)       0:03:31.534 *********
2026-07-09 14:48:47.400340 | mon1 | skipping: [osd1] => (item=1)
2026-07-09 14:48:47.400451 | mon1 | skipping: [osd1] => (item=1)
2026-07-09 14:48:47.400459 | mon1 | skipping: [osd1] => (item=1)
2026-07-09 14:48:47.400526 | mon1 | skipping: [osd1]
2026-07-09 14:48:47.400827 | mon1 |
2026-07-09 14:48:47.400881 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-07-09 14:48:47.400887 | mon1 | Thursday 09 July 2026  14:48:47 +0000 (0:00:00.043)       0:03:31.577 *********
2026-07-09 14:48:47.476510 | mon1 | skipping: [osd1]
2026-07-09 14:48:47.476587 | mon1 |
2026-07-09 14:48:47.477141 | mon1 | PLAY [Deploy Ceph exporters] ***************************************************
2026-07-09 14:48:47.477226 | mon1 |
2026-07-09 14:48:47.477233 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-09 14:48:47.477241 | mon1 | Thursday 09 July 2026  14:48:47 +0000 (0:00:00.075)       0:03:31.653 *********
2026-07-09 14:48:48.420764 | mon1 | ok: [mon1]
2026-07-09 14:48:48.420835 | mon1 |
2026-07-09 14:48:48.420915 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:48:48.421059 | mon1 | Thursday 09 July 2026  14:48:48 +0000 (0:00:00.944)       0:03:32.598 *********
2026-07-09 14:48:48.656170 | mon1 | ok: [mon1]
2026-07-09 14:48:48.656231 | mon1 |
2026-07-09 14:48:48.656454 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:48:48.656501 | mon1 | Thursday 09 July 2026  14:48:48 +0000 (0:00:00.235)       0:03:32.833 *********
2026-07-09 14:48:48.687822 | mon1 | skipping: [mon1]
2026-07-09 14:48:48.687932 | mon1 |
2026-07-09 14:48:48.688256 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-09 14:48:48.688302 | mon1 | Thursday 09 July 2026  14:48:48 +0000 (0:00:00.031)       0:03:32.865 *********
2026-07-09 14:48:48.901478 | mon1 | ok: [mon1]
2026-07-09 14:48:48.901547 | mon1 |
2026-07-09 14:48:48.901749 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:48:48.901954 | mon1 | Thursday 09 July 2026  14:48:48 +0000 (0:00:00.213)       0:03:33.079 *********
2026-07-09 14:48:48.967027 | mon1 | ok: [mon1] => {
2026-07-09 14:48:49.011225 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-09 14:48:49.011268 | mon1 | }
2026-07-09 14:48:49.011300 | mon1 |
2026-07-09 14:48:49.011310 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:48:49.011320 | mon1 | Thursday 09 July 2026  14:48:48 +0000 (0:00:00.065)       0:03:33.144 *********
2026-07-09 14:48:49.311476 | mon1 | ok: [mon1]
2026-07-09 14:48:49.311550 | mon1 |
2026-07-09 14:48:49.311873 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:48:49.311920 | mon1 | Thursday 09 July 2026  14:48:49 +0000 (0:00:00.344)       0:03:33.489 *********
2026-07-09 14:48:49.346741 | mon1 | skipping: [mon1]
2026-07-09 14:48:49.346810 | mon1 |
2026-07-09 14:48:49.347054 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:48:49.347113 | mon1 | Thursday 09 July 2026  14:48:49 +0000 (0:00:00.035)       0:03:33.524 *********
2026-07-09 14:48:49.384289 | mon1 | skipping: [mon1]
2026-07-09 14:48:49.384359 | mon1 |
2026-07-09 14:48:49.384370 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:48:49.384380 | mon1 | Thursday 09 July 2026  14:48:49 +0000 (0:00:00.036)       0:03:33.560 *********
2026-07-09 14:48:49.617941 | mon1 | ok: [mon1]
2026-07-09 14:48:49.618017 | mon1 |
2026-07-09 14:48:49.618186 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-09 14:48:49.618386 | mon1 | Thursday 09 July 2026  14:48:49 +0000 (0:00:00.234)       0:03:33.795 *********
2026-07-09 14:48:50.826292 | mon1 | ok: [mon1]
2026-07-09 14:48:50.826345 | mon1 |
2026-07-09 14:48:50.826353 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:48:50.826359 | mon1 | Thursday 09 July 2026  14:48:50 +0000 (0:00:01.208)       0:03:35.003 *********
2026-07-09 14:48:50.906032 | mon1 | ok: [mon1] => {
2026-07-09 14:48:50.906142 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-09 14:48:50.906667 | mon1 | }
2026-07-09 14:48:50.906688 | mon1 |
2026-07-09 14:48:50.906695 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:48:50.906702 | mon1 | Thursday 09 July 2026  14:48:50 +0000 (0:00:00.080)       0:03:35.083 *********
2026-07-09 14:48:51.281002 | mon1 | ok: [mon1]
2026-07-09 14:48:51.281067 | mon1 |
2026-07-09 14:48:51.281161 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:48:51.281294 | mon1 | Thursday 09 July 2026  14:48:51 +0000 (0:00:00.375)       0:03:35.458 *********
2026-07-09 14:48:53.261987 | mon1 | ok: [mon1]
2026-07-09 14:48:53.262044 | mon1 |
2026-07-09 14:48:53.262052 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-09 14:48:53.262058 | mon1 | Thursday 09 July 2026  14:48:53 +0000 (0:00:01.980)       0:03:37.438 *********
2026-07-09 14:48:53.284664 | mon1 | skipping: [mon1]
2026-07-09 14:48:53.284707 | mon1 |
2026-07-09 14:48:53.284713 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-09 14:48:53.284719 | mon1 | Thursday 09 July 2026  14:48:53 +0000 (0:00:00.022)       0:03:37.461 *********
2026-07-09 14:48:53.311273 | mon1 | skipping: [mon1]
2026-07-09 14:48:53.311381 | mon1 |
2026-07-09 14:48:53.311391 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-09 14:48:53.311410 | mon1 | Thursday 09 July 2026  14:48:53 +0000 (0:00:00.026)       0:03:37.488 *********
2026-07-09 14:48:53.333164 | mon1 | skipping: [mon1]
2026-07-09 14:48:53.333243 | mon1 |
2026-07-09 14:48:53.333320 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-09 14:48:53.333428 | mon1 | Thursday 09 July 2026  14:48:53 +0000 (0:00:00.022)       0:03:37.510 *********
2026-07-09 14:48:54.550151 | mon1 | ok: [mon1]
2026-07-09 14:48:54.550572 | mon1 |
2026-07-09 14:48:54.550594 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-09 14:48:54.550602 | mon1 | Thursday 09 July 2026  14:48:54 +0000 (0:00:01.217)       0:03:38.727 *********
2026-07-09 14:48:55.000973 | mon1 | ok: [mon1]
2026-07-09 14:48:55.001048 | mon1 |
2026-07-09 14:48:55.001316 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-09 14:48:55.001408 | mon1 | Thursday 09 July 2026  14:48:54 +0000 (0:00:00.450)       0:03:39.178 *********
2026-07-09 14:48:55.978065 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-07-09 14:48:55.978175 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-09 14:48:55.978189 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-09 14:48:55.978706 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-09 14:48:55.978751 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-09 14:48:55.978759 | mon1 |
2026-07-09 14:48:55.978766 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-09 14:48:55.978771 | mon1 | Thursday 09 July 2026  14:48:55 +0000 (0:00:00.977)       0:03:40.155 *********
2026-07-09 14:48:56.526729 | mon1 | ok: [mon1]
2026-07-09 14:48:56.526778 | mon1 |
2026-07-09 14:48:56.526786 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-09 14:48:56.526798 | mon1 | Thursday 09 July 2026  14:48:56 +0000 (0:00:00.542)       0:03:40.698 *********
2026-07-09 14:48:56.526804 | mon1 |
2026-07-09 14:48:56.526809 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-09 14:48:56.526814 | mon1 | Thursday 09 July 2026  14:48:56 +0000 (0:00:00.005)       0:03:40.703 *********
2026-07-09 14:48:56.912144 | mon1 | ok: [mon1]
2026-07-09 14:48:56.912213 | mon1 |
2026-07-09 14:48:56.912304 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-09 14:48:56.912442 | mon1 | Thursday 09 July 2026  14:48:56 +0000 (0:00:00.386)       0:03:41.089 *********
2026-07-09 14:48:57.129664 | mon1 | ok: [mon1]
2026-07-09 14:48:57.129745 | mon1 |
2026-07-09 14:48:57.129967 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-09 14:48:57.129984 | mon1 | Thursday 09 July 2026  14:48:57 +0000 (0:00:00.216)       0:03:41.306 *********
2026-07-09 14:48:57.209737 | mon1 | ok: [mon1] => {
2026-07-09 14:48:57.209844 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-09 14:48:57.210447 | mon1 | }
2026-07-09 14:48:57.210492 | mon1 |
2026-07-09 14:48:57.210497 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-09 14:48:57.210502 | mon1 | Thursday 09 July 2026  14:48:57 +0000 (0:00:00.080)       0:03:41.387 *********
2026-07-09 14:48:57.571436 | mon1 | ok: [mon1]
2026-07-09 14:48:57.571500 | mon1 |
2026-07-09 14:48:57.571725 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-09 14:48:57.571769 | mon1 | Thursday 09 July 2026  14:48:57 +0000 (0:00:00.361)       0:03:41.749 *********
2026-07-09 14:49:00.964255 | mon1 | ok: [mon1]
2026-07-09 14:49:00.965425 | mon1 |
2026-07-09 14:49:00.965498 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-09 14:49:00.965509 | mon1 | Thursday 09 July 2026  14:49:00 +0000 (0:00:03.392)       0:03:45.141 *********
2026-07-09 14:49:02.015484 | mon1 | ok: [mon1]
2026-07-09 14:49:02.015567 | mon1 |
2026-07-09 14:49:02.015984 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-09 14:49:02.016038 | mon1 | Thursday 09 July 2026  14:49:02 +0000 (0:00:01.051)       0:03:46.192 *********
2026-07-09 14:49:02.225767 | mon1 | ok: [mon1]
2026-07-09 14:49:02.225827 | mon1 |
2026-07-09 14:49:02.225837 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-09 14:49:02.225845 | mon1 | Thursday 09 July 2026  14:49:02 +0000 (0:00:00.209)       0:03:46.402 *********
2026-07-09 14:49:02.674765 | mon1 | ok: [mon1]
2026-07-09 14:49:02.674841 | mon1 |
2026-07-09 14:49:02.675037 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-09 14:49:02.675110 | mon1 | Thursday 09 July 2026  14:49:02 +0000 (0:00:00.450)       0:03:46.852 *********
2026-07-09 14:49:03.327709 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-07-09 14:49:03.327808 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-09 14:49:03.328294 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-09 14:49:03.328324 | mon1 |
2026-07-09 14:49:03.328331 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-09 14:49:03.328336 | mon1 | Thursday 09 July 2026  14:49:03 +0000 (0:00:00.652)       0:03:47.505 *********
2026-07-09 14:49:03.761061 | mon1 | ok: [mon1]
2026-07-09 14:49:03.761471 | mon1 |
2026-07-09 14:49:03.761488 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-09 14:49:03.761493 | mon1 | Thursday 09 July 2026  14:49:03 +0000 (0:00:00.433)       0:03:47.938 *********
2026-07-09 14:49:04.217909 | mon1 | ok: [mon1]
2026-07-09 14:49:04.217976 | mon1 |
2026-07-09 14:49:04.218451 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-09 14:49:04.218494 | mon1 | Thursday 09 July 2026  14:49:04 +0000 (0:00:00.450)       0:03:48.389 *********
2026-07-09 14:49:04.218500 | mon1 |
2026-07-09 14:49:04.218504 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-09 14:49:04.218508 | mon1 | Thursday 09 July 2026  14:49:04 +0000 (0:00:00.006)       0:03:48.395 *********
2026-07-09 14:49:04.577262 | mon1 | ok: [mon1]
2026-07-09 14:49:04.581396 | mon1 |
2026-07-09 14:49:04.581465 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-09 14:49:04.581477 | mon1 | Thursday 09 July 2026  14:49:04 +0000 (0:00:00.358)       0:03:48.754 *********
2026-07-09 14:49:04.624758 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-07-09 14:49:04.624850 | mon1 |
2026-07-09 14:49:04.625097 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-09 14:49:04.625119 | mon1 | Thursday 09 July 2026  14:49:04 +0000 (0:00:00.047)       0:03:48.801 *********
2026-07-09 14:49:06.121430 | mon1 | ok: [mon1]
2026-07-09 14:49:06.121687 | mon1 |
2026-07-09 14:49:06.121702 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-09 14:49:06.121887 | mon1 | Thursday 09 July 2026  14:49:06 +0000 (0:00:01.496)       0:03:50.298 *********
2026-07-09 14:49:06.774227 | mon1 | ok: [mon1] => (item=chronyd)
2026-07-09 14:49:06.774363 | mon1 | ok: [mon1] => (item=sshd)
2026-07-09 14:49:06.774736 | mon1 |
2026-07-09 14:49:06.774753 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-09 14:49:06.774759 | mon1 | Thursday 09 July 2026  14:49:06 +0000 (0:00:00.653)       0:03:50.951 *********
2026-07-09 14:49:07.128043 | mon1 | ok: [mon1]
2026-07-09 14:49:07.128174 | mon1 |
2026-07-09 14:49:07.128192 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-09 14:49:07.128283 | mon1 | Thursday 09 July 2026  14:49:07 +0000 (0:00:00.353)       0:03:51.305 *********
2026-07-09 14:49:07.362740 | mon1 | ok: [mon1]
2026-07-09 14:49:07.362812 | mon1 |
2026-07-09 14:49:07.362818 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-09 14:49:07.362824 | mon1 | Thursday 09 July 2026  14:49:07 +0000 (0:00:00.234)       0:03:51.539 *********
2026-07-09 14:49:07.629462 | mon1 | ok: [mon1]
2026-07-09 14:49:07.629564 | mon1 |
2026-07-09 14:49:07.629574 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-09 14:49:07.629732 | mon1 | Thursday 09 July 2026  14:49:07 +0000 (0:00:00.267)       0:03:51.807 *********
2026-07-09 14:49:07.853756 | mon1 | ok: [mon1]
2026-07-09 14:49:07.853800 | mon1 |
2026-07-09 14:49:07.853805 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] ***********
2026-07-09 14:49:07.853810 | mon1 | Thursday 09 July 2026  14:49:07 +0000 (0:00:00.224)       0:03:52.031 *********
2026-07-09 14:49:17.311963 | mon1 | ok: [mon1]
2026-07-09 14:49:17.312041 | mon1 |
2026-07-09 14:49:17.312160 | mon1 | PLAY RECAP *********************************************************************
2026-07-09 14:49:17.314792 | mon1 | mon1                       : ok=83   changed=0    unreachable=0    failed=0    skipped=15   rescued=0    ignored=0
2026-07-09 14:49:17.314814 | mon1 | osd1                       : ok=48   changed=0    unreachable=0    failed=0    skipped=9    rescued=0    ignored=0
2026-07-09 14:49:17.314829 | mon1 |
2026-07-09 14:49:17.314833 | mon1 |
2026-07-09 14:49:17.314837 | mon1 | TASKS RECAP ********************************************************************
2026-07-09 14:49:17.314841 | mon1 | Thursday 09 July 2026  14:49:17 +0000 (0:00:09.458)       0:04:01.489 *********
2026-07-09 14:49:17.314850 | mon1 | ===============================================================================
2026-07-09 14:49:17.314854 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.12s
2026-07-09 14:49:17.314858 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 21.71s
2026-07-09 14:49:17.314862 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 13.64s
2026-07-09 14:49:17.314866 | mon1 | vexxhost.ceph.mgr : Configure manager modules -------------------------- 13.58s
2026-07-09 14:49:17.314869 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ----- 11.92s
2026-07-09 14:49:17.314873 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` --------------------------------- 10.16s
2026-07-09 14:49:17.314877 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 10.08s
2026-07-09 14:49:17.314881 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 9.46s
2026-07-09 14:49:17.314884 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 9.33s
2026-07-09 14:49:17.314888 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 8.88s
2026-07-09 14:49:17.314892 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 8.22s
2026-07-09 14:49:17.314895 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 8.18s
2026-07-09 14:49:17.314899 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 8.16s
2026-07-09 14:49:17.314903 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.91s
2026-07-09 14:49:17.314906 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 7.31s
2026-07-09 14:49:17.314910 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.36s
2026-07-09 14:49:17.314914 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.12s
2026-07-09 14:49:17.314918 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.42s
2026-07-09 14:49:17.314921 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.39s
2026-07-09 14:49:17.314925 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.33s
2026-07-09 14:49:17.438961 | mon1 | INFO     [default > idempotence] Executed: Successful
2026-07-09 14:49:17.447322 | mon1 | INFO     [default > side_effect] Executing
2026-07-09 14:49:17.447837 | mon1 | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-07-09 14:49:17.453342 | mon1 | INFO     [default > verify] Executing
2026-07-09 14:49:18.125415 | mon1 |
2026-07-09 14:49:18.125829 | mon1 | PLAY [Verify] ******************************************************************
2026-07-09 14:49:18.126147 | mon1 |
2026-07-09 14:49:18.126591 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-09 14:49:18.126966 | mon1 | Thursday 09 July 2026  14:49:18 +0000 (0:00:00.009)       0:00:00.009 *********
2026-07-09 14:49:19.378951 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-07-09 14:49:19.379024 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-07-09 14:49:19.379187 | mon1 | interpreter could change the meaning of that path. See
2026-07-09 14:49:19.379330 | mon1 | https://docs.ansible.com/ansible-
2026-07-09 14:49:19.379492 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-09 14:49:19.385461 | mon1 | ok: [mon1]
2026-07-09 14:49:19.385574 | mon1 |
2026-07-09 14:49:19.385702 | mon1 | TASK [Get cluster health status] ***********************************************
2026-07-09 14:49:19.385876 | mon1 | Thursday 09 July 2026  14:49:19 +0000 (0:00:01.260)       0:00:01.269 *********
2026-07-09 14:49:32.349690 | mon1 | ok: [mon1]
2026-07-09 14:49:32.349826 | mon1 |
2026-07-09 14:49:32.350009 | mon1 | TASK [Print cluster health status] *********************************************
2026-07-09 14:49:32.350214 | mon1 | Thursday 09 July 2026  14:49:32 +0000 (0:00:12.963)       0:00:14.233 *********
2026-07-09 14:49:32.379419 | mon1 | ok: [mon1] => {
2026-07-09 14:49:32.379601 | mon1 |     "_ceph_health": {
2026-07-09 14:49:32.379820 | mon1 |         "changed": false,
2026-07-09 14:49:32.380026 | mon1 |         "cmd": [
2026-07-09 14:49:32.380281 | mon1 |             "cephadm",
2026-07-09 14:49:32.380599 | mon1 |             "shell",
2026-07-09 14:49:32.380836 | mon1 |             "--",
2026-07-09 14:49:32.381083 | mon1 |             "ceph",
2026-07-09 14:49:32.381382 | mon1 |             "health"
2026-07-09 14:49:32.381592 | mon1 |         ],
2026-07-09 14:49:32.381801 | mon1 |         "delta": "0:00:12.704811",
2026-07-09 14:49:32.382008 | mon1 |         "end": "2026-07-09 14:49:32.321394",
2026-07-09 14:49:32.382255 | mon1 |         "failed": false,
2026-07-09 14:49:32.382553 | mon1 |         "msg": "",
2026-07-09 14:49:32.382792 | mon1 |         "rc": 0,
2026-07-09 14:49:32.383054 | mon1 |         "start": "2026-07-09 14:49:19.616583",
2026-07-09 14:49:32.383402 | mon1 |         "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config",
2026-07-09 14:49:32.383686 | mon1 |         "stderr_lines": [
2026-07-09 14:49:32.383965 | mon1 |             "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2",
2026-07-09 14:49:32.384200 | mon1 |             "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config"
2026-07-09 14:49:32.384481 | mon1 |         ],
2026-07-09 14:49:32.384693 | mon1 |         "stdout": "HEALTH_OK",
2026-07-09 14:49:32.384887 | mon1 |         "stdout_lines": [
2026-07-09 14:49:32.385019 | mon1 |             "HEALTH_OK"
2026-07-09 14:49:32.385147 | mon1 |         ]
2026-07-09 14:49:32.385261 | mon1 |     }
2026-07-09 14:49:32.385378 | mon1 | }
2026-07-09 14:49:32.385494 | mon1 |
2026-07-09 14:49:32.385622 | mon1 | TASK [Assert that the cluster status is healthy] *******************************
2026-07-09 14:49:32.385750 | mon1 | Thursday 09 July 2026  14:49:32 +0000 (0:00:00.029)       0:00:14.263 *********
2026-07-09 14:49:32.406703 | mon1 | ok: [mon1] => {
2026-07-09 14:49:32.406725 | mon1 |     "changed": false,
2026-07-09 14:49:32.406735 | mon1 |     "msg": "All assertions passed"
2026-07-09 14:49:32.406856 | mon1 | }
2026-07-09 14:49:32.406987 | mon1 |
2026-07-09 14:49:32.407148 | mon1 | TASK [Create a test Ceph pool] *************************************************
2026-07-09 14:49:32.407309 | mon1 | Thursday 09 July 2026  14:49:32 +0000 (0:00:00.027)       0:00:14.290 *********
2026-07-09 14:50:13.160902 | mon1 | changed: [mon1]
2026-07-09 14:50:13.161089 | mon1 |
2026-07-09 14:50:13.161425 | mon1 | TASK [Create a test Ceph key] **************************************************
2026-07-09 14:50:13.161752 | mon1 | Thursday 09 July 2026  14:50:13 +0000 (0:00:40.753)       0:00:55.044 *********
2026-07-09 14:50:17.732798 | mon1 | changed: [mon1]
2026-07-09 14:50:17.732852 | mon1 |
2026-07-09 14:50:17.732858 | mon1 | TASK [Retrieve info for the test Ceph key] *************************************
2026-07-09 14:50:17.732863 | mon1 | Thursday 09 July 2026  14:50:17 +0000 (0:00:04.572)       0:00:59.616 *********
2026-07-09 14:50:20.271240 | mon1 | ok: [mon1]
2026-07-09 14:50:20.271371 | mon1 |
2026-07-09 14:50:20.271684 | mon1 | TASK [Assert that key_info returns the correct key] ****************************
2026-07-09 14:50:20.271738 | mon1 | Thursday 09 July 2026  14:50:20 +0000 (0:00:02.538)       0:01:02.155 *********
2026-07-09 14:50:20.310777 | mon1 | ok: [mon1] => {
2026-07-09 14:50:20.311248 | mon1 |     "changed": false,
2026-07-09 14:50:20.311295 | mon1 |     "msg": "All assertions passed"
2026-07-09 14:50:20.312031 | mon1 | }
2026-07-09 14:50:20.312100 | mon1 |
2026-07-09 14:50:20.312112 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] *********
2026-07-09 14:50:20.312122 | mon1 | Thursday 09 July 2026  14:50:20 +0000 (0:00:00.038)       0:01:02.194 *********
2026-07-09 14:50:22.278433 | mon1 | ok: [mon1]
2026-07-09 14:50:22.278696 | mon1 |
2026-07-09 14:50:22.278715 | mon1 | TASK [Assert that the legacy key module info state returns the correct key] ****
2026-07-09 14:50:22.278743 | mon1 | Thursday 09 July 2026  14:50:22 +0000 (0:00:01.967)       0:01:04.162 *********
2026-07-09 14:50:22.321467 | mon1 | ok: [mon1] => {
2026-07-09 14:50:22.321542 | mon1 |     "changed": false,
2026-07-09 14:50:22.321554 | mon1 |     "msg": "All assertions passed"
2026-07-09 14:50:22.321666 | mon1 | }
2026-07-09 14:50:22.321682 | mon1 |
2026-07-09 14:50:22.321692 | mon1 | PLAY RECAP *********************************************************************
2026-07-09 14:50:22.321703 | mon1 | mon1                       : ok=10   changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-07-09 14:50:22.321712 | mon1 |
2026-07-09 14:50:22.321721 | mon1 |
2026-07-09 14:50:22.321731 | mon1 | TASKS RECAP ********************************************************************
2026-07-09 14:50:22.321740 | mon1 | Thursday 09 July 2026  14:50:22 +0000 (0:00:00.038)       0:01:04.200 *********
2026-07-09 14:50:22.321749 | mon1 | ===============================================================================
2026-07-09 14:50:22.321759 | mon1 | Create a test Ceph pool ------------------------------------------------ 40.75s
2026-07-09 14:50:22.321768 | mon1 | Get cluster health status ---------------------------------------------- 12.96s
2026-07-09 14:50:22.321777 | mon1 | Create a test Ceph key -------------------------------------------------- 4.57s
2026-07-09 14:50:22.321786 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 2.54s
2026-07-09 14:50:22.321795 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 1.97s
2026-07-09 14:50:22.321804 | mon1 | Gathering Facts --------------------------------------------------------- 1.26s
2026-07-09 14:50:22.321814 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s
2026-07-09 14:50:22.321823 | mon1 | Assert that the legacy key module info state returns the correct key ---- 0.04s
2026-07-09 14:50:22.321833 | mon1 | Print cluster health status --------------------------------------------- 0.03s
2026-07-09 14:50:22.321845 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s
2026-07-09 14:50:22.397826 | mon1 | INFO     [default > verify] Executed: Successful
2026-07-09 14:50:22.404029 | mon1 | INFO     [default > cleanup] Executing
2026-07-09 14:50:22.404431 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-07-09 14:50:22.411530 | mon1 | INFO     [default > destroy] Executing
2026-07-09 14:50:22.411744 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-07-09 14:50:22.411925 | mon1 | INFO     [default > destroy] Executed: Successful
2026-07-09 14:50:22.412424 | mon1 | WARNING  Molecule executed 1 scenario (1 missing files)
2026-07-09 14:50:32.996596 | mon1 | ok: Runtime: 0:17:18.780244
2026-07-09 14:50:33.015860 | 
2026-07-09 14:50:33.016009 | PLAY RECAP
2026-07-09 14:50:33.016060 | mon1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-09 14:50:33.016082 | 
2026-07-09 14:50:33.157097 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-07-09 14:50:33.162910 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-07-09 14:50:33.850653 | 
2026-07-09 14:50:33.850855 | PLAY [all]
2026-07-09 14:50:33.864463 | 
2026-07-09 14:50:33.864639 | TASK [fetch-output : Set log path for multiple nodes]
2026-07-09 14:50:33.931881 | mon1 | ok
2026-07-09 14:50:33.938940 | osd1 | ok
2026-07-09 14:50:33.946391 | 
2026-07-09 14:50:33.946621 | TASK [fetch-output : Set log path for single node]
2026-07-09 14:50:33.975145 | mon1 | skipping: Conditional result was False
2026-07-09 14:50:33.986328 | osd1 | skipping: Conditional result was False
2026-07-09 14:50:33.998760 | 
2026-07-09 14:50:33.998942 | LOOP [fetch-output : Ensure local output dirs]
2026-07-09 14:50:34.433545 | osd1 -> localhost | changed: "/var/lib/zuul/builds/d7677849ead14426b574f811d7facec1/work/logs/osd1"
2026-07-09 14:50:34.457297 | mon1 -> localhost | changed: "/var/lib/zuul/builds/d7677849ead14426b574f811d7facec1/work/logs/mon1"
2026-07-09 14:50:34.670763 | osd1 -> localhost | changed: "/var/lib/zuul/builds/d7677849ead14426b574f811d7facec1/work/artifacts"
2026-07-09 14:50:34.687923 | mon1 -> localhost | ok: "/var/lib/zuul/builds/d7677849ead14426b574f811d7facec1/work/artifacts"
2026-07-09 14:50:34.922464 | osd1 -> localhost | changed: "/var/lib/zuul/builds/d7677849ead14426b574f811d7facec1/work/docs"
2026-07-09 14:50:34.933742 | mon1 -> localhost | ok: "/var/lib/zuul/builds/d7677849ead14426b574f811d7facec1/work/docs"
2026-07-09 14:50:35.397182 | mon1 -> localhost | changed: All items complete
2026-07-09 14:50:35.397477 | 
2026-07-09 14:50:35.412486 | 
2026-07-09 14:50:35.412608 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-07-09 14:50:36.086919 | mon1 | changed: .d..t...... ./
2026-07-09 14:50:36.106006 | osd1 | changed: .d..t...... ./
2026-07-09 14:50:36.568236 | mon1 | changed: .d..t...... ./
2026-07-09 14:50:36.574374 | osd1 | ok
2026-07-09 14:50:37.032438 | osd1 | changed: .d..t...... ./
2026-07-09 14:50:37.038585 | mon1 | ok
2026-07-09 14:50:37.071926 | 
2026-07-09 14:50:37.072068 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-07-09 14:50:37.557034 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008868
2026-07-09 14:50:37.557456 | mon1 -> localhost | changed: All items complete
2026-07-09 14:50:37.557525 | 
2026-07-09 14:50:37.807687 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.008407
2026-07-09 14:50:37.831420 | 
2026-07-09 14:50:37.831546 | PLAY [all]
2026-07-09 14:50:37.841542 | 
2026-07-09 14:50:37.841692 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-07-09 14:50:38.292929 | mon1 | changed
2026-07-09 14:50:39.219228 | osd1 | changed
2026-07-09 14:50:39.231336 | 
2026-07-09 14:50:39.231440 | PLAY RECAP
2026-07-09 14:50:39.231502 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-07-09 14:50:39.231537 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-07-09 14:50:39.231557 | 
2026-07-09 14:50:39.396052 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-07-09 14:50:39.402242 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-07-09 14:50:40.074770 | 
2026-07-09 14:50:40.074930 | PLAY [localhost]
2026-07-09 14:50:40.090488 | 
2026-07-09 14:50:40.090722 | TASK [Generate Zuul manifest]
2026-07-09 14:50:40.113483 | localhost | ok
2026-07-09 14:50:40.134425 | 
2026-07-09 14:50:40.134581 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-07-09 14:50:40.694383 | localhost | changed
2026-07-09 14:50:40.706918 | 
2026-07-09 14:50:40.707091 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-07-09 14:50:40.756167 | localhost | ok
2026-07-09 14:50:40.764417 | 
2026-07-09 14:50:40.764570 | TASK [Upload logs]
2026-07-09 14:50:40.783972 | localhost | ok
2026-07-09 14:50:40.865733 | 
2026-07-09 14:50:40.865901 | TASK [Set zuul-log-path fact]
2026-07-09 14:50:40.888707 | localhost | ok
2026-07-09 14:50:40.904667 | 
2026-07-09 14:50:40.904811 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-07-09 14:50:40.934882 | localhost | ok
2026-07-09 14:50:40.943969 | 
2026-07-09 14:50:40.944053 | TASK [upload-logs : Create log directories]
2026-07-09 14:50:41.405526 | localhost | changed
2026-07-09 14:50:41.411700 | 
2026-07-09 14:50:41.411811 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-07-09 14:50:41.962149 | localhost -> localhost | ok: Runtime: 0:00:00.130349
2026-07-09 14:50:41.970338 | 
2026-07-09 14:50:41.970484 | TASK [upload-logs : Upload logs to log server]
2026-07-09 14:50:42.503065 | localhost | Output suppressed because no_log was given
2026-07-09 14:50:42.509165 | 
2026-07-09 14:50:42.509291 | LOOP [upload-logs : Compress console log and json output]
2026-07-09 14:50:42.612887 | localhost | skipping: Conditional result was False
2026-07-09 14:50:42.624615 | localhost | skipping: Conditional result was False
2026-07-09 14:50:42.647109 | 
2026-07-09 14:50:42.647306 | LOOP [upload-logs : Upload compressed console log and json output]
2026-07-09 14:50:42.751756 | localhost | skipping: Conditional result was False
2026-07-09 14:50:42.752433 | 
2026-07-09 14:50:42.757028 | localhost | skipping: Conditional result was False
2026-07-09 14:50:42.814228 | 
2026-07-09 14:50:42.814405 | LOOP [upload-logs : Upload console log and json output]