2026-08-06 15:24:39.191983 | Job console starting
2026-08-06 15:24:39.208495 | Updating git repos
2026-08-06 15:24:39.234577 | Cloning repos into workspace
2026-08-06 15:24:39.274490 | Restoring repo states
2026-08-06 15:24:39.281312 | Merging changes
2026-08-06 15:24:39.572145 | Checking out repos
2026-08-06 15:24:39.608745 | Preparing playbooks
2026-08-06 15:24:40.558362 | Running Ansible setup
2026-08-06 15:24:46.245876 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-06 15:24:46.815573 | 
2026-08-06 15:24:46.815694 | PLAY [localhost]
2026-08-06 15:24:46.822903 | 
2026-08-06 15:24:46.822970 | TASK [Gathering Facts]
2026-08-06 15:24:47.662071 | localhost | ok
2026-08-06 15:24:47.672133 | 
2026-08-06 15:24:47.672210 | TASK [Setup log path fact]
2026-08-06 15:24:47.689458 | localhost | ok
2026-08-06 15:24:47.703594 | 
2026-08-06 15:24:47.703655 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-06 15:24:47.732384 | localhost | ok
2026-08-06 15:24:47.740008 | 
2026-08-06 15:24:47.740078 | TASK [emit-job-header : Print job information]
2026-08-06 15:24:47.779698 | # Job Information
2026-08-06 15:24:47.779835 | Ansible Version: 2.16.18
2026-08-06 15:24:47.779879 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble
2026-08-06 15:24:47.779910 | Pipeline: check
2026-08-06 15:24:47.779938 | Executor: 2d72f0692154
2026-08-06 15:24:47.779964 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/119
2026-08-06 15:24:47.779996 | Event ID: b17d6910-91aa-11f1-9901-9bf91cfd9257
2026-08-06 15:24:47.783662 | 
2026-08-06 15:24:47.783745 | LOOP [emit-job-header : Print node information]
2026-08-06 15:24:47.877752 | localhost | ok:
2026-08-06 15:24:47.878024 | localhost | # Node Information
2026-08-06 15:24:47.878066 | localhost | Inventory Hostname: mon1
2026-08-06 15:24:47.878099 | localhost | Hostname: np0000188140
2026-08-06 15:24:47.878129 | localhost | Username: zuul
2026-08-06 15:24:47.878162 | localhost | Distro: Ubuntu 24.04
2026-08-06 15:24:47.878191 | localhost | Provider: yul1
2026-08-06 15:24:47.878219 | localhost | Region: ca-ymq-1
2026-08-06 15:24:47.878246 | localhost | Label: ubuntu-noble
2026-08-06 15:24:47.878273 | localhost | Product Name: OpenStack Nova
2026-08-06 15:24:47.878300 | localhost | Interface IP: 199.204.45.61
2026-08-06 15:24:47.927220 | localhost | ok:
2026-08-06 15:24:47.927384 | localhost | # Node Information
2026-08-06 15:24:47.927439 | localhost | Inventory Hostname: osd1
2026-08-06 15:24:47.927484 | localhost | Hostname: np0000188143
2026-08-06 15:24:47.927526 | localhost | Username: zuul
2026-08-06 15:24:47.927568 | localhost | Distro: Ubuntu 24.04
2026-08-06 15:24:47.927609 | localhost | Provider: yul1
2026-08-06 15:24:47.927650 | localhost | Region: ca-ymq-1
2026-08-06 15:24:47.927691 | localhost | Label: ubuntu-noble
2026-08-06 15:24:47.927730 | localhost | Product Name: OpenStack Nova
2026-08-06 15:24:47.927771 | localhost | Interface IP: 199.19.213.206
2026-08-06 15:24:47.941838 | 
2026-08-06 15:24:47.941955 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-08-06 15:24:48.291262 | localhost -> localhost | changed
2026-08-06 15:24:48.300190 | 
2026-08-06 15:24:48.300625 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-08-06 15:24:49.066585 | localhost -> localhost | changed
2026-08-06 15:24:49.075454 | 
2026-08-06 15:24:49.075519 | PLAY [all]
2026-08-06 15:24:49.084852 | 
2026-08-06 15:24:49.084942 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-08-06 15:24:49.301040 | mon1 -> localhost | ok
2026-08-06 15:24:49.312528 | 
2026-08-06 15:24:49.312621 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-08-06 15:24:49.346772 | mon1 | ok
2026-08-06 15:24:49.351478 | osd1 | ok
2026-08-06 15:24:49.371613 | mon1 | included: /var/lib/zuul/builds/248618a074d8460fba140260f2074143/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-06 15:24:49.371663 | osd1 | included: /var/lib/zuul/builds/248618a074d8460fba140260f2074143/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-06 15:24:49.378236 | 
2026-08-06 15:24:49.378297 | TASK [add-build-sshkey : Create Temp SSH key]
2026-08-06 15:24:50.967074 | mon1 -> localhost | Generating public/private rsa key pair.
2026-08-06 15:24:50.967258 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/248618a074d8460fba140260f2074143/work/248618a074d8460fba140260f2074143_id_rsa
2026-08-06 15:24:50.967291 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/248618a074d8460fba140260f2074143/work/248618a074d8460fba140260f2074143_id_rsa.pub
2026-08-06 15:24:50.967319 | mon1 -> localhost | The key fingerprint is:
2026-08-06 15:24:50.967370 | mon1 -> localhost | SHA256:3gdMNUN8f0cVZyA5o6Z2xd/M0CkAJ4hA761hFUvlFes zuul-build-sshkey
2026-08-06 15:24:50.967394 | mon1 -> localhost | The key's randomart image is:
2026-08-06 15:24:50.967415 | mon1 -> localhost | +---[RSA 3072]----+
2026-08-06 15:24:50.967437 | mon1 -> localhost | |  .o. .oo+.*B..o*|
2026-08-06 15:24:50.967457 | mon1 -> localhost | |    ....+ +o*+..o|
2026-08-06 15:24:50.967477 | mon1 -> localhost | |     . o ..+.+ +.|
2026-08-06 15:24:50.967497 | mon1 -> localhost | |    . o  o+ o...=|
2026-08-06 15:24:50.967517 | mon1 -> localhost | |     + .SooE ..=o|
2026-08-06 15:24:50.967536 | mon1 -> localhost | |    . o.o...  . +|
2026-08-06 15:24:50.967555 | mon1 -> localhost | |     . .... .    |
2026-08-06 15:24:50.967574 | mon1 -> localhost | |           .     |
2026-08-06 15:24:50.967593 | mon1 -> localhost | |                 |
2026-08-06 15:24:50.967612 | mon1 -> localhost | +----[SHA256]-----+
2026-08-06 15:24:50.967661 | mon1 -> localhost | ok: Runtime: 0:00:01.198696
2026-08-06 15:24:50.973547 | 
2026-08-06 15:24:50.974056 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-08-06 15:24:51.004650 | mon1 | ok
2026-08-06 15:24:51.009164 | osd1 | ok
2026-08-06 15:24:51.022395 | mon1 | included: /var/lib/zuul/builds/248618a074d8460fba140260f2074143/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-06 15:24:51.022441 | osd1 | included: /var/lib/zuul/builds/248618a074d8460fba140260f2074143/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-06 15:24:51.033271 | 
2026-08-06 15:24:51.033337 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-08-06 15:24:51.057566 | mon1 | skipping: Conditional result was False
2026-08-06 15:24:51.068865 | osd1 | skipping: Conditional result was False
2026-08-06 15:24:51.079325 | 
2026-08-06 15:24:51.079417 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-08-06 15:24:51.591283 | mon1 | changed
2026-08-06 15:24:51.597882 | osd1 | changed
2026-08-06 15:24:51.603164 | 
2026-08-06 15:24:51.603228 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-08-06 15:24:51.821340 | mon1 | ok
2026-08-06 15:24:51.826637 | osd1 | ok
2026-08-06 15:24:51.832255 | 
2026-08-06 15:24:51.832323 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-08-06 15:24:52.383222 | mon1 | changed
2026-08-06 15:24:52.433302 | osd1 | changed
2026-08-06 15:24:52.440311 | 
2026-08-06 15:24:52.440381 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-08-06 15:24:52.997046 | mon1 | changed
2026-08-06 15:24:53.003826 | osd1 | changed
2026-08-06 15:24:53.009426 | 
2026-08-06 15:24:53.009492 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-08-06 15:24:53.034823 | mon1 | skipping: Conditional result was False
2026-08-06 15:24:53.045894 | osd1 | skipping: Conditional result was False
2026-08-06 15:24:53.054012 | 
2026-08-06 15:24:53.054102 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-08-06 15:24:53.355049 | mon1 -> localhost | changed
2026-08-06 15:24:53.377238 | 
2026-08-06 15:24:53.377317 | TASK [add-build-sshkey : Add back temp key]
2026-08-06 15:24:53.646355 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/248618a074d8460fba140260f2074143/work/248618a074d8460fba140260f2074143_id_rsa (zuul-build-sshkey)
2026-08-06 15:24:53.646641 | mon1 -> localhost | ok: Runtime: 0:00:00.012671
2026-08-06 15:24:53.653401 | 
2026-08-06 15:24:53.653475 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-08-06 15:24:53.948332 | mon1 | ok
2026-08-06 15:24:53.954976 | osd1 | ok
2026-08-06 15:24:53.960153 | 
2026-08-06 15:24:53.960223 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-08-06 15:24:53.984651 | mon1 | skipping: Conditional result was False
2026-08-06 15:24:53.996729 | osd1 | skipping: Conditional result was False
2026-08-06 15:24:54.015982 | 
2026-08-06 15:24:54.016069 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-08-06 15:24:54.326609 | osd1 | ok
2026-08-06 15:24:54.331376 | mon1 | ok
2026-08-06 15:24:54.337651 | 
2026-08-06 15:24:54.337715 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-08-06 15:24:55.150742 | osd1 | Output suppressed because no_log was given
2026-08-06 15:24:55.200503 | mon1 | Output suppressed because no_log was given
2026-08-06 15:24:55.216472 | 
2026-08-06 15:24:55.216540 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-08-06 15:24:55.445318 | mon1 | ok: "logs"
2026-08-06 15:24:55.445557 | mon1 | ok: All items complete
2026-08-06 15:24:55.445585 | 
2026-08-06 15:24:55.451218 | osd1 | ok: "logs"
2026-08-06 15:24:55.637125 | mon1 | ok: "artifacts"
2026-08-06 15:24:55.641879 | osd1 | ok: "artifacts"
2026-08-06 15:24:55.834306 | mon1 | ok: "docs"
2026-08-06 15:24:55.839762 | osd1 | ok: "docs"
2026-08-06 15:24:55.856085 | 
2026-08-06 15:24:55.856254 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-08-06 15:24:56.080647 | mon1 | changed: "logs"
2026-08-06 15:24:56.081006 | mon1 | ok: All items complete
2026-08-06 15:24:56.081036 | 
2026-08-06 15:24:56.087247 | osd1 | changed: "logs"
2026-08-06 15:24:56.271164 | osd1 | changed: "artifacts"
2026-08-06 15:24:56.288645 | mon1 | changed: "artifacts"
2026-08-06 15:24:56.462555 | osd1 | changed: "docs"
2026-08-06 15:24:56.481778 | mon1 | changed: "docs"
2026-08-06 15:24:56.507370 | 
2026-08-06 15:24:56.507504 | PLAY RECAP
2026-08-06 15:24:56.507558 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-06 15:24:56.507590 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-06 15:24:56.507615 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-06 15:24:56.507634 | 
2026-08-06 15:24:56.674504 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-06 15:24:56.679601 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-06 15:24:57.275495 | 
2026-08-06 15:24:57.275644 | PLAY [all]
2026-08-06 15:24:57.287124 | 
2026-08-06 15:24:57.287201 | TASK [setup-uv : Extract archive]
2026-08-06 15:24:59.711326 | mon1 | changed
2026-08-06 15:25:00.580401 | osd1 | changed
2026-08-06 15:25:00.588974 | 
2026-08-06 15:25:00.589078 | TASK [setup-uv : Print version]
2026-08-06 15:25:00.998570 | mon1 | uv 0.8.13
2026-08-06 15:25:00.989468 | osd1 | uv 0.8.13
2026-08-06 15:25:01.158286 | mon1 | ok: Runtime: 0:00:00.015820
2026-08-06 15:25:01.167775 | osd1 | ok: Runtime: 0:00:00.014525
2026-08-06 15:25:01.181545 | 
2026-08-06 15:25:01.181607 | TASK [Install Ansible collection siblings]
2026-08-06 15:25:01.613145 | mon1 | ok:
2026-08-06 15:25:01.613316 | mon1 | Skipping community.general: no checked-out sibling
2026-08-06 15:25:01.613345 | mon1 | Skipping ansible.utils: no checked-out sibling
2026-08-06 15:25:01.613366 | mon1 | Skipping vexxhost.containers: no checked-out sibling
2026-08-06 15:25:01.614991 | 
2026-08-06 15:25:01.615036 | PLAY RECAP
2026-08-06 15:25:01.615082 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-06 15:25:01.615123 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-06 15:25:01.615143 | 
2026-08-06 15:25:01.733091 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-06 15:25:01.737540 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-06 15:25:02.305011 | 
2026-08-06 15:25:02.305136 | PLAY [all]
2026-08-06 15:25:02.316612 | 
2026-08-06 15:25:02.316685 | LOOP [Check inventory directories]
2026-08-06 15:25:02.722228 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-06 15:25:02.905554 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory"
2026-08-06 15:25:03.091799 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory"
2026-08-06 15:25:03.112705 | 
2026-08-06 15:25:03.112881 | LOOP [Copy inventory file for Zuul]
2026-08-06 15:25:04.006484 | mon1 | changed:
2026-08-06 15:25:04.006744 | mon1 | {
2026-08-06 15:25:04.006786 | mon1 |   "ansible_loop_var": "item",
2026-08-06 15:25:04.006819 | mon1 |   "changed": false,
2026-08-06 15:25:04.006848 | mon1 |   "failed": false,
2026-08-06 15:25:04.006887 | mon1 |   "invocation": {
2026-08-06 15:25:04.006915 | mon1 |     "module_args": {
2026-08-06 15:25:04.006941 | mon1 |       "checksum_algorithm": "sha1",
2026-08-06 15:25:04.006967 | mon1 |       "follow": true,
2026-08-06 15:25:04.006993 | mon1 |       "get_attributes": true,
2026-08-06 15:25:04.007020 | mon1 |       "get_checksum": true,
2026-08-06 15:25:04.007046 | mon1 |       "get_mime": true,
2026-08-06 15:25:04.007071 | mon1 |       "path": "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-06 15:25:04.007097 | mon1 |     }
2026-08-06 15:25:04.007123 | mon1 |   },
2026-08-06 15:25:04.007148 | mon1 |   "item": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-06 15:25:04.007172 | mon1 |   "stat": {
2026-08-06 15:25:04.007196 | mon1 |     "atime": 1786029895.0743322,
2026-08-06 15:25:04.007221 | mon1 |     "attr_flags": "e",
2026-08-06 15:25:04.007246 | mon1 |     "attributes": [
2026-08-06 15:25:04.007270 | mon1 |       "extents"
2026-08-06 15:25:04.007295 | mon1 |     ],
2026-08-06 15:25:04.007319 | mon1 |     "block_size": 4096,
2026-08-06 15:25:04.007343 | mon1 |     "blocks": 8,
2026-08-06 15:25:04.007368 | mon1 |     "charset": "unknown",
2026-08-06 15:25:04.007395 | mon1 |     "ctime": 1786029895.0963335,
2026-08-06 15:25:04.007420 | mon1 |     "dev": 64769,
2026-08-06 15:25:04.007445 | mon1 |     "device_type": 0,
2026-08-06 15:25:04.007470 | mon1 |     "executable": true,
2026-08-06 15:25:04.007494 | mon1 |     "exists": true,
2026-08-06 15:25:04.007518 | mon1 |     "gid": 1000,
2026-08-06 15:25:04.007543 | mon1 |     "gr_name": "zuul",
2026-08-06 15:25:04.007567 | mon1 |     "inode": 1024032,
2026-08-06 15:25:04.007592 | mon1 |     "isblk": false,
2026-08-06 15:25:04.007617 | mon1 |     "ischr": false,
2026-08-06 15:25:04.007641 | mon1 |     "isdir": true,
2026-08-06 15:25:04.007666 | mon1 |     "isfifo": false,
2026-08-06 15:25:04.007690 | mon1 |     "isgid": false,
2026-08-06 15:25:04.007714 | mon1 |     "islnk": false,
2026-08-06 15:25:04.007738 | mon1 |     "isreg": false,
2026-08-06 15:25:04.007763 | mon1 |     "issock": false,
2026-08-06 15:25:04.007787 | mon1 |     "isuid": false,
2026-08-06 15:25:04.007811 | mon1 |     "mimetype": "unknown",
2026-08-06 15:25:04.007835 | mon1 |     "mode": "0755",
2026-08-06 15:25:04.007860 | mon1 |     "mtime": 1786029879.5405943,
2026-08-06 15:25:04.007884 | mon1 |     "nlink": 10,
2026-08-06 15:25:04.007909 | mon1 |     "path": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-06 15:25:04.007934 | mon1 |     "pw_name": "zuul",
2026-08-06 15:25:04.007963 | mon1 |     "readable": true,
2026-08-06 15:25:04.007989 | mon1 |     "rgrp": true,
2026-08-06 15:25:04.008013 | mon1 |     "roth": true,
2026-08-06 15:25:04.008038 | mon1 |     "rusr": true,
2026-08-06 15:25:04.008062 | mon1 |     "size": 4096,
2026-08-06 15:25:04.008101 | mon1 |     "uid": 1000,
2026-08-06 15:25:04.008127 | mon1 |     "version": "4280000234",
2026-08-06 15:25:04.008153 | mon1 |     "wgrp": false,
2026-08-06 15:25:04.008179 | mon1 |     "woth": false,
2026-08-06 15:25:04.008205 | mon1 |     "writeable": true,
2026-08-06 15:25:04.008229 | mon1 |     "wusr": true,
2026-08-06 15:25:04.008253 | mon1 |     "xgrp": true,
2026-08-06 15:25:04.008277 | mon1 |     "xoth": true,
2026-08-06 15:25:04.008300 | mon1 |     "xusr": true
2026-08-06 15:25:04.008323 | mon1 |   }
2026-08-06 15:25:04.008347 | mon1 | }
2026-08-06 15:25:04.008394 | mon1 | ok: All items complete
2026-08-06 15:25:04.008424 | 
2026-08-06 15:25:04.010158 | mon1 | skipping: Conditional result was False
2026-08-06 15:25:04.010994 | mon1 | skipping: Conditional result was False
2026-08-06 15:25:04.024413 | 
2026-08-06 15:25:04.024609 | LOOP [Switch "ansible_host" to private IP]
2026-08-06 15:25:04.393851 | mon1 | changed: 2 replacements made
2026-08-06 15:25:04.395681 | mon1 | skipping: Conditional result was False
2026-08-06 15:25:04.396518 | mon1 | skipping: Conditional result was False
2026-08-06 15:25:04.416275 | 
2026-08-06 15:25:04.416465 | TASK [Run Molecule scenario]
2026-08-06 15:25:04.871595 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3
2026-08-06 15:25:04.871774 | mon1 | Creating virtual environment at: .venv
2026-08-06 15:25:05.158224 | mon1 | Downloading netaddr (2.2MiB)
2026-08-06 15:25:05.162574 | mon1 | Downloading pygments (1.2MiB)
2026-08-06 15:25:05.162922 | mon1 | Downloading ansible-core (2.1MiB)
2026-08-06 15:25:05.163184 | mon1 | Downloading cryptography (4.3MiB)
2026-08-06 15:25:05.359721 | mon1 |  Downloading netaddr
2026-08-06 15:25:05.369749 | mon1 |  Downloading cryptography
2026-08-06 15:25:05.418829 | mon1 |  Downloading pygments
2026-08-06 15:25:05.572337 | mon1 |  Downloading ansible-core
2026-08-06 15:25:05.625088 | mon1 | Installed 37 packages in 52ms
2026-08-06 15:25:06.358565 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-08-06 15:25:06.358690 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-08-06 15:25:07.035064 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-08-06 15:25:07.035173 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-08-06 15:25:51.454007 | mon1 | INFO     [default > dependency] Executing
2026-08-06 15:25:51.454257 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-08-06 15:25:51.454540 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-08-06 15:25:51.454712 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-08-06 15:25:51.462134 | mon1 | INFO     [default > cleanup] Executing
2026-08-06 15:25:51.462477 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-06 15:25:51.467991 | mon1 | INFO     [default > destroy] Executing
2026-08-06 15:25:51.468043 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-08-06 15:25:51.468117 | mon1 | INFO     [default > destroy] Executed: Successful
2026-08-06 15:25:51.473674 | mon1 | INFO     [default > syntax] Executing
2026-08-06 15:25:52.618122 | mon1 |
2026-08-06 15:25:52.618448 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-06 15:25:52.672989 | mon1 | INFO     [default > syntax] Executed: Successful
2026-08-06 15:25:52.684470 | mon1 | INFO     [default > create] Executing
2026-08-06 15:25:52.686084 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-06 15:25:52.692061 | mon1 | INFO     [default > prepare] Executing
2026-08-06 15:25:53.477891 | mon1 |
2026-08-06 15:25:53.478146 | mon1 | PLAY [Prepare] *****************************************************************
2026-08-06 15:25:53.478500 | mon1 |
2026-08-06 15:25:53.478845 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:25:53.479113 | mon1 | Thursday 06 August 2026  15:25:53 +0000 (0:00:00.040)       0:00:00.040 *******
2026-08-06 15:25:54.763385 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-08-06 15:25:54.763444 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-06 15:25:54.763457 | mon1 | interpreter could change the meaning of that path. See
2026-08-06 15:25:54.763475 | mon1 | https://docs.ansible.com/ansible-
2026-08-06 15:25:54.763608 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-06 15:25:54.768632 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-08-06 15:25:54.768770 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-06 15:25:54.768926 | mon1 | interpreter could change the meaning of that path. See
2026-08-06 15:25:54.769084 | mon1 | https://docs.ansible.com/ansible-
2026-08-06 15:25:54.769290 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-06 15:25:54.775935 | mon1 | ok: [mon1]
2026-08-06 15:25:54.776142 | mon1 | ok: [osd1]
2026-08-06 15:25:54.776399 | mon1 |
2026-08-06 15:25:54.776630 | mon1 | TASK [Configure short hostname] ************************************************
2026-08-06 15:25:54.776866 | mon1 | Thursday 06 August 2026  15:25:54 +0000 (0:00:01.299)       0:00:01.339 *******
2026-08-06 15:25:55.527823 | mon1 | changed: [mon1]
2026-08-06 15:25:55.528048 | mon1 | changed: [osd1]
2026-08-06 15:25:55.528315 | mon1 |
2026-08-06 15:25:55.528560 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-08-06 15:25:55.528813 | mon1 | Thursday 06 August 2026  15:25:55 +0000 (0:00:00.751)       0:00:02.091 *******
2026-08-06 15:25:55.843315 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-08-06 15:25:55.843363 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-08-06 15:25:55.843373 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-08-06 15:25:55.854162 | mon1 | changed: [mon1]
2026-08-06 15:25:55.854191 | mon1 | changed: [osd1]
2026-08-06 15:25:55.854201 | mon1 |
2026-08-06 15:25:55.854210 | mon1 | TASK [Update apt cache] ********************************************************
2026-08-06 15:25:55.854219 | mon1 | Thursday 06 August 2026  15:25:55 +0000 (0:00:00.325)       0:00:02.416 *******
2026-08-06 15:26:21.367456 | mon1 | changed: [osd1]
2026-08-06 15:26:21.367532 | mon1 | changed: [mon1]
2026-08-06 15:26:21.367735 | mon1 |
2026-08-06 15:26:21.368056 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-08-06 15:26:21.368359 | mon1 |
2026-08-06 15:26:21.368599 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:26:21.368848 | mon1 | Thursday 06 August 2026  15:26:21 +0000 (0:00:25.513)       0:00:27.930 *******
2026-08-06 15:26:22.151852 | mon1 | ok: [osd1]
2026-08-06 15:26:22.152053 | mon1 |
2026-08-06 15:26:22.152347 | mon1 | TASK [Install depedencies] *****************************************************
2026-08-06 15:26:22.152604 | mon1 | Thursday 06 August 2026  15:26:22 +0000 (0:00:00.784)       0:00:28.715 *******
2026-08-06 15:26:40.680883 | mon1 | changed: [osd1]
2026-08-06 15:26:40.680959 | mon1 |
2026-08-06 15:26:40.681101 | mon1 | TASK [Start up service] ********************************************************
2026-08-06 15:26:40.681151 | mon1 | Thursday 06 August 2026  15:26:40 +0000 (0:00:18.527)       0:00:47.242 *******
2026-08-06 15:26:41.331099 | mon1 | ok: [osd1]
2026-08-06 15:26:41.331377 | mon1 |
2026-08-06 15:26:41.331594 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-08-06 15:26:41.331840 | mon1 | Thursday 06 August 2026  15:26:41 +0000 (0:00:00.652)       0:00:47.894 *******
2026-08-06 15:26:41.680513 | mon1 | ok: [osd1]
2026-08-06 15:26:41.680722 | mon1 |
2026-08-06 15:26:41.680971 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-08-06 15:26:41.681224 | mon1 | Thursday 06 August 2026  15:26:41 +0000 (0:00:00.348)       0:00:48.243 *******
2026-08-06 15:26:42.442996 | mon1 | changed: [osd1]
2026-08-06 15:26:42.443065 | mon1 |
2026-08-06 15:26:42.443220 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-08-06 15:26:42.443389 | mon1 | Thursday 06 August 2026  15:26:42 +0000 (0:00:00.763)       0:00:49.006 *******
2026-08-06 15:26:42.679278 | mon1 | ok: [osd1]
2026-08-06 15:26:42.679467 | mon1 |
2026-08-06 15:26:42.679932 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-08-06 15:26:42.680289 | mon1 | Thursday 06 August 2026  15:26:42 +0000 (0:00:00.235)       0:00:49.242 *******
2026-08-06 15:26:42.706893 | mon1 | skipping: [osd1]
2026-08-06 15:26:42.707386 | mon1 |
2026-08-06 15:26:42.707764 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-08-06 15:26:42.708188 | mon1 | Thursday 06 August 2026  15:26:42 +0000 (0:00:00.027)       0:00:49.269 *******
2026-08-06 15:26:43.387934 | mon1 | changed: [osd1] => (item=osd0)
2026-08-06 15:26:43.388161 | mon1 | changed: [osd1] => (item=osd1)
2026-08-06 15:26:43.388470 | mon1 | changed: [osd1] => (item=osd2)
2026-08-06 15:26:43.388706 | mon1 |
2026-08-06 15:26:43.388986 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-08-06 15:26:43.389221 | mon1 | Thursday 06 August 2026  15:26:43 +0000 (0:00:00.681)       0:00:49.951 *******
2026-08-06 15:26:44.145426 | mon1 | changed: [osd1] => (item=osd0)
2026-08-06 15:26:44.145661 | mon1 | changed: [osd1] => (item=osd1)
2026-08-06 15:26:44.145966 | mon1 | changed: [osd1] => (item=osd2)
2026-08-06 15:26:44.146222 | mon1 |
2026-08-06 15:26:44.146551 | mon1 | TASK [Start loop devices] ******************************************************
2026-08-06 15:26:44.146853 | mon1 | Thursday 06 August 2026  15:26:44 +0000 (0:00:00.757)       0:00:50.708 *******
2026-08-06 15:26:44.933589 | mon1 | changed: [osd1] => (item=osd0)
2026-08-06 15:26:44.933665 | mon1 | changed: [osd1] => (item=osd1)
2026-08-06 15:26:44.933731 | mon1 | changed: [osd1] => (item=osd2)
2026-08-06 15:26:44.933831 | mon1 |
2026-08-06 15:26:44.933951 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-08-06 15:26:44.934065 | mon1 | Thursday 06 August 2026  15:26:44 +0000 (0:00:00.788)       0:00:51.496 *******
2026-08-06 15:26:46.384658 | mon1 | changed: [osd1] => (item=osd0)
2026-08-06 15:26:46.384877 | mon1 | changed: [osd1] => (item=osd1)
2026-08-06 15:26:46.385120 | mon1 | changed: [osd1] => (item=osd2)
2026-08-06 15:26:46.385393 | mon1 |
2026-08-06 15:26:46.385634 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-08-06 15:26:46.385878 | mon1 | Thursday 06 August 2026  15:26:46 +0000 (0:00:01.451)       0:00:52.947 *******
2026-08-06 15:26:47.736911 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-08-06 15:26:47.737090 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-08-06 15:26:47.737373 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-08-06 15:26:47.737592 | mon1 |
2026-08-06 15:26:47.737852 | mon1 | PLAY RECAP *********************************************************************
2026-08-06 15:26:47.738101 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-08-06 15:26:47.738385 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-06 15:26:47.738689 | mon1 |
2026-08-06 15:26:47.738954 | mon1 |
2026-08-06 15:26:47.739171 | mon1 | TASKS RECAP ********************************************************************
2026-08-06 15:26:47.739443 | mon1 | Thursday 06 August 2026  15:26:47 +0000 (0:00:01.353)       0:00:54.300 *******
2026-08-06 15:26:47.739667 | mon1 | ===============================================================================
2026-08-06 15:26:47.739922 | mon1 | Update apt cache ------------------------------------------------------- 25.51s
2026-08-06 15:26:47.740203 | mon1 | Install depedencies ---------------------------------------------------- 18.53s
2026-08-06 15:26:47.740530 | mon1 | Create a volume group for each loop device ------------------------------ 1.45s
2026-08-06 15:26:47.740743 | mon1 | Create a logical volume for each loop device ---------------------------- 1.35s
2026-08-06 15:26:47.741003 | mon1 | Gathering Facts --------------------------------------------------------- 1.30s
2026-08-06 15:26:47.741141 | mon1 | Start loop devices ------------------------------------------------------ 0.79s
2026-08-06 15:26:47.741332 | mon1 | Gathering Facts --------------------------------------------------------- 0.78s
2026-08-06 15:26:47.741474 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.76s
2026-08-06 15:26:47.741624 | mon1 | Set permissions on loopback devices ------------------------------------- 0.76s
2026-08-06 15:26:47.741822 | mon1 | Configure short hostname ------------------------------------------------ 0.75s
2026-08-06 15:26:47.742027 | mon1 | Create devices for Ceph ------------------------------------------------- 0.68s
2026-08-06 15:26:47.742174 | mon1 | Start up service -------------------------------------------------------- 0.65s
2026-08-06 15:26:47.742354 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.35s
2026-08-06 15:26:47.742507 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.33s
2026-08-06 15:26:47.742659 | mon1 | Get list of all loopback devices ---------------------------------------- 0.24s
2026-08-06 15:26:47.742817 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-08-06 15:26:47.809844 | mon1 | INFO     [default > prepare] Executed: Successful
2026-08-06 15:26:47.818964 | mon1 | INFO     [default > converge] Executing
2026-08-06 15:26:48.832679 | mon1 |
2026-08-06 15:26:48.832871 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-08-06 15:26:48.833089 | mon1 |
2026-08-06 15:26:48.833367 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:26:48.833661 | mon1 | Thursday 06 August 2026  15:26:48 +0000 (0:00:00.053)       0:00:00.053 *******
2026-08-06 15:26:49.873148 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-08-06 15:26:49.873400 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-06 15:26:49.873662 | mon1 | interpreter could change the meaning of that path. See
2026-08-06 15:26:49.873898 | mon1 | https://docs.ansible.com/ansible-
2026-08-06 15:26:49.874151 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-06 15:26:49.885314 | mon1 | ok: [mon1]
2026-08-06 15:26:49.885538 | mon1 |
2026-08-06 15:26:49.885792 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:26:49.886161 | mon1 | Thursday 06 August 2026  15:26:49 +0000 (0:00:01.053)       0:00:01.106 *******
2026-08-06 15:26:50.228491 | mon1 | ok: [mon1]
2026-08-06 15:26:50.228559 | mon1 |
2026-08-06 15:26:50.228571 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:26:50.228580 | mon1 | Thursday 06 August 2026  15:26:50 +0000 (0:00:00.341)       0:00:01.448 *******
2026-08-06 15:26:50.272103 | mon1 | skipping: [mon1]
2026-08-06 15:26:50.272179 | mon1 |
2026-08-06 15:26:50.272194 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-06 15:26:50.272406 | mon1 | Thursday 06 August 2026  15:26:50 +0000 (0:00:00.044)       0:00:01.493 *******
2026-08-06 15:26:50.635412 | mon1 | changed: [mon1]
2026-08-06 15:26:50.635472 | mon1 |
2026-08-06 15:26:50.635482 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:26:50.635491 | mon1 | Thursday 06 August 2026  15:26:50 +0000 (0:00:00.361)       0:00:01.854 *******
2026-08-06 15:26:50.747471 | mon1 | ok: [mon1] => {
2026-08-06 15:26:50.747584 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-06 15:26:50.747605 | mon1 | }
2026-08-06 15:26:50.747781 | mon1 |
2026-08-06 15:26:50.748068 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:26:50.748342 | mon1 | Thursday 06 August 2026  15:26:50 +0000 (0:00:00.113)       0:00:01.968 *******
2026-08-06 15:26:51.534108 | mon1 | changed: [mon1]
2026-08-06 15:26:51.534354 | mon1 |
2026-08-06 15:26:51.534369 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:26:51.534378 | mon1 | Thursday 06 August 2026  15:26:51 +0000 (0:00:00.785)       0:00:02.754 *******
2026-08-06 15:26:51.580169 | mon1 | skipping: [mon1]
2026-08-06 15:26:51.580308 | mon1 |
2026-08-06 15:26:51.580326 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:26:51.580336 | mon1 | Thursday 06 August 2026  15:26:51 +0000 (0:00:00.045)       0:00:02.800 *******
2026-08-06 15:26:51.630509 | mon1 | skipping: [mon1]
2026-08-06 15:26:51.630539 | mon1 |
2026-08-06 15:26:51.630548 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:26:51.630557 | mon1 | Thursday 06 August 2026  15:26:51 +0000 (0:00:00.050)       0:00:02.850 *******
2026-08-06 15:26:51.888880 | mon1 | ok: [mon1]
2026-08-06 15:26:51.888931 | mon1 |
2026-08-06 15:26:51.888943 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:26:51.888954 | mon1 | Thursday 06 August 2026  15:26:51 +0000 (0:00:00.258)       0:00:03.108 *******
2026-08-06 15:26:52.903327 | mon1 | ok: [mon1]
2026-08-06 15:26:52.903385 | mon1 |
2026-08-06 15:26:52.903782 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:26:52.903833 | mon1 | Thursday 06 August 2026  15:26:52 +0000 (0:00:01.015)       0:00:04.123 *******
2026-08-06 15:26:53.100389 | mon1 | ok: [mon1] => {
2026-08-06 15:26:53.100454 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-06 15:26:53.100490 | mon1 | }
2026-08-06 15:26:53.100499 | mon1 |
2026-08-06 15:26:53.100509 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:26:53.100518 | mon1 | Thursday 06 August 2026  15:26:53 +0000 (0:00:00.195)       0:00:04.319 *******
2026-08-06 15:26:54.043390 | mon1 | changed: [mon1]
2026-08-06 15:26:54.043431 | mon1 |
2026-08-06 15:26:54.043436 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:26:54.043440 | mon1 | Thursday 06 August 2026  15:26:54 +0000 (0:00:00.944)       0:00:05.264 *******
2026-08-06 15:26:57.219315 | mon1 | changed: [mon1]
2026-08-06 15:26:57.219373 | mon1 |
2026-08-06 15:26:57.219383 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-06 15:26:57.219393 | mon1 | Thursday 06 August 2026  15:26:57 +0000 (0:00:03.175)       0:00:08.439 *******
2026-08-06 15:26:57.254408 | mon1 | skipping: [mon1]
2026-08-06 15:26:57.254473 | mon1 |
2026-08-06 15:26:57.254484 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-06 15:26:57.254494 | mon1 | Thursday 06 August 2026  15:26:57 +0000 (0:00:00.034)       0:00:08.474 *******
2026-08-06 15:26:57.291407 | mon1 | skipping: [mon1]
2026-08-06 15:26:57.291468 | mon1 |
2026-08-06 15:26:57.291479 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-06 15:26:57.291495 | mon1 | Thursday 06 August 2026  15:26:57 +0000 (0:00:00.036)       0:00:08.511 *******
2026-08-06 15:26:57.323763 | mon1 | skipping: [mon1]
2026-08-06 15:26:57.323841 | mon1 |
2026-08-06 15:26:57.323909 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-06 15:26:57.324014 | mon1 | Thursday 06 August 2026  15:26:57 +0000 (0:00:00.033)       0:00:08.544 *******
2026-08-06 15:27:04.484856 | mon1 | changed: [mon1]
2026-08-06 15:27:04.484917 | mon1 |
2026-08-06 15:27:04.484931 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-06 15:27:04.484943 | mon1 | Thursday 06 August 2026  15:27:04 +0000 (0:00:07.160)       0:00:15.704 *******
2026-08-06 15:27:05.153725 | mon1 | changed: [mon1]
2026-08-06 15:27:05.153756 | mon1 |
2026-08-06 15:27:05.153762 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-06 15:27:05.153768 | mon1 | Thursday 06 August 2026  15:27:05 +0000 (0:00:00.667)       0:00:16.371 *******
2026-08-06 15:27:06.254333 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-08-06 15:27:06.254385 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-06 15:27:06.254394 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-06 15:27:06.254400 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-06 15:27:06.254407 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-06 15:27:06.254414 | mon1 |
2026-08-06 15:27:06.254769 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-06 15:27:06.254822 | mon1 | Thursday 06 August 2026  15:27:06 +0000 (0:00:01.101)       0:00:17.473 *******
2026-08-06 15:27:06.970456 | mon1 | changed: [mon1]
2026-08-06 15:27:06.970530 | mon1 |
2026-08-06 15:27:06.970544 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-06 15:27:06.970557 | mon1 | Thursday 06 August 2026  15:27:06 +0000 (0:00:00.704)       0:00:18.178 *******
2026-08-06 15:27:06.970568 | mon1 |
2026-08-06 15:27:06.970580 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-06 15:27:06.970591 | mon1 | Thursday 06 August 2026  15:27:06 +0000 (0:00:00.010)       0:00:18.188 *******
2026-08-06 15:27:08.055938 | mon1 | ok: [mon1]
2026-08-06 15:27:08.055965 | mon1 |
2026-08-06 15:27:08.055972 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-06 15:27:08.055977 | mon1 | Thursday 06 August 2026  15:27:08 +0000 (0:00:01.085)       0:00:19.273 *******
2026-08-06 15:27:08.602348 | mon1 | changed: [mon1]
2026-08-06 15:27:08.602455 | mon1 |
2026-08-06 15:27:08.602473 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-06 15:27:08.603007 | mon1 | Thursday 06 August 2026  15:27:08 +0000 (0:00:00.548)       0:00:19.822 *******
2026-08-06 15:27:09.288792 | mon1 | changed: [mon1]
2026-08-06 15:27:09.288842 | mon1 |
2026-08-06 15:27:09.288853 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:27:09.288862 | mon1 | Thursday 06 August 2026  15:27:09 +0000 (0:00:00.686)       0:00:20.508 *******
2026-08-06 15:27:09.546741 | mon1 | ok: [mon1]
2026-08-06 15:27:09.546785 | mon1 |
2026-08-06 15:27:09.546795 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:27:09.546805 | mon1 | Thursday 06 August 2026  15:27:09 +0000 (0:00:00.258)       0:00:20.766 *******
2026-08-06 15:27:09.633005 | mon1 | ok: [mon1] => {
2026-08-06 15:27:09.633036 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-06 15:27:09.633046 | mon1 | }
2026-08-06 15:27:09.633056 | mon1 |
2026-08-06 15:27:09.633065 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:27:09.633074 | mon1 | Thursday 06 August 2026  15:27:09 +0000 (0:00:00.085)       0:00:20.852 *******
2026-08-06 15:27:10.621173 | mon1 | changed: [mon1]
2026-08-06 15:27:10.621262 | mon1 |
2026-08-06 15:27:10.621277 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:27:10.621287 | mon1 | Thursday 06 August 2026  15:27:10 +0000 (0:00:00.987)       0:00:21.839 *******
2026-08-06 15:27:15.194397 | mon1 | changed: [mon1]
2026-08-06 15:27:15.194444 | mon1 |
2026-08-06 15:27:15.194451 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-06 15:27:15.194457 | mon1 | Thursday 06 August 2026  15:27:15 +0000 (0:00:04.574)       0:00:26.414 *******
2026-08-06 15:27:16.135313 | mon1 | ok: [mon1]
2026-08-06 15:27:16.135357 | mon1 |
2026-08-06 15:27:16.135900 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-06 15:27:16.135944 | mon1 | Thursday 06 August 2026  15:27:16 +0000 (0:00:00.940)       0:00:27.355 *******
2026-08-06 15:27:16.594078 | mon1 | changed: [mon1]
2026-08-06 15:27:16.594117 | mon1 |
2026-08-06 15:27:16.594122 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-06 15:27:16.594128 | mon1 | Thursday 06 August 2026  15:27:16 +0000 (0:00:00.459)       0:00:27.814 *******
2026-08-06 15:27:17.180824 | mon1 | changed: [mon1]
2026-08-06 15:27:17.180906 | mon1 |
2026-08-06 15:27:17.180915 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-06 15:27:17.180922 | mon1 | Thursday 06 August 2026  15:27:17 +0000 (0:00:00.585)       0:00:28.400 *******
2026-08-06 15:27:17.889356 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-08-06 15:27:17.889424 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-06 15:27:17.890322 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-06 15:27:17.890385 | mon1 |
2026-08-06 15:27:17.890401 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-06 15:27:17.890597 | mon1 | Thursday 06 August 2026  15:27:17 +0000 (0:00:00.708)       0:00:29.109 *******
2026-08-06 15:27:18.447325 | mon1 | changed: [mon1]
2026-08-06 15:27:18.447386 | mon1 |
2026-08-06 15:27:18.447560 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-06 15:27:18.447836 | mon1 | Thursday 06 August 2026  15:27:18 +0000 (0:00:00.558)       0:00:29.667 *******
2026-08-06 15:27:19.010986 | mon1 | changed: [mon1]
2026-08-06 15:27:19.011178 | mon1 |
2026-08-06 15:27:19.011482 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-06 15:27:19.011757 | mon1 | Thursday 06 August 2026  15:27:19 +0000 (0:00:00.557)       0:00:30.224 *******
2026-08-06 15:27:19.012042 | mon1 |
2026-08-06 15:27:19.012332 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-06 15:27:19.012584 | mon1 | Thursday 06 August 2026  15:27:19 +0000 (0:00:00.007)       0:00:30.232 *******
2026-08-06 15:27:19.855439 | mon1 | ok: [mon1]
2026-08-06 15:27:19.855638 | mon1 |
2026-08-06 15:27:19.855940 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-06 15:27:19.856254 | mon1 | Thursday 06 August 2026  15:27:19 +0000 (0:00:00.844)       0:00:31.076 *******
2026-08-06 15:27:21.022123 | mon1 | changed: [mon1]
2026-08-06 15:27:21.022186 | mon1 |
2026-08-06 15:27:21.022200 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-06 15:27:21.022212 | mon1 | Thursday 06 August 2026  15:27:21 +0000 (0:00:01.165)       0:00:32.242 *******
2026-08-06 15:27:21.680404 | mon1 | changed: [mon1]
2026-08-06 15:27:21.680459 | mon1 |
2026-08-06 15:27:21.680857 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-06 15:27:21.680909 | mon1 | Thursday 06 August 2026  15:27:21 +0000 (0:00:00.658)       0:00:32.900 *******
2026-08-06 15:27:21.738634 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-06 15:27:21.738682 | mon1 |
2026-08-06 15:27:21.738696 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-06 15:27:21.738709 | mon1 | Thursday 06 August 2026  15:27:21 +0000 (0:00:00.058)       0:00:32.959 *******
2026-08-06 15:27:39.590875 | mon1 | changed: [mon1]
2026-08-06 15:27:39.590945 | mon1 |
2026-08-06 15:27:39.590958 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-06 15:27:39.590971 | mon1 | Thursday 06 August 2026  15:27:39 +0000 (0:00:17.851)       0:00:50.810 *******
2026-08-06 15:27:40.383376 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-08-06 15:27:40.383472 | mon1 | ok: [mon1] => (item=ssh)
2026-08-06 15:27:40.384129 | mon1 |
2026-08-06 15:27:40.384190 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-06 15:27:40.384204 | mon1 | Thursday 06 August 2026  15:27:40 +0000 (0:00:00.793)       0:00:51.603 *******
2026-08-06 15:27:41.404555 | mon1 | changed: [mon1]
2026-08-06 15:27:41.404612 | mon1 |
2026-08-06 15:27:41.404626 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-06 15:27:41.404639 | mon1 | Thursday 06 August 2026  15:27:41 +0000 (0:00:01.020)       0:00:52.624 *******
2026-08-06 15:27:41.645860 | mon1 | ok: [mon1]
2026-08-06 15:27:41.645916 | mon1 |
2026-08-06 15:27:41.645930 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-06 15:27:41.645943 | mon1 | Thursday 06 August 2026  15:27:41 +0000 (0:00:00.241)       0:00:52.865 *******
2026-08-06 15:27:42.156012 | mon1 | changed: [mon1]
2026-08-06 15:27:42.156097 | mon1 |
2026-08-06 15:27:42.156111 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-06 15:27:42.156123 | mon1 | Thursday 06 August 2026  15:27:42 +0000 (0:00:00.509)       0:00:53.375 *******
2026-08-06 15:27:42.509822 | mon1 | changed: [mon1]
2026-08-06 15:27:42.509880 | mon1 |
2026-08-06 15:27:42.509921 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-08-06 15:27:42.509934 | mon1 | Thursday 06 August 2026  15:27:42 +0000 (0:00:00.354)       0:00:53.729 *******
2026-08-06 15:27:42.638781 | mon1 | ok: [mon1]
2026-08-06 15:27:42.638839 | mon1 |
2026-08-06 15:27:42.638853 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-08-06 15:27:42.638865 | mon1 | Thursday 06 August 2026  15:27:42 +0000 (0:00:00.128)       0:00:53.858 *******
2026-08-06 15:27:42.896744 | mon1 | ok: [mon1] => (item=mon1)
2026-08-06 15:27:42.896805 | mon1 |
2026-08-06 15:27:42.896819 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-08-06 15:27:42.896831 | mon1 | Thursday 06 August 2026  15:27:42 +0000 (0:00:00.258)       0:00:54.117 *******
2026-08-06 15:27:42.947150 | mon1 | ok: [mon1]
2026-08-06 15:27:42.947194 | mon1 |
2026-08-06 15:27:42.947201 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-08-06 15:27:42.947207 | mon1 | Thursday 06 August 2026  15:27:42 +0000 (0:00:00.050)       0:00:54.167 *******
2026-08-06 15:27:43.023821 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1
2026-08-06 15:27:43.023906 | mon1 |
2026-08-06 15:27:43.023917 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-08-06 15:27:43.023926 | mon1 | Thursday 06 August 2026  15:27:43 +0000 (0:00:00.075)       0:00:54.243 *******
2026-08-06 15:27:43.347735 | mon1 | changed: [mon1]
2026-08-06 15:27:43.347782 | mon1 |
2026-08-06 15:27:43.347792 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-08-06 15:27:43.347802 | mon1 | Thursday 06 August 2026  15:27:43 +0000 (0:00:00.324)       0:00:54.567 *******
2026-08-06 15:27:44.113338 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-08-06 15:27:44.113392 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-08-06 15:27:44.113402 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-08-06 15:27:44.113411 | mon1 |
2026-08-06 15:27:44.113421 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-08-06 15:27:44.113429 | mon1 | Thursday 06 August 2026  15:27:44 +0000 (0:00:00.764)       0:00:55.332 *******
2026-08-06 15:29:11.685619 | mon1 | ok: [mon1]
2026-08-06 15:29:11.685659 | mon1 |
2026-08-06 15:29:11.685665 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-08-06 15:29:11.685671 | mon1 | Thursday 06 August 2026  15:29:11 +0000 (0:01:27.571)       0:02:22.903 *******
2026-08-06 15:29:11.942387 | mon1 | changed: [mon1]
2026-08-06 15:29:11.942453 | mon1 |
2026-08-06 15:29:11.942466 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-08-06 15:29:11.942479 | mon1 | Thursday 06 August 2026  15:29:11 +0000 (0:00:00.258)       0:02:23.162 *******
2026-08-06 15:29:11.985789 | mon1 | ok: [mon1]
2026-08-06 15:29:11.985844 | mon1 |
2026-08-06 15:29:11.985858 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-06 15:29:11.985870 | mon1 | Thursday 06 August 2026  15:29:11 +0000 (0:00:00.043)       0:02:23.205 *******
2026-08-06 15:29:12.058404 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-08-06 15:29:12.058454 | mon1 |
2026-08-06 15:29:12.058482 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-06 15:29:12.058501 | mon1 | Thursday 06 August 2026  15:29:12 +0000 (0:00:00.073)       0:02:23.279 *******
2026-08-06 15:29:13.918326 | mon1 | ok: [mon1]
2026-08-06 15:29:13.918575 | mon1 |
2026-08-06 15:29:13.918902 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-06 15:29:13.919164 | mon1 | Thursday 06 August 2026  15:29:13 +0000 (0:00:01.860)       0:02:25.139 *******
2026-08-06 15:29:13.977503 | mon1 | ok: [mon1] => (item=mon1)
2026-08-06 15:29:13.977691 | mon1 |
2026-08-06 15:29:13.977943 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-06 15:29:13.978191 | mon1 | Thursday 06 August 2026  15:29:13 +0000 (0:00:00.059)       0:02:25.198 *******
2026-08-06 15:29:14.412939 | mon1 | ok: [mon1]
2026-08-06 15:29:14.413171 | mon1 |
2026-08-06 15:29:14.413622 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-06 15:29:14.413784 | mon1 | Thursday 06 August 2026  15:29:14 +0000 (0:00:00.434)       0:02:25.633 *******
2026-08-06 15:29:17.060428 | mon1 | ok: [mon1]
2026-08-06 15:29:17.060562 | mon1 |
2026-08-06 15:29:17.060588 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-08-06 15:29:17.060892 | mon1 | Thursday 06 August 2026  15:29:17 +0000 (0:00:02.647)       0:02:28.280 *******
2026-08-06 15:29:20.736953 | mon1 | changed: [mon1]
2026-08-06 15:29:20.736984 | mon1 |
2026-08-06 15:29:20.736990 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-08-06 15:29:20.736996 | mon1 | Thursday 06 August 2026  15:29:20 +0000 (0:00:03.675)       0:02:31.956 *******
2026-08-06 15:29:22.653625 | mon1 | ok: [mon1]
2026-08-06 15:29:22.653679 | mon1 |
2026-08-06 15:29:22.653755 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-06 15:29:22.653867 | mon1 | Thursday 06 August 2026  15:29:22 +0000 (0:00:01.918)       0:02:33.874 *******
2026-08-06 15:29:22.720517 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-08-06 15:29:22.720600 | mon1 |
2026-08-06 15:29:22.720719 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-06 15:29:22.720830 | mon1 | Thursday 06 August 2026  15:29:22 +0000 (0:00:00.065)       0:02:33.940 *******
2026-08-06 15:29:22.768258 | mon1 | skipping: [mon1]
2026-08-06 15:29:22.768303 | mon1 |
2026-08-06 15:29:22.768434 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-06 15:29:22.768543 | mon1 | Thursday 06 August 2026  15:29:22 +0000 (0:00:00.048)       0:02:33.989 *******
2026-08-06 15:29:22.821608 | mon1 | skipping: [mon1] => (item=mon1)
2026-08-06 15:29:22.821736 | mon1 | skipping: [mon1]
2026-08-06 15:29:22.821877 | mon1 |
2026-08-06 15:29:22.822003 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-06 15:29:22.822114 | mon1 | Thursday 06 August 2026  15:29:22 +0000 (0:00:00.052)       0:02:34.042 *******
2026-08-06 15:29:23.150829 | mon1 | ok: [mon1]
2026-08-06 15:29:23.150892 | mon1 |
2026-08-06 15:29:23.150908 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-06 15:29:23.150922 | mon1 | Thursday 06 August 2026  15:29:23 +0000 (0:00:00.328)       0:02:34.370 *******
2026-08-06 15:29:25.780322 | mon1 | ok: [mon1]
2026-08-06 15:29:25.780402 | mon1 |
2026-08-06 15:29:25.780419 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-08-06 15:29:25.780436 | mon1 | Thursday 06 August 2026  15:29:25 +0000 (0:00:02.628)       0:02:36.999 *******
2026-08-06 15:29:28.991781 | mon1 | changed: [mon1]
2026-08-06 15:29:28.991847 | mon1 |
2026-08-06 15:29:28.991862 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-08-06 15:29:28.991874 | mon1 | Thursday 06 August 2026  15:29:28 +0000 (0:00:03.212)       0:02:40.211 *******
2026-08-06 15:29:30.844337 | mon1 | ok: [mon1]
2026-08-06 15:29:30.844415 | mon1 |
2026-08-06 15:29:30.844778 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-08-06 15:29:30.844834 | mon1 | Thursday 06 August 2026  15:29:30 +0000 (0:00:01.852)       0:02:42.064 *******
2026-08-06 15:29:38.603076 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'})
2026-08-06 15:29:38.603116 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-08-06 15:29:38.603123 | mon1 | changed: [mon1] => (item={'name': 'prometheus'})
2026-08-06 15:29:38.603128 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-08-06 15:29:38.603133 | mon1 |
2026-08-06 15:29:38.603139 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-08-06 15:29:38.603144 | mon1 |
2026-08-06 15:29:38.603150 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:29:38.603155 | mon1 | Thursday 06 August 2026  15:29:38 +0000 (0:00:07.757)       0:02:49.821 *******
2026-08-06 15:29:39.765752 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-08-06 15:29:39.766018 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-06 15:29:39.766255 | mon1 | interpreter could change the meaning of that path. See
2026-08-06 15:29:39.766477 | mon1 | https://docs.ansible.com/ansible-
2026-08-06 15:29:39.766688 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-06 15:29:39.777128 | mon1 | ok: [osd1]
2026-08-06 15:29:39.777354 | mon1 |
2026-08-06 15:29:39.777570 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:29:39.777781 | mon1 | Thursday 06 August 2026  15:29:39 +0000 (0:00:01.176)       0:02:50.998 *******
2026-08-06 15:29:40.022785 | mon1 | ok: [osd1]
2026-08-06 15:29:40.023119 | mon1 |
2026-08-06 15:29:40.023471 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:29:40.023820 | mon1 | Thursday 06 August 2026  15:29:40 +0000 (0:00:00.245)       0:02:51.243 *******
2026-08-06 15:29:40.060285 | mon1 | skipping: [osd1]
2026-08-06 15:29:40.060602 | mon1 |
2026-08-06 15:29:40.060921 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-06 15:29:40.061301 | mon1 | Thursday 06 August 2026  15:29:40 +0000 (0:00:00.037)       0:02:51.281 *******
2026-08-06 15:29:40.327597 | mon1 | changed: [osd1]
2026-08-06 15:29:40.327981 | mon1 |
2026-08-06 15:29:40.328330 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:29:40.328647 | mon1 | Thursday 06 August 2026  15:29:40 +0000 (0:00:00.267)       0:02:51.548 *******
2026-08-06 15:29:40.388943 | mon1 | ok: [osd1] => {
2026-08-06 15:29:40.389360 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-06 15:29:40.389692 | mon1 | }
2026-08-06 15:29:40.389992 | mon1 |
2026-08-06 15:29:40.390357 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:29:40.390693 | mon1 | Thursday 06 August 2026  15:29:40 +0000 (0:00:00.061)       0:02:51.609 *******
2026-08-06 15:29:41.041487 | mon1 | changed: [osd1]
2026-08-06 15:29:41.041840 | mon1 |
2026-08-06 15:29:41.042168 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:29:41.042513 | mon1 | Thursday 06 August 2026  15:29:41 +0000 (0:00:00.652)       0:02:52.262 *******
2026-08-06 15:29:41.086787 | mon1 | skipping: [osd1]
2026-08-06 15:29:41.087013 | mon1 |
2026-08-06 15:29:41.087214 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:29:41.087435 | mon1 | Thursday 06 August 2026  15:29:41 +0000 (0:00:00.045)       0:02:52.307 *******
2026-08-06 15:29:41.131692 | mon1 | skipping: [osd1]
2026-08-06 15:29:41.132559 | mon1 |
2026-08-06 15:29:41.132585 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:29:41.132595 | mon1 | Thursday 06 August 2026  15:29:41 +0000 (0:00:00.044)       0:02:52.352 *******
2026-08-06 15:29:41.374412 | mon1 | ok: [osd1]
2026-08-06 15:29:41.374481 | mon1 |
2026-08-06 15:29:41.374493 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:29:41.374504 | mon1 | Thursday 06 August 2026  15:29:41 +0000 (0:00:00.241)       0:02:52.593 *******
2026-08-06 15:29:42.276722 | mon1 | ok: [osd1]
2026-08-06 15:29:42.276939 | mon1 |
2026-08-06 15:29:42.277202 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:29:42.277489 | mon1 | Thursday 06 August 2026  15:29:42 +0000 (0:00:00.903)       0:02:53.497 *******
2026-08-06 15:29:42.343602 | mon1 | ok: [osd1] => {
2026-08-06 15:29:42.343838 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-06 15:29:42.344092 | mon1 | }
2026-08-06 15:29:42.344363 | mon1 |
2026-08-06 15:29:42.344659 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:29:42.344892 | mon1 | Thursday 06 August 2026  15:29:42 +0000 (0:00:00.067)       0:02:53.564 *******
2026-08-06 15:29:43.159667 | mon1 | changed: [osd1]
2026-08-06 15:29:43.159864 | mon1 |
2026-08-06 15:29:43.160127 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:29:43.160472 | mon1 | Thursday 06 August 2026  15:29:43 +0000 (0:00:00.815)       0:02:54.380 *******
2026-08-06 15:29:46.987800 | mon1 | changed: [osd1]
2026-08-06 15:29:46.988010 | mon1 |
2026-08-06 15:29:46.988284 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-06 15:29:46.988540 | mon1 | Thursday 06 August 2026  15:29:46 +0000 (0:00:03.827)       0:02:58.208 *******
2026-08-06 15:29:47.020396 | mon1 | skipping: [osd1]
2026-08-06 15:29:47.020619 | mon1 |
2026-08-06 15:29:47.020904 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-06 15:29:47.021151 | mon1 | Thursday 06 August 2026  15:29:47 +0000 (0:00:00.032)       0:02:58.241 *******
2026-08-06 15:29:47.053259 | mon1 | skipping: [osd1]
2026-08-06 15:29:47.053500 | mon1 |
2026-08-06 15:29:47.053756 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-06 15:29:47.054003 | mon1 | Thursday 06 August 2026  15:29:47 +0000 (0:00:00.032)       0:02:58.274 *******
2026-08-06 15:29:47.087209 | mon1 | skipping: [osd1]
2026-08-06 15:29:47.087478 | mon1 |
2026-08-06 15:29:47.087751 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-06 15:29:47.088015 | mon1 | Thursday 06 August 2026  15:29:47 +0000 (0:00:00.033)       0:02:58.308 *******
2026-08-06 15:29:54.727292 | mon1 | changed: [osd1]
2026-08-06 15:29:54.727537 | mon1 |
2026-08-06 15:29:54.727829 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-06 15:29:54.728147 | mon1 | Thursday 06 August 2026  15:29:54 +0000 (0:00:07.639)       0:03:05.947 *******
2026-08-06 15:29:55.285539 | mon1 | changed: [osd1]
2026-08-06 15:29:55.285756 | mon1 |
2026-08-06 15:29:55.286084 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-06 15:29:55.286398 | mon1 | Thursday 06 August 2026  15:29:55 +0000 (0:00:00.558)       0:03:06.506 *******
2026-08-06 15:29:56.432387 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'})
2026-08-06 15:29:56.432483 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-06 15:29:56.433393 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-06 15:29:56.433453 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-06 15:29:56.433460 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-06 15:29:56.433466 | mon1 |
2026-08-06 15:29:56.433472 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-06 15:29:56.433478 | mon1 | Thursday 06 August 2026  15:29:56 +0000 (0:00:01.146)       0:03:07.653 *******
2026-08-06 15:29:57.170457 | mon1 | changed: [osd1]
2026-08-06 15:29:57.170559 | mon1 |
2026-08-06 15:29:57.170570 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-06 15:29:57.170580 | mon1 | Thursday 06 August 2026  15:29:57 +0000 (0:00:00.729)       0:03:08.383 *******
2026-08-06 15:29:57.170589 | mon1 |
2026-08-06 15:29:57.170598 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-06 15:29:57.170615 | mon1 | Thursday 06 August 2026  15:29:57 +0000 (0:00:00.006)       0:03:08.389 *******
2026-08-06 15:29:58.088713 | mon1 | ok: [osd1]
2026-08-06 15:29:58.088778 | mon1 |
2026-08-06 15:29:58.088866 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-06 15:29:58.088976 | mon1 | Thursday 06 August 2026  15:29:58 +0000 (0:00:00.919)       0:03:09.309 *******
2026-08-06 15:29:58.675873 | mon1 | changed: [osd1]
2026-08-06 15:29:58.675933 | mon1 |
2026-08-06 15:29:58.675944 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-06 15:29:58.675954 | mon1 | Thursday 06 August 2026  15:29:58 +0000 (0:00:00.585)       0:03:09.895 *******
2026-08-06 15:30:00.388802 | mon1 | changed: [osd1]
2026-08-06 15:30:00.388860 | mon1 |
2026-08-06 15:30:00.388871 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:30:00.388882 | mon1 | Thursday 06 August 2026  15:30:00 +0000 (0:00:01.712)       0:03:11.608 *******
2026-08-06 15:30:00.640766 | mon1 | ok: [osd1]
2026-08-06 15:30:00.640825 | mon1 |
2026-08-06 15:30:00.640836 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:30:00.640845 | mon1 | Thursday 06 August 2026  15:30:00 +0000 (0:00:00.252)       0:03:11.860 *******
2026-08-06 15:30:00.703277 | mon1 | ok: [osd1] => {
2026-08-06 15:30:00.703326 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-06 15:30:00.703336 | mon1 | }
2026-08-06 15:30:00.703346 | mon1 |
2026-08-06 15:30:00.703367 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:30:00.703376 | mon1 | Thursday 06 August 2026  15:30:00 +0000 (0:00:00.062)       0:03:11.922 *******
2026-08-06 15:30:01.738180 | mon1 | changed: [osd1]
2026-08-06 15:30:01.738309 | mon1 |
2026-08-06 15:30:01.738321 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:30:01.738331 | mon1 | Thursday 06 August 2026  15:30:01 +0000 (0:00:01.035)       0:03:12.957 *******
2026-08-06 15:30:06.328195 | mon1 | changed: [osd1]
2026-08-06 15:30:06.328360 | mon1 |
2026-08-06 15:30:06.328372 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-06 15:30:06.328382 | mon1 | Thursday 06 August 2026  15:30:06 +0000 (0:00:04.589)       0:03:17.546 *******
2026-08-06 15:30:07.239455 | mon1 | ok: [osd1]
2026-08-06 15:30:07.239549 | mon1 |
2026-08-06 15:30:07.239592 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-06 15:30:07.239980 | mon1 | Thursday 06 August 2026  15:30:07 +0000 (0:00:00.912)       0:03:18.459 *******
2026-08-06 15:30:07.543458 | mon1 | changed: [osd1]
2026-08-06 15:30:07.543538 | mon1 |
2026-08-06 15:30:07.543828 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-06 15:30:07.544175 | mon1 | Thursday 06 August 2026  15:30:07 +0000 (0:00:00.304)       0:03:18.763 *******
2026-08-06 15:30:08.122145 | mon1 | changed: [osd1]
2026-08-06 15:30:08.122214 | mon1 |
2026-08-06 15:30:08.122260 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-06 15:30:08.122276 | mon1 | Thursday 06 August 2026  15:30:08 +0000 (0:00:00.578)       0:03:19.341 *******
2026-08-06 15:30:08.810197 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'})
2026-08-06 15:30:08.810285 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-06 15:30:08.810301 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-06 15:30:08.810311 | mon1 |
2026-08-06 15:30:08.810321 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-06 15:30:08.810330 | mon1 | Thursday 06 August 2026  15:30:08 +0000 (0:00:00.687)       0:03:20.029 *******
2026-08-06 15:30:09.375751 | mon1 | changed: [osd1]
2026-08-06 15:30:09.375804 | mon1 |
2026-08-06 15:30:09.375817 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-06 15:30:09.375830 | mon1 | Thursday 06 August 2026  15:30:09 +0000 (0:00:00.565)       0:03:20.594 *******
2026-08-06 15:30:09.970405 | mon1 | changed: [osd1]
2026-08-06 15:30:09.970523 | mon1 |
2026-08-06 15:30:09.970559 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-06 15:30:09.971511 | mon1 | Thursday 06 August 2026  15:30:09 +0000 (0:00:00.590)       0:03:21.184 *******
2026-08-06 15:30:09.971577 | mon1 |
2026-08-06 15:30:09.971591 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-06 15:30:09.971604 | mon1 | Thursday 06 August 2026  15:30:09 +0000 (0:00:00.006)       0:03:21.190 *******
2026-08-06 15:30:10.862403 | mon1 | ok: [osd1]
2026-08-06 15:30:10.862467 | mon1 |
2026-08-06 15:30:10.862876 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-06 15:30:10.862913 | mon1 | Thursday 06 August 2026  15:30:10 +0000 (0:00:00.891)       0:03:22.082 *******
2026-08-06 15:30:11.863767 | mon1 | changed: [osd1]
2026-08-06 15:30:11.863830 | mon1 |
2026-08-06 15:30:11.863843 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-06 15:30:11.863856 | mon1 | Thursday 06 August 2026  15:30:11 +0000 (0:00:01.000)       0:03:23.083 *******
2026-08-06 15:30:12.561803 | mon1 | changed: [osd1]
2026-08-06 15:30:12.561858 | mon1 |
2026-08-06 15:30:12.561872 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-06 15:30:12.561884 | mon1 | Thursday 06 August 2026  15:30:12 +0000 (0:00:00.698)       0:03:23.781 *******
2026-08-06 15:30:12.615291 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-06 15:30:12.615335 | mon1 |
2026-08-06 15:30:12.615344 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-06 15:30:12.615353 | mon1 | Thursday 06 August 2026  15:30:12 +0000 (0:00:00.054)       0:03:23.836 *******
2026-08-06 15:30:13.599766 | mon1 | ok: [osd1]
2026-08-06 15:30:13.599813 | mon1 |
2026-08-06 15:30:13.599827 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-06 15:30:13.599839 | mon1 | Thursday 06 August 2026  15:30:13 +0000 (0:00:00.982)       0:03:24.818 *******
2026-08-06 15:30:14.407320 | mon1 | ok: [osd1] => (item=systemd-timesyncd)
2026-08-06 15:30:14.407398 | mon1 | ok: [osd1] => (item=ssh)
2026-08-06 15:30:14.408025 | mon1 |
2026-08-06 15:30:14.408049 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-06 15:30:14.408060 | mon1 | Thursday 06 August 2026  15:30:14 +0000 (0:00:00.808)       0:03:25.627 *******
2026-08-06 15:30:16.135886 | mon1 | changed: [osd1]
2026-08-06 15:30:16.135942 | mon1 |
2026-08-06 15:30:16.135952 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-06 15:30:16.135962 | mon1 | Thursday 06 August 2026  15:30:16 +0000 (0:00:01.727)       0:03:27.354 *******
2026-08-06 15:30:16.382922 | mon1 | ok: [osd1]
2026-08-06 15:30:16.382973 | mon1 |
2026-08-06 15:30:16.382984 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-06 15:30:16.382994 | mon1 | Thursday 06 August 2026  15:30:16 +0000 (0:00:00.247)       0:03:27.602 *******
2026-08-06 15:30:16.754104 | mon1 | changed: [osd1]
2026-08-06 15:30:16.754159 | mon1 |
2026-08-06 15:30:16.754170 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-06 15:30:16.754205 | mon1 | Thursday 06 August 2026  15:30:16 +0000 (0:00:00.371)       0:03:27.973 *******
2026-08-06 15:30:17.016528 | mon1 | changed: [osd1]
2026-08-06 15:30:17.016579 | mon1 |
2026-08-06 15:30:17.016587 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-08-06 15:30:17.016594 | mon1 | Thursday 06 August 2026  15:30:17 +0000 (0:00:00.263)       0:03:28.236 *******
2026-08-06 15:30:17.284028 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-08-06 15:30:17.284066 | mon1 |
2026-08-06 15:30:17.284071 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-08-06 15:30:17.284076 | mon1 | Thursday 06 August 2026  15:30:17 +0000 (0:00:00.268)       0:03:28.504 *******
2026-08-06 15:30:17.341363 | mon1 | ok: [osd1]
2026-08-06 15:30:17.341428 | mon1 |
2026-08-06 15:30:17.341882 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-06 15:30:17.341930 | mon1 | Thursday 06 August 2026  15:30:17 +0000 (0:00:00.057)       0:03:28.561 *******
2026-08-06 15:30:17.448747 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-08-06 15:30:17.448803 | mon1 |
2026-08-06 15:30:17.448814 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-06 15:30:17.448823 | mon1 | Thursday 06 August 2026  15:30:17 +0000 (0:00:00.105)       0:03:28.667 *******
2026-08-06 15:30:19.320675 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:30:19.320755 | mon1 |
2026-08-06 15:30:19.320856 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-06 15:30:19.320978 | mon1 | Thursday 06 August 2026  15:30:19 +0000 (0:00:01.873)       0:03:30.540 *******
2026-08-06 15:30:19.379402 | mon1 | ok: [osd1] => (item=osd1)
2026-08-06 15:30:19.379462 | mon1 |
2026-08-06 15:30:19.379848 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-06 15:30:19.379907 | mon1 | Thursday 06 August 2026  15:30:19 +0000 (0:00:00.058)       0:03:30.599 *******
2026-08-06 15:30:19.702314 | mon1 | changed: [osd1]
2026-08-06 15:30:19.702367 | mon1 |
2026-08-06 15:30:19.702872 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-06 15:30:19.702933 | mon1 | Thursday 06 August 2026  15:30:19 +0000 (0:00:00.321)       0:03:30.920 *******
2026-08-06 15:30:25.549665 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:30:25.549733 | mon1 |
2026-08-06 15:30:25.549842 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-08-06 15:30:25.549952 | mon1 | Thursday 06 August 2026  15:30:25 +0000 (0:00:05.849)       0:03:36.770 *******
2026-08-06 15:30:26.485359 | mon1 | ok: [osd1]
2026-08-06 15:30:26.485412 | mon1 |
2026-08-06 15:30:26.485483 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-08-06 15:30:26.485741 | mon1 | Thursday 06 August 2026  15:30:26 +0000 (0:00:00.935)       0:03:37.705 *******
2026-08-06 15:31:09.113052 | mon1 | ok: [osd1]
2026-08-06 15:31:09.113147 | mon1 |
2026-08-06 15:31:09.113165 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-08-06 15:31:09.113216 | mon1 | Thursday 06 August 2026  15:31:09 +0000 (0:00:42.626)       0:04:20.332 *******
2026-08-06 15:31:53.157358 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data)
2026-08-06 15:31:53.157423 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data)
2026-08-06 15:31:53.157444 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data)
2026-08-06 15:31:53.158297 | mon1 |
2026-08-06 15:31:53.158375 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-08-06 15:31:53.158392 | mon1 | Thursday 06 August 2026  15:31:53 +0000 (0:00:44.044)       0:05:04.376 *******
2026-08-06 15:31:55.258824 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:31:55.258916 | mon1 |
2026-08-06 15:31:55.258924 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-08-06 15:31:55.258932 | mon1 | Thursday 06 August 2026  15:31:55 +0000 (0:00:02.101)       0:05:06.477 *******
2026-08-06 15:31:57.208262 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:31:57.208372 | mon1 |
2026-08-06 15:31:57.208388 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-08-06 15:31:57.208402 | mon1 | Thursday 06 August 2026  15:31:57 +0000 (0:00:01.950)       0:05:08.427 *******
2026-08-06 15:31:57.266839 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-08-06 15:31:57.266937 | mon1 |
2026-08-06 15:31:57.266951 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-08-06 15:31:57.266971 | mon1 | Thursday 06 August 2026  15:31:57 +0000 (0:00:00.059)       0:05:08.486 *******
2026-08-06 15:31:57.313785 | mon1 | ok: [osd1]
2026-08-06 15:31:57.313929 | mon1 |
2026-08-06 15:31:57.314092 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-08-06 15:31:57.314311 | mon1 | Thursday 06 August 2026  15:31:57 +0000 (0:00:00.047)       0:05:08.534 *******
2026-08-06 15:31:59.220282 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:31:59.221292 | mon1 |
2026-08-06 15:31:59.221330 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-08-06 15:31:59.221368 | mon1 | Thursday 06 August 2026  15:31:59 +0000 (0:00:01.904)       0:05:10.439 *******
2026-08-06 15:31:59.260920 | mon1 | ok: [osd1]
2026-08-06 15:31:59.260983 | mon1 |
2026-08-06 15:31:59.260997 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-08-06 15:31:59.261010 | mon1 | Thursday 06 August 2026  15:31:59 +0000 (0:00:00.041)       0:05:10.480 *******
2026-08-06 15:31:59.285896 | mon1 | failed: [osd1] (item=2) => {"ansible_loop_var": "item", "changed": false, "item": 2, "msg": "Failed as requested from task"}
2026-08-06 15:31:59.304693 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:31:59.304724 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:31:59.304737 | mon1 |
2026-08-06 15:31:59.304749 | mon1 | TASK [vexxhost.ceph.osd : Failed after retry] **********************************
2026-08-06 15:31:59.304761 | mon1 | Thursday 06 August 2026  15:31:59 +0000 (0:00:00.043)       0:05:10.524 *******
2026-08-06 15:31:59.334347 | mon1 | skipping: [osd1]
2026-08-06 15:31:59.334405 | mon1 |
2026-08-06 15:31:59.334419 | mon1 | TASK [vexxhost.ceph.osd : Give 5 seconds pause before retry] *******************
2026-08-06 15:31:59.334534 | mon1 | Thursday 06 August 2026  15:31:59 +0000 (0:00:00.030)       0:05:10.554 *******
2026-08-06 15:32:04.370440 | mon1 | Pausing for 5 seconds
2026-08-06 15:32:04.370528 | mon1 | ok: [osd1]
2026-08-06 15:32:04.370543 | mon1 |
2026-08-06 15:32:04.370564 | mon1 | TASK [vexxhost.ceph.osd : Recheck OSDs] ****************************************
2026-08-06 15:32:04.370837 | mon1 | Thursday 06 August 2026  15:32:04 +0000 (0:00:05.036)       0:05:15.590 *******
2026-08-06 15:32:04.422740 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-08-06 15:32:04.422919 | mon1 |
2026-08-06 15:32:04.423183 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-08-06 15:32:04.423450 | mon1 | Thursday 06 August 2026  15:32:04 +0000 (0:00:00.053)       0:05:15.643 *******
2026-08-06 15:32:04.469807 | mon1 | ok: [osd1]
2026-08-06 15:32:04.469984 | mon1 |
2026-08-06 15:32:04.470382 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-08-06 15:32:04.470642 | mon1 | Thursday 06 August 2026  15:32:04 +0000 (0:00:00.047)       0:05:15.690 *******
2026-08-06 15:32:06.393314 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:32:06.393532 | mon1 |
2026-08-06 15:32:06.393801 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-08-06 15:32:06.394045 | mon1 | Thursday 06 August 2026  15:32:06 +0000 (0:00:01.922)       0:05:17.613 *******
2026-08-06 15:32:06.443753 | mon1 | ok: [osd1]
2026-08-06 15:32:06.443952 | mon1 |
2026-08-06 15:32:06.444201 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-08-06 15:32:06.444500 | mon1 | Thursday 06 August 2026  15:32:06 +0000 (0:00:00.051)       0:05:17.664 *******
2026-08-06 15:32:06.485746 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:32:06.485944 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:32:06.486179 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:32:06.486481 | mon1 | skipping: [osd1]
2026-08-06 15:32:06.486762 | mon1 |
2026-08-06 15:32:06.487015 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-08-06 15:32:06.487305 | mon1 | Thursday 06 August 2026  15:32:06 +0000 (0:00:00.042)       0:05:17.706 *******
2026-08-06 15:32:06.553131 | mon1 | skipping: [osd1]
2026-08-06 15:32:06.553372 | mon1 |
2026-08-06 15:32:06.553658 | mon1 | PLAY [Deploy Ceph exporters] ***************************************************
2026-08-06 15:32:06.553880 | mon1 |
2026-08-06 15:32:06.554140 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:32:06.554433 | mon1 | Thursday 06 August 2026  15:32:06 +0000 (0:00:00.067)       0:05:17.774 *******
2026-08-06 15:32:07.520806 | mon1 | ok: [mon1]
2026-08-06 15:32:07.521064 | mon1 |
2026-08-06 15:32:07.521472 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:32:07.521808 | mon1 | Thursday 06 August 2026  15:32:07 +0000 (0:00:00.967)       0:05:18.741 *******
2026-08-06 15:32:07.766946 | mon1 | ok: [mon1]
2026-08-06 15:32:07.767105 | mon1 |
2026-08-06 15:32:07.767419 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:32:07.767643 | mon1 | Thursday 06 August 2026  15:32:07 +0000 (0:00:00.246)       0:05:18.988 *******
2026-08-06 15:32:07.805514 | mon1 | skipping: [mon1]
2026-08-06 15:32:07.805651 | mon1 |
2026-08-06 15:32:07.805918 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-06 15:32:07.806147 | mon1 | Thursday 06 August 2026  15:32:07 +0000 (0:00:00.038)       0:05:19.026 *******
2026-08-06 15:32:08.055321 | mon1 | ok: [mon1]
2026-08-06 15:32:08.055584 | mon1 |
2026-08-06 15:32:08.055848 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:32:08.056107 | mon1 | Thursday 06 August 2026  15:32:08 +0000 (0:00:00.249)       0:05:19.276 *******
2026-08-06 15:32:08.115134 | mon1 | ok: [mon1] => {
2026-08-06 15:32:08.115407 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-06 15:32:08.115638 | mon1 | }
2026-08-06 15:32:08.115855 | mon1 |
2026-08-06 15:32:08.116102 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:32:08.116376 | mon1 | Thursday 06 August 2026  15:32:08 +0000 (0:00:00.059)       0:05:19.336 *******
2026-08-06 15:32:08.481373 | mon1 | ok: [mon1]
2026-08-06 15:32:08.481464 | mon1 |
2026-08-06 15:32:08.481666 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:32:08.481910 | mon1 | Thursday 06 August 2026  15:32:08 +0000 (0:00:00.366)       0:05:19.702 *******
2026-08-06 15:32:08.527051 | mon1 | skipping: [mon1]
2026-08-06 15:32:08.527319 | mon1 |
2026-08-06 15:32:08.527578 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:32:08.527850 | mon1 | Thursday 06 August 2026  15:32:08 +0000 (0:00:00.045)       0:05:19.748 *******
2026-08-06 15:32:08.569219 | mon1 | skipping: [mon1]
2026-08-06 15:32:08.569448 | mon1 |
2026-08-06 15:32:08.569697 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:32:08.569940 | mon1 | Thursday 06 August 2026  15:32:08 +0000 (0:00:00.042)       0:05:19.790 *******
2026-08-06 15:32:08.809299 | mon1 | ok: [mon1]
2026-08-06 15:32:08.809547 | mon1 |
2026-08-06 15:32:08.809907 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:32:08.810269 | mon1 | Thursday 06 August 2026  15:32:08 +0000 (0:00:00.239)       0:05:20.030 *******
2026-08-06 15:32:09.763376 | mon1 | ok: [mon1]
2026-08-06 15:32:09.763450 | mon1 |
2026-08-06 15:32:09.763469 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:32:09.763686 | mon1 | Thursday 06 August 2026  15:32:09 +0000 (0:00:00.953)       0:05:20.983 *******
2026-08-06 15:32:09.843989 | mon1 | ok: [mon1] => {
2026-08-06 15:32:09.844125 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-06 15:32:09.844305 | mon1 | }
2026-08-06 15:32:09.844420 | mon1 |
2026-08-06 15:32:09.844543 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:32:09.844691 | mon1 | Thursday 06 August 2026  15:32:09 +0000 (0:00:00.079)       0:05:21.063 *******
2026-08-06 15:32:10.306123 | mon1 | ok: [mon1]
2026-08-06 15:32:10.306201 | mon1 |
2026-08-06 15:32:10.306211 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:32:10.306222 | mon1 | Thursday 06 August 2026  15:32:10 +0000 (0:00:00.460)       0:05:21.524 *******
2026-08-06 15:32:12.410727 | mon1 | ok: [mon1]
2026-08-06 15:32:12.410783 | mon1 |
2026-08-06 15:32:12.410794 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-06 15:32:12.410803 | mon1 | Thursday 06 August 2026  15:32:12 +0000 (0:00:02.105)       0:05:23.630 *******
2026-08-06 15:32:12.445454 | mon1 | skipping: [mon1]
2026-08-06 15:32:12.445528 | mon1 |
2026-08-06 15:32:12.445671 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-06 15:32:12.445908 | mon1 | Thursday 06 August 2026  15:32:12 +0000 (0:00:00.035)       0:05:23.666 *******
2026-08-06 15:32:12.474625 | mon1 | skipping: [mon1]
2026-08-06 15:32:12.474790 | mon1 |
2026-08-06 15:32:12.475057 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-06 15:32:12.475319 | mon1 | Thursday 06 August 2026  15:32:12 +0000 (0:00:00.029)       0:05:23.695 *******
2026-08-06 15:32:12.510207 | mon1 | skipping: [mon1]
2026-08-06 15:32:12.510427 | mon1 |
2026-08-06 15:32:12.510691 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-06 15:32:12.510934 | mon1 | Thursday 06 August 2026  15:32:12 +0000 (0:00:00.035)       0:05:23.731 *******
2026-08-06 15:32:13.453985 | mon1 | ok: [mon1]
2026-08-06 15:32:13.454185 | mon1 |
2026-08-06 15:32:13.454514 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-06 15:32:13.454777 | mon1 | Thursday 06 August 2026  15:32:13 +0000 (0:00:00.943)       0:05:24.675 *******
2026-08-06 15:32:14.002078 | mon1 | ok: [mon1]
2026-08-06 15:32:14.002338 | mon1 |
2026-08-06 15:32:14.002598 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-06 15:32:14.002847 | mon1 | Thursday 06 August 2026  15:32:14 +0000 (0:00:00.547)       0:05:25.222 *******
2026-08-06 15:32:15.157402 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-08-06 15:32:15.157652 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-06 15:32:15.157904 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-06 15:32:15.158165 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-06 15:32:15.158455 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-06 15:32:15.158692 | mon1 |
2026-08-06 15:32:15.158990 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-06 15:32:15.159298 | mon1 | Thursday 06 August 2026  15:32:15 +0000 (0:00:01.155)       0:05:26.378 *******
2026-08-06 15:32:15.863509 | mon1 | ok: [mon1]
2026-08-06 15:32:15.863704 | mon1 |
2026-08-06 15:32:15.863962 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-06 15:32:15.864374 | mon1 | Thursday 06 August 2026  15:32:15 +0000 (0:00:00.700)       0:05:27.078 *******
2026-08-06 15:32:15.864590 | mon1 |
2026-08-06 15:32:15.864833 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-06 15:32:15.865076 | mon1 | Thursday 06 August 2026  15:32:15 +0000 (0:00:00.005)       0:05:27.084 *******
2026-08-06 15:32:16.328474 | mon1 | ok: [mon1]
2026-08-06 15:32:16.328731 | mon1 |
2026-08-06 15:32:16.328910 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:32:16.329077 | mon1 | Thursday 06 August 2026  15:32:16 +0000 (0:00:00.464)       0:05:27.549 *******
2026-08-06 15:32:16.582472 | mon1 | ok: [mon1]
2026-08-06 15:32:16.582565 | mon1 |
2026-08-06 15:32:16.582710 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:32:16.582848 | mon1 | Thursday 06 August 2026  15:32:16 +0000 (0:00:00.254)       0:05:27.803 *******
2026-08-06 15:32:16.644557 | mon1 | ok: [mon1] => {
2026-08-06 15:32:16.644821 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-06 15:32:16.645061 | mon1 | }
2026-08-06 15:32:16.645346 | mon1 |
2026-08-06 15:32:16.645617 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:32:16.645924 | mon1 | Thursday 06 August 2026  15:32:16 +0000 (0:00:00.061)       0:05:27.865 *******
2026-08-06 15:32:17.062014 | mon1 | ok: [mon1]
2026-08-06 15:32:17.062272 | mon1 |
2026-08-06 15:32:17.062582 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:32:17.062848 | mon1 | Thursday 06 August 2026  15:32:17 +0000 (0:00:00.417)       0:05:28.283 *******
2026-08-06 15:32:20.341161 | mon1 | ok: [mon1]
2026-08-06 15:32:20.341383 | mon1 |
2026-08-06 15:32:20.341639 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-06 15:32:20.341914 | mon1 | Thursday 06 August 2026  15:32:20 +0000 (0:00:03.278)       0:05:31.561 *******
2026-08-06 15:32:21.253317 | mon1 | ok: [mon1]
2026-08-06 15:32:21.253374 | mon1 |
2026-08-06 15:32:21.253386 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-06 15:32:21.253396 | mon1 | Thursday 06 August 2026  15:32:21 +0000 (0:00:00.910)       0:05:32.472 *******
2026-08-06 15:32:21.512408 | mon1 | ok: [mon1]
2026-08-06 15:32:21.512475 | mon1 |
2026-08-06 15:32:21.513079 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-06 15:32:21.513107 | mon1 | Thursday 06 August 2026  15:32:21 +0000 (0:00:00.261)       0:05:32.733 *******
2026-08-06 15:32:22.055726 | mon1 | ok: [mon1]
2026-08-06 15:32:22.055776 | mon1 |
2026-08-06 15:32:22.055788 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-06 15:32:22.055798 | mon1 | Thursday 06 August 2026  15:32:22 +0000 (0:00:00.541)       0:05:33.274 *******
2026-08-06 15:32:22.739363 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-08-06 15:32:22.739402 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-06 15:32:22.740031 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-06 15:32:22.740045 | mon1 |
2026-08-06 15:32:22.740265 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-06 15:32:22.740484 | mon1 | Thursday 06 August 2026  15:32:22 +0000 (0:00:00.684)       0:05:33.959 *******
2026-08-06 15:32:23.281713 | mon1 | ok: [mon1]
2026-08-06 15:32:23.281767 | mon1 |
2026-08-06 15:32:23.281776 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-06 15:32:23.281782 | mon1 | Thursday 06 August 2026  15:32:23 +0000 (0:00:00.541)       0:05:34.501 *******
2026-08-06 15:32:23.830377 | mon1 | ok: [mon1]
2026-08-06 15:32:23.830427 | mon1 |
2026-08-06 15:32:23.830438 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-06 15:32:23.830470 | mon1 | Thursday 06 August 2026  15:32:23 +0000 (0:00:00.539)       0:05:35.040 *******
2026-08-06 15:32:23.830479 | mon1 |
2026-08-06 15:32:23.830488 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-06 15:32:23.830503 | mon1 | Thursday 06 August 2026  15:32:23 +0000 (0:00:00.008)       0:05:35.049 *******
2026-08-06 15:32:24.279312 | mon1 | ok: [mon1]
2026-08-06 15:32:24.279382 | mon1 |
2026-08-06 15:32:24.279850 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-06 15:32:24.279893 | mon1 | Thursday 06 August 2026  15:32:24 +0000 (0:00:00.450)       0:05:35.499 *******
2026-08-06 15:32:24.333565 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-06 15:32:24.333603 | mon1 |
2026-08-06 15:32:24.333613 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-06 15:32:24.333622 | mon1 | Thursday 06 August 2026  15:32:24 +0000 (0:00:00.053)       0:05:35.552 *******
2026-08-06 15:32:25.204331 | mon1 | ok: [mon1]
2026-08-06 15:32:25.204410 | mon1 |
2026-08-06 15:32:25.204602 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-06 15:32:25.204630 | mon1 | Thursday 06 August 2026  15:32:25 +0000 (0:00:00.869)       0:05:36.422 *******
2026-08-06 15:32:26.006183 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-08-06 15:32:26.006221 | mon1 | ok: [mon1] => (item=ssh)
2026-08-06 15:32:26.006245 | mon1 |
2026-08-06 15:32:26.006249 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-06 15:32:26.006254 | mon1 | Thursday 06 August 2026  15:32:26 +0000 (0:00:00.803)       0:05:37.226 *******
2026-08-06 15:32:27.512848 | mon1 | ok: [mon1]
2026-08-06 15:32:27.512903 | mon1 |
2026-08-06 15:32:27.512914 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-06 15:32:27.512924 | mon1 | Thursday 06 August 2026  15:32:27 +0000 (0:00:01.505)       0:05:38.732 *******
2026-08-06 15:32:27.751340 | mon1 | ok: [mon1]
2026-08-06 15:32:27.751409 | mon1 |
2026-08-06 15:32:27.751930 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-06 15:32:27.751987 | mon1 | Thursday 06 August 2026  15:32:27 +0000 (0:00:00.239)       0:05:38.971 *******
2026-08-06 15:32:28.050855 | mon1 | ok: [mon1]
2026-08-06 15:32:28.050908 | mon1 |
2026-08-06 15:32:28.050919 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-06 15:32:28.050928 | mon1 | Thursday 06 August 2026  15:32:28 +0000 (0:00:00.299)       0:05:39.270 *******
2026-08-06 15:32:28.296124 | mon1 | ok: [mon1]
2026-08-06 15:32:28.296164 | mon1 |
2026-08-06 15:32:28.296170 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] ***********
2026-08-06 15:32:28.296175 | mon1 | Thursday 06 August 2026  15:32:28 +0000 (0:00:00.245)       0:05:39.515 *******
2026-08-06 15:32:31.433607 | mon1 | changed: [mon1]
2026-08-06 15:32:31.433690 | mon1 |
2026-08-06 15:32:31.433939 | mon1 | PLAY RECAP *********************************************************************
2026-08-06 15:32:31.434055 | mon1 | mon1                       : ok=93   changed=30   unreachable=0    failed=0    skipped=14   rescued=0    ignored=0
2026-08-06 15:32:31.434173 | mon1 | osd1                       : ok=58   changed=23   unreachable=0    failed=0    skipped=9    rescued=1    ignored=0
2026-08-06 15:32:31.434284 | mon1 |
2026-08-06 15:32:31.434382 | mon1 |
2026-08-06 15:32:31.434512 | mon1 | TASKS RECAP ********************************************************************
2026-08-06 15:32:31.434611 | mon1 | Thursday 06 August 2026  15:32:31 +0000 (0:00:03.136)       0:05:42.652 *******
2026-08-06 15:32:31.434711 | mon1 | ===============================================================================
2026-08-06 15:32:31.434818 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 87.57s
2026-08-06 15:32:31.434924 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 44.04s
2026-08-06 15:32:31.435038 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 42.63s
2026-08-06 15:32:31.435155 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 17.85s
2026-08-06 15:32:31.435270 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.76s
2026-08-06 15:32:31.435375 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.64s
2026-08-06 15:32:31.435481 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.16s
2026-08-06 15:32:31.435588 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 5.85s
2026-08-06 15:32:31.435704 | mon1 | vexxhost.ceph.osd : Give 5 seconds pause before retry ------------------- 5.04s
2026-08-06 15:32:31.435817 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.59s
2026-08-06 15:32:31.435926 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.57s
2026-08-06 15:32:31.436033 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.83s
2026-08-06 15:32:31.436142 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 3.68s
2026-08-06 15:32:31.439391 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.28s
2026-08-06 15:32:31.439479 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 3.21s
2026-08-06 15:32:31.439588 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.18s
2026-08-06 15:32:31.439694 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 3.14s
2026-08-06 15:32:31.439801 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.65s
2026-08-06 15:32:31.439904 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.63s
2026-08-06 15:32:31.440010 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.11s
2026-08-06 15:32:31.527264 | mon1 | INFO     [default > converge] Executed: Successful
2026-08-06 15:32:31.531099 | mon1 | INFO     [default > idempotence] Executing
2026-08-06 15:32:32.534700 | mon1 |
2026-08-06 15:32:32.535124 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-08-06 15:32:32.535522 | mon1 |
2026-08-06 15:32:32.535944 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:32:32.536398 | mon1 | Thursday 06 August 2026  15:32:32 +0000 (0:00:00.051)       0:00:00.051 *******
2026-08-06 15:32:34.779666 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-08-06 15:32:34.780050 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-06 15:32:34.780466 | mon1 | interpreter could change the meaning of that path. See
2026-08-06 15:32:34.780791 | mon1 | https://docs.ansible.com/ansible-
2026-08-06 15:32:34.781098 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-06 15:32:34.794871 | mon1 | ok: [mon1]
2026-08-06 15:32:34.795040 | mon1 |
2026-08-06 15:32:34.795238 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:32:34.795423 | mon1 | Thursday 06 August 2026  15:32:34 +0000 (0:00:02.260)       0:00:02.311 *******
2026-08-06 15:32:35.129888 | mon1 | ok: [mon1]
2026-08-06 15:32:35.129956 | mon1 |
2026-08-06 15:32:35.130130 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:32:35.130313 | mon1 | Thursday 06 August 2026  15:32:35 +0000 (0:00:00.335)       0:00:02.646 *******
2026-08-06 15:32:35.170414 | mon1 | skipping: [mon1]
2026-08-06 15:32:35.170559 | mon1 |
2026-08-06 15:32:35.170809 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-06 15:32:35.171055 | mon1 | Thursday 06 August 2026  15:32:35 +0000 (0:00:00.040)       0:00:02.687 *******
2026-08-06 15:32:35.513449 | mon1 | ok: [mon1]
2026-08-06 15:32:35.513644 | mon1 |
2026-08-06 15:32:35.513903 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:32:35.514155 | mon1 | Thursday 06 August 2026  15:32:35 +0000 (0:00:00.342)       0:00:03.029 *******
2026-08-06 15:32:35.590327 | mon1 | ok: [mon1] => {
2026-08-06 15:32:35.590551 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-06 15:32:35.590784 | mon1 | }
2026-08-06 15:32:35.591005 | mon1 |
2026-08-06 15:32:35.591336 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:32:35.591572 | mon1 | Thursday 06 August 2026  15:32:35 +0000 (0:00:00.077)       0:00:03.107 *******
2026-08-06 15:32:36.091322 | mon1 | ok: [mon1]
2026-08-06 15:32:36.091372 | mon1 |
2026-08-06 15:32:36.091384 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:32:36.091394 | mon1 | Thursday 06 August 2026  15:32:36 +0000 (0:00:00.499)       0:00:03.606 *******
2026-08-06 15:32:36.140817 | mon1 | skipping: [mon1]
2026-08-06 15:32:36.140881 | mon1 |
2026-08-06 15:32:36.140892 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:32:36.140903 | mon1 | Thursday 06 August 2026  15:32:36 +0000 (0:00:00.049)       0:00:03.655 *******
2026-08-06 15:32:36.187041 | mon1 | skipping: [mon1]
2026-08-06 15:32:36.187319 | mon1 |
2026-08-06 15:32:36.187578 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:32:36.187817 | mon1 | Thursday 06 August 2026  15:32:36 +0000 (0:00:00.047)       0:00:03.703 *******
2026-08-06 15:32:36.437362 | mon1 | ok: [mon1]
2026-08-06 15:32:36.437567 | mon1 |
2026-08-06 15:32:36.437863 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:32:36.438130 | mon1 | Thursday 06 August 2026  15:32:36 +0000 (0:00:00.250)       0:00:03.953 *******
2026-08-06 15:32:37.483817 | mon1 | ok: [mon1]
2026-08-06 15:32:37.483989 | mon1 |
2026-08-06 15:32:37.484280 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:32:37.484527 | mon1 | Thursday 06 August 2026  15:32:37 +0000 (0:00:01.046)       0:00:05.000 *******
2026-08-06 15:32:37.677896 | mon1 | ok: [mon1] => {
2026-08-06 15:32:37.678140 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-06 15:32:37.679095 | mon1 | }
2026-08-06 15:32:37.679126 | mon1 |
2026-08-06 15:32:37.679136 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:32:37.679150 | mon1 | Thursday 06 August 2026  15:32:37 +0000 (0:00:00.194)       0:00:05.194 *******
2026-08-06 15:32:38.226947 | mon1 | ok: [mon1]
2026-08-06 15:32:38.227508 | mon1 |
2026-08-06 15:32:38.227702 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:32:38.227816 | mon1 | Thursday 06 August 2026  15:32:38 +0000 (0:00:00.549)       0:00:05.743 *******
2026-08-06 15:32:40.671841 | mon1 | ok: [mon1]
2026-08-06 15:32:40.672073 | mon1 |
2026-08-06 15:32:40.672388 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-06 15:32:40.672656 | mon1 | Thursday 06 August 2026  15:32:40 +0000 (0:00:02.444)       0:00:08.188 *******
2026-08-06 15:32:40.707076 | mon1 | skipping: [mon1]
2026-08-06 15:32:40.707304 | mon1 |
2026-08-06 15:32:40.707557 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-06 15:32:40.707798 | mon1 | Thursday 06 August 2026  15:32:40 +0000 (0:00:00.035)       0:00:08.223 *******
2026-08-06 15:32:40.743216 | mon1 | skipping: [mon1]
2026-08-06 15:32:40.743326 | mon1 |
2026-08-06 15:32:40.743453 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-06 15:32:40.743601 | mon1 | Thursday 06 August 2026  15:32:40 +0000 (0:00:00.036)       0:00:08.259 *******
2026-08-06 15:32:40.778881 | mon1 | skipping: [mon1]
2026-08-06 15:32:40.779048 | mon1 |
2026-08-06 15:32:40.779354 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-06 15:32:40.779587 | mon1 | Thursday 06 August 2026  15:32:40 +0000 (0:00:00.035)       0:00:08.295 *******
2026-08-06 15:32:41.667565 | mon1 | ok: [mon1]
2026-08-06 15:32:41.667770 | mon1 |
2026-08-06 15:32:41.668035 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-06 15:32:41.668341 | mon1 | Thursday 06 August 2026  15:32:41 +0000 (0:00:00.888)       0:00:09.183 *******
2026-08-06 15:32:42.228390 | mon1 | ok: [mon1]
2026-08-06 15:32:42.228449 | mon1 |
2026-08-06 15:32:42.228486 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-06 15:32:42.228503 | mon1 | Thursday 06 August 2026  15:32:42 +0000 (0:00:00.559)       0:00:09.743 *******
2026-08-06 15:32:43.353696 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-08-06 15:32:43.353732 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-06 15:32:43.353737 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-06 15:32:43.353741 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-06 15:32:43.353745 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-06 15:32:43.353749 | mon1 |
2026-08-06 15:32:43.353753 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-06 15:32:43.353760 | mon1 | Thursday 06 August 2026  15:32:43 +0000 (0:00:01.124)       0:00:10.868 *******
2026-08-06 15:32:44.022634 | mon1 | ok: [mon1]
2026-08-06 15:32:44.022691 | mon1 |
2026-08-06 15:32:44.022822 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-06 15:32:44.023318 | mon1 | Thursday 06 August 2026  15:32:44 +0000 (0:00:00.659)       0:00:11.527 *******
2026-08-06 15:32:44.023354 | mon1 |
2026-08-06 15:32:44.023358 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-06 15:32:44.023363 | mon1 | Thursday 06 August 2026  15:32:44 +0000 (0:00:00.011)       0:00:11.539 *******
2026-08-06 15:32:44.680777 | mon1 | ok: [mon1]
2026-08-06 15:32:44.680827 | mon1 |
2026-08-06 15:32:44.680838 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:32:44.680847 | mon1 | Thursday 06 August 2026  15:32:44 +0000 (0:00:00.657)       0:00:12.196 *******
2026-08-06 15:32:44.926704 | mon1 | ok: [mon1]
2026-08-06 15:32:44.926755 | mon1 |
2026-08-06 15:32:44.926766 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:32:44.926775 | mon1 | Thursday 06 August 2026  15:32:44 +0000 (0:00:00.245)       0:00:12.442 *******
2026-08-06 15:32:45.005031 | mon1 | ok: [mon1] => {
2026-08-06 15:32:45.005550 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-06 15:32:45.005783 | mon1 | }
2026-08-06 15:32:45.006604 | mon1 |
2026-08-06 15:32:45.006629 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:32:45.006639 | mon1 | Thursday 06 August 2026  15:32:45 +0000 (0:00:00.079)       0:00:12.521 *******
2026-08-06 15:32:45.440846 | mon1 | ok: [mon1]
2026-08-06 15:32:45.440909 | mon1 |
2026-08-06 15:32:45.440920 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:32:45.440929 | mon1 | Thursday 06 August 2026  15:32:45 +0000 (0:00:00.434)       0:00:12.955 *******
2026-08-06 15:32:48.713335 | mon1 | ok: [mon1]
2026-08-06 15:32:48.713395 | mon1 |
2026-08-06 15:32:48.713464 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-06 15:32:48.713721 | mon1 | Thursday 06 August 2026  15:32:48 +0000 (0:00:03.273)       0:00:16.229 *******
2026-08-06 15:32:49.585081 | mon1 | ok: [mon1]
2026-08-06 15:32:49.585325 | mon1 |
2026-08-06 15:32:49.585629 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-06 15:32:49.585872 | mon1 | Thursday 06 August 2026  15:32:49 +0000 (0:00:00.872)       0:00:17.101 *******
2026-08-06 15:32:49.915562 | mon1 | ok: [mon1]
2026-08-06 15:32:49.915696 | mon1 |
2026-08-06 15:32:49.915938 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-06 15:32:49.916183 | mon1 | Thursday 06 August 2026  15:32:49 +0000 (0:00:00.330)       0:00:17.432 *******
2026-08-06 15:32:50.452673 | mon1 | ok: [mon1]
2026-08-06 15:32:50.452914 | mon1 |
2026-08-06 15:32:50.453325 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-06 15:32:50.453639 | mon1 | Thursday 06 August 2026  15:32:50 +0000 (0:00:00.535)       0:00:17.967 *******
2026-08-06 15:32:51.130189 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-08-06 15:32:51.130263 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-06 15:32:51.130296 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-06 15:32:51.130306 | mon1 |
2026-08-06 15:32:51.130316 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-06 15:32:51.130325 | mon1 | Thursday 06 August 2026  15:32:51 +0000 (0:00:00.677)       0:00:18.645 *******
2026-08-06 15:32:51.654318 | mon1 | ok: [mon1]
2026-08-06 15:32:51.654362 | mon1 |
2026-08-06 15:32:51.654875 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-06 15:32:51.654903 | mon1 | Thursday 06 August 2026  15:32:51 +0000 (0:00:00.524)       0:00:19.170 *******
2026-08-06 15:32:52.188385 | mon1 | ok: [mon1]
2026-08-06 15:32:52.188447 | mon1 |
2026-08-06 15:32:52.188465 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-06 15:32:52.189462 | mon1 | Thursday 06 August 2026  15:32:52 +0000 (0:00:00.527)       0:00:19.697 *******
2026-08-06 15:32:52.189533 | mon1 |
2026-08-06 15:32:52.189548 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-06 15:32:52.189560 | mon1 | Thursday 06 August 2026  15:32:52 +0000 (0:00:00.007)       0:00:19.704 *******
2026-08-06 15:32:52.641818 | mon1 | ok: [mon1]
2026-08-06 15:32:52.641938 | mon1 |
2026-08-06 15:32:52.641952 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-06 15:32:52.641962 | mon1 | Thursday 06 August 2026  15:32:52 +0000 (0:00:00.452)       0:00:20.156 *******
2026-08-06 15:32:52.698133 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-06 15:32:52.698205 | mon1 |
2026-08-06 15:32:52.698216 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-06 15:32:52.698257 | mon1 | Thursday 06 August 2026  15:32:52 +0000 (0:00:00.055)       0:00:20.212 *******
2026-08-06 15:32:54.611830 | mon1 | ok: [mon1]
2026-08-06 15:32:54.611891 | mon1 |
2026-08-06 15:32:54.611902 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-06 15:32:54.611912 | mon1 | Thursday 06 August 2026  15:32:54 +0000 (0:00:01.914)       0:00:22.126 *******
2026-08-06 15:32:55.420383 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-08-06 15:32:55.420448 | mon1 | ok: [mon1] => (item=ssh)
2026-08-06 15:32:55.421078 | mon1 |
2026-08-06 15:32:55.421119 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-06 15:32:55.421131 | mon1 | Thursday 06 August 2026  15:32:55 +0000 (0:00:00.809)       0:00:22.936 *******
2026-08-06 15:32:56.446666 | mon1 | ok: [mon1]
2026-08-06 15:32:56.446745 | mon1 |
2026-08-06 15:32:56.446827 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-06 15:32:56.446935 | mon1 | Thursday 06 August 2026  15:32:56 +0000 (0:00:01.026)       0:00:23.962 *******
2026-08-06 15:32:56.695692 | mon1 | ok: [mon1]
2026-08-06 15:32:56.695751 | mon1 |
2026-08-06 15:32:56.695861 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-06 15:32:56.695972 | mon1 | Thursday 06 August 2026  15:32:56 +0000 (0:00:00.248)       0:00:24.211 *******
2026-08-06 15:32:57.182651 | mon1 | ok: [mon1]
2026-08-06 15:32:57.182713 | mon1 |
2026-08-06 15:32:57.182834 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-06 15:32:57.182945 | mon1 | Thursday 06 August 2026  15:32:57 +0000 (0:00:00.486)       0:00:24.698 *******
2026-08-06 15:32:57.559806 | mon1 | ok: [mon1]
2026-08-06 15:32:57.559857 | mon1 |
2026-08-06 15:32:57.559871 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-08-06 15:32:57.559884 | mon1 | Thursday 06 August 2026  15:32:57 +0000 (0:00:00.377)       0:00:25.075 *******
2026-08-06 15:32:57.639280 | mon1 | ok: [mon1]
2026-08-06 15:32:57.639316 | mon1 |
2026-08-06 15:32:57.639428 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-08-06 15:32:57.639684 | mon1 | Thursday 06 August 2026  15:32:57 +0000 (0:00:00.078)       0:00:25.153 *******
2026-08-06 15:32:57.916146 | mon1 | ok: [mon1] => (item=mon1)
2026-08-06 15:32:57.916443 | mon1 |
2026-08-06 15:32:57.916737 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-08-06 15:32:57.917016 | mon1 | Thursday 06 August 2026  15:32:57 +0000 (0:00:00.278)       0:00:25.432 *******
2026-08-06 15:32:57.961281 | mon1 | ok: [mon1]
2026-08-06 15:32:57.961500 | mon1 |
2026-08-06 15:32:57.961755 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-08-06 15:32:57.962026 | mon1 | Thursday 06 August 2026  15:32:57 +0000 (0:00:00.046)       0:00:25.478 *******
2026-08-06 15:32:57.999800 | mon1 | skipping: [mon1]
2026-08-06 15:32:58 | mon1 |
2026-08-06 15:32:58.000298 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-06 15:32:58.000581 | mon1 | Thursday 06 August 2026  15:32:57 +0000 (0:00:00.038)       0:00:25.516 *******
2026-08-06 15:32:58.078871 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-08-06 15:32:58.079057 | mon1 |
2026-08-06 15:32:58.079394 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-06 15:32:58.079624 | mon1 | Thursday 06 August 2026  15:32:58 +0000 (0:00:00.078)       0:00:25.595 *******
2026-08-06 15:33:00.114191 | mon1 | ok: [mon1]
2026-08-06 15:33:00.114460 | mon1 |
2026-08-06 15:33:00.114767 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-06 15:33:00.115039 | mon1 | Thursday 06 August 2026  15:33:00 +0000 (0:00:02.035)       0:00:27.630 *******
2026-08-06 15:33:00.170092 | mon1 | ok: [mon1] => (item=mon1)
2026-08-06 15:33:00.170153 | mon1 |
2026-08-06 15:33:00.170287 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-06 15:33:00.170397 | mon1 | Thursday 06 August 2026  15:33:00 +0000 (0:00:00.056)       0:00:27.686 *******
2026-08-06 15:33:00.592824 | mon1 | ok: [mon1]
2026-08-06 15:33:00.593026 | mon1 |
2026-08-06 15:33:00.593327 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-06 15:33:00.593593 | mon1 | Thursday 06 August 2026  15:33:00 +0000 (0:00:00.422)       0:00:28.109 *******
2026-08-06 15:33:03.302429 | mon1 | ok: [mon1]
2026-08-06 15:33:03.303101 | mon1 |
2026-08-06 15:33:03.303150 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-08-06 15:33:03.303164 | mon1 | Thursday 06 August 2026  15:33:03 +0000 (0:00:02.709)       0:00:30.818 *******
2026-08-06 15:33:05.073421 | mon1 | ok: [mon1]
2026-08-06 15:33:05.073478 | mon1 |
2026-08-06 15:33:05.073488 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-08-06 15:33:05.073497 | mon1 | Thursday 06 August 2026  15:33:05 +0000 (0:00:01.770)       0:00:32.589 *******
2026-08-06 15:33:06.991628 | mon1 | ok: [mon1]
2026-08-06 15:33:06.991697 | mon1 |
2026-08-06 15:33:06.991711 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-06 15:33:06.991724 | mon1 | Thursday 06 August 2026  15:33:06 +0000 (0:00:01.917)       0:00:34.507 *******
2026-08-06 15:33:07.062567 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-08-06 15:33:07.062603 | mon1 |
2026-08-06 15:33:07.062616 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-06 15:33:07.062628 | mon1 | Thursday 06 August 2026  15:33:07 +0000 (0:00:00.071)       0:00:34.578 *******
2026-08-06 15:33:07.111679 | mon1 | skipping: [mon1]
2026-08-06 15:33:07.111733 | mon1 |
2026-08-06 15:33:07.111746 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-06 15:33:07.111759 | mon1 | Thursday 06 August 2026  15:33:07 +0000 (0:00:00.048)       0:00:34.626 *******
2026-08-06 15:33:07.159741 | mon1 | skipping: [mon1] => (item=mon1)
2026-08-06 15:33:07.159847 | mon1 | skipping: [mon1]
2026-08-06 15:33:07.159988 | mon1 |
2026-08-06 15:33:07.160148 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-06 15:33:07.160409 | mon1 | Thursday 06 August 2026  15:33:07 +0000 (0:00:00.048)       0:00:34.675 *******
2026-08-06 15:33:07.487048 | mon1 | ok: [mon1]
2026-08-06 15:33:07.487088 | mon1 |
2026-08-06 15:33:07.487095 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-06 15:33:07.487101 | mon1 | Thursday 06 August 2026  15:33:07 +0000 (0:00:00.327)       0:00:35.002 *******
2026-08-06 15:33:10.172832 | mon1 | ok: [mon1]
2026-08-06 15:33:10.172903 | mon1 |
2026-08-06 15:33:10.173014 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-08-06 15:33:10.173128 | mon1 | Thursday 06 August 2026  15:33:10 +0000 (0:00:02.686)       0:00:37.689 *******
2026-08-06 15:33:11.886657 | mon1 | ok: [mon1]
2026-08-06 15:33:11.886741 | mon1 |
2026-08-06 15:33:11.886825 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-08-06 15:33:11.886940 | mon1 | Thursday 06 August 2026  15:33:11 +0000 (0:00:01.712)       0:00:39.401 *******
2026-08-06 15:33:13.768419 | mon1 | ok: [mon1]
2026-08-06 15:33:13.768486 | mon1 |
2026-08-06 15:33:13.768509 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-08-06 15:33:13.768800 | mon1 | Thursday 06 August 2026  15:33:13 +0000 (0:00:01.882)       0:00:41.284 *******
2026-08-06 15:33:21.281126 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'})
2026-08-06 15:33:21.281184 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-08-06 15:33:21.281198 | mon1 | ok: [mon1] => (item={'name': 'prometheus'})
2026-08-06 15:33:21.281210 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-08-06 15:33:21.281222 | mon1 |
2026-08-06 15:33:21.281269 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-08-06 15:33:21.281281 | mon1 |
2026-08-06 15:33:21.281293 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:33:21.281304 | mon1 | Thursday 06 August 2026  15:33:21 +0000 (0:00:07.511)       0:00:48.795 *******
2026-08-06 15:33:22.495314 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-08-06 15:33:22.495395 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-06 15:33:22.495649 | mon1 | interpreter could change the meaning of that path. See
2026-08-06 15:33:22.495891 | mon1 | https://docs.ansible.com/ansible-
2026-08-06 15:33:22.496137 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-06 15:33:22.508369 | mon1 | ok: [osd1]
2026-08-06 15:33:22.508395 | mon1 |
2026-08-06 15:33:22.508403 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:33:22.508629 | mon1 | Thursday 06 August 2026  15:33:22 +0000 (0:00:01.228)       0:00:50.023 *******
2026-08-06 15:33:22.754907 | mon1 | ok: [osd1]
2026-08-06 15:33:22.754983 | mon1 |
2026-08-06 15:33:22.755076 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:33:22.755279 | mon1 | Thursday 06 August 2026  15:33:22 +0000 (0:00:00.247)       0:00:50.270 *******
2026-08-06 15:33:22.799699 | mon1 | skipping: [osd1]
2026-08-06 15:33:22.799742 | mon1 |
2026-08-06 15:33:22.799755 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-06 15:33:22.799767 | mon1 | Thursday 06 August 2026  15:33:22 +0000 (0:00:00.044)       0:00:50.315 *******
2026-08-06 15:33:23.070359 | mon1 | ok: [osd1]
2026-08-06 15:33:23.070462 | mon1 |
2026-08-06 15:33:23.070477 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:33:23.070499 | mon1 | Thursday 06 August 2026  15:33:23 +0000 (0:00:00.268)       0:00:50.584 *******
2026-08-06 15:33:23.140744 | mon1 | ok: [osd1] => {
2026-08-06 15:33:23.140871 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-06 15:33:23.140886 | mon1 | }
2026-08-06 15:33:23.140982 | mon1 |
2026-08-06 15:33:23.141083 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:33:23.141197 | mon1 | Thursday 06 August 2026  15:33:23 +0000 (0:00:00.072)       0:00:50.656 *******
2026-08-06 15:33:23.525857 | mon1 | ok: [osd1]
2026-08-06 15:33:23.525917 | mon1 |
2026-08-06 15:33:23.525931 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:33:23.525944 | mon1 | Thursday 06 August 2026  15:33:23 +0000 (0:00:00.383)       0:00:51.040 *******
2026-08-06 15:33:23.580675 | mon1 | skipping: [osd1]
2026-08-06 15:33:23.580751 | mon1 |
2026-08-06 15:33:23.580867 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:33:23.580987 | mon1 | Thursday 06 August 2026  15:33:23 +0000 (0:00:00.054)       0:00:51.094 *******
2026-08-06 15:33:23.619201 | mon1 | skipping: [osd1]
2026-08-06 15:33:23.619424 | mon1 |
2026-08-06 15:33:23.619494 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:33:23.619568 | mon1 | Thursday 06 August 2026  15:33:23 +0000 (0:00:00.041)       0:00:51.135 *******
2026-08-06 15:33:23.874801 | mon1 | ok: [osd1]
2026-08-06 15:33:23.874849 | mon1 |
2026-08-06 15:33:23.874860 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:33:23.874870 | mon1 | Thursday 06 August 2026  15:33:23 +0000 (0:00:00.254)       0:00:51.390 *******
2026-08-06 15:33:24.836750 | mon1 | ok: [osd1]
2026-08-06 15:33:24.836799 | mon1 |
2026-08-06 15:33:24.836810 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:33:24.836819 | mon1 | Thursday 06 August 2026  15:33:24 +0000 (0:00:00.961)       0:00:52.352 *******
2026-08-06 15:33:25.027373 | mon1 | ok: [osd1] => {
2026-08-06 15:33:25.027429 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-06 15:33:25.027439 | mon1 | }
2026-08-06 15:33:25.027449 | mon1 |
2026-08-06 15:33:25.027459 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:33:25.027468 | mon1 | Thursday 06 August 2026  15:33:25 +0000 (0:00:00.189)       0:00:52.541 *******
2026-08-06 15:33:25.569507 | mon1 | ok: [osd1]
2026-08-06 15:33:25.569603 | mon1 |
2026-08-06 15:33:25.569615 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:33:25.569634 | mon1 | Thursday 06 August 2026  15:33:25 +0000 (0:00:00.543)       0:00:53.085 *******
2026-08-06 15:33:27.819308 | mon1 | ok: [osd1]
2026-08-06 15:33:27.819369 | mon1 |
2026-08-06 15:33:27.819379 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-06 15:33:27.819389 | mon1 | Thursday 06 August 2026  15:33:27 +0000 (0:00:02.249)       0:00:55.334 *******
2026-08-06 15:33:27.855348 | mon1 | skipping: [osd1]
2026-08-06 15:33:27.855429 | mon1 |
2026-08-06 15:33:27.855732 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-06 15:33:27.855991 | mon1 | Thursday 06 August 2026  15:33:27 +0000 (0:00:00.037)       0:00:55.371 *******
2026-08-06 15:33:27.889676 | mon1 | skipping: [osd1]
2026-08-06 15:33:27.889892 | mon1 |
2026-08-06 15:33:27.890163 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-06 15:33:27.890472 | mon1 | Thursday 06 August 2026  15:33:27 +0000 (0:00:00.034)       0:00:55.406 *******
2026-08-06 15:33:27.928537 | mon1 | skipping: [osd1]
2026-08-06 15:33:27.928726 | mon1 |
2026-08-06 15:33:27.928980 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-06 15:33:27.929429 | mon1 | Thursday 06 August 2026  15:33:27 +0000 (0:00:00.038)       0:00:55.444 *******
2026-08-06 15:33:28.898455 | mon1 | ok: [osd1]
2026-08-06 15:33:28.898524 | mon1 |
2026-08-06 15:33:28.898942 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-06 15:33:28.898964 | mon1 | Thursday 06 August 2026  15:33:28 +0000 (0:00:00.969)       0:00:56.414 *******
2026-08-06 15:33:29.445779 | mon1 | ok: [osd1]
2026-08-06 15:33:29.445826 | mon1 |
2026-08-06 15:33:29.445837 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-06 15:33:29.445847 | mon1 | Thursday 06 August 2026  15:33:29 +0000 (0:00:00.546)       0:00:56.960 *******
2026-08-06 15:33:30.572380 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'})
2026-08-06 15:33:30.572450 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-06 15:33:30.573126 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-06 15:33:30.573207 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-06 15:33:30.573578 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-06 15:33:30.573887 | mon1 |
2026-08-06 15:33:30.574276 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-06 15:33:30.574607 | mon1 | Thursday 06 August 2026  15:33:30 +0000 (0:00:01.126)       0:00:58.087 *******
2026-08-06 15:33:31.251423 | mon1 | ok: [osd1]
2026-08-06 15:33:31.251476 | mon1 |
2026-08-06 15:33:31.251487 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-06 15:33:31.251496 | mon1 | Thursday 06 August 2026  15:33:31 +0000 (0:00:00.672)       0:00:58.760 *******
2026-08-06 15:33:31.251640 | mon1 |
2026-08-06 15:33:31.251893 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-06 15:33:31.252221 | mon1 | Thursday 06 August 2026  15:33:31 +0000 (0:00:00.007)       0:00:58.767 *******
2026-08-06 15:33:31.737975 | mon1 | ok: [osd1]
2026-08-06 15:33:31.738192 | mon1 |
2026-08-06 15:33:31.738427 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:33:31.738674 | mon1 | Thursday 06 August 2026  15:33:31 +0000 (0:00:00.487)       0:00:59.254 *******
2026-08-06 15:33:31.982476 | mon1 | ok: [osd1]
2026-08-06 15:33:31.982649 | mon1 |
2026-08-06 15:33:31.982904 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:33:31.983158 | mon1 | Thursday 06 August 2026  15:33:31 +0000 (0:00:00.244)       0:00:59.499 *******
2026-08-06 15:33:32.058166 | mon1 | ok: [osd1] => {
2026-08-06 15:33:32.058478 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-06 15:33:32.058662 | mon1 | }
2026-08-06 15:33:32.058879 | mon1 |
2026-08-06 15:33:32.059132 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:33:32.059480 | mon1 | Thursday 06 August 2026  15:33:32 +0000 (0:00:00.075)       0:00:59.574 *******
2026-08-06 15:33:32.505039 | mon1 | ok: [osd1]
2026-08-06 15:33:32.505190 | mon1 |
2026-08-06 15:33:32.505560 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:33:32.505739 | mon1 | Thursday 06 August 2026  15:33:32 +0000 (0:00:00.446)       0:01:00.021 *******
2026-08-06 15:33:36.793643 | mon1 | ok: [osd1]
2026-08-06 15:33:36.793820 | mon1 |
2026-08-06 15:33:36.794121 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-06 15:33:36.794485 | mon1 | Thursday 06 August 2026  15:33:36 +0000 (0:00:04.288)       0:01:04.309 *******
2026-08-06 15:33:37.735655 | mon1 | ok: [osd1]
2026-08-06 15:33:37.735796 | mon1 |
2026-08-06 15:33:37.736027 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-06 15:33:37.736282 | mon1 | Thursday 06 August 2026  15:33:37 +0000 (0:00:00.941)       0:01:05.251 *******
2026-08-06 15:33:37.980369 | mon1 | ok: [osd1]
2026-08-06 15:33:37.980421 | mon1 |
2026-08-06 15:33:37.980432 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-06 15:33:37.980447 | mon1 | Thursday 06 August 2026  15:33:37 +0000 (0:00:00.244)       0:01:05.495 *******
2026-08-06 15:33:38.521816 | mon1 | ok: [osd1]
2026-08-06 15:33:38.521866 | mon1 |
2026-08-06 15:33:38.521877 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-06 15:33:38.521887 | mon1 | Thursday 06 August 2026  15:33:38 +0000 (0:00:00.540)       0:01:06.036 *******
2026-08-06 15:33:39.227887 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'})
2026-08-06 15:33:39.228108 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-06 15:33:39.229134 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-06 15:33:39.229182 | mon1 |
2026-08-06 15:33:39.229193 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-06 15:33:39.229203 | mon1 | Thursday 06 August 2026  15:33:39 +0000 (0:00:00.707)       0:01:06.743 *******
2026-08-06 15:33:39.755813 | mon1 | ok: [osd1]
2026-08-06 15:33:39.755868 | mon1 |
2026-08-06 15:33:39.755878 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-06 15:33:39.755888 | mon1 | Thursday 06 August 2026  15:33:39 +0000 (0:00:00.527)       0:01:07.270 *******
2026-08-06 15:33:40.303286 | mon1 | ok: [osd1]
2026-08-06 15:33:40.303323 | mon1 |
2026-08-06 15:33:40.303339 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-06 15:33:40.303352 | mon1 | Thursday 06 August 2026  15:33:40 +0000 (0:00:00.539)       0:01:07.810 *******
2026-08-06 15:33:40.303356 | mon1 |
2026-08-06 15:33:40.303363 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-06 15:33:40.303744 | mon1 | Thursday 06 August 2026  15:33:40 +0000 (0:00:00.007)       0:01:07.818 *******
2026-08-06 15:33:40.744719 | mon1 | ok: [osd1]
2026-08-06 15:33:40.744794 | mon1 |
2026-08-06 15:33:40.744872 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-06 15:33:40.744983 | mon1 | Thursday 06 August 2026  15:33:40 +0000 (0:00:00.442)       0:01:08.260 *******
2026-08-06 15:33:40.798183 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-06 15:33:40.798259 | mon1 |
2026-08-06 15:33:40.798522 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-06 15:33:40.798550 | mon1 | Thursday 06 August 2026  15:33:40 +0000 (0:00:00.054)       0:01:08.314 *******
2026-08-06 15:33:41.740336 | mon1 | ok: [osd1]
2026-08-06 15:33:41.740385 | mon1 |
2026-08-06 15:33:41.740392 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-06 15:33:41.740398 | mon1 | Thursday 06 August 2026  15:33:41 +0000 (0:00:00.941)       0:01:09.255 *******
2026-08-06 15:33:42.558184 | mon1 | ok: [osd1] => (item=systemd-timesyncd)
2026-08-06 15:33:42.558273 | mon1 | ok: [osd1] => (item=ssh)
2026-08-06 15:33:42.558289 | mon1 |
2026-08-06 15:33:42.558299 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-06 15:33:42.558308 | mon1 | Thursday 06 August 2026  15:33:42 +0000 (0:00:00.816)       0:01:10.072 *******
2026-08-06 15:33:44.696328 | mon1 | ok: [osd1]
2026-08-06 15:33:44.696452 | mon1 |
2026-08-06 15:33:44.696769 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-06 15:33:44.697043 | mon1 | Thursday 06 August 2026  15:33:44 +0000 (0:00:02.140)       0:01:12.212 *******
2026-08-06 15:33:44.940937 | mon1 | ok: [osd1]
2026-08-06 15:33:44.941150 | mon1 |
2026-08-06 15:33:44.941447 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-06 15:33:44.941695 | mon1 | Thursday 06 August 2026  15:33:44 +0000 (0:00:00.244)       0:01:12.457 *******
2026-08-06 15:33:45.256156 | mon1 | ok: [osd1]
2026-08-06 15:33:45.256361 | mon1 |
2026-08-06 15:33:45.256673 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-06 15:33:45.256923 | mon1 | Thursday 06 August 2026  15:33:45 +0000 (0:00:00.315)       0:01:12.772 *******
2026-08-06 15:33:45.517034 | mon1 | ok: [osd1]
2026-08-06 15:33:45.517200 | mon1 |
2026-08-06 15:33:45.517497 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-08-06 15:33:45.517749 | mon1 | Thursday 06 August 2026  15:33:45 +0000 (0:00:00.260)       0:01:13.033 *******
2026-08-06 15:33:45.795394 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-08-06 15:33:45.795464 | mon1 |
2026-08-06 15:33:45.795475 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-08-06 15:33:45.795485 | mon1 | Thursday 06 August 2026  15:33:45 +0000 (0:00:00.277)       0:01:13.310 *******
2026-08-06 15:33:45.842651 | mon1 | ok: [osd1]
2026-08-06 15:33:45.842726 | mon1 |
2026-08-06 15:33:45.842839 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-06 15:33:45.842947 | mon1 | Thursday 06 August 2026  15:33:45 +0000 (0:00:00.047)       0:01:13.358 *******
2026-08-06 15:33:45.905425 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-08-06 15:33:45.905492 | mon1 |
2026-08-06 15:33:45.905743 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-06 15:33:45.905770 | mon1 | Thursday 06 August 2026  15:33:45 +0000 (0:00:00.063)       0:01:13.422 *******
2026-08-06 15:33:47.813963 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:33:47.814004 | mon1 |
2026-08-06 15:33:47.814012 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-06 15:33:47.814033 | mon1 | Thursday 06 August 2026  15:33:47 +0000 (0:00:01.906)       0:01:15.329 *******
2026-08-06 15:33:47.867391 | mon1 | ok: [osd1] => (item=osd1)
2026-08-06 15:33:47.867462 | mon1 |
2026-08-06 15:33:47.867473 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-06 15:33:47.867489 | mon1 | Thursday 06 August 2026  15:33:47 +0000 (0:00:00.055)       0:01:15.384 *******
2026-08-06 15:33:48.207739 | mon1 | ok: [osd1]
2026-08-06 15:33:48.207838 | mon1 |
2026-08-06 15:33:48.208022 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-06 15:33:48.208180 | mon1 | Thursday 06 August 2026  15:33:48 +0000 (0:00:00.339)       0:01:15.723 *******
2026-08-06 15:33:50.923027 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:33:50.923070 | mon1 |
2026-08-06 15:33:50.923076 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-08-06 15:33:50.923082 | mon1 | Thursday 06 August 2026  15:33:50 +0000 (0:00:02.713)       0:01:18.437 *******
2026-08-06 15:33:57.343601 | mon1 | ok: [osd1]
2026-08-06 15:33:57.343659 | mon1 |
2026-08-06 15:33:57.343672 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-08-06 15:33:57.343685 | mon1 | Thursday 06 August 2026  15:33:57 +0000 (0:00:06.421)       0:01:24.859 *******
2026-08-06 15:33:59.081643 | mon1 | ok: [osd1]
2026-08-06 15:33:59.081762 | mon1 |
2026-08-06 15:33:59.081899 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-08-06 15:33:59.082036 | mon1 | Thursday 06 August 2026  15:33:59 +0000 (0:00:01.737)       0:01:26.596 *******
2026-08-06 15:33:59.148760 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data)
2026-08-06 15:33:59.148796 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data)
2026-08-06 15:33:59.148806 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data)
2026-08-06 15:33:59.148814 | mon1 | skipping: [osd1]
2026-08-06 15:33:59.148823 | mon1 |
2026-08-06 15:33:59.148831 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-08-06 15:33:59.148840 | mon1 | Thursday 06 August 2026  15:33:59 +0000 (0:00:00.067)       0:01:26.664 *******
2026-08-06 15:34:01.176344 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:34:01.176459 | mon1 |
2026-08-06 15:34:01.176482 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-08-06 15:34:01.176797 | mon1 | Thursday 06 August 2026  15:34:01 +0000 (0:00:02.027)       0:01:28.691 *******
2026-08-06 15:34:03.142043 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:34:03.142113 | mon1 |
2026-08-06 15:34:03.142128 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-08-06 15:34:03.142142 | mon1 | Thursday 06 August 2026  15:34:03 +0000 (0:00:01.965)       0:01:30.657 *******
2026-08-06 15:34:03.205456 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-08-06 15:34:03.205523 | mon1 |
2026-08-06 15:34:03.206008 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-08-06 15:34:03.206066 | mon1 | Thursday 06 August 2026  15:34:03 +0000 (0:00:00.063)       0:01:30.720 *******
2026-08-06 15:34:03.255403 | mon1 | ok: [osd1]
2026-08-06 15:34:03.255479 | mon1 |
2026-08-06 15:34:03.255494 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-08-06 15:34:03.255513 | mon1 | Thursday 06 August 2026  15:34:03 +0000 (0:00:00.050)       0:01:30.770 *******
2026-08-06 15:34:05.160889 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:34:05.160994 | mon1 |
2026-08-06 15:34:05.161009 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-08-06 15:34:05.161022 | mon1 | Thursday 06 August 2026  15:34:05 +0000 (0:00:01.905)       0:01:32.676 *******
2026-08-06 15:34:05.208335 | mon1 | ok: [osd1]
2026-08-06 15:34:05.208400 | mon1 |
2026-08-06 15:34:05.208875 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-08-06 15:34:05.208940 | mon1 | Thursday 06 August 2026  15:34:05 +0000 (0:00:00.047)       0:01:32.723 *******
2026-08-06 15:34:05.252983 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:34:05.253041 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:34:05.253051 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:34:05.253060 | mon1 | skipping: [osd1]
2026-08-06 15:34:05.253069 | mon1 |
2026-08-06 15:34:05.253275 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-08-06 15:34:05.253475 | mon1 | Thursday 06 August 2026  15:34:05 +0000 (0:00:00.044)       0:01:32.768 *******
2026-08-06 15:34:05.323769 | mon1 | skipping: [osd1]
2026-08-06 15:34:05.323805 | mon1 |
2026-08-06 15:34:05.323809 | mon1 | PLAY [Deploy Ceph exporters] ***************************************************
2026-08-06 15:34:05.323814 | mon1 |
2026-08-06 15:34:05.323826 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:34:05.323830 | mon1 | Thursday 06 August 2026  15:34:05 +0000 (0:00:00.069)       0:01:32.837 *******
2026-08-06 15:34:06.282163 | mon1 | ok: [mon1]
2026-08-06 15:34:06.282292 | mon1 |
2026-08-06 15:34:06.282312 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:34:06.282322 | mon1 | Thursday 06 August 2026  15:34:06 +0000 (0:00:00.959)       0:01:33.796 *******
2026-08-06 15:34:06.526791 | mon1 | ok: [mon1]
2026-08-06 15:34:06.526848 | mon1 |
2026-08-06 15:34:06.526859 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:34:06.526868 | mon1 | Thursday 06 August 2026  15:34:06 +0000 (0:00:00.245)       0:01:34.041 *******
2026-08-06 15:34:06.570938 | mon1 | skipping: [mon1]
2026-08-06 15:34:06.571003 | mon1 |
2026-08-06 15:34:06.571014 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-06 15:34:06.571024 | mon1 | Thursday 06 August 2026  15:34:06 +0000 (0:00:00.044)       0:01:34.086 *******
2026-08-06 15:34:06.855968 | mon1 | ok: [mon1]
2026-08-06 15:34:06.856004 | mon1 |
2026-08-06 15:34:06.856009 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:34:06.856014 | mon1 | Thursday 06 August 2026  15:34:06 +0000 (0:00:00.284)       0:01:34.371 *******
2026-08-06 15:34:06.926301 | mon1 | ok: [mon1] => {
2026-08-06 15:34:06.926354 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-06 15:34:06.926364 | mon1 | }
2026-08-06 15:34:06.926374 | mon1 |
2026-08-06 15:34:06.926383 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:34:06.926392 | mon1 | Thursday 06 August 2026  15:34:06 +0000 (0:00:00.070)       0:01:34.441 *******
2026-08-06 15:34:07.309369 | mon1 | ok: [mon1]
2026-08-06 15:34:07.309438 | mon1 |
2026-08-06 15:34:07.309495 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:34:07.309789 | mon1 | Thursday 06 August 2026  15:34:07 +0000 (0:00:00.382)       0:01:34.824 *******
2026-08-06 15:34:07.351561 | mon1 | skipping: [mon1]
2026-08-06 15:34:07.351599 | mon1 |
2026-08-06 15:34:07.351610 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:34:07.351620 | mon1 | Thursday 06 August 2026  15:34:07 +0000 (0:00:00.042)       0:01:34.867 *******
2026-08-06 15:34:07.392568 | mon1 | skipping: [mon1]
2026-08-06 15:34:07.392598 | mon1 |
2026-08-06 15:34:07.392609 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:34:07.392618 | mon1 | Thursday 06 August 2026  15:34:07 +0000 (0:00:00.041)       0:01:34.908 *******
2026-08-06 15:34:07.636815 | mon1 | ok: [mon1]
2026-08-06 15:34:07.636872 | mon1 |
2026-08-06 15:34:07.636883 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:34:07.636893 | mon1 | Thursday 06 August 2026  15:34:07 +0000 (0:00:00.243)       0:01:35.151 *******
2026-08-06 15:34:08.547657 | mon1 | ok: [mon1]
2026-08-06 15:34:08.547727 | mon1 |
2026-08-06 15:34:08.547835 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:34:08.547945 | mon1 | Thursday 06 August 2026  15:34:08 +0000 (0:00:00.909)       0:01:36.061 *******
2026-08-06 15:34:08.730222 | mon1 | ok: [mon1] => {
2026-08-06 15:34:08.730340 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-06 15:34:08.730947 | mon1 | }
2026-08-06 15:34:08.730975 | mon1 |
2026-08-06 15:34:08.730981 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:34:08.730988 | mon1 | Thursday 06 August 2026  15:34:08 +0000 (0:00:00.184)       0:01:36.246 *******
2026-08-06 15:34:09.281794 | mon1 | ok: [mon1]
2026-08-06 15:34:09.281851 | mon1 |
2026-08-06 15:34:09.281866 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:34:09.281878 | mon1 | Thursday 06 August 2026  15:34:09 +0000 (0:00:00.549)       0:01:36.796 *******
2026-08-06 15:34:11.450027 | mon1 | ok: [mon1]
2026-08-06 15:34:11.450079 | mon1 |
2026-08-06 15:34:11.450090 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-06 15:34:11.450099 | mon1 | Thursday 06 August 2026  15:34:11 +0000 (0:00:02.167)       0:01:38.963 *******
2026-08-06 15:34:11.478398 | mon1 | skipping: [mon1]
2026-08-06 15:34:11.478442 | mon1 |
2026-08-06 15:34:11.478457 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-06 15:34:11.478647 | mon1 | Thursday 06 August 2026  15:34:11 +0000 (0:00:00.030)       0:01:38.994 *******
2026-08-06 15:34:11.508755 | mon1 | skipping: [mon1]
2026-08-06 15:34:11.508982 | mon1 |
2026-08-06 15:34:11.509304 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-06 15:34:11.509601 | mon1 | Thursday 06 August 2026  15:34:11 +0000 (0:00:00.030)       0:01:39.025 *******
2026-08-06 15:34:11.541506 | mon1 | skipping: [mon1]
2026-08-06 15:34:11.541747 | mon1 |
2026-08-06 15:34:11.542045 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-06 15:34:11.542392 | mon1 | Thursday 06 August 2026  15:34:11 +0000 (0:00:00.032)       0:01:39.057 *******
2026-08-06 15:34:12.430462 | mon1 | ok: [mon1]
2026-08-06 15:34:12.430658 | mon1 |
2026-08-06 15:34:12.430969 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-06 15:34:12.431223 | mon1 | Thursday 06 August 2026  15:34:12 +0000 (0:00:00.889)       0:01:39.946 *******
2026-08-06 15:34:12.968401 | mon1 | ok: [mon1]
2026-08-06 15:34:12.968456 | mon1 |
2026-08-06 15:34:12.968463 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-06 15:34:12.968470 | mon1 | Thursday 06 August 2026  15:34:12 +0000 (0:00:00.537)       0:01:40.483 *******
2026-08-06 15:34:14.081712 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-08-06 15:34:14.081856 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-06 15:34:14.082017 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-06 15:34:14.082191 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-06 15:34:14.082382 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-06 15:34:14.082523 | mon1 |
2026-08-06 15:34:14.082673 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-06 15:34:14.082872 | mon1 | Thursday 06 August 2026  15:34:14 +0000 (0:00:01.114)       0:01:41.598 *******
2026-08-06 15:34:14.753409 | mon1 | ok: [mon1]
2026-08-06 15:34:14.753461 | mon1 |
2026-08-06 15:34:14.753478 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-06 15:34:14.754299 | mon1 | Thursday 06 August 2026  15:34:14 +0000 (0:00:00.664)       0:01:42.262 *******
2026-08-06 15:34:14.754335 | mon1 |
2026-08-06 15:34:14.754346 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-06 15:34:14.754495 | mon1 | Thursday 06 August 2026  15:34:14 +0000 (0:00:00.006)       0:01:42.269 *******
2026-08-06 15:34:15.198343 | mon1 | ok: [mon1]
2026-08-06 15:34:15.198394 | mon1 |
2026-08-06 15:34:15.198959 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:34:15.198988 | mon1 | Thursday 06 August 2026  15:34:15 +0000 (0:00:00.444)       0:01:42.713 *******
2026-08-06 15:34:15.448664 | mon1 | ok: [mon1]
2026-08-06 15:34:15.448755 | mon1 |
2026-08-06 15:34:15.448823 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:34:15.448933 | mon1 | Thursday 06 August 2026  15:34:15 +0000 (0:00:00.249)       0:01:42.963 *******
2026-08-06 15:34:15.526572 | mon1 | ok: [mon1] => {
2026-08-06 15:34:15.526709 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-06 15:34:15.526847 | mon1 | }
2026-08-06 15:34:15.526987 | mon1 |
2026-08-06 15:34:15.527146 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:34:15.527395 | mon1 | Thursday 06 August 2026  15:34:15 +0000 (0:00:00.079)       0:01:43.043 *******
2026-08-06 15:34:15.963815 | mon1 | ok: [mon1]
2026-08-06 15:34:15.963864 | mon1 |
2026-08-06 15:34:15.963874 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:34:15.963884 | mon1 | Thursday 06 August 2026  15:34:15 +0000 (0:00:00.435)       0:01:43.478 *******
2026-08-06 15:34:19.270807 | mon1 | ok: [mon1]
2026-08-06 15:34:19.270866 | mon1 |
2026-08-06 15:34:19.270877 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-06 15:34:19.270887 | mon1 | Thursday 06 August 2026  15:34:19 +0000 (0:00:03.307)       0:01:46.786 *******
2026-08-06 15:34:20.441746 | mon1 | ok: [mon1]
2026-08-06 15:34:20.441805 | mon1 |
2026-08-06 15:34:20.441816 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-06 15:34:20.441826 | mon1 | Thursday 06 August 2026  15:34:20 +0000 (0:00:01.169)       0:01:47.955 *******
2026-08-06 15:34:20.689139 | mon1 | ok: [mon1]
2026-08-06 15:34:20.689264 | mon1 |
2026-08-06 15:34:20.689281 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-06 15:34:20.689291 | mon1 | Thursday 06 August 2026  15:34:20 +0000 (0:00:00.247)       0:01:48.203 *******
2026-08-06 15:34:21.251032 | mon1 | ok: [mon1]
2026-08-06 15:34:21.251091 | mon1 |
2026-08-06 15:34:21.251102 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-06 15:34:21.251112 | mon1 | Thursday 06 August 2026  15:34:21 +0000 (0:00:00.562)       0:01:48.766 *******
2026-08-06 15:34:21.977060 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-08-06 15:34:21.977104 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-06 15:34:21.977111 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-06 15:34:21.977117 | mon1 |
2026-08-06 15:34:21.977124 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-06 15:34:21.977130 | mon1 | Thursday 06 August 2026  15:34:21 +0000 (0:00:00.723)       0:01:49.489 *******
2026-08-06 15:34:22.488787 | mon1 | ok: [mon1]
2026-08-06 15:34:22.488832 | mon1 |
2026-08-06 15:34:22.488843 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-06 15:34:22.488852 | mon1 | Thursday 06 August 2026  15:34:22 +0000 (0:00:00.513)       0:01:50.002 *******
2026-08-06 15:34:23.021306 | mon1 | ok: [mon1]
2026-08-06 15:34:23.021356 | mon1 |
2026-08-06 15:34:23.021367 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-06 15:34:23.021377 | mon1 | Thursday 06 August 2026  15:34:23 +0000 (0:00:00.526)       0:01:50.528 *******
2026-08-06 15:34:23.021386 | mon1 |
2026-08-06 15:34:23.021395 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-06 15:34:23.021436 | mon1 | Thursday 06 August 2026  15:34:23 +0000 (0:00:00.007)       0:01:50.536 *******
2026-08-06 15:34:23.458867 | mon1 | ok: [mon1]
2026-08-06 15:34:23.458947 | mon1 |
2026-08-06 15:34:23.459273 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-06 15:34:23.459517 | mon1 | Thursday 06 August 2026  15:34:23 +0000 (0:00:00.438)       0:01:50.975 *******
2026-08-06 15:34:23.513622 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-06 15:34:23.513844 | mon1 |
2026-08-06 15:34:23.514128 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-06 15:34:23.514443 | mon1 | Thursday 06 August 2026  15:34:23 +0000 (0:00:00.054)       0:01:51.030 *******
2026-08-06 15:34:24.427196 | mon1 | ok: [mon1]
2026-08-06 15:34:24.427462 | mon1 |
2026-08-06 15:34:24.427771 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-06 15:34:24.428076 | mon1 | Thursday 06 August 2026  15:34:24 +0000 (0:00:00.913)       0:01:51.943 *******
2026-08-06 15:34:25.242464 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-08-06 15:34:25.242537 | mon1 | ok: [mon1] => (item=ssh)
2026-08-06 15:34:25.242550 | mon1 |
2026-08-06 15:34:25.242568 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-06 15:34:25.242752 | mon1 | Thursday 06 August 2026  15:34:25 +0000 (0:00:00.814)       0:01:52.758 *******
2026-08-06 15:34:26.517258 | mon1 | ok: [mon1]
2026-08-06 15:34:26.517318 | mon1 |
2026-08-06 15:34:26.517325 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-06 15:34:26.517332 | mon1 | Thursday 06 August 2026  15:34:26 +0000 (0:00:01.274)       0:01:54.033 *******
2026-08-06 15:34:26.799729 | mon1 | ok: [mon1]
2026-08-06 15:34:26.799779 | mon1 |
2026-08-06 15:34:26.799790 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-06 15:34:26.799800 | mon1 | Thursday 06 August 2026  15:34:26 +0000 (0:00:00.282)       0:01:54.315 *******
2026-08-06 15:34:27.115692 | mon1 | ok: [mon1]
2026-08-06 15:34:27.115761 | mon1 |
2026-08-06 15:34:27.115862 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-06 15:34:27.115981 | mon1 | Thursday 06 August 2026  15:34:27 +0000 (0:00:00.315)       0:01:54.630 *******
2026-08-06 15:34:27.361399 | mon1 | ok: [mon1]
2026-08-06 15:34:27.361457 | mon1 |
2026-08-06 15:34:27.361841 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] ***********
2026-08-06 15:34:27.361864 | mon1 | Thursday 06 August 2026  15:34:27 +0000 (0:00:00.245)       0:01:54.876 *******
2026-08-06 15:34:29.094303 | mon1 | ok: [mon1]
2026-08-06 15:34:29.094363 | mon1 |
2026-08-06 15:34:29.094378 | mon1 | PLAY RECAP *********************************************************************
2026-08-06 15:34:29.094390 | mon1 | mon1                       : ok=83   changed=0    unreachable=0    failed=0    skipped=15   rescued=0    ignored=0
2026-08-06 15:34:29.094402 | mon1 | osd1                       : ok=48   changed=0    unreachable=0    failed=0    skipped=9    rescued=0    ignored=0
2026-08-06 15:34:29.094414 | mon1 |
2026-08-06 15:34:29.094426 | mon1 |
2026-08-06 15:34:29.094437 | mon1 | TASKS RECAP ********************************************************************
2026-08-06 15:34:29.094449 | mon1 | Thursday 06 August 2026  15:34:29 +0000 (0:00:01.731)       0:01:56.607 *******
2026-08-06 15:34:29.094460 | mon1 | ===============================================================================
2026-08-06 15:34:29.094664 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.51s
2026-08-06 15:34:29.094974 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 6.42s
2026-08-06 15:34:29.095308 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.29s
2026-08-06 15:34:29.095634 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.31s
2026-08-06 15:34:29.095940 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.27s
2026-08-06 15:34:29.096277 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.71s
2026-08-06 15:34:29.096593 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.71s
2026-08-06 15:34:29.096894 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.69s
2026-08-06 15:34:29.097192 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.44s
2026-08-06 15:34:29.097544 | mon1 | Gathering Facts --------------------------------------------------------- 2.26s
2026-08-06 15:34:29.097868 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.25s
2026-08-06 15:34:29.098170 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.17s
2026-08-06 15:34:29.098503 | mon1 | vexxhost.ceph.cephadm : Download "cephadm" ------------------------------ 2.14s
2026-08-06 15:34:29.098838 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 2.04s
2026-08-06 15:34:29.099131 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 2.03s
2026-08-06 15:34:29.099457 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 1.97s
2026-08-06 15:34:29.099760 | mon1 | vexxhost.ceph.mon : Validate monitor exist ------------------------------ 1.92s
2026-08-06 15:34:29.100057 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 1.91s
2026-08-06 15:34:29.100387 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.91s
2026-08-06 15:34:29.100797 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 1.91s
2026-08-06 15:34:29.194817 | mon1 | INFO     [default > idempotence] Executed: Successful
2026-08-06 15:34:29.207035 | mon1 | INFO     [default > side_effect] Executing
2026-08-06 15:34:29.207419 | mon1 | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-06 15:34:29.213203 | mon1 | INFO     [default > verify] Executing
2026-08-06 15:34:29.948578 | mon1 |
2026-08-06 15:34:29.948963 | mon1 | PLAY [Verify] ******************************************************************
2026-08-06 15:34:29.949294 | mon1 |
2026-08-06 15:34:29.949668 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:34:29.950005 | mon1 | Thursday 06 August 2026  15:34:29 +0000 (0:00:00.008)       0:00:00.008 *******
2026-08-06 15:34:31.182761 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-08-06 15:34:31.183169 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-06 15:34:31.183537 | mon1 | interpreter could change the meaning of that path. See
2026-08-06 15:34:31.183878 | mon1 | https://docs.ansible.com/ansible-
2026-08-06 15:34:31.184209 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-06 15:34:31.188844 | mon1 | ok: [mon1]
2026-08-06 15:34:31.189139 | mon1 |
2026-08-06 15:34:31.189474 | mon1 | TASK [List locally deployed Ceph daemons] **************************************
2026-08-06 15:34:31.189810 | mon1 | Thursday 06 August 2026  15:34:31 +0000 (0:00:01.240)       0:00:01.249 *******
2026-08-06 15:34:32.137332 | mon1 | ok: [mon1]
2026-08-06 15:34:32.137390 | mon1 |
2026-08-06 15:34:32.137401 | mon1 | TASK [Collect deployed Ceph container images] **********************************
2026-08-06 15:34:32.137411 | mon1 | Thursday 06 August 2026  15:34:32 +0000 (0:00:00.947)       0:00:02.196 *******
2026-08-06 15:34:32.182522 | mon1 | ok: [mon1]
2026-08-06 15:34:32.182762 | mon1 |
2026-08-06 15:34:32.183038 | mon1 | TASK [Assert that a deployed Ceph container image was found] *******************
2026-08-06 15:34:32.183361 | mon1 | Thursday 06 August 2026  15:34:32 +0000 (0:00:00.045)       0:00:02.242 *******
2026-08-06 15:34:32.208130 | mon1 | fatal: [mon1]: FAILED! => {
2026-08-06 15:34:32.208411 | mon1 |     "assertion": "_ceph_container_images | length > 0",
2026-08-06 15:34:32.208646 | mon1 |     "changed": false,
2026-08-06 15:34:32.208878 | mon1 |     "evaluated_to": false,
2026-08-06 15:34:32.209157 | mon1 |     "msg": "No deployed monitor container image was found in cephadm metadata"
2026-08-06 15:34:32.209433 | mon1 | }
2026-08-06 15:34:32.209735 | mon1 |
2026-08-06 15:34:32.210033 | mon1 | PLAY RECAP *********************************************************************
2026-08-06 15:34:32.210340 | mon1 | mon1                       : ok=3    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0
2026-08-06 15:34:32.210569 | mon1 |
2026-08-06 15:34:32.210800 | mon1 |
2026-08-06 15:34:32.211021 | mon1 | TASKS RECAP ********************************************************************
2026-08-06 15:34:32.211290 | mon1 | Thursday 06 August 2026  15:34:32 +0000 (0:00:00.028)       0:00:02.270 *******
2026-08-06 15:34:32.211499 | mon1 | ===============================================================================
2026-08-06 15:34:32.211746 | mon1 | Gathering Facts --------------------------------------------------------- 1.24s
2026-08-06 15:34:32.211992 | mon1 | List locally deployed Ceph daemons -------------------------------------- 0.95s
2026-08-06 15:34:32.212222 | mon1 | Collect deployed Ceph container images ---------------------------------- 0.05s
2026-08-06 15:34:32.212497 | mon1 | Assert that a deployed Ceph container image was found ------------------- 0.03s
2026-08-06 15:34:32.279284 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/verify.yml
2026-08-06 15:34:32.279427 | mon1 | ERROR    [default > verify] Executed: Failed
2026-08-06 15:34:32.279555 | mon1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/verify.yml
2026-08-06 15:34:32.447716 | mon1 | ERROR
2026-08-06 15:34:32.448221 | mon1 | {
2026-08-06 15:34:32.448253 | mon1 |   "delta": "0:09:27.551357",
2026-08-06 15:34:32.448274 | mon1 |   "end": "2026-08-06 15:34:32.348953",
2026-08-06 15:34:32.448296 | mon1 |   "msg": "non-zero return code",
2026-08-06 15:34:32.448315 | mon1 |   "rc": 2,
2026-08-06 15:34:32.448333 | mon1 |   "start": "2026-08-06 15:25:04.797596"
2026-08-06 15:34:32.448352 | mon1 | }
failure
2026-08-06 15:34:32.462186 | 
2026-08-06 15:34:32.462272 | PLAY RECAP
2026-08-06 15:34:32.462319 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-08-06 15:34:32.462341 | 
2026-08-06 15:34:32.603290 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-06 15:34:32.607162 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-06 15:34:33.232582 | 
2026-08-06 15:34:33.232706 | PLAY [all]
2026-08-06 15:34:33.245142 | 
2026-08-06 15:34:33.245221 | TASK [fetch-output : Set log path for multiple nodes]
2026-08-06 15:34:33.299186 | mon1 | ok
2026-08-06 15:34:33.304884 | osd1 | ok
2026-08-06 15:34:33.309582 | 
2026-08-06 15:34:33.309659 | TASK [fetch-output : Set log path for single node]
2026-08-06 15:34:33.333222 | mon1 | skipping: Conditional result was False
2026-08-06 15:34:33.344244 | osd1 | skipping: Conditional result was False
2026-08-06 15:34:33.356397 | 
2026-08-06 15:34:33.356489 | LOOP [fetch-output : Ensure local output dirs]
2026-08-06 15:34:33.748648 | mon1 -> localhost | changed: "/var/lib/zuul/builds/248618a074d8460fba140260f2074143/work/logs/mon1"
2026-08-06 15:34:33.754265 | osd1 -> localhost | changed: "/var/lib/zuul/builds/248618a074d8460fba140260f2074143/work/logs/osd1"
2026-08-06 15:34:33.954129 | osd1 -> localhost | changed: "/var/lib/zuul/builds/248618a074d8460fba140260f2074143/work/artifacts"
2026-08-06 15:34:33.991416 | mon1 -> localhost | ok: "/var/lib/zuul/builds/248618a074d8460fba140260f2074143/work/artifacts"
2026-08-06 15:34:34.155396 | osd1 -> localhost | changed: "/var/lib/zuul/builds/248618a074d8460fba140260f2074143/work/docs"
2026-08-06 15:34:34.215635 | mon1 -> localhost | ok: "/var/lib/zuul/builds/248618a074d8460fba140260f2074143/work/docs"
2026-08-06 15:34:34.215792 | mon1 -> localhost | changed: All items complete
2026-08-06 15:34:34.215830 | 
2026-08-06 15:34:34.231153 | 
2026-08-06 15:34:34.231321 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-08-06 15:34:34.882301 | mon1 | changed: .d..t...... ./
2026-08-06 15:34:34.887500 | osd1 | changed: .d..t...... ./
2026-08-06 15:34:35.347668 | mon1 | ok
2026-08-06 15:34:35.352597 | osd1 | changed: .d..t...... ./
2026-08-06 15:34:35.808788 | osd1 | changed: .d..t...... ./
2026-08-06 15:34:35.831986 | mon1 | ok
2026-08-06 15:34:35.832055 | mon1 | changed: All items complete
2026-08-06 15:34:35.832078 | 
2026-08-06 15:34:35.863465 | 
2026-08-06 15:34:35.863594 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-08-06 15:34:36.270655 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007289
2026-08-06 15:34:36.486560 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006522
2026-08-06 15:34:36.507035 | 
2026-08-06 15:34:36.507135 | PLAY [all]
2026-08-06 15:34:36.513468 | 
2026-08-06 15:34:36.513530 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-08-06 15:34:36.984906 | mon1 | changed
2026-08-06 15:34:37.180774 | osd1 | changed
2026-08-06 15:34:37.191039 | 
2026-08-06 15:34:37.191087 | PLAY RECAP
2026-08-06 15:34:37.191133 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-06 15:34:37.191163 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-06 15:34:37.191183 | 
2026-08-06 15:34:37.307882 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-06 15:34:37.311532 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-08-06 15:34:37.881965 | 
2026-08-06 15:34:37.882188 | PLAY [localhost]
2026-08-06 15:34:37.891623 | 
2026-08-06 15:34:37.892043 | TASK [Generate Zuul manifest]
2026-08-06 15:34:37.913286 | localhost | ok
2026-08-06 15:34:37.930088 | 
2026-08-06 15:34:37.930167 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-08-06 15:34:38.325738 | localhost | changed
2026-08-06 15:34:38.337386 | 
2026-08-06 15:34:38.337487 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-08-06 15:34:38.369507 | localhost | ok
2026-08-06 15:34:38.383326 | 
2026-08-06 15:34:38.383424 | TASK [Upload logs]
2026-08-06 15:34:38.402724 | localhost | ok
2026-08-06 15:34:38.461982 | 
2026-08-06 15:34:38.462117 | TASK [Set zuul-log-path fact]
2026-08-06 15:34:38.482792 | localhost | ok
2026-08-06 15:34:38.494452 | 
2026-08-06 15:34:38.494518 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-06 15:34:38.525471 | localhost | ok
2026-08-06 15:34:38.534787 | 
2026-08-06 15:34:38.534855 | TASK [upload-logs : Create log directories]
2026-08-06 15:34:38.918641 | localhost | changed
2026-08-06 15:34:38.925413 | 
2026-08-06 15:34:38.925504 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-08-06 15:34:39.362499 | localhost -> localhost | ok: Runtime: 0:00:00.005430
2026-08-06 15:34:39.369087 | 
2026-08-06 15:34:39.369159 | TASK [upload-logs : Upload logs to log server]
2026-08-06 15:34:39.807480 | localhost | Output suppressed because no_log was given
2026-08-06 15:34:39.812344 | 
2026-08-06 15:34:39.812412 | LOOP [upload-logs : Compress console log and json output]
2026-08-06 15:34:39.893216 | localhost | skipping: Conditional result was False
2026-08-06 15:34:39.900663 | localhost | skipping: Conditional result was False
2026-08-06 15:34:39.918152 | 
2026-08-06 15:34:39.918259 | LOOP [upload-logs : Upload compressed console log and json output]
2026-08-06 15:34:39.997146 | localhost | skipping: Conditional result was False
2026-08-06 15:34:39.997516 | 
2026-08-06 15:34:40.001434 | localhost | skipping: Conditional result was False
2026-08-06 15:34:40.043703 | 
2026-08-06 15:34:40.043847 | LOOP [upload-logs : Upload console log and json output]