2026-07-06 02:23:21.762210 | Job console starting
2026-07-06 02:23:21.776290 | Updating git repos
2026-07-06 02:23:21.798959 | Cloning repos into workspace
2026-07-06 02:23:21.890615 | Restoring repo states
2026-07-06 02:23:21.898644 | Merging changes
2026-07-06 02:23:22.133786 | Checking out repos
2026-07-06 02:23:22.170006 | Preparing playbooks
2026-07-06 02:23:23.312390 | Running Ansible setup
2026-07-06 02:23:27.446966 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-07-06 02:23:28.082752 | 
2026-07-06 02:23:28.082897 | PLAY [localhost]
2026-07-06 02:23:28.090339 | 
2026-07-06 02:23:28.090408 | TASK [Gathering Facts]
2026-07-06 02:23:28.961980 | localhost | ok
2026-07-06 02:23:28.972759 | 
2026-07-06 02:23:28.972863 | TASK [Setup log path fact]
2026-07-06 02:23:28.993864 | localhost | ok
2026-07-06 02:23:29.006647 | 
2026-07-06 02:23:29.006717 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-07-06 02:23:29.036563 | localhost | ok
2026-07-06 02:23:29.043413 | 
2026-07-06 02:23:29.043488 | TASK [emit-job-header : Print job information]
2026-07-06 02:23:29.085777 | # Job Information
2026-07-06 02:23:29.085983 | Ansible Version: 2.16.18
2026-07-06 02:23:29.086055 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy
2026-07-06 02:23:29.086107 | Pipeline: check
2026-07-06 02:23:29.086152 | Executor: 2d72f0692154
2026-07-06 02:23:29.086196 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/111
2026-07-06 02:23:29.086249 | Event ID: 789ee510-78e1-11f1-8241-e0f109c4bf88
2026-07-06 02:23:29.093067 | 
2026-07-06 02:23:29.093239 | LOOP [emit-job-header : Print node information]
2026-07-06 02:23:29.193919 | localhost | ok:
2026-07-06 02:23:29.194176 | localhost | # Node Information
2026-07-06 02:23:29.194217 | localhost | Inventory Hostname: mon1
2026-07-06 02:23:29.194249 | localhost | Hostname: np0000184136
2026-07-06 02:23:29.194277 | localhost | Username: zuul
2026-07-06 02:23:29.194308 | localhost | Distro: Ubuntu 22.04
2026-07-06 02:23:29.194337 | localhost | Provider: yul1
2026-07-06 02:23:29.194364 | localhost | Region: ca-ymq-1
2026-07-06 02:23:29.194390 | localhost | Label: ubuntu-jammy
2026-07-06 02:23:29.194416 | localhost | Product Name: OpenStack Nova
2026-07-06 02:23:29.194442 | localhost | Interface IP: 199.19.213.105
2026-07-06 02:23:29.238352 | localhost | ok:
2026-07-06 02:23:29.238484 | localhost | # Node Information
2026-07-06 02:23:29.238543 | localhost | Inventory Hostname: osd1
2026-07-06 02:23:29.238590 | localhost | Hostname: np0000184137
2026-07-06 02:23:29.238633 | localhost | Username: zuul
2026-07-06 02:23:29.238675 | localhost | Distro: Ubuntu 22.04
2026-07-06 02:23:29.238719 | localhost | Provider: yul1
2026-07-06 02:23:29.238760 | localhost | Region: ca-ymq-1
2026-07-06 02:23:29.238800 | localhost | Label: ubuntu-jammy
2026-07-06 02:23:29.238841 | localhost | Product Name: OpenStack Nova
2026-07-06 02:23:29.238883 | localhost | Interface IP: 199.19.213.60
2026-07-06 02:23:29.255465 | 
2026-07-06 02:23:29.255650 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-07-06 02:23:29.657401 | localhost -> localhost | changed
2026-07-06 02:23:29.664352 | 
2026-07-06 02:23:29.664705 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-07-06 02:23:30.526682 | localhost -> localhost | changed
2026-07-06 02:23:30.535789 | 
2026-07-06 02:23:30.535863 | PLAY [all]
2026-07-06 02:23:30.545431 | 
2026-07-06 02:23:30.545517 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-07-06 02:23:30.761682 | mon1 -> localhost | ok
2026-07-06 02:23:30.768734 | 
2026-07-06 02:23:30.768853 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-07-06 02:23:30.800259 | mon1 | ok
2026-07-06 02:23:30.804485 | osd1 | ok
2026-07-06 02:23:30.822778 | mon1 | included: /var/lib/zuul/builds/424277dfe0b6410487cd474957978173/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-07-06 02:23:30.822903 | osd1 | included: /var/lib/zuul/builds/424277dfe0b6410487cd474957978173/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-07-06 02:23:30.829152 | 
2026-07-06 02:23:30.829251 | TASK [add-build-sshkey : Create Temp SSH key]
2026-07-06 02:23:31.786646 | mon1 -> localhost | Generating public/private rsa key pair.
2026-07-06 02:23:31.786938 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/424277dfe0b6410487cd474957978173/work/424277dfe0b6410487cd474957978173_id_rsa
2026-07-06 02:23:31.787009 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/424277dfe0b6410487cd474957978173/work/424277dfe0b6410487cd474957978173_id_rsa.pub
2026-07-06 02:23:31.787063 | mon1 -> localhost | The key fingerprint is:
2026-07-06 02:23:31.787113 | mon1 -> localhost | SHA256:WsugROsjPDsYKmObP1K0UQdH/O1lPdeDMXb3TM7epIs zuul-build-sshkey
2026-07-06 02:23:31.787162 | mon1 -> localhost | The key's randomart image is:
2026-07-06 02:23:31.787209 | mon1 -> localhost | +---[RSA 3072]----+
2026-07-06 02:23:31.787255 | mon1 -> localhost | |     .+o         |
2026-07-06 02:23:31.787302 | mon1 -> localhost | |     ..o     + .o|
2026-07-06 02:23:31.787347 | mon1 -> localhost | |    o . . . . *=+|
2026-07-06 02:23:31.787392 | mon1 -> localhost | |   + .   . . + +O|
2026-07-06 02:23:31.787437 | mon1 -> localhost | |  . = . S . o  +=|
2026-07-06 02:23:31.787481 | mon1 -> localhost | |.. = . = . .  . o|
2026-07-06 02:23:31.787524 | mon1 -> localhost | |.o= + . o    . . |
2026-07-06 02:23:31.787568 | mon1 -> localhost | |=oo= .      E .  |
2026-07-06 02:23:31.787611 | mon1 -> localhost | |o+=o.            |
2026-07-06 02:23:31.787655 | mon1 -> localhost | +----[SHA256]-----+
2026-07-06 02:23:31.787748 | mon1 -> localhost | ok: Runtime: 0:00:00.514387
2026-07-06 02:23:31.794712 | 
2026-07-06 02:23:31.794778 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-07-06 02:23:31.828839 | mon1 | ok
2026-07-06 02:23:31.835199 | osd1 | ok
2026-07-06 02:23:31.850229 | mon1 | included: /var/lib/zuul/builds/424277dfe0b6410487cd474957978173/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-07-06 02:23:31.850295 | osd1 | included: /var/lib/zuul/builds/424277dfe0b6410487cd474957978173/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-07-06 02:23:31.860114 | 
2026-07-06 02:23:31.860172 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-07-06 02:23:31.885413 | mon1 | skipping: Conditional result was False
2026-07-06 02:23:31.896697 | osd1 | skipping: Conditional result was False
2026-07-06 02:23:31.906102 | 
2026-07-06 02:23:31.906194 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-07-06 02:23:32.358401 | osd1 | changed
2026-07-06 02:23:32.377988 | mon1 | changed
2026-07-06 02:23:32.383375 | 
2026-07-06 02:23:32.383436 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-07-06 02:23:32.579637 | mon1 | ok
2026-07-06 02:23:32.587738 | osd1 | ok
2026-07-06 02:23:32.593659 | 
2026-07-06 02:23:32.593725 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-07-06 02:23:33.074664 | osd1 | changed
2026-07-06 02:23:33.079487 | mon1 | changed
2026-07-06 02:23:33.087646 | 
2026-07-06 02:23:33.087852 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-07-06 02:23:33.626123 | osd1 | changed
2026-07-06 02:23:33.630862 | mon1 | changed
2026-07-06 02:23:33.635757 | 
2026-07-06 02:23:33.635825 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-07-06 02:23:33.662678 | mon1 | skipping: Conditional result was False
2026-07-06 02:23:33.674056 | osd1 | skipping: Conditional result was False
2026-07-06 02:23:33.683711 | 
2026-07-06 02:23:33.683835 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-07-06 02:23:33.992904 | mon1 -> localhost | changed
2026-07-06 02:23:34.012347 | 
2026-07-06 02:23:34.012420 | TASK [add-build-sshkey : Add back temp key]
2026-07-06 02:23:34.299706 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/424277dfe0b6410487cd474957978173/work/424277dfe0b6410487cd474957978173_id_rsa (zuul-build-sshkey)
2026-07-06 02:23:34.299991 | mon1 -> localhost | ok: Runtime: 0:00:00.011817
2026-07-06 02:23:34.306909 | 
2026-07-06 02:23:34.306985 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-07-06 02:23:34.575094 | mon1 | ok
2026-07-06 02:23:34.581713 | osd1 | ok
2026-07-06 02:23:34.585988 | 
2026-07-06 02:23:34.586050 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-07-06 02:23:34.609520 | mon1 | skipping: Conditional result was False
2026-07-06 02:23:34.620599 | osd1 | skipping: Conditional result was False
2026-07-06 02:23:34.640352 | 
2026-07-06 02:23:34.640455 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-07-06 02:23:34.922735 | mon1 | ok
2026-07-06 02:23:34.927070 | osd1 | ok
2026-07-06 02:23:34.932496 | 
2026-07-06 02:23:34.932566 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-07-06 02:23:35.628368 | mon1 | Output suppressed because no_log was given
2026-07-06 02:23:35.633154 | osd1 | Output suppressed because no_log was given
2026-07-06 02:23:35.645887 | 
2026-07-06 02:23:35.645955 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-07-06 02:23:35.826215 | mon1 | ok: "logs"
2026-07-06 02:23:35.826517 | mon1 | ok: All items complete
2026-07-06 02:23:35.826574 | 
2026-07-06 02:23:35.831787 | osd1 | ok: "logs"
2026-07-06 02:23:35.977923 | mon1 | ok: "artifacts"
2026-07-06 02:23:35.988169 | osd1 | ok: "artifacts"
2026-07-06 02:23:36.144228 | osd1 | ok: "docs"
2026-07-06 02:23:36.150637 | mon1 | ok: "docs"
2026-07-06 02:23:36.162662 | 
2026-07-06 02:23:36.162811 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-07-06 02:23:36.341808 | mon1 | changed: "logs"
2026-07-06 02:23:36.342138 | mon1 | ok: All items complete
2026-07-06 02:23:36.342183 | 
2026-07-06 02:23:36.354744 | osd1 | changed: "logs"
2026-07-06 02:23:36.503448 | mon1 | changed: "artifacts"
2026-07-06 02:23:36.583259 | osd1 | changed: "artifacts"
2026-07-06 02:23:36.662556 | mon1 | changed: "docs"
2026-07-06 02:23:36.669710 | osd1 | changed: "docs"
2026-07-06 02:23:36.689927 | 
2026-07-06 02:23:36.689989 | PLAY RECAP
2026-07-06 02:23:36.690036 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-06 02:23:36.690067 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-07-06 02:23:36.690092 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-07-06 02:23:36.690112 | 
2026-07-06 02:23:36.842426 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-07-06 02:23:37.031782 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-07-06 02:23:37.622442 | 
2026-07-06 02:23:37.622568 | PLAY [all]
2026-07-06 02:23:37.633304 | 
2026-07-06 02:23:37.633378 | TASK [setup-uv : Extract archive]
2026-07-06 02:23:39.886759 | osd1 | changed
2026-07-06 02:23:39.961099 | mon1 | changed
2026-07-06 02:23:39.970171 | 
2026-07-06 02:23:39.970255 | TASK [setup-uv : Print version]
2026-07-06 02:23:40.089825 | osd1 | uv 0.8.13
2026-07-06 02:23:40.038468 | mon1 | uv 0.8.13
2026-07-06 02:23:40.527626 | mon1 | ok: Runtime: 0:00:00.013039
2026-07-06 02:23:40.537052 | osd1 | ok: Runtime: 0:00:00.018385
2026-07-06 02:23:40.549611 | 
2026-07-06 02:23:40.549674 | TASK [Install Ansible collection siblings]
2026-07-06 02:23:40.938856 | mon1 | ok:
2026-07-06 02:23:40.939077 | mon1 | Skipping community.general: no checked-out sibling
2026-07-06 02:23:40.939118 | mon1 | Skipping ansible.utils: no checked-out sibling
2026-07-06 02:23:40.939149 | mon1 | Skipping vexxhost.containers: no checked-out sibling
2026-07-06 02:23:40.941305 | 
2026-07-06 02:23:40.941373 | PLAY RECAP
2026-07-06 02:23:40.941433 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-06 02:23:40.941489 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-06 02:23:40.941517 | 
2026-07-06 02:23:41.066240 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-07-06 02:23:41.070443 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-07-06 02:23:41.688737 | 
2026-07-06 02:23:41.688875 | PLAY [all]
2026-07-06 02:23:41.711639 | 
2026-07-06 02:23:41.711733 | LOOP [Check inventory directories]
2026-07-06 02:23:42.042171 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph"
2026-07-06 02:23:42.199642 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory"
2026-07-06 02:23:42.348115 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory"
2026-07-06 02:23:42.361110 | 
2026-07-06 02:23:42.361358 | LOOP [Copy inventory file for Zuul]
2026-07-06 02:23:43.161484 | mon1 | changed:
2026-07-06 02:23:43.161688 | mon1 | {
2026-07-06 02:23:43.161722 | mon1 |   "ansible_loop_var": "item",
2026-07-06 02:23:43.161745 | mon1 |   "changed": false,
2026-07-06 02:23:43.161766 | mon1 |   "failed": false,
2026-07-06 02:23:43.161791 | mon1 |   "invocation": {
2026-07-06 02:23:43.161811 | mon1 |     "module_args": {
2026-07-06 02:23:43.161830 | mon1 |       "checksum_algorithm": "sha1",
2026-07-06 02:23:43.161848 | mon1 |       "follow": true,
2026-07-06 02:23:43.161866 | mon1 |       "get_attributes": true,
2026-07-06 02:23:43.161885 | mon1 |       "get_checksum": true,
2026-07-06 02:23:43.161903 | mon1 |       "get_mime": true,
2026-07-06 02:23:43.161921 | mon1 |       "path": "src/github.com/vexxhost/ansible-collection-ceph"
2026-07-06 02:23:43.161940 | mon1 |     }
2026-07-06 02:23:43.161957 | mon1 |   },
2026-07-06 02:23:43.161975 | mon1 |   "item": "src/github.com/vexxhost/ansible-collection-ceph",
2026-07-06 02:23:43.161992 | mon1 |   "stat": {
2026-07-06 02:23:43.162010 | mon1 |     "atime": 1783304615.236,
2026-07-06 02:23:43.162028 | mon1 |     "attr_flags": "e",
2026-07-06 02:23:43.162045 | mon1 |     "attributes": [
2026-07-06 02:23:43.162062 | mon1 |       "extents"
2026-07-06 02:23:43.162079 | mon1 |     ],
2026-07-06 02:23:43.162097 | mon1 |     "block_size": 4096,
2026-07-06 02:23:43.162114 | mon1 |     "blocks": 8,
2026-07-06 02:23:43.162131 | mon1 |     "charset": "unknown",
2026-07-06 02:23:43.162150 | mon1 |     "ctime": 1783304615.248,
2026-07-06 02:23:43.162168 | mon1 |     "dev": 64513,
2026-07-06 02:23:43.162186 | mon1 |     "device_type": 0,
2026-07-06 02:23:43.162203 | mon1 |     "executable": true,
2026-07-06 02:23:43.162220 | mon1 |     "exists": true,
2026-07-06 02:23:43.162237 | mon1 |     "gid": 1000,
2026-07-06 02:23:43.162253 | mon1 |     "gr_name": "zuul",
2026-07-06 02:23:43.162270 | mon1 |     "inode": 1041953,
2026-07-06 02:23:43.162333 | mon1 |     "isblk": false,
2026-07-06 02:23:43.162353 | mon1 |     "ischr": false,
2026-07-06 02:23:43.162370 | mon1 |     "isdir": true,
2026-07-06 02:23:43.162387 | mon1 |     "isfifo": false,
2026-07-06 02:23:43.162404 | mon1 |     "isgid": false,
2026-07-06 02:23:43.162420 | mon1 |     "islnk": false,
2026-07-06 02:23:43.162437 | mon1 |     "isreg": false,
2026-07-06 02:23:43.162453 | mon1 |     "issock": false,
2026-07-06 02:23:43.162469 | mon1 |     "isuid": false,
2026-07-06 02:23:43.162485 | mon1 |     "mimetype": "unknown",
2026-07-06 02:23:43.162502 | mon1 |     "mode": "0755",
2026-07-06 02:23:43.162519 | mon1 |     "mtime": 1783304601.9121604,
2026-07-06 02:23:43.162535 | mon1 |     "nlink": 10,
2026-07-06 02:23:43.162552 | mon1 |     "path": "src/github.com/vexxhost/ansible-collection-ceph",
2026-07-06 02:23:43.162573 | mon1 |     "pw_name": "zuul",
2026-07-06 02:23:43.162596 | mon1 |     "readable": true,
2026-07-06 02:23:43.162619 | mon1 |     "rgrp": true,
2026-07-06 02:23:43.162640 | mon1 |     "roth": true,
2026-07-06 02:23:43.162660 | mon1 |     "rusr": true,
2026-07-06 02:23:43.162677 | mon1 |     "size": 4096,
2026-07-06 02:23:43.162708 | mon1 |     "uid": 1000,
2026-07-06 02:23:43.162726 | mon1 |     "version": "648166562",
2026-07-06 02:23:43.162744 | mon1 |     "wgrp": false,
2026-07-06 02:23:43.162763 | mon1 |     "woth": false,
2026-07-06 02:23:43.162781 | mon1 |     "writeable": true,
2026-07-06 02:23:43.162798 | mon1 |     "wusr": true,
2026-07-06 02:23:43.162815 | mon1 |     "xgrp": true,
2026-07-06 02:23:43.162832 | mon1 |     "xoth": true,
2026-07-06 02:23:43.162848 | mon1 |     "xusr": true
2026-07-06 02:23:43.162865 | mon1 |   }
2026-07-06 02:23:43.162883 | mon1 | }
2026-07-06 02:23:43.162915 | mon1 | ok: All items complete
2026-07-06 02:23:43.162936 | 
2026-07-06 02:23:43.164207 | mon1 | skipping: Conditional result was False
2026-07-06 02:23:43.165948 | mon1 | skipping: Conditional result was False
2026-07-06 02:23:43.181661 | 
2026-07-06 02:23:43.181806 | LOOP [Switch "ansible_host" to private IP]
2026-07-06 02:23:43.511497 | mon1 | changed: 2 replacements made
2026-07-06 02:23:43.512821 | mon1 | skipping: Conditional result was False
2026-07-06 02:23:43.513779 | mon1 | skipping: Conditional result was False
2026-07-06 02:23:43.534824 | 
2026-07-06 02:23:43.534967 | TASK [Run Molecule scenario]
2026-07-06 02:23:43.840004 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-07-06 02:23:44.631401 | mon1 |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-07-06 02:23:44.835591 | mon1 | Using CPython 3.13.7
2026-07-06 02:23:44.835658 | mon1 | Creating virtual environment at: .venv
2026-07-06 02:23:45.747866 | mon1 | Downloading ansible-core (2.1MiB)
2026-07-06 02:23:45.751780 | mon1 | Downloading cryptography (4.3MiB)
2026-07-06 02:23:45.752790 | mon1 | Downloading pygments (1.2MiB)
2026-07-06 02:23:45.753922 | mon1 | Downloading netaddr (2.2MiB)
2026-07-06 02:23:46.211747 | mon1 |  Downloading pygments
2026-07-06 02:23:46.251781 | mon1 |  Downloading netaddr
2026-07-06 02:23:46.323932 | mon1 |  Downloading cryptography
2026-07-06 02:23:46.378432 | mon1 |  Downloading ansible-core
2026-07-06 02:23:46.408634 | mon1 | Installed 36 packages in 29ms
2026-07-06 02:23:47.551602 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-07-06 02:23:47.551691 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-07-06 02:23:48.170819 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-07-06 02:23:48.170957 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-07-06 02:24:01.419840 | mon1 | INFO     [default > dependency] Executing
2026-07-06 02:24:01.419983 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-07-06 02:24:01.420278 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-07-06 02:24:01.420436 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-07-06 02:24:01.426321 | mon1 | INFO     [default > cleanup] Executing
2026-07-06 02:24:01.426625 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-07-06 02:24:01.431729 | mon1 | INFO     [default > destroy] Executing
2026-07-06 02:24:01.431774 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-07-06 02:24:01.431812 | mon1 | INFO     [default > destroy] Executed: Successful
2026-07-06 02:24:01.437136 | mon1 | INFO     [default > syntax] Executing
2026-07-06 02:24:02.424450 | mon1 |
2026-07-06 02:24:02.424687 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-07-06 02:24:02.488888 | mon1 | INFO     [default > syntax] Executed: Successful
2026-07-06 02:24:02.499041 | mon1 | INFO     [default > create] Executing
2026-07-06 02:24:02.501078 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-07-06 02:24:02.506631 | mon1 | INFO     [default > prepare] Executing
2026-07-06 02:24:03.183707 | mon1 |
2026-07-06 02:24:03.183815 | mon1 | PLAY [Prepare] *****************************************************************
2026-07-06 02:24:03.183829 | mon1 |
2026-07-06 02:24:03.183932 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:24:03.184051 | mon1 | Monday 06 July 2026  02:24:03 +0000 (0:00:00.032)       0:00:00.032 ***********
2026-07-06 02:24:04.391537 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-07-06 02:24:04.391628 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-07-06 02:24:04.391745 | mon1 | interpreter could change the meaning of that path. See
2026-07-06 02:24:04.391852 | mon1 | https://docs.ansible.com/ansible-
2026-07-06 02:24:04.391965 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-06 02:24:04.396116 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-07-06 02:24:04.396234 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-07-06 02:24:04.396365 | mon1 | interpreter could change the meaning of that path. See
2026-07-06 02:24:04.396523 | mon1 | https://docs.ansible.com/ansible-
2026-07-06 02:24:04.396632 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-06 02:24:04.402700 | mon1 | ok: [mon1]
2026-07-06 02:24:04.402815 | mon1 | ok: [osd1]
2026-07-06 02:24:04.402936 | mon1 |
2026-07-06 02:24:04.403071 | mon1 | TASK [Configure short hostname] ************************************************
2026-07-06 02:24:04.403203 | mon1 | Monday 06 July 2026  02:24:04 +0000 (0:00:01.219)       0:00:01.252 ***********
2026-07-06 02:24:05.100251 | mon1 | changed: [osd1]
2026-07-06 02:24:05.100448 | mon1 | changed: [mon1]
2026-07-06 02:24:05.100672 | mon1 |
2026-07-06 02:24:05.100981 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-07-06 02:24:05.101306 | mon1 | Monday 06 July 2026  02:24:05 +0000 (0:00:00.696)       0:00:01.949 ***********
2026-07-06 02:24:05.395153 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-07-06 02:24:05.395385 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-07-06 02:24:05.395703 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-07-06 02:24:05.406905 | mon1 | changed: [mon1]
2026-07-06 02:24:05.406958 | mon1 | changed: [osd1]
2026-07-06 02:24:05.406979 | mon1 |
2026-07-06 02:24:05.407003 | mon1 | TASK [Update apt cache] ********************************************************
2026-07-06 02:24:05.407016 | mon1 | Monday 06 July 2026  02:24:05 +0000 (0:00:00.306)       0:00:02.256 ***********
2026-07-06 02:24:12.685519 | mon1 | changed: [osd1]
2026-07-06 02:24:12.685710 | mon1 | changed: [mon1]
2026-07-06 02:24:12.685932 | mon1 |
2026-07-06 02:24:12.686155 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-07-06 02:24:12.686370 | mon1 |
2026-07-06 02:24:12.686615 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:24:12.686835 | mon1 | Monday 06 July 2026  02:24:12 +0000 (0:00:07.278)       0:00:09.534 ***********
2026-07-06 02:24:13.399315 | mon1 | ok: [osd1]
2026-07-06 02:24:13.399465 | mon1 |
2026-07-06 02:24:13.399830 | mon1 | TASK [Install depedencies] *****************************************************
2026-07-06 02:24:13.399926 | mon1 | Monday 06 July 2026  02:24:13 +0000 (0:00:00.713)       0:00:10.248 ***********
2026-07-06 02:24:38.983083 | mon1 | changed: [osd1]
2026-07-06 02:24:38.983199 | mon1 |
2026-07-06 02:24:38.983507 | mon1 | TASK [Start up service] ********************************************************
2026-07-06 02:24:38.983783 | mon1 | Monday 06 July 2026  02:24:38 +0000 (0:00:25.583)       0:00:35.831 ***********
2026-07-06 02:24:39.552300 | mon1 | ok: [osd1]
2026-07-06 02:24:39.552403 | mon1 |
2026-07-06 02:24:39.552545 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-07-06 02:24:39.552710 | mon1 | Monday 06 July 2026  02:24:39 +0000 (0:00:00.569)       0:00:36.401 ***********
2026-07-06 02:24:39.859828 | mon1 | ok: [osd1]
2026-07-06 02:24:39.860097 | mon1 |
2026-07-06 02:24:39.860399 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-07-06 02:24:39.860690 | mon1 | Monday 06 July 2026  02:24:39 +0000 (0:00:00.307)       0:00:36.708 ***********
2026-07-06 02:24:40.554676 | mon1 | changed: [osd1]
2026-07-06 02:24:40.554768 | mon1 |
2026-07-06 02:24:40.554874 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-07-06 02:24:40.555022 | mon1 | Monday 06 July 2026  02:24:40 +0000 (0:00:00.694)       0:00:37.403 ***********
2026-07-06 02:24:40.752904 | mon1 | ok: [osd1]
2026-07-06 02:24:40.753291 | mon1 |
2026-07-06 02:24:40.753592 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-07-06 02:24:40.753982 | mon1 | Monday 06 July 2026  02:24:40 +0000 (0:00:00.198)       0:00:37.601 ***********
2026-07-06 02:24:40.778287 | mon1 | skipping: [osd1]
2026-07-06 02:24:40.778395 | mon1 |
2026-07-06 02:24:40.778523 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-07-06 02:24:40.778655 | mon1 | Monday 06 July 2026  02:24:40 +0000 (0:00:00.025)       0:00:37.627 ***********
2026-07-06 02:24:41.334047 | mon1 | changed: [osd1] => (item=osd0)
2026-07-06 02:24:41.334215 | mon1 | changed: [osd1] => (item=osd1)
2026-07-06 02:24:41.334422 | mon1 | changed: [osd1] => (item=osd2)
2026-07-06 02:24:41.334611 | mon1 |
2026-07-06 02:24:41.334814 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-07-06 02:24:41.335013 | mon1 | Monday 06 July 2026  02:24:41 +0000 (0:00:00.555)       0:00:38.182 ***********
2026-07-06 02:24:41.955408 | mon1 | changed: [osd1] => (item=osd0)
2026-07-06 02:24:41.955600 | mon1 | changed: [osd1] => (item=osd1)
2026-07-06 02:24:41.955815 | mon1 | changed: [osd1] => (item=osd2)
2026-07-06 02:24:41.956011 | mon1 |
2026-07-06 02:24:41.956250 | mon1 | TASK [Start loop devices] ******************************************************
2026-07-06 02:24:41.956460 | mon1 | Monday 06 July 2026  02:24:41 +0000 (0:00:00.621)       0:00:38.804 ***********
2026-07-06 02:24:42.672684 | mon1 | changed: [osd1] => (item=osd0)
2026-07-06 02:24:42.672895 | mon1 | changed: [osd1] => (item=osd1)
2026-07-06 02:24:42.673229 | mon1 | changed: [osd1] => (item=osd2)
2026-07-06 02:24:42.673444 | mon1 |
2026-07-06 02:24:42.673669 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-07-06 02:24:42.673961 | mon1 | Monday 06 July 2026  02:24:42 +0000 (0:00:00.716)       0:00:39.521 ***********
2026-07-06 02:24:45.585599 | mon1 | changed: [osd1] => (item=osd0)
2026-07-06 02:24:45.585787 | mon1 | changed: [osd1] => (item=osd1)
2026-07-06 02:24:45.586024 | mon1 | changed: [osd1] => (item=osd2)
2026-07-06 02:24:45.586251 | mon1 |
2026-07-06 02:24:45.586497 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-07-06 02:24:45.586711 | mon1 | Monday 06 July 2026  02:24:45 +0000 (0:00:02.912)       0:00:42.433 ***********
2026-07-06 02:24:47.482947 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-07-06 02:24:47.483041 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-07-06 02:24:47.483318 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-07-06 02:24:47.483329 | mon1 |
2026-07-06 02:24:47.483340 | mon1 | PLAY RECAP *********************************************************************
2026-07-06 02:24:47.483351 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-07-06 02:24:47.483406 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-07-06 02:24:47.483417 | mon1 |
2026-07-06 02:24:47.483425 | mon1 |
2026-07-06 02:24:47.483434 | mon1 | TASKS RECAP ********************************************************************
2026-07-06 02:24:47.483444 | mon1 | Monday 06 July 2026  02:24:47 +0000 (0:00:01.898)       0:00:44.331 ***********
2026-07-06 02:24:47.483463 | mon1 | ===============================================================================
2026-07-06 02:24:47.483472 | mon1 | Install depedencies ---------------------------------------------------- 25.58s
2026-07-06 02:24:47.483481 | mon1 | Update apt cache -------------------------------------------------------- 7.28s
2026-07-06 02:24:47.483490 | mon1 | Create a volume group for each loop device ------------------------------ 2.91s
2026-07-06 02:24:47.483597 | mon1 | Create a logical volume for each loop device ---------------------------- 1.90s
2026-07-06 02:24:47.483723 | mon1 | Gathering Facts --------------------------------------------------------- 1.22s
2026-07-06 02:24:47.484010 | mon1 | Start loop devices ------------------------------------------------------ 0.72s
2026-07-06 02:24:47.484015 | mon1 | Gathering Facts --------------------------------------------------------- 0.71s
2026-07-06 02:24:47.484091 | mon1 | Configure short hostname ------------------------------------------------ 0.70s
2026-07-06 02:24:47.484218 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.70s
2026-07-06 02:24:47.484346 | mon1 | Set permissions on loopback devices ------------------------------------- 0.62s
2026-07-06 02:24:47.484509 | mon1 | Start up service -------------------------------------------------------- 0.57s
2026-07-06 02:24:47.484675 | mon1 | Create devices for Ceph ------------------------------------------------- 0.56s
2026-07-06 02:24:47.484874 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.31s
2026-07-06 02:24:47.485095 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.31s
2026-07-06 02:24:47.485251 | mon1 | Get list of all loopback devices ---------------------------------------- 0.20s
2026-07-06 02:24:47.485424 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-07-06 02:24:47.565542 | mon1 | INFO     [default > prepare] Executed: Successful
2026-07-06 02:24:47.575516 | mon1 | INFO     [default > converge] Executing
2026-07-06 02:24:48.452271 | mon1 |
2026-07-06 02:24:48.452516 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-07-06 02:24:48.452728 | mon1 |
2026-07-06 02:24:48.452942 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:24:48.453300 | mon1 | Monday 06 July 2026  02:24:48 +0000 (0:00:00.045)       0:00:00.045 ***********
2026-07-06 02:24:49.492519 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-07-06 02:24:49.492607 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-07-06 02:24:49.492742 | mon1 | interpreter could change the meaning of that path. See
2026-07-06 02:24:49.492882 | mon1 | https://docs.ansible.com/ansible-
2026-07-06 02:24:49.493078 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-06 02:24:49.504829 | mon1 | ok: [mon1]
2026-07-06 02:24:49.504947 | mon1 |
2026-07-06 02:24:49.505072 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:24:49.505232 | mon1 | Monday 06 July 2026  02:24:49 +0000 (0:00:01.052)       0:00:01.098 ***********
2026-07-06 02:24:49.790742 | mon1 | ok: [mon1]
2026-07-06 02:24:49.790918 | mon1 |
2026-07-06 02:24:49.791148 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:24:49.791362 | mon1 | Monday 06 July 2026  02:24:49 +0000 (0:00:00.285)       0:00:01.384 ***********
2026-07-06 02:24:49.826715 | mon1 | skipping: [mon1]
2026-07-06 02:24:49.826925 | mon1 |
2026-07-06 02:24:49.827193 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-06 02:24:49.827417 | mon1 | Monday 06 July 2026  02:24:49 +0000 (0:00:00.036)       0:00:01.420 ***********
2026-07-06 02:24:50.133720 | mon1 | changed: [mon1]
2026-07-06 02:24:50.133950 | mon1 |
2026-07-06 02:24:50.134247 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:24:50.134522 | mon1 | Monday 06 July 2026  02:24:50 +0000 (0:00:00.306)       0:00:01.726 ***********
2026-07-06 02:24:50.244290 | mon1 | ok: [mon1] => {
2026-07-06 02:24:50.244503 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-06 02:24:50.244720 | mon1 | }
2026-07-06 02:24:50.244926 | mon1 |
2026-07-06 02:24:50.245204 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:24:50.245479 | mon1 | Monday 06 July 2026  02:24:50 +0000 (0:00:00.110)       0:00:01.837 ***********
2026-07-06 02:24:50.952004 | mon1 | changed: [mon1]
2026-07-06 02:24:50.952100 | mon1 |
2026-07-06 02:24:50.952112 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:24:50.952205 | mon1 | Monday 06 July 2026  02:24:50 +0000 (0:00:00.708)       0:00:02.545 ***********
2026-07-06 02:24:50.995820 | mon1 | skipping: [mon1]
2026-07-06 02:24:50.996000 | mon1 |
2026-07-06 02:24:50.996211 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:24:50.996412 | mon1 | Monday 06 July 2026  02:24:50 +0000 (0:00:00.043)       0:00:02.589 ***********
2026-07-06 02:24:51.038764 | mon1 | skipping: [mon1]
2026-07-06 02:24:51.038949 | mon1 |
2026-07-06 02:24:51.039159 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:24:51.039356 | mon1 | Monday 06 July 2026  02:24:51 +0000 (0:00:00.043)       0:00:02.632 ***********
2026-07-06 02:24:51.247267 | mon1 | ok: [mon1]
2026-07-06 02:24:51.247363 | mon1 |
2026-07-06 02:24:51.247531 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:24:51.247734 | mon1 | Monday 06 July 2026  02:24:51 +0000 (0:00:00.207)       0:00:02.840 ***********
2026-07-06 02:24:52.667465 | mon1 | ok: [mon1]
2026-07-06 02:24:52.667657 | mon1 |
2026-07-06 02:24:52.668013 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:24:52.668289 | mon1 | Monday 06 July 2026  02:24:52 +0000 (0:00:01.420)       0:00:04.260 ***********
2026-07-06 02:24:52.739942 | mon1 | ok: [mon1] => {
2026-07-06 02:24:52.740039 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-06 02:24:52.740117 | mon1 | }
2026-07-06 02:24:52.740205 | mon1 |
2026-07-06 02:24:52.740407 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:24:52.740537 | mon1 | Monday 06 July 2026  02:24:52 +0000 (0:00:00.073)       0:00:04.333 ***********
2026-07-06 02:24:53.738053 | mon1 | changed: [mon1]
2026-07-06 02:24:53.738138 | mon1 |
2026-07-06 02:24:53.738152 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:24:53.738285 | mon1 | Monday 06 July 2026  02:24:53 +0000 (0:00:00.998)       0:00:05.331 ***********
2026-07-06 02:24:56.670595 | mon1 | changed: [mon1]
2026-07-06 02:24:56.670702 | mon1 |
2026-07-06 02:24:56.670718 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-06 02:24:56.670789 | mon1 | Monday 06 July 2026  02:24:56 +0000 (0:00:02.932)       0:00:08.264 ***********
2026-07-06 02:24:56.705775 | mon1 | skipping: [mon1]
2026-07-06 02:24:56.705935 | mon1 |
2026-07-06 02:24:56.706076 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-06 02:24:56.706208 | mon1 | Monday 06 July 2026  02:24:56 +0000 (0:00:00.033)       0:00:08.297 ***********
2026-07-06 02:24:56.733694 | mon1 | skipping: [mon1]
2026-07-06 02:24:56.733719 | mon1 |
2026-07-06 02:24:56.733726 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-06 02:24:56.733733 | mon1 | Monday 06 July 2026  02:24:56 +0000 (0:00:00.029)       0:00:08.327 ***********
2026-07-06 02:24:56.764289 | mon1 | skipping: [mon1]
2026-07-06 02:24:56.764327 | mon1 |
2026-07-06 02:24:56.764336 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-06 02:24:56.764342 | mon1 | Monday 06 July 2026  02:24:56 +0000 (0:00:00.030)       0:00:08.357 ***********
2026-07-06 02:25:02.343193 | mon1 | changed: [mon1]
2026-07-06 02:25:02.343377 | mon1 |
2026-07-06 02:25:02.343386 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-06 02:25:02.343430 | mon1 | Monday 06 July 2026  02:25:02 +0000 (0:00:05.579)       0:00:13.936 ***********
2026-07-06 02:25:02.945149 | mon1 | changed: [mon1]
2026-07-06 02:25:02.945230 | mon1 |
2026-07-06 02:25:02.945519 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-06 02:25:02.945541 | mon1 | Monday 06 July 2026  02:25:02 +0000 (0:00:00.601)       0:00:14.538 ***********
2026-07-06 02:25:03.911428 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-07-06 02:25:03.911634 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-06 02:25:03.911643 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-06 02:25:03.912111 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-06 02:25:03.912166 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-06 02:25:03.912173 | mon1 |
2026-07-06 02:25:03.912179 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-06 02:25:03.912184 | mon1 | Monday 06 July 2026  02:25:03 +0000 (0:00:00.966)       0:00:15.505 ***********
2026-07-06 02:25:04.560465 | mon1 | changed: [mon1]
2026-07-06 02:25:04.560568 | mon1 |
2026-07-06 02:25:04.560580 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-06 02:25:04.561012 | mon1 | Monday 06 July 2026  02:25:04 +0000 (0:00:00.640)       0:00:16.145 ***********
2026-07-06 02:25:04.561106 | mon1 |
2026-07-06 02:25:04.561116 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-07-06 02:25:04.561123 | mon1 | Monday 06 July 2026  02:25:04 +0000 (0:00:00.008)       0:00:16.154 ***********
2026-07-06 02:25:05.477926 | mon1 | ok: [mon1]
2026-07-06 02:25:05.477986 | mon1 |
2026-07-06 02:25:05.477995 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-07-06 02:25:05.478002 | mon1 | Monday 06 July 2026  02:25:05 +0000 (0:00:00.917)       0:00:17.071 ***********
2026-07-06 02:25:06.230087 | mon1 | changed: [mon1]
2026-07-06 02:25:06.230216 | mon1 |
2026-07-06 02:25:06.230229 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-06 02:25:06.230356 | mon1 | Monday 06 July 2026  02:25:06 +0000 (0:00:00.752)       0:00:17.824 ***********
2026-07-06 02:25:06.746397 | mon1 | changed: [mon1]
2026-07-06 02:25:06.746492 | mon1 |
2026-07-06 02:25:06.746557 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:25:06.746691 | mon1 | Monday 06 July 2026  02:25:06 +0000 (0:00:00.516)       0:00:18.340 ***********
2026-07-06 02:25:06.965838 | mon1 | ok: [mon1]
2026-07-06 02:25:06.965921 | mon1 |
2026-07-06 02:25:06.966108 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:25:06.966160 | mon1 | Monday 06 July 2026  02:25:06 +0000 (0:00:00.219)       0:00:18.559 ***********
2026-07-06 02:25:07.043372 | mon1 | ok: [mon1] => {
2026-07-06 02:25:07.043455 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-06 02:25:07.043471 | mon1 | }
2026-07-06 02:25:07.043821 | mon1 |
2026-07-06 02:25:07.043883 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:25:07.043890 | mon1 | Monday 06 July 2026  02:25:07 +0000 (0:00:00.077)       0:00:18.636 ***********
2026-07-06 02:25:07.924436 | mon1 | changed: [mon1]
2026-07-06 02:25:07.924532 | mon1 |
2026-07-06 02:25:07.924551 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:25:07.924696 | mon1 | Monday 06 July 2026  02:25:07 +0000 (0:00:00.881)       0:00:19.518 ***********
2026-07-06 02:25:12.461172 | mon1 | changed: [mon1]
2026-07-06 02:25:12.461275 | mon1 |
2026-07-06 02:25:12.461290 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-06 02:25:12.461446 | mon1 | Monday 06 July 2026  02:25:12 +0000 (0:00:04.536)       0:00:24.054 ***********
2026-07-06 02:25:13.642128 | mon1 | ok: [mon1]
2026-07-06 02:25:13.642208 | mon1 |
2026-07-06 02:25:13.642429 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-06 02:25:13.642492 | mon1 | Monday 06 July 2026  02:25:13 +0000 (0:00:01.181)       0:00:25.235 ***********
2026-07-06 02:25:14.114873 | mon1 | changed: [mon1]
2026-07-06 02:25:14.114936 | mon1 |
2026-07-06 02:25:14.114942 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-06 02:25:14.114948 | mon1 | Monday 06 July 2026  02:25:14 +0000 (0:00:00.472)       0:00:25.708 ***********
2026-07-06 02:25:14.595841 | mon1 | changed: [mon1]
2026-07-06 02:25:14.595911 | mon1 |
2026-07-06 02:25:14.596128 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-06 02:25:14.596200 | mon1 | Monday 06 July 2026  02:25:14 +0000 (0:00:00.481)       0:00:26.189 ***********
2026-07-06 02:25:15.193590 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-07-06 02:25:15.193711 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-06 02:25:15.194349 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-06 02:25:15.194419 | mon1 |
2026-07-06 02:25:15.194426 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-06 02:25:15.194432 | mon1 | Monday 06 July 2026  02:25:15 +0000 (0:00:00.597)       0:00:26.787 ***********
2026-07-06 02:25:15.659519 | mon1 | changed: [mon1]
2026-07-06 02:25:15.659608 | mon1 |
2026-07-06 02:25:15.659622 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-06 02:25:15.659802 | mon1 | Monday 06 July 2026  02:25:15 +0000 (0:00:00.466)       0:00:27.253 ***********
2026-07-06 02:25:16.119883 | mon1 | changed: [mon1]
2026-07-06 02:25:16.119970 | mon1 |
2026-07-06 02:25:16.120026 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-06 02:25:16.120434 | mon1 | Monday 06 July 2026  02:25:16 +0000 (0:00:00.453)       0:00:27.707 ***********
2026-07-06 02:25:16.120487 | mon1 |
2026-07-06 02:25:16.120493 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-07-06 02:25:16.120511 | mon1 | Monday 06 July 2026  02:25:16 +0000 (0:00:00.006)       0:00:27.713 ***********
2026-07-06 02:25:16.786386 | mon1 | ok: [mon1]
2026-07-06 02:25:16.786467 | mon1 |
2026-07-06 02:25:16.786822 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-07-06 02:25:16.786870 | mon1 | Monday 06 July 2026  02:25:16 +0000 (0:00:00.667)       0:00:28.380 ***********
2026-07-06 02:25:18.470766 | mon1 | changed: [mon1]
2026-07-06 02:25:18.470839 | mon1 |
2026-07-06 02:25:18.471106 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-06 02:25:18.471172 | mon1 | Monday 06 July 2026  02:25:18 +0000 (0:00:01.684)       0:00:30.064 ***********
2026-07-06 02:25:19.024283 | mon1 | changed: [mon1]
2026-07-06 02:25:19.024354 | mon1 |
2026-07-06 02:25:19.024579 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-06 02:25:19.024619 | mon1 | Monday 06 July 2026  02:25:19 +0000 (0:00:00.553)       0:00:30.617 ***********
2026-07-06 02:25:19.068399 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-07-06 02:25:19.068824 | mon1 |
2026-07-06 02:25:19.068875 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-06 02:25:19.068884 | mon1 | Monday 06 July 2026  02:25:19 +0000 (0:00:00.044)       0:00:30.662 ***********
2026-07-06 02:25:53.204049 | mon1 | changed: [mon1]
2026-07-06 02:25:53.204155 | mon1 |
2026-07-06 02:25:53.204444 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-06 02:25:53.204611 | mon1 | Monday 06 July 2026  02:25:53 +0000 (0:00:34.135)       0:01:04.797 ***********
2026-07-06 02:25:53.909931 | mon1 | ok: [mon1] => (item=chronyd)
2026-07-06 02:25:53.910045 | mon1 | ok: [mon1] => (item=sshd)
2026-07-06 02:25:53.910480 | mon1 |
2026-07-06 02:25:53.910544 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-06 02:25:53.910552 | mon1 | Monday 06 July 2026  02:25:53 +0000 (0:00:00.706)       0:01:05.503 ***********
2026-07-06 02:25:54.200851 | mon1 | changed: [mon1]
2026-07-06 02:25:54.200949 | mon1 |
2026-07-06 02:25:54.200961 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-06 02:25:54.201074 | mon1 | Monday 06 July 2026  02:25:54 +0000 (0:00:00.289)       0:01:05.793 ***********
2026-07-06 02:25:54.436890 | mon1 | ok: [mon1]
2026-07-06 02:25:54.436966 | mon1 |
2026-07-06 02:25:54.437028 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-06 02:25:54.437158 | mon1 | Monday 06 July 2026  02:25:54 +0000 (0:00:00.237)       0:01:06.030 ***********
2026-07-06 02:25:56.930914 | mon1 | changed: [mon1]
2026-07-06 02:25:56.931101 | mon1 |
2026-07-06 02:25:56.931383 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-06 02:25:56.931603 | mon1 | Monday 06 July 2026  02:25:56 +0000 (0:00:02.493)       0:01:08.524 ***********
2026-07-06 02:25:57.241873 | mon1 | changed: [mon1]
2026-07-06 02:25:57.242117 | mon1 |
2026-07-06 02:25:57.242458 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-07-06 02:25:57.242692 | mon1 | Monday 06 July 2026  02:25:57 +0000 (0:00:00.310)       0:01:08.835 ***********
2026-07-06 02:25:57.348862 | mon1 | ok: [mon1]
2026-07-06 02:25:57.348961 | mon1 |
2026-07-06 02:25:57.349141 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-07-06 02:25:57.349261 | mon1 | Monday 06 July 2026  02:25:57 +0000 (0:00:00.107)       0:01:08.942 ***********
2026-07-06 02:25:57.550618 | mon1 | ok: [mon1] => (item=mon1)
2026-07-06 02:25:57.550737 | mon1 |
2026-07-06 02:25:57.550929 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-07-06 02:25:57.551144 | mon1 | Monday 06 July 2026  02:25:57 +0000 (0:00:00.201)       0:01:09.144 ***********
2026-07-06 02:25:57.594925 | mon1 | ok: [mon1]
2026-07-06 02:25:57.595130 | mon1 |
2026-07-06 02:25:57.595375 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-07-06 02:25:57.595574 | mon1 | Monday 06 July 2026  02:25:57 +0000 (0:00:00.044)       0:01:09.188 ***********
2026-07-06 02:25:57.667638 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1
2026-07-06 02:25:57.667915 | mon1 |
2026-07-06 02:25:57.668224 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-07-06 02:25:57.668518 | mon1 | Monday 06 July 2026  02:25:57 +0000 (0:00:00.072)       0:01:09.261 ***********
2026-07-06 02:25:57.954438 | mon1 | changed: [mon1]
2026-07-06 02:25:57.954499 | mon1 |
2026-07-06 02:25:57.954511 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-07-06 02:25:57.954522 | mon1 | Monday 06 July 2026  02:25:57 +0000 (0:00:00.286)       0:01:09.547 ***********
2026-07-06 02:25:58.653216 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-07-06 02:25:58.653649 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-07-06 02:25:58.653702 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-07-06 02:25:58.653719 | mon1 |
2026-07-06 02:25:58.653880 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-07-06 02:25:58.654065 | mon1 | Monday 06 July 2026  02:25:58 +0000 (0:00:00.699)       0:01:10.246 ***********
2026-07-06 02:27:42.138090 | mon1 | ok: [mon1]
2026-07-06 02:27:42.138353 | mon1 |
2026-07-06 02:27:42.138636 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-07-06 02:27:42.138896 | mon1 | Monday 06 July 2026  02:27:42 +0000 (0:01:43.484)       0:02:53.731 ***********
2026-07-06 02:27:42.358501 | mon1 | changed: [mon1]
2026-07-06 02:27:42.359563 | mon1 |
2026-07-06 02:27:42.359574 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-07-06 02:27:42.359579 | mon1 | Monday 06 July 2026  02:27:42 +0000 (0:00:00.220)       0:02:53.952 ***********
2026-07-06 02:27:42.390324 | mon1 | ok: [mon1]
2026-07-06 02:27:42.390404 | mon1 |
2026-07-06 02:27:42.390504 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-06 02:27:42.390601 | mon1 | Monday 06 July 2026  02:27:42 +0000 (0:00:00.031)       0:02:53.984 ***********
2026-07-06 02:27:42.453545 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-07-06 02:27:42.453737 | mon1 |
2026-07-06 02:27:42.454030 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-06 02:27:42.454264 | mon1 | Monday 06 July 2026  02:27:42 +0000 (0:00:00.062)       0:02:54.047 ***********
2026-07-06 02:27:47.989766 | mon1 | ok: [mon1]
2026-07-06 02:27:47.989941 | mon1 |
2026-07-06 02:27:47.989958 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-06 02:27:47.990036 | mon1 | Monday 06 July 2026  02:27:47 +0000 (0:00:05.535)       0:02:59.583 ***********
2026-07-06 02:27:48.037340 | mon1 | ok: [mon1] => (item=mon1)
2026-07-06 02:27:48.037497 | mon1 |
2026-07-06 02:27:48.037740 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-06 02:27:48.037958 | mon1 | Monday 06 July 2026  02:27:48 +0000 (0:00:00.047)       0:02:59.630 ***********
2026-07-06 02:27:48.393399 | mon1 | ok: [mon1]
2026-07-06 02:27:48.393485 | mon1 |
2026-07-06 02:27:48.393660 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-06 02:27:48.393841 | mon1 | Monday 06 July 2026  02:27:48 +0000 (0:00:00.355)       0:02:59.986 ***********
2026-07-06 02:27:54.778748 | mon1 | ok: [mon1]
2026-07-06 02:27:54.778820 | mon1 |
2026-07-06 02:27:54.778975 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-07-06 02:27:54.779106 | mon1 | Monday 06 July 2026  02:27:54 +0000 (0:00:06.386)       0:03:06.372 ***********
2026-07-06 02:28:06.472774 | mon1 | changed: [mon1]
2026-07-06 02:28:06.472997 | mon1 |
2026-07-06 02:28:06.473371 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-07-06 02:28:06.473662 | mon1 | Monday 06 July 2026  02:28:06 +0000 (0:00:11.693)       0:03:18.066 ***********
2026-07-06 02:28:20.497199 | mon1 | ok: [mon1]
2026-07-06 02:28:20.497286 | mon1 |
2026-07-06 02:28:20.497317 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-06 02:28:20.497461 | mon1 | Monday 06 July 2026  02:28:20 +0000 (0:00:14.024)       0:03:32.091 ***********
2026-07-06 02:28:20.557830 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-07-06 02:28:20.557888 | mon1 |
2026-07-06 02:28:20.558087 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-06 02:28:20.558130 | mon1 | Monday 06 July 2026  02:28:20 +0000 (0:00:00.060)       0:03:32.151 ***********
2026-07-06 02:28:20.600164 | mon1 | skipping: [mon1]
2026-07-06 02:28:20.600593 | mon1 |
2026-07-06 02:28:20.600627 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-06 02:28:20.600635 | mon1 | Monday 06 July 2026  02:28:20 +0000 (0:00:00.042)       0:03:32.193 ***********
2026-07-06 02:28:20.642124 | mon1 | skipping: [mon1] => (item=mon1)
2026-07-06 02:28:20.642191 | mon1 | skipping: [mon1]
2026-07-06 02:28:20.642283 | mon1 |
2026-07-06 02:28:20.642512 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-06 02:28:20.642556 | mon1 | Monday 06 July 2026  02:28:20 +0000 (0:00:00.042)       0:03:32.236 ***********
2026-07-06 02:28:20.878870 | mon1 | ok: [mon1]
2026-07-06 02:28:20.878942 | mon1 |
2026-07-06 02:28:20.879021 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-06 02:28:20.879155 | mon1 | Monday 06 July 2026  02:28:20 +0000 (0:00:00.236)       0:03:32.472 ***********
2026-07-06 02:28:27.279265 | mon1 | ok: [mon1]
2026-07-06 02:28:27.279378 | mon1 |
2026-07-06 02:28:27.279391 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-07-06 02:28:27.279529 | mon1 | Monday 06 July 2026  02:28:27 +0000 (0:00:06.400)       0:03:38.873 ***********
2026-07-06 02:28:38.955838 | mon1 | changed: [mon1]
2026-07-06 02:28:38.955920 | mon1 |
2026-07-06 02:28:38.956111 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-07-06 02:28:38.956159 | mon1 | Monday 06 July 2026  02:28:38 +0000 (0:00:11.676)       0:03:50.549 ***********
2026-07-06 02:28:45.359018 | mon1 | ok: [mon1]
2026-07-06 02:28:45.359118 | mon1 |
2026-07-06 02:28:45.359458 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-07-06 02:28:45.359508 | mon1 | Monday 06 July 2026  02:28:45 +0000 (0:00:06.403)       0:03:56.952 ***********
2026-07-06 02:28:51.748176 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'})
2026-07-06 02:28:51.748263 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-07-06 02:28:51.748280 | mon1 | changed: [mon1] => (item={'name': 'prometheus'})
2026-07-06 02:28:51.748410 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-07-06 02:28:51.748493 | mon1 |
2026-07-06 02:28:51.748626 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-07-06 02:28:51.748727 | mon1 |
2026-07-06 02:28:51.748815 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:28:51.748911 | mon1 | Monday 06 July 2026  02:28:51 +0000 (0:00:06.389)       0:04:03.342 ***********
2026-07-06 02:28:52.840518 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-07-06 02:28:52.840650 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-07-06 02:28:52.840810 | mon1 | interpreter could change the meaning of that path. See
2026-07-06 02:28:52.840970 | mon1 | https://docs.ansible.com/ansible-
2026-07-06 02:28:52.841154 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-06 02:28:52.851568 | mon1 | ok: [osd1]
2026-07-06 02:28:52.851689 | mon1 |
2026-07-06 02:28:52.851874 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:28:52.852019 | mon1 | Monday 06 July 2026  02:28:52 +0000 (0:00:01.103)       0:04:04.445 ***********
2026-07-06 02:28:53.061680 | mon1 | ok: [osd1]
2026-07-06 02:28:53.061737 | mon1 |
2026-07-06 02:28:53.061839 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:28:53.061938 | mon1 | Monday 06 July 2026  02:28:53 +0000 (0:00:00.210)       0:04:04.655 ***********
2026-07-06 02:28:53.092606 | mon1 | skipping: [osd1]
2026-07-06 02:28:53.092673 | mon1 |
2026-07-06 02:28:53.092750 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-06 02:28:53.092842 | mon1 | Monday 06 July 2026  02:28:53 +0000 (0:00:00.031)       0:04:04.686 ***********
2026-07-06 02:28:53.304981 | mon1 | changed: [osd1]
2026-07-06 02:28:53.305102 | mon1 |
2026-07-06 02:28:53.305120 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:28:53.305277 | mon1 | Monday 06 July 2026  02:28:53 +0000 (0:00:00.212)       0:04:04.898 ***********
2026-07-06 02:28:53.356929 | mon1 | ok: [osd1] => {
2026-07-06 02:28:53.357088 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-06 02:28:53.357286 | mon1 | }
2026-07-06 02:28:53.357406 | mon1 |
2026-07-06 02:28:53.357532 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:28:53.357663 | mon1 | Monday 06 July 2026  02:28:53 +0000 (0:00:00.051)       0:04:04.950 ***********
2026-07-06 02:28:53.838296 | mon1 | changed: [osd1]
2026-07-06 02:28:53.838445 | mon1 |
2026-07-06 02:28:53.838685 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:28:53.838856 | mon1 | Monday 06 July 2026  02:28:53 +0000 (0:00:00.481)       0:04:05.432 ***********
2026-07-06 02:28:53.869544 | mon1 | skipping: [osd1]
2026-07-06 02:28:53.869654 | mon1 |
2026-07-06 02:28:53.869781 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:28:53.869906 | mon1 | Monday 06 July 2026  02:28:53 +0000 (0:00:00.031)       0:04:05.463 ***********
2026-07-06 02:28:53.908027 | mon1 | skipping: [osd1]
2026-07-06 02:28:53.908096 | mon1 |
2026-07-06 02:28:53.908238 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:28:53.908352 | mon1 | Monday 06 July 2026  02:28:53 +0000 (0:00:00.038)       0:04:05.502 ***********
2026-07-06 02:28:54.103400 | mon1 | ok: [osd1]
2026-07-06 02:28:54.103465 | mon1 |
2026-07-06 02:28:54.103547 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:28:54.103645 | mon1 | Monday 06 July 2026  02:28:54 +0000 (0:00:00.195)       0:04:05.697 ***********
2026-07-06 02:28:55.153756 | mon1 | ok: [osd1]
2026-07-06 02:28:55.153824 | mon1 |
2026-07-06 02:28:55.153916 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:28:55.153994 | mon1 | Monday 06 July 2026  02:28:55 +0000 (0:00:01.050)       0:04:06.747 ***********
2026-07-06 02:28:55.208610 | mon1 | ok: [osd1] => {
2026-07-06 02:28:55.208681 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-06 02:28:55.208724 | mon1 | }
2026-07-06 02:28:55.208816 | mon1 |
2026-07-06 02:28:55.209018 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:28:55.209101 | mon1 | Monday 06 July 2026  02:28:55 +0000 (0:00:00.055)       0:04:06.802 ***********
2026-07-06 02:28:55.863886 | mon1 | changed: [osd1]
2026-07-06 02:28:55.863982 | mon1 |
2026-07-06 02:28:55.864135 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:28:55.864288 | mon1 | Monday 06 July 2026  02:28:55 +0000 (0:00:00.654)       0:04:07.457 ***********
2026-07-06 02:28:58.492831 | mon1 | changed: [osd1]
2026-07-06 02:28:58.492876 | mon1 |
2026-07-06 02:28:58.492884 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-06 02:28:58.492890 | mon1 | Monday 06 July 2026  02:28:58 +0000 (0:00:02.626)       0:04:10.083 ***********
2026-07-06 02:28:58.517693 | mon1 | skipping: [osd1]
2026-07-06 02:28:58.517736 | mon1 |
2026-07-06 02:28:58.517744 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-06 02:28:58.517751 | mon1 | Monday 06 July 2026  02:28:58 +0000 (0:00:00.027)       0:04:10.111 ***********
2026-07-06 02:28:58.543194 | mon1 | skipping: [osd1]
2026-07-06 02:28:58.543231 | mon1 |
2026-07-06 02:28:58.543236 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-06 02:28:58.543241 | mon1 | Monday 06 July 2026  02:28:58 +0000 (0:00:00.025)       0:04:10.136 ***********
2026-07-06 02:28:58.573234 | mon1 | skipping: [osd1]
2026-07-06 02:28:58.573285 | mon1 |
2026-07-06 02:28:58.573293 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-06 02:28:58.573300 | mon1 | Monday 06 July 2026  02:28:58 +0000 (0:00:00.029)       0:04:10.166 ***********
2026-07-06 02:29:03.834618 | mon1 | changed: [osd1]
2026-07-06 02:29:03.834689 | mon1 |
2026-07-06 02:29:03.834884 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-06 02:29:03.834924 | mon1 | Monday 06 July 2026  02:29:03 +0000 (0:00:05.262)       0:04:15.428 ***********
2026-07-06 02:29:04.305283 | mon1 | changed: [osd1]
2026-07-06 02:29:04.305363 | mon1 |
2026-07-06 02:29:04.305602 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-06 02:29:04.305622 | mon1 | Monday 06 July 2026  02:29:04 +0000 (0:00:00.470)       0:04:15.899 ***********
2026-07-06 02:29:05.251260 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'})
2026-07-06 02:29:05.251311 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-06 02:29:05.251322 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-06 02:29:05.251330 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-06 02:29:05.251339 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-06 02:29:05.251347 | mon1 |
2026-07-06 02:29:05.251355 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-06 02:29:05.251363 | mon1 | Monday 06 July 2026  02:29:05 +0000 (0:00:00.944)       0:04:16.843 ***********
2026-07-06 02:29:05.770056 | mon1 | changed: [osd1]
2026-07-06 02:29:05.771005 | mon1 |
2026-07-06 02:29:05.771040 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-06 02:29:05.771055 | mon1 | Monday 06 July 2026  02:29:05 +0000 (0:00:00.509)       0:04:17.352 ***********
2026-07-06 02:29:05.771349 | mon1 |
2026-07-06 02:29:05.771715 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-07-06 02:29:05.771734 | mon1 | Monday 06 July 2026  02:29:05 +0000 (0:00:00.010)       0:04:17.363 ***********
2026-07-06 02:29:06.431742 | mon1 | ok: [osd1]
2026-07-06 02:29:06.431785 | mon1 |
2026-07-06 02:29:06.431791 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-07-06 02:29:06.431802 | mon1 | Monday 06 July 2026  02:29:06 +0000 (0:00:00.662)       0:04:18.025 ***********
2026-07-06 02:29:06.866605 | mon1 | changed: [osd1]
2026-07-06 02:29:06.866647 | mon1 |
2026-07-06 02:29:06.866653 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-06 02:29:06.866657 | mon1 | Monday 06 July 2026  02:29:06 +0000 (0:00:00.434)       0:04:18.460 ***********
2026-07-06 02:29:07.368537 | mon1 | changed: [osd1]
2026-07-06 02:29:07.368593 | mon1 |
2026-07-06 02:29:07.368700 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:29:07.368836 | mon1 | Monday 06 July 2026  02:29:07 +0000 (0:00:00.502)       0:04:18.962 ***********
2026-07-06 02:29:07.556816 | mon1 | ok: [osd1]
2026-07-06 02:29:07.556882 | mon1 |
2026-07-06 02:29:07.556902 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:29:07.557009 | mon1 | Monday 06 July 2026  02:29:07 +0000 (0:00:00.188)       0:04:19.150 ***********
2026-07-06 02:29:07.615350 | mon1 | ok: [osd1] => {
2026-07-06 02:29:07.615979 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-06 02:29:07.616047 | mon1 | }
2026-07-06 02:29:07.616059 | mon1 |
2026-07-06 02:29:07.616069 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:29:07.616086 | mon1 | Monday 06 July 2026  02:29:07 +0000 (0:00:00.057)       0:04:19.208 ***********
2026-07-06 02:29:08.429974 | mon1 | changed: [osd1]
2026-07-06 02:29:08.430049 | mon1 |
2026-07-06 02:29:08.430404 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:29:08.430453 | mon1 | Monday 06 July 2026  02:29:08 +0000 (0:00:00.815)       0:04:20.023 ***********
2026-07-06 02:29:12.809983 | mon1 | changed: [osd1]
2026-07-06 02:29:12.810063 | mon1 |
2026-07-06 02:29:12.810381 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-06 02:29:12.810435 | mon1 | Monday 06 July 2026  02:29:12 +0000 (0:00:04.379)       0:04:24.403 ***********
2026-07-06 02:29:13.793382 | mon1 | ok: [osd1]
2026-07-06 02:29:13.793473 | mon1 |
2026-07-06 02:29:13.793536 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-06 02:29:13.793643 | mon1 | Monday 06 July 2026  02:29:13 +0000 (0:00:00.983)       0:04:25.387 ***********
2026-07-06 02:29:14.013556 | mon1 | changed: [osd1]
2026-07-06 02:29:14.013672 | mon1 |
2026-07-06 02:29:14.013826 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-06 02:29:14.014004 | mon1 | Monday 06 July 2026  02:29:14 +0000 (0:00:00.220)       0:04:25.607 ***********
2026-07-06 02:29:14.471623 | mon1 | changed: [osd1]
2026-07-06 02:29:14.471713 | mon1 |
2026-07-06 02:29:14.471862 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-06 02:29:14.472003 | mon1 | Monday 06 July 2026  02:29:14 +0000 (0:00:00.458)       0:04:26.065 ***********
2026-07-06 02:29:15.035806 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'})
2026-07-06 02:29:15.035849 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-06 02:29:15.035855 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-06 02:29:15.035860 | mon1 |
2026-07-06 02:29:15.035864 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-06 02:29:15.035868 | mon1 | Monday 06 July 2026  02:29:15 +0000 (0:00:00.563)       0:04:26.629 ***********
2026-07-06 02:29:15.492387 | mon1 | changed: [osd1]
2026-07-06 02:29:15.492448 | mon1 |
2026-07-06 02:29:15.492545 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-06 02:29:15.492644 | mon1 | Monday 06 July 2026  02:29:15 +0000 (0:00:00.457)       0:04:27.086 ***********
2026-07-06 02:29:15.934318 | mon1 | changed: [osd1]
2026-07-06 02:29:15.934374 | mon1 |
2026-07-06 02:29:15.934460 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-06 02:29:15.934824 | mon1 | Monday 06 July 2026  02:29:15 +0000 (0:00:00.435)       0:04:27.521 ***********
2026-07-06 02:29:15.934867 | mon1 |
2026-07-06 02:29:15.934873 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-07-06 02:29:15.934877 | mon1 | Monday 06 July 2026  02:29:15 +0000 (0:00:00.006)       0:04:27.528 ***********
2026-07-06 02:29:16.596121 | mon1 | ok: [osd1]
2026-07-06 02:29:16.596212 | mon1 |
2026-07-06 02:29:16.596592 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-07-06 02:29:16.596671 | mon1 | Monday 06 July 2026  02:29:16 +0000 (0:00:00.661)       0:04:28.189 ***********
2026-07-06 02:29:17.914423 | mon1 | changed: [osd1]
2026-07-06 02:29:17.914554 | mon1 |
2026-07-06 02:29:17.914602 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-06 02:29:17.914793 | mon1 | Monday 06 July 2026  02:29:17 +0000 (0:00:01.318)       0:04:29.508 ***********
2026-07-06 02:29:18.456338 | mon1 | changed: [osd1]
2026-07-06 02:29:18.456416 | mon1 |
2026-07-06 02:29:18.456428 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-06 02:29:18.456571 | mon1 | Monday 06 July 2026  02:29:18 +0000 (0:00:00.542)       0:04:30.050 ***********
2026-07-06 02:29:18.501072 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-07-06 02:29:18.501506 | mon1 |
2026-07-06 02:29:18.501553 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-06 02:29:18.501561 | mon1 | Monday 06 July 2026  02:29:18 +0000 (0:00:00.044)       0:04:30.094 ***********
2026-07-06 02:29:23.461236 | mon1 | changed: [osd1]
2026-07-06 02:29:23.461413 | mon1 |
2026-07-06 02:29:23.461540 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-06 02:29:23.461654 | mon1 | Monday 06 July 2026  02:29:23 +0000 (0:00:04.959)       0:04:35.054 ***********
2026-07-06 02:29:24.126331 | mon1 | ok: [osd1] => (item=chronyd)
2026-07-06 02:29:24.126545 | mon1 | ok: [osd1] => (item=sshd)
2026-07-06 02:29:24.126773 | mon1 |
2026-07-06 02:29:24.127079 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-06 02:29:24.127304 | mon1 | Monday 06 July 2026  02:29:24 +0000 (0:00:00.664)       0:04:35.719 ***********
2026-07-06 02:29:24.712675 | mon1 | changed: [osd1]
2026-07-06 02:29:24.712824 | mon1 |
2026-07-06 02:29:24.713078 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-06 02:29:24.713315 | mon1 | Monday 06 July 2026  02:29:24 +0000 (0:00:00.586)       0:04:36.306 ***********
2026-07-06 02:29:24.904328 | mon1 | ok: [osd1]
2026-07-06 02:29:24.904496 | mon1 |
2026-07-06 02:29:24.904718 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-06 02:29:24.905543 | mon1 | Monday 06 July 2026  02:29:24 +0000 (0:00:00.191)       0:04:36.497 ***********
2026-07-06 02:29:25.199188 | mon1 | changed: [osd1]
2026-07-06 02:29:25.199325 | mon1 |
2026-07-06 02:29:25.199485 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-06 02:29:25.199749 | mon1 | Monday 06 July 2026  02:29:25 +0000 (0:00:00.294)       0:04:36.792 ***********
2026-07-06 02:29:25.411828 | mon1 | changed: [osd1]
2026-07-06 02:29:25.412020 | mon1 |
2026-07-06 02:29:25.412259 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-07-06 02:29:25.412573 | mon1 | Monday 06 July 2026  02:29:25 +0000 (0:00:00.212)       0:04:37.005 ***********
2026-07-06 02:29:25.632288 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-07-06 02:29:25.632517 | mon1 |
2026-07-06 02:29:25.632785 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-07-06 02:29:25.633040 | mon1 | Monday 06 July 2026  02:29:25 +0000 (0:00:00.220)       0:04:37.226 ***********
2026-07-06 02:29:25.678374 | mon1 | ok: [osd1]
2026-07-06 02:29:25.678584 | mon1 |
2026-07-06 02:29:25.678816 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-06 02:29:25.679133 | mon1 | Monday 06 July 2026  02:29:25 +0000 (0:00:00.046)       0:04:37.272 ***********
2026-07-06 02:29:25.733266 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-07-06 02:29:25.733339 | mon1 |
2026-07-06 02:29:25.733352 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-06 02:29:25.733514 | mon1 | Monday 06 July 2026  02:29:25 +0000 (0:00:00.054)       0:04:37.326 ***********
2026-07-06 02:29:34.649946 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:29:34.650055 | mon1 |
2026-07-06 02:29:34.650439 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-06 02:29:34.650492 | mon1 | Monday 06 July 2026  02:29:34 +0000 (0:00:08.917)       0:04:46.243 ***********
2026-07-06 02:29:34.690931 | mon1 | ok: [osd1] => (item=osd1)
2026-07-06 02:29:34.690998 | mon1 |
2026-07-06 02:29:34.691205 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-06 02:29:34.691249 | mon1 | Monday 06 July 2026  02:29:34 +0000 (0:00:00.041)       0:04:46.284 ***********
2026-07-06 02:29:34.942481 | mon1 | changed: [osd1]
2026-07-06 02:29:34.942546 | mon1 |
2026-07-06 02:29:34.942754 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-06 02:29:34.942771 | mon1 | Monday 06 July 2026  02:29:34 +0000 (0:00:00.251)       0:04:46.536 ***********
2026-07-06 02:29:44.043129 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:29:44.043211 | mon1 |
2026-07-06 02:29:44.043403 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-07-06 02:29:44.043418 | mon1 | Monday 06 July 2026  02:29:44 +0000 (0:00:09.100)       0:04:55.637 ***********
2026-07-06 02:29:45.570572 | mon1 | ok: [osd1]
2026-07-06 02:29:45.570638 | mon1 |
2026-07-06 02:29:45.570729 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-07-06 02:29:45.570864 | mon1 | Monday 06 July 2026  02:29:45 +0000 (0:00:01.527)       0:04:57.164 ***********
2026-07-06 02:33:05.322986 | mon1 | ok: [osd1]
2026-07-06 02:33:05.323077 | mon1 |
2026-07-06 02:33:05.323374 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-07-06 02:33:05.323425 | mon1 | Monday 06 July 2026  02:33:05 +0000 (0:03:19.752)       0:08:16.916 ***********
2026-07-06 02:34:48.130041 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data)
2026-07-06 02:34:48.130172 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data)
2026-07-06 02:34:48.130698 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data)
2026-07-06 02:34:48.130719 | mon1 |
2026-07-06 02:34:48.130727 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-07-06 02:34:48.130733 | mon1 | Monday 06 July 2026  02:34:48 +0000 (0:01:42.806)       0:09:59.723 ***********
2026-07-06 02:34:54.338917 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:34:54.338970 | mon1 |
2026-07-06 02:34:54.338977 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-07-06 02:34:54.338984 | mon1 | Monday 06 July 2026  02:34:54 +0000 (0:00:06.208)       0:10:05.932 ***********
2026-07-06 02:35:00.393184 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:35:00.393253 | mon1 |
2026-07-06 02:35:00.393269 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-07-06 02:35:00.393291 | mon1 | Monday 06 July 2026  02:35:00 +0000 (0:00:06.054)       0:10:11.986 ***********
2026-07-06 02:35:00.446815 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-07-06 02:35:00.446883 | mon1 |
2026-07-06 02:35:00.447163 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-07-06 02:35:00.447212 | mon1 | Monday 06 July 2026  02:35:00 +0000 (0:00:00.053)       0:10:12.040 ***********
2026-07-06 02:35:00.479682 | mon1 | ok: [osd1]
2026-07-06 02:35:00.480114 | mon1 |
2026-07-06 02:35:00.480147 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-07-06 02:35:00.480155 | mon1 | Monday 06 July 2026  02:35:00 +0000 (0:00:00.032)       0:10:12.073 ***********
2026-07-06 02:35:06.452241 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:35:06.452355 | mon1 |
2026-07-06 02:35:06.452643 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-07-06 02:35:06.452690 | mon1 | Monday 06 July 2026  02:35:06 +0000 (0:00:05.972)       0:10:18.046 ***********
2026-07-06 02:35:06.492427 | mon1 | ok: [osd1]
2026-07-06 02:35:06.492544 | mon1 |
2026-07-06 02:35:06.492887 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-07-06 02:35:06.492932 | mon1 | Monday 06 July 2026  02:35:06 +0000 (0:00:00.039)       0:10:18.085 ***********
2026-07-06 02:35:06.534670 | mon1 | skipping: [osd1] => (item=1)
2026-07-06 02:35:06.534735 | mon1 | skipping: [osd1] => (item=1)
2026-07-06 02:35:06.535258 | mon1 | skipping: [osd1] => (item=1)
2026-07-06 02:35:06.535302 | mon1 | skipping: [osd1]
2026-07-06 02:35:06.535308 | mon1 |
2026-07-06 02:35:06.535313 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-07-06 02:35:06.535318 | mon1 | Monday 06 July 2026  02:35:06 +0000 (0:00:00.042)       0:10:18.128 ***********
2026-07-06 02:35:06.593822 | mon1 | skipping: [osd1]
2026-07-06 02:35:06.593857 | mon1 |
2026-07-06 02:35:06.593862 | mon1 | PLAY [Deploy Ceph exporters] ***************************************************
2026-07-06 02:35:06.593867 | mon1 |
2026-07-06 02:35:06.593871 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:35:06.593875 | mon1 | Monday 06 July 2026  02:35:06 +0000 (0:00:00.058)       0:10:18.187 ***********
2026-07-06 02:35:07.435045 | mon1 | ok: [mon1]
2026-07-06 02:35:07.435089 | mon1 |
2026-07-06 02:35:07.435096 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:35:07.435103 | mon1 | Monday 06 July 2026  02:35:07 +0000 (0:00:00.841)       0:10:19.028 ***********
2026-07-06 02:35:07.637820 | mon1 | ok: [mon1]
2026-07-06 02:35:07.637900 | mon1 |
2026-07-06 02:35:07.638110 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:35:07.638152 | mon1 | Monday 06 July 2026  02:35:07 +0000 (0:00:00.203)       0:10:19.231 ***********
2026-07-06 02:35:07.676378 | mon1 | skipping: [mon1]
2026-07-06 02:35:07.676468 | mon1 |
2026-07-06 02:35:07.676764 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-06 02:35:07.676866 | mon1 | Monday 06 July 2026  02:35:07 +0000 (0:00:00.038)       0:10:19.270 ***********
2026-07-06 02:35:07.873146 | mon1 | ok: [mon1]
2026-07-06 02:35:07.873213 | mon1 |
2026-07-06 02:35:07.873407 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:35:07.873453 | mon1 | Monday 06 July 2026  02:35:07 +0000 (0:00:00.196)       0:10:19.467 ***********
2026-07-06 02:35:07.922594 | mon1 | ok: [mon1] => {
2026-07-06 02:35:07.922666 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-06 02:35:07.923049 | mon1 | }
2026-07-06 02:35:07.923092 | mon1 |
2026-07-06 02:35:07.923097 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:35:07.923102 | mon1 | Monday 06 July 2026  02:35:07 +0000 (0:00:00.049)       0:10:19.516 ***********
2026-07-06 02:35:08.223470 | mon1 | ok: [mon1]
2026-07-06 02:35:08.223563 | mon1 |
2026-07-06 02:35:08.223915 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:35:08.223963 | mon1 | Monday 06 July 2026  02:35:08 +0000 (0:00:00.300)       0:10:19.817 ***********
2026-07-06 02:35:08.261959 | mon1 | skipping: [mon1]
2026-07-06 02:35:08.262333 | mon1 |
2026-07-06 02:35:08.262377 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:35:08.262383 | mon1 | Monday 06 July 2026  02:35:08 +0000 (0:00:00.038)       0:10:19.855 ***********
2026-07-06 02:35:08.295611 | mon1 | skipping: [mon1]
2026-07-06 02:35:08.295680 | mon1 |
2026-07-06 02:35:08.295866 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:35:08.295905 | mon1 | Monday 06 July 2026  02:35:08 +0000 (0:00:00.033)       0:10:19.889 ***********
2026-07-06 02:35:08.496106 | mon1 | ok: [mon1]
2026-07-06 02:35:08.496177 | mon1 |
2026-07-06 02:35:08.496383 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:35:08.496420 | mon1 | Monday 06 July 2026  02:35:08 +0000 (0:00:00.200)       0:10:20.090 ***********
2026-07-06 02:35:09.573007 | mon1 | ok: [mon1]
2026-07-06 02:35:09.573116 | mon1 |
2026-07-06 02:35:09.573354 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:35:09.573397 | mon1 | Monday 06 July 2026  02:35:09 +0000 (0:00:01.076)       0:10:21.167 ***********
2026-07-06 02:35:09.635604 | mon1 | ok: [mon1] => {
2026-07-06 02:35:09.635676 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-06 02:35:09.636048 | mon1 | }
2026-07-06 02:35:09.636092 | mon1 |
2026-07-06 02:35:09.636097 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:35:09.636103 | mon1 | Monday 06 July 2026  02:35:09 +0000 (0:00:00.062)       0:10:21.229 ***********
2026-07-06 02:35:09.963077 | mon1 | ok: [mon1]
2026-07-06 02:35:09.963503 | mon1 |
2026-07-06 02:35:09.963552 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:35:09.963560 | mon1 | Monday 06 July 2026  02:35:09 +0000 (0:00:00.326)       0:10:21.556 ***********
2026-07-06 02:35:11.870356 | mon1 | ok: [mon1]
2026-07-06 02:35:11.870411 | mon1 |
2026-07-06 02:35:11.870519 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-06 02:35:11.870630 | mon1 | Monday 06 July 2026  02:35:11 +0000 (0:00:01.908)       0:10:23.464 ***********
2026-07-06 02:35:11.897703 | mon1 | skipping: [mon1]
2026-07-06 02:35:11.897777 | mon1 |
2026-07-06 02:35:11.897921 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-06 02:35:11.898125 | mon1 | Monday 06 July 2026  02:35:11 +0000 (0:00:00.027)       0:10:23.491 ***********
2026-07-06 02:35:11.923026 | mon1 | skipping: [mon1]
2026-07-06 02:35:11.923142 | mon1 |
2026-07-06 02:35:11.923468 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-06 02:35:11.923518 | mon1 | Monday 06 July 2026  02:35:11 +0000 (0:00:00.024)       0:10:23.516 ***********
2026-07-06 02:35:11.949928 | mon1 | skipping: [mon1]
2026-07-06 02:35:11.950320 | mon1 |
2026-07-06 02:35:11.950359 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-06 02:35:11.950367 | mon1 | Monday 06 July 2026  02:35:11 +0000 (0:00:00.026)       0:10:23.543 ***********
2026-07-06 02:35:13.023998 | mon1 | ok: [mon1]
2026-07-06 02:35:13.024074 | mon1 |
2026-07-06 02:35:13.024409 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-06 02:35:13.024458 | mon1 | Monday 06 July 2026  02:35:13 +0000 (0:00:01.074)       0:10:24.617 ***********
2026-07-06 02:35:13.462892 | mon1 | ok: [mon1]
2026-07-06 02:35:13.462936 | mon1 |
2026-07-06 02:35:13.462946 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-06 02:35:13.462951 | mon1 | Monday 06 July 2026  02:35:13 +0000 (0:00:00.438)       0:10:25.056 ***********
2026-07-06 02:35:14.373941 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-07-06 02:35:14.374109 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-06 02:35:14.375018 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-06 02:35:14.375067 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-06 02:35:14.375075 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-06 02:35:14.375082 | mon1 |
2026-07-06 02:35:14.375088 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-06 02:35:14.375094 | mon1 | Monday 06 July 2026  02:35:14 +0000 (0:00:00.911)       0:10:25.967 ***********
2026-07-06 02:35:14.881984 | mon1 | ok: [mon1]
2026-07-06 02:35:14.882063 | mon1 |
2026-07-06 02:35:14.882118 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-06 02:35:14.882515 | mon1 | Monday 06 July 2026  02:35:14 +0000 (0:00:00.503)       0:10:26.471 ***********
2026-07-06 02:35:14.882555 | mon1 |
2026-07-06 02:35:14.882561 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-06 02:35:14.882566 | mon1 | Monday 06 July 2026  02:35:14 +0000 (0:00:00.004)       0:10:26.475 ***********
2026-07-06 02:35:15.242636 | mon1 | ok: [mon1]
2026-07-06 02:35:15.242709 | mon1 |
2026-07-06 02:35:15.242799 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:35:15.242939 | mon1 | Monday 06 July 2026  02:35:15 +0000 (0:00:00.360)       0:10:26.836 ***********
2026-07-06 02:35:15.445400 | mon1 | ok: [mon1]
2026-07-06 02:35:15.445459 | mon1 |
2026-07-06 02:35:15.445556 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:35:15.445662 | mon1 | Monday 06 July 2026  02:35:15 +0000 (0:00:00.202)       0:10:27.039 ***********
2026-07-06 02:35:15.500138 | mon1 | ok: [mon1] => {
2026-07-06 02:35:15.501126 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-06 02:35:15.501197 | mon1 | }
2026-07-06 02:35:15.501209 | mon1 |
2026-07-06 02:35:15.501444 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:35:15.501609 | mon1 | Monday 06 July 2026  02:35:15 +0000 (0:00:00.054)       0:10:27.093 ***********
2026-07-06 02:35:15.841535 | mon1 | ok: [mon1]
2026-07-06 02:35:15.841605 | mon1 |
2026-07-06 02:35:15.841689 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:35:15.841819 | mon1 | Monday 06 July 2026  02:35:15 +0000 (0:00:00.342)       0:10:27.435 ***********
2026-07-06 02:35:18.923850 | mon1 | ok: [mon1]
2026-07-06 02:35:18.923893 | mon1 |
2026-07-06 02:35:18.923899 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-06 02:35:18.923903 | mon1 | Monday 06 July 2026  02:35:18 +0000 (0:00:03.081)       0:10:30.517 ***********
2026-07-06 02:35:20.007541 | mon1 | ok: [mon1]
2026-07-06 02:35:20.007980 | mon1 |
2026-07-06 02:35:20.008031 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-06 02:35:20.008039 | mon1 | Monday 06 July 2026  02:35:20 +0000 (0:00:01.084)       0:10:31.601 ***********
2026-07-06 02:35:20.206196 | mon1 | ok: [mon1]
2026-07-06 02:35:20.206267 | mon1 |
2026-07-06 02:35:20.206359 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-06 02:35:20.206497 | mon1 | Monday 06 July 2026  02:35:20 +0000 (0:00:00.198)       0:10:31.799 ***********
2026-07-06 02:35:20.637348 | mon1 | ok: [mon1]
2026-07-06 02:35:20.637422 | mon1 |
2026-07-06 02:35:20.637764 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-06 02:35:20.637812 | mon1 | Monday 06 July 2026  02:35:20 +0000 (0:00:00.431)       0:10:32.231 ***********
2026-07-06 02:35:21.189325 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-07-06 02:35:21.190034 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-06 02:35:21.190080 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-06 02:35:21.190088 | mon1 |
2026-07-06 02:35:21.190094 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-06 02:35:21.190100 | mon1 | Monday 06 July 2026  02:35:21 +0000 (0:00:00.552)       0:10:32.783 ***********
2026-07-06 02:35:21.627994 | mon1 | ok: [mon1]
2026-07-06 02:35:21.628044 | mon1 |
2026-07-06 02:35:21.628051 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-06 02:35:21.628058 | mon1 | Monday 06 July 2026  02:35:21 +0000 (0:00:00.438)       0:10:33.221 ***********
2026-07-06 02:35:22.051444 | mon1 | ok: [mon1]
2026-07-06 02:35:22.051568 | mon1 |
2026-07-06 02:35:22.051580 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-06 02:35:22.051999 | mon1 | Monday 06 July 2026  02:35:22 +0000 (0:00:00.419)       0:10:33.640 ***********
2026-07-06 02:35:22.052054 | mon1 |
2026-07-06 02:35:22.052060 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-06 02:35:22.052065 | mon1 | Monday 06 July 2026  02:35:22 +0000 (0:00:00.004)       0:10:33.645 ***********
2026-07-06 02:35:22.407026 | mon1 | ok: [mon1]
2026-07-06 02:35:22.407634 | mon1 |
2026-07-06 02:35:22.407686 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-06 02:35:22.407694 | mon1 | Monday 06 July 2026  02:35:22 +0000 (0:00:00.355)       0:10:34.000 ***********
2026-07-06 02:35:22.456477 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-07-06 02:35:22.456887 | mon1 |
2026-07-06 02:35:22.456913 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-06 02:35:22.456921 | mon1 | Monday 06 July 2026  02:35:22 +0000 (0:00:00.049)       0:10:34.050 ***********
2026-07-06 02:35:23.506046 | mon1 | ok: [mon1]
2026-07-06 02:35:23.506120 | mon1 |
2026-07-06 02:35:23.506203 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-06 02:35:23.506334 | mon1 | Monday 06 July 2026  02:35:23 +0000 (0:00:01.049)       0:10:35.100 ***********
2026-07-06 02:35:24.179582 | mon1 | ok: [mon1] => (item=chronyd)
2026-07-06 02:35:24.179868 | mon1 | ok: [mon1] => (item=sshd)
2026-07-06 02:35:24.179882 | mon1 |
2026-07-06 02:35:24.180129 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-06 02:35:24.180182 | mon1 | Monday 06 July 2026  02:35:24 +0000 (0:00:00.673)       0:10:35.773 ***********
2026-07-06 02:35:24.862862 | mon1 | ok: [mon1]
2026-07-06 02:35:24.862929 | mon1 |
2026-07-06 02:35:24.863028 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-06 02:35:24.863161 | mon1 | Monday 06 July 2026  02:35:24 +0000 (0:00:00.683)       0:10:36.456 ***********
2026-07-06 02:35:25.057140 | mon1 | ok: [mon1]
2026-07-06 02:35:25.057206 | mon1 |
2026-07-06 02:35:25.057432 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-06 02:35:25.057476 | mon1 | Monday 06 July 2026  02:35:25 +0000 (0:00:00.194)       0:10:36.651 ***********
2026-07-06 02:35:25.294089 | mon1 | ok: [mon1]
2026-07-06 02:35:25.294170 | mon1 |
2026-07-06 02:35:25.294414 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-06 02:35:25.294539 | mon1 | Monday 06 July 2026  02:35:25 +0000 (0:00:00.236)       0:10:36.887 ***********
2026-07-06 02:35:25.503382 | mon1 | ok: [mon1]
2026-07-06 02:35:25.503504 | mon1 |
2026-07-06 02:35:25.503517 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] ***********
2026-07-06 02:35:25.503583 | mon1 | Monday 06 July 2026  02:35:25 +0000 (0:00:00.209)       0:10:37.097 ***********
2026-07-06 02:35:37.382806 | mon1 | changed: [mon1]
2026-07-06 02:35:37.382902 | mon1 |
2026-07-06 02:35:37.383014 | mon1 | PLAY RECAP *********************************************************************
2026-07-06 02:35:37.383109 | mon1 | mon1                       : ok=93   changed=30   unreachable=0    failed=0    skipped=14   rescued=0    ignored=0
2026-07-06 02:35:37.383231 | mon1 | osd1                       : ok=53   changed=24   unreachable=0    failed=0    skipped=8    rescued=0    ignored=0
2026-07-06 02:35:37.383344 | mon1 |
2026-07-06 02:35:37.383409 | mon1 |
2026-07-06 02:35:37.383502 | mon1 | TASKS RECAP ********************************************************************
2026-07-06 02:35:37.383599 | mon1 | Monday 06 July 2026  02:35:37 +0000 (0:00:11.879)       0:10:48.976 ***********
2026-07-06 02:35:37.383687 | mon1 | ===============================================================================
2026-07-06 02:35:37.383807 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ----------------- 199.75s
2026-07-06 02:35:37.383912 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 103.48s
2026-07-06 02:35:37.383991 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 102.81s
2026-07-06 02:35:37.384100 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 34.14s
2026-07-06 02:35:37.384181 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.02s
2026-07-06 02:35:37.384275 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ---------- 11.88s
2026-07-06 02:35:37.384371 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 11.69s
2026-07-06 02:35:37.384472 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 11.68s
2026-07-06 02:35:37.384566 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 9.10s
2026-07-06 02:35:37.384661 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 8.92s
2026-07-06 02:35:37.384754 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.40s
2026-07-06 02:35:37.384847 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.40s
2026-07-06 02:35:37.384958 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 6.39s
2026-07-06 02:35:37.385075 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.39s
2026-07-06 02:35:37.385167 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.21s
2026-07-06 02:35:37.385258 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.05s
2026-07-06 02:35:37.385351 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 5.97s
2026-07-06 02:35:37.385446 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.58s
2026-07-06 02:35:37.385540 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.54s
2026-07-06 02:35:37.385713 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.26s
2026-07-06 02:35:37.535067 | mon1 | INFO     [default > converge] Executed: Successful
2026-07-06 02:35:37.540486 | mon1 | INFO     [default > idempotence] Executing
2026-07-06 02:35:38.440335 | mon1 |
2026-07-06 02:35:38.440432 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-07-06 02:35:38.440454 | mon1 |
2026-07-06 02:35:38.440583 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:35:38.440700 | mon1 | Monday 06 July 2026  02:35:38 +0000 (0:00:00.059)       0:00:00.059 ***********
2026-07-06 02:35:39.676768 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-07-06 02:35:39.676971 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-07-06 02:35:39.677304 | mon1 | interpreter could change the meaning of that path. See
2026-07-06 02:35:39.677546 | mon1 | https://docs.ansible.com/ansible-
2026-07-06 02:35:39.677778 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-06 02:35:39.686916 | mon1 | ok: [mon1]
2026-07-06 02:35:39.687121 | mon1 |
2026-07-06 02:35:39.687362 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:35:39.687583 | mon1 | Monday 06 July 2026  02:35:39 +0000 (0:00:01.246)       0:00:01.306 ***********
2026-07-06 02:35:39.970379 | mon1 | ok: [mon1]
2026-07-06 02:35:39.970580 | mon1 |
2026-07-06 02:35:39.970826 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:35:39.971092 | mon1 | Monday 06 July 2026  02:35:39 +0000 (0:00:00.283)       0:00:01.589 ***********
2026-07-06 02:35:40.005484 | mon1 | skipping: [mon1]
2026-07-06 02:35:40.005665 | mon1 |
2026-07-06 02:35:40.005863 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-06 02:35:40.006080 | mon1 | Monday 06 July 2026  02:35:40 +0000 (0:00:00.035)       0:00:01.624 ***********
2026-07-06 02:35:40.313455 | mon1 | ok: [mon1]
2026-07-06 02:35:40.313646 | mon1 |
2026-07-06 02:35:40.313874 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:35:40.314091 | mon1 | Monday 06 July 2026  02:35:40 +0000 (0:00:00.307)       0:00:01.932 ***********
2026-07-06 02:35:40.394168 | mon1 | ok: [mon1] => {
2026-07-06 02:35:40.394378 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-06 02:35:40.394586 | mon1 | }
2026-07-06 02:35:40.394770 | mon1 |
2026-07-06 02:35:40.394980 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:35:40.395190 | mon1 | Monday 06 July 2026  02:35:40 +0000 (0:00:00.080)       0:00:02.013 ***********
2026-07-06 02:35:40.913946 | mon1 | ok: [mon1]
2026-07-06 02:35:40.914122 | mon1 |
2026-07-06 02:35:40.914357 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:35:40.914576 | mon1 | Monday 06 July 2026  02:35:40 +0000 (0:00:00.519)       0:00:02.532 ***********
2026-07-06 02:35:40.958080 | mon1 | skipping: [mon1]
2026-07-06 02:35:40.958246 | mon1 |
2026-07-06 02:35:40.958469 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:35:40.958683 | mon1 | Monday 06 July 2026  02:35:40 +0000 (0:00:00.044)       0:00:02.577 ***********
2026-07-06 02:35:40.997985 | mon1 | skipping: [mon1]
2026-07-06 02:35:40.998147 | mon1 |
2026-07-06 02:35:40.998403 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:35:40.998726 | mon1 | Monday 06 July 2026  02:35:40 +0000 (0:00:00.040)       0:00:02.617 ***********
2026-07-06 02:35:41.215658 | mon1 | ok: [mon1]
2026-07-06 02:35:41.215856 | mon1 |
2026-07-06 02:35:41.216112 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:35:41.216351 | mon1 | Monday 06 July 2026  02:35:41 +0000 (0:00:00.216)       0:00:02.833 ***********
2026-07-06 02:35:42.587877 | mon1 | ok: [mon1]
2026-07-06 02:35:42.587990 | mon1 |
2026-07-06 02:35:42.587999 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:35:42.588006 | mon1 | Monday 06 July 2026  02:35:42 +0000 (0:00:01.372)       0:00:04.206 ***********
2026-07-06 02:35:42.660212 | mon1 | ok: [mon1] => {
2026-07-06 02:35:42.660287 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-06 02:35:42.660371 | mon1 | }
2026-07-06 02:35:42.660651 | mon1 |
2026-07-06 02:35:42.660669 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:35:42.660674 | mon1 | Monday 06 July 2026  02:35:42 +0000 (0:00:00.072)       0:00:04.279 ***********
2026-07-06 02:35:42.994663 | mon1 | ok: [mon1]
2026-07-06 02:35:42.994747 | mon1 |
2026-07-06 02:35:42.994905 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:35:42.994921 | mon1 | Monday 06 July 2026  02:35:42 +0000 (0:00:00.334)       0:00:04.613 ***********
2026-07-06 02:35:46.204961 | mon1 | ok: [mon1]
2026-07-06 02:35:46.205029 | mon1 |
2026-07-06 02:35:46.205237 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-06 02:35:46.205254 | mon1 | Monday 06 July 2026  02:35:46 +0000 (0:00:03.210)       0:00:07.824 ***********
2026-07-06 02:35:46.233816 | mon1 | skipping: [mon1]
2026-07-06 02:35:46.233901 | mon1 |
2026-07-06 02:35:46.233996 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-06 02:35:46.234091 | mon1 | Monday 06 July 2026  02:35:46 +0000 (0:00:00.029)       0:00:07.853 ***********
2026-07-06 02:35:46.259995 | mon1 | skipping: [mon1]
2026-07-06 02:35:46.260040 | mon1 |
2026-07-06 02:35:46.260140 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-06 02:35:46.260239 | mon1 | Monday 06 July 2026  02:35:46 +0000 (0:00:00.025)       0:00:07.879 ***********
2026-07-06 02:35:46.284286 | mon1 | skipping: [mon1]
2026-07-06 02:35:46.284365 | mon1 |
2026-07-06 02:35:46.284610 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-06 02:35:46.284657 | mon1 | Monday 06 July 2026  02:35:46 +0000 (0:00:00.024)       0:00:07.903 ***********
2026-07-06 02:35:47.321709 | mon1 | ok: [mon1]
2026-07-06 02:35:47.321800 | mon1 |
2026-07-06 02:35:47.321824 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-06 02:35:47.321837 | mon1 | Monday 06 July 2026  02:35:47 +0000 (0:00:01.037)       0:00:08.940 ***********
2026-07-06 02:35:47.743355 | mon1 | ok: [mon1]
2026-07-06 02:35:47.743419 | mon1 |
2026-07-06 02:35:47.743502 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-06 02:35:47.743596 | mon1 | Monday 06 July 2026  02:35:47 +0000 (0:00:00.422)       0:00:09.362 ***********
2026-07-06 02:35:48.632639 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-07-06 02:35:48.632768 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-06 02:35:48.632909 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-06 02:35:48.633106 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-06 02:35:48.633270 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-06 02:35:48.633390 | mon1 |
2026-07-06 02:35:48.633547 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-06 02:35:48.633682 | mon1 | Monday 06 July 2026  02:35:48 +0000 (0:00:00.889)       0:00:10.251 ***********
2026-07-06 02:35:49.172703 | mon1 | ok: [mon1]
2026-07-06 02:35:49.172780 | mon1 |
2026-07-06 02:35:49.172853 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-06 02:35:49.172960 | mon1 | Monday 06 July 2026  02:35:49 +0000 (0:00:00.533)       0:00:10.785 ***********
2026-07-06 02:35:49.173078 | mon1 |
2026-07-06 02:35:49.173176 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-06 02:35:49.173275 | mon1 | Monday 06 July 2026  02:35:49 +0000 (0:00:00.006)       0:00:10.791 ***********
2026-07-06 02:35:49.772487 | mon1 | ok: [mon1]
2026-07-06 02:35:49.772554 | mon1 |
2026-07-06 02:35:49.772566 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:35:49.772577 | mon1 | Monday 06 July 2026  02:35:49 +0000 (0:00:00.598)       0:00:11.390 ***********
2026-07-06 02:35:49.984461 | mon1 | ok: [mon1]
2026-07-06 02:35:49.984531 | mon1 |
2026-07-06 02:35:49.984675 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:35:49.984823 | mon1 | Monday 06 July 2026  02:35:49 +0000 (0:00:00.213)       0:00:11.603 ***********
2026-07-06 02:35:50.054432 | mon1 | ok: [mon1] => {
2026-07-06 02:35:50.054494 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-06 02:35:50.054611 | mon1 | }
2026-07-06 02:35:50.054689 | mon1 |
2026-07-06 02:35:50.054891 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:35:50.054926 | mon1 | Monday 06 July 2026  02:35:50 +0000 (0:00:00.070)       0:00:11.673 ***********
2026-07-06 02:35:50.401575 | mon1 | ok: [mon1]
2026-07-06 02:35:50.401660 | mon1 |
2026-07-06 02:35:50.401733 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:35:50.401849 | mon1 | Monday 06 July 2026  02:35:50 +0000 (0:00:00.347)       0:00:12.020 ***********
2026-07-06 02:35:53.465674 | mon1 | ok: [mon1]
2026-07-06 02:35:53.465753 | mon1 |
2026-07-06 02:35:53.465989 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-06 02:35:53.466054 | mon1 | Monday 06 July 2026  02:35:53 +0000 (0:00:03.063)       0:00:15.084 ***********
2026-07-06 02:35:54.501259 | mon1 | ok: [mon1]
2026-07-06 02:35:54.501364 | mon1 |
2026-07-06 02:35:54.501376 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-06 02:35:54.501496 | mon1 | Monday 06 July 2026  02:35:54 +0000 (0:00:01.035)       0:00:16.120 ***********
2026-07-06 02:35:54.833974 | mon1 | ok: [mon1]
2026-07-06 02:35:54.834213 | mon1 |
2026-07-06 02:35:54.834411 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-06 02:35:54.834632 | mon1 | Monday 06 July 2026  02:35:54 +0000 (0:00:00.332)       0:00:16.452 ***********
2026-07-06 02:35:55.272473 | mon1 | ok: [mon1]
2026-07-06 02:35:55.272609 | mon1 |
2026-07-06 02:35:55.272852 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-06 02:35:55.273070 | mon1 | Monday 06 July 2026  02:35:55 +0000 (0:00:00.438)       0:00:16.891 ***********
2026-07-06 02:35:55.814285 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-07-06 02:35:55.814379 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-06 02:35:55.814510 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-06 02:35:55.814619 | mon1 |
2026-07-06 02:35:55.814753 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-06 02:35:55.814886 | mon1 | Monday 06 July 2026  02:35:55 +0000 (0:00:00.542)       0:00:17.433 ***********
2026-07-06 02:35:56.204710 | mon1 | ok: [mon1]
2026-07-06 02:35:56.204953 | mon1 |
2026-07-06 02:35:56.205322 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-06 02:35:56.205538 | mon1 | Monday 06 July 2026  02:35:56 +0000 (0:00:00.390)       0:00:17.823 ***********
2026-07-06 02:35:56.631075 | mon1 | ok: [mon1]
2026-07-06 02:35:56.631143 | mon1 |
2026-07-06 02:35:56.631227 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-06 02:35:56.631326 | mon1 | Monday 06 July 2026  02:35:56 +0000 (0:00:00.420)       0:00:18.244 ***********
2026-07-06 02:35:56.631410 | mon1 |
2026-07-06 02:35:56.631503 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-06 02:35:56.631595 | mon1 | Monday 06 July 2026  02:35:56 +0000 (0:00:00.006)       0:00:18.250 ***********
2026-07-06 02:35:56.973003 | mon1 | ok: [mon1]
2026-07-06 02:35:56.973046 | mon1 |
2026-07-06 02:35:56.973672 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-06 02:35:56.973755 | mon1 | Monday 06 July 2026  02:35:56 +0000 (0:00:00.341)       0:00:18.591 ***********
2026-07-06 02:35:57.013984 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-07-06 02:35:57.014049 | mon1 |
2026-07-06 02:35:57.014265 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-06 02:35:57.014311 | mon1 | Monday 06 July 2026  02:35:57 +0000 (0:00:00.041)       0:00:18.633 ***********
2026-07-06 02:35:57.997933 | mon1 | ok: [mon1]
2026-07-06 02:35:57.998003 | mon1 |
2026-07-06 02:35:57.998085 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-06 02:35:57.998217 | mon1 | Monday 06 July 2026  02:35:57 +0000 (0:00:00.984)       0:00:19.617 ***********
2026-07-06 02:35:58.640676 | mon1 | ok: [mon1] => (item=chronyd)
2026-07-06 02:35:58.640754 | mon1 | ok: [mon1] => (item=sshd)
2026-07-06 02:35:58.640787 | mon1 |
2026-07-06 02:35:58.641023 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-06 02:35:58.641064 | mon1 | Monday 06 July 2026  02:35:58 +0000 (0:00:00.642)       0:00:20.260 ***********
2026-07-06 02:35:58.920112 | mon1 | ok: [mon1]
2026-07-06 02:35:58.920159 | mon1 |
2026-07-06 02:35:58.920164 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-06 02:35:58.920169 | mon1 | Monday 06 July 2026  02:35:58 +0000 (0:00:00.278)       0:00:20.538 ***********
2026-07-06 02:35:59.105815 | mon1 | ok: [mon1]
2026-07-06 02:35:59.105853 | mon1 |
2026-07-06 02:35:59.105858 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-06 02:35:59.105863 | mon1 | Monday 06 July 2026  02:35:59 +0000 (0:00:00.186)       0:00:20.724 ***********
2026-07-06 02:35:59.477006 | mon1 | ok: [mon1]
2026-07-06 02:35:59.477076 | mon1 |
2026-07-06 02:35:59.477398 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-06 02:35:59.477477 | mon1 | Monday 06 July 2026  02:35:59 +0000 (0:00:00.371)       0:00:21.095 ***********
2026-07-06 02:35:59.775866 | mon1 | ok: [mon1]
2026-07-06 02:35:59.775955 | mon1 |
2026-07-06 02:35:59.776034 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-07-06 02:35:59.776145 | mon1 | Monday 06 July 2026  02:35:59 +0000 (0:00:00.299)       0:00:21.395 ***********
2026-07-06 02:35:59.866269 | mon1 | ok: [mon1]
2026-07-06 02:35:59.866735 | mon1 |
2026-07-06 02:35:59.866788 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-07-06 02:35:59.866797 | mon1 | Monday 06 July 2026  02:35:59 +0000 (0:00:00.089)       0:00:21.485 ***********
2026-07-06 02:36:00.121189 | mon1 | ok: [mon1] => (item=mon1)
2026-07-06 02:36:00.121264 | mon1 |
2026-07-06 02:36:00.121468 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-07-06 02:36:00.121510 | mon1 | Monday 06 July 2026  02:36:00 +0000 (0:00:00.255)       0:00:21.740 ***********
2026-07-06 02:36:00.164261 | mon1 | ok: [mon1]
2026-07-06 02:36:00.164327 | mon1 |
2026-07-06 02:36:00.164566 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-07-06 02:36:00.164609 | mon1 | Monday 06 July 2026  02:36:00 +0000 (0:00:00.042)       0:00:21.783 ***********
2026-07-06 02:36:00.199711 | mon1 | skipping: [mon1]
2026-07-06 02:36:00.199760 | mon1 |
2026-07-06 02:36:00.199882 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-06 02:36:00.199979 | mon1 | Monday 06 July 2026  02:36:00 +0000 (0:00:00.035)       0:00:21.818 ***********
2026-07-06 02:36:00.262359 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-07-06 02:36:00.262426 | mon1 |
2026-07-06 02:36:00.262655 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-06 02:36:00.262700 | mon1 | Monday 06 July 2026  02:36:00 +0000 (0:00:00.062)       0:00:21.881 ***********
2026-07-06 02:36:06.307629 | mon1 | ok: [mon1]
2026-07-06 02:36:06.307706 | mon1 |
2026-07-06 02:36:06.308066 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-06 02:36:06.308165 | mon1 | Monday 06 July 2026  02:36:06 +0000 (0:00:06.044)       0:00:27.925 ***********
2026-07-06 02:36:06.351116 | mon1 | ok: [mon1] => (item=mon1)
2026-07-06 02:36:06.351241 | mon1 |
2026-07-06 02:36:06.351250 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-06 02:36:06.351326 | mon1 | Monday 06 July 2026  02:36:06 +0000 (0:00:00.044)       0:00:27.970 ***********
2026-07-06 02:36:06.711655 | mon1 | ok: [mon1]
2026-07-06 02:36:06.711750 | mon1 |
2026-07-06 02:36:06.712044 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-06 02:36:06.712117 | mon1 | Monday 06 July 2026  02:36:06 +0000 (0:00:00.360)       0:00:28.330 ***********
2026-07-06 02:36:13.111659 | mon1 | ok: [mon1]
2026-07-06 02:36:13.111735 | mon1 |
2026-07-06 02:36:13.111801 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-07-06 02:36:13.111926 | mon1 | Monday 06 July 2026  02:36:13 +0000 (0:00:06.400)       0:00:34.730 ***********
2026-07-06 02:36:19.128617 | mon1 | ok: [mon1]
2026-07-06 02:36:19.128695 | mon1 |
2026-07-06 02:36:19.128884 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-07-06 02:36:19.128922 | mon1 | Monday 06 July 2026  02:36:19 +0000 (0:00:06.016)       0:00:40.747 ***********
2026-07-06 02:36:33.923239 | mon1 | ok: [mon1]
2026-07-06 02:36:33.923376 | mon1 |
2026-07-06 02:36:33.923389 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-06 02:36:33.923402 | mon1 | Monday 06 July 2026  02:36:33 +0000 (0:00:14.794)       0:00:55.541 ***********
2026-07-06 02:36:33.991740 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-07-06 02:36:33.991790 | mon1 |
2026-07-06 02:36:33.992047 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-06 02:36:33.992123 | mon1 | Monday 06 July 2026  02:36:33 +0000 (0:00:00.068)       0:00:55.610 ***********
2026-07-06 02:36:34.043714 | mon1 | skipping: [mon1]
2026-07-06 02:36:34.043809 | mon1 |
2026-07-06 02:36:34.044141 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-06 02:36:34.044194 | mon1 | Monday 06 July 2026  02:36:34 +0000 (0:00:00.051)       0:00:55.662 ***********
2026-07-06 02:36:34.090816 | mon1 | skipping: [mon1] => (item=mon1)
2026-07-06 02:36:34.090903 | mon1 | skipping: [mon1]
2026-07-06 02:36:34.091201 | mon1 |
2026-07-06 02:36:34.091248 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-06 02:36:34.091255 | mon1 | Monday 06 July 2026  02:36:34 +0000 (0:00:00.047)       0:00:55.709 ***********
2026-07-06 02:36:34.377225 | mon1 | ok: [mon1]
2026-07-06 02:36:34.377316 | mon1 |
2026-07-06 02:36:34.377332 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-06 02:36:34.377512 | mon1 | Monday 06 July 2026  02:36:34 +0000 (0:00:00.286)       0:00:55.995 ***********
2026-07-06 02:36:41.047822 | mon1 | ok: [mon1]
2026-07-06 02:36:41.047937 | mon1 |
2026-07-06 02:36:41.047950 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-07-06 02:36:41.048056 | mon1 | Monday 06 July 2026  02:36:41 +0000 (0:00:06.670)       0:01:02.666 ***********
2026-07-06 02:36:47.049029 | mon1 | ok: [mon1]
2026-07-06 02:36:47.049189 | mon1 |
2026-07-06 02:36:47.049511 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-07-06 02:36:47.049564 | mon1 | Monday 06 July 2026  02:36:47 +0000 (0:00:06.001)       0:01:08.667 ***********
2026-07-06 02:36:53.598454 | mon1 | ok: [mon1]
2026-07-06 02:36:53.598533 | mon1 |
2026-07-06 02:36:53.598609 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-07-06 02:36:53.598707 | mon1 | Monday 06 July 2026  02:36:53 +0000 (0:00:06.540)       0:01:15.208 ***********
2026-07-06 02:37:00.796867 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'})
2026-07-06 02:37:00.797074 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-07-06 02:37:00.797335 | mon1 | ok: [mon1] => (item={'name': 'prometheus'})
2026-07-06 02:37:00.797531 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-07-06 02:37:00.797722 | mon1 |
2026-07-06 02:37:00.797935 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-07-06 02:37:00.798120 | mon1 |
2026-07-06 02:37:00.798365 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:37:00.798571 | mon1 | Monday 06 July 2026  02:37:00 +0000 (0:00:07.206)       0:01:22.415 ***********
2026-07-06 02:37:01.938988 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-07-06 02:37:01.939612 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-07-06 02:37:01.939666 | mon1 | interpreter could change the meaning of that path. See
2026-07-06 02:37:01.939673 | mon1 | https://docs.ansible.com/ansible-
2026-07-06 02:37:01.939679 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-06 02:37:01.951678 | mon1 | ok: [osd1]
2026-07-06 02:37:01.952137 | mon1 |
2026-07-06 02:37:01.952184 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:37:01.952193 | mon1 | Monday 06 July 2026  02:37:01 +0000 (0:00:01.154)       0:01:23.570 ***********
2026-07-06 02:37:02.172170 | mon1 | ok: [osd1]
2026-07-06 02:37:02.172252 | mon1 |
2026-07-06 02:37:02.172313 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:37:02.172427 | mon1 | Monday 06 July 2026  02:37:02 +0000 (0:00:00.220)       0:01:23.791 ***********
2026-07-06 02:37:02.208061 | mon1 | skipping: [osd1]
2026-07-06 02:37:02.208366 | mon1 |
2026-07-06 02:37:02.208410 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-06 02:37:02.208416 | mon1 | Monday 06 July 2026  02:37:02 +0000 (0:00:00.035)       0:01:23.827 ***********
2026-07-06 02:37:02.423257 | mon1 | ok: [osd1]
2026-07-06 02:37:02.423330 | mon1 |
2026-07-06 02:37:02.423384 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:37:02.423502 | mon1 | Monday 06 July 2026  02:37:02 +0000 (0:00:00.215)       0:01:24.042 ***********
2026-07-06 02:37:02.492280 | mon1 | ok: [osd1] => {
2026-07-06 02:37:02.492460 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-06 02:37:02.492685 | mon1 | }
2026-07-06 02:37:02.492915 | mon1 |
2026-07-06 02:37:02.493186 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:37:02.493385 | mon1 | Monday 06 July 2026  02:37:02 +0000 (0:00:00.068)       0:01:24.111 ***********
2026-07-06 02:37:02.796651 | mon1 | ok: [osd1]
2026-07-06 02:37:02.796717 | mon1 |
2026-07-06 02:37:02.796736 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:37:02.796899 | mon1 | Monday 06 July 2026  02:37:02 +0000 (0:00:00.304)       0:01:24.415 ***********
2026-07-06 02:37:02.836279 | mon1 | skipping: [osd1]
2026-07-06 02:37:02.836378 | mon1 |
2026-07-06 02:37:02.836544 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:37:02.836668 | mon1 | Monday 06 July 2026  02:37:02 +0000 (0:00:00.040)       0:01:24.455 ***********
2026-07-06 02:37:02.877234 | mon1 | skipping: [osd1]
2026-07-06 02:37:02.877306 | mon1 |
2026-07-06 02:37:02.877379 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:37:02.877532 | mon1 | Monday 06 July 2026  02:37:02 +0000 (0:00:00.040)       0:01:24.496 ***********
2026-07-06 02:37:03.081618 | mon1 | ok: [osd1]
2026-07-06 02:37:03.081706 | mon1 |
2026-07-06 02:37:03.081727 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:37:03.081847 | mon1 | Monday 06 July 2026  02:37:03 +0000 (0:00:00.204)       0:01:24.700 ***********
2026-07-06 02:37:04.108134 | mon1 | ok: [osd1]
2026-07-06 02:37:04.108199 | mon1 |
2026-07-06 02:37:04.108282 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:37:04.108451 | mon1 | Monday 06 July 2026  02:37:04 +0000 (0:00:01.026)       0:01:25.727 ***********
2026-07-06 02:37:04.177597 | mon1 | ok: [osd1] => {
2026-07-06 02:37:04.177761 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-06 02:37:04.178004 | mon1 | }
2026-07-06 02:37:04.178219 | mon1 |
2026-07-06 02:37:04.178458 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:37:04.178687 | mon1 | Monday 06 July 2026  02:37:04 +0000 (0:00:00.069)       0:01:25.796 ***********
2026-07-06 02:37:04.508368 | mon1 | ok: [osd1]
2026-07-06 02:37:04.508430 | mon1 |
2026-07-06 02:37:04.508503 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:37:04.508634 | mon1 | Monday 06 July 2026  02:37:04 +0000 (0:00:00.330)       0:01:26.127 ***********
2026-07-06 02:37:06.492767 | mon1 | ok: [osd1]
2026-07-06 02:37:06.492832 | mon1 |
2026-07-06 02:37:06.492899 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-06 02:37:06.492981 | mon1 | Monday 06 July 2026  02:37:06 +0000 (0:00:01.984)       0:01:28.111 ***********
2026-07-06 02:37:06.518720 | mon1 | skipping: [osd1]
2026-07-06 02:37:06.518833 | mon1 |
2026-07-06 02:37:06.519097 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-06 02:37:06.519344 | mon1 | Monday 06 July 2026  02:37:06 +0000 (0:00:00.025)       0:01:28.137 ***********
2026-07-06 02:37:06.548968 | mon1 | skipping: [osd1]
2026-07-06 02:37:06.549237 | mon1 |
2026-07-06 02:37:06.549437 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-06 02:37:06.549639 | mon1 | Monday 06 July 2026  02:37:06 +0000 (0:00:00.027)       0:01:28.165 ***********
2026-07-06 02:37:06.575578 | mon1 | skipping: [osd1]
2026-07-06 02:37:06.575623 | mon1 |
2026-07-06 02:37:06.575630 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-06 02:37:06.575637 | mon1 | Monday 06 July 2026  02:37:06 +0000 (0:00:00.029)       0:01:28.194 ***********
2026-07-06 02:37:07.670007 | mon1 | ok: [osd1]
2026-07-06 02:37:07.670085 | mon1 |
2026-07-06 02:37:07.670437 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-06 02:37:07.670522 | mon1 | Monday 06 July 2026  02:37:07 +0000 (0:00:01.094)       0:01:29.288 ***********
2026-07-06 02:37:08.116678 | mon1 | ok: [osd1]
2026-07-06 02:37:08.116810 | mon1 |
2026-07-06 02:37:08.116822 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-06 02:37:08.116991 | mon1 | Monday 06 July 2026  02:37:08 +0000 (0:00:00.446)       0:01:29.735 ***********
2026-07-06 02:37:09.010163 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'})
2026-07-06 02:37:09.010270 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-06 02:37:09.011016 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-06 02:37:09.011067 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-06 02:37:09.011076 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-06 02:37:09.011083 | mon1 |
2026-07-06 02:37:09.011090 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-06 02:37:09.011104 | mon1 | Monday 06 July 2026  02:37:09 +0000 (0:00:00.893)       0:01:30.628 ***********
2026-07-06 02:37:09.547218 | mon1 | ok: [osd1]
2026-07-06 02:37:09.547297 | mon1 |
2026-07-06 02:37:09.547358 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-06 02:37:09.547768 | mon1 | Monday 06 July 2026  02:37:09 +0000 (0:00:00.531)       0:01:31.160 ***********
2026-07-06 02:37:09.547812 | mon1 |
2026-07-06 02:37:09.547817 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-06 02:37:09.547822 | mon1 | Monday 06 July 2026  02:37:09 +0000 (0:00:00.005)       0:01:31.166 ***********
2026-07-06 02:37:09.903301 | mon1 | ok: [osd1]
2026-07-06 02:37:09.903378 | mon1 |
2026-07-06 02:37:09.903438 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:37:09.903579 | mon1 | Monday 06 July 2026  02:37:09 +0000 (0:00:00.355)       0:01:31.522 ***********
2026-07-06 02:37:10.107942 | mon1 | ok: [osd1]
2026-07-06 02:37:10.108005 | mon1 |
2026-07-06 02:37:10.108201 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:37:10.108217 | mon1 | Monday 06 July 2026  02:37:10 +0000 (0:00:00.204)       0:01:31.726 ***********
2026-07-06 02:37:10.183609 | mon1 | ok: [osd1] => {
2026-07-06 02:37:10.183718 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-06 02:37:10.184264 | mon1 | }
2026-07-06 02:37:10.184314 | mon1 |
2026-07-06 02:37:10.184323 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:37:10.184330 | mon1 | Monday 06 July 2026  02:37:10 +0000 (0:00:00.075)       0:01:31.802 ***********
2026-07-06 02:37:10.548866 | mon1 | ok: [osd1]
2026-07-06 02:37:10.548945 | mon1 |
2026-07-06 02:37:10.549035 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:37:10.549248 | mon1 | Monday 06 July 2026  02:37:10 +0000 (0:00:00.365)       0:01:32.167 ***********
2026-07-06 02:37:13.581749 | mon1 | ok: [osd1]
2026-07-06 02:37:13.581823 | mon1 |
2026-07-06 02:37:13.581889 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-06 02:37:13.582074 | mon1 | Monday 06 July 2026  02:37:13 +0000 (0:00:03.032)       0:01:35.200 ***********
2026-07-06 02:37:14.610076 | mon1 | ok: [osd1]
2026-07-06 02:37:14.610185 | mon1 |
2026-07-06 02:37:14.610192 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-06 02:37:14.610348 | mon1 | Monday 06 July 2026  02:37:14 +0000 (0:00:01.028)       0:01:36.228 ***********
2026-07-06 02:37:14.814236 | mon1 | ok: [osd1]
2026-07-06 02:37:14.814315 | mon1 |
2026-07-06 02:37:14.814704 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-06 02:37:14.814753 | mon1 | Monday 06 July 2026  02:37:14 +0000 (0:00:00.204)       0:01:36.433 ***********
2026-07-06 02:37:15.228077 | mon1 | ok: [osd1]
2026-07-06 02:37:15.228577 | mon1 |
2026-07-06 02:37:15.228604 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-06 02:37:15.228613 | mon1 | Monday 06 July 2026  02:37:15 +0000 (0:00:00.414)       0:01:36.847 ***********
2026-07-06 02:37:15.801709 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'})
2026-07-06 02:37:15.801785 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-06 02:37:15.802149 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-06 02:37:15.802191 | mon1 |
2026-07-06 02:37:15.802197 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-06 02:37:15.802202 | mon1 | Monday 06 July 2026  02:37:15 +0000 (0:00:00.573)       0:01:37.420 ***********
2026-07-06 02:37:16.244004 | mon1 | ok: [osd1]
2026-07-06 02:37:16.244077 | mon1 |
2026-07-06 02:37:16.244139 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-06 02:37:16.244259 | mon1 | Monday 06 July 2026  02:37:16 +0000 (0:00:00.442)       0:01:37.862 ***********
2026-07-06 02:37:16.707537 | mon1 | ok: [osd1]
2026-07-06 02:37:16.707620 | mon1 |
2026-07-06 02:37:16.707638 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-06 02:37:16.708050 | mon1 | Monday 06 July 2026  02:37:16 +0000 (0:00:00.456)       0:01:38.318 ***********
2026-07-06 02:37:16.708093 | mon1 |
2026-07-06 02:37:16.708098 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-06 02:37:16.708103 | mon1 | Monday 06 July 2026  02:37:16 +0000 (0:00:00.007)       0:01:38.326 ***********
2026-07-06 02:37:17.057287 | mon1 | ok: [osd1]
2026-07-06 02:37:17.057350 | mon1 |
2026-07-06 02:37:17.057526 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-06 02:37:17.057542 | mon1 | Monday 06 July 2026  02:37:17 +0000 (0:00:00.349)       0:01:38.676 ***********
2026-07-06 02:37:17.098402 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-07-06 02:37:17.098464 | mon1 |
2026-07-06 02:37:17.098826 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-06 02:37:17.098915 | mon1 | Monday 06 July 2026  02:37:17 +0000 (0:00:00.040)       0:01:38.716 ***********
2026-07-06 02:37:18.173951 | mon1 | ok: [osd1]
2026-07-06 02:37:18.174024 | mon1 |
2026-07-06 02:37:18.174287 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-06 02:37:18.174340 | mon1 | Monday 06 July 2026  02:37:18 +0000 (0:00:01.076)       0:01:39.792 ***********
2026-07-06 02:37:18.817094 | mon1 | ok: [osd1] => (item=chronyd)
2026-07-06 02:37:18.817160 | mon1 | ok: [osd1] => (item=sshd)
2026-07-06 02:37:18.817489 | mon1 |
2026-07-06 02:37:18.817531 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-06 02:37:18.817549 | mon1 | Monday 06 July 2026  02:37:18 +0000 (0:00:00.643)       0:01:40.436 ***********
2026-07-06 02:37:19.117231 | mon1 | ok: [osd1]
2026-07-06 02:37:19.117305 | mon1 |
2026-07-06 02:37:19.117511 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-06 02:37:19.117553 | mon1 | Monday 06 July 2026  02:37:19 +0000 (0:00:00.300)       0:01:40.736 ***********
2026-07-06 02:37:19.314434 | mon1 | ok: [osd1]
2026-07-06 02:37:19.314498 | mon1 |
2026-07-06 02:37:19.314664 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-06 02:37:19.314679 | mon1 | Monday 06 July 2026  02:37:19 +0000 (0:00:00.197)       0:01:40.933 ***********
2026-07-06 02:37:19.550880 | mon1 | ok: [osd1]
2026-07-06 02:37:19.551309 | mon1 |
2026-07-06 02:37:19.551329 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-06 02:37:19.551336 | mon1 | Monday 06 July 2026  02:37:19 +0000 (0:00:00.236)       0:01:41.169 ***********
2026-07-06 02:37:19.749972 | mon1 | ok: [osd1]
2026-07-06 02:37:19.750049 | mon1 |
2026-07-06 02:37:19.750108 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-07-06 02:37:19.750234 | mon1 | Monday 06 July 2026  02:37:19 +0000 (0:00:00.199)       0:01:41.368 ***********
2026-07-06 02:37:19.963632 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-07-06 02:37:19.963731 | mon1 |
2026-07-06 02:37:19.964078 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-07-06 02:37:19.964124 | mon1 | Monday 06 July 2026  02:37:19 +0000 (0:00:00.213)       0:01:41.582 ***********
2026-07-06 02:37:20.003864 | mon1 | ok: [osd1]
2026-07-06 02:37:20.003949 | mon1 |
2026-07-06 02:37:20.004176 | mon1 | TASK [Install Ceph host] *******************************************************
2026-07-06 02:37:20.004221 | mon1 | Monday 06 July 2026  02:37:20 +0000 (0:00:00.040)       0:01:41.622 ***********
2026-07-06 02:37:20.066428 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-07-06 02:37:20.066491 | mon1 |
2026-07-06 02:37:20.066716 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-07-06 02:37:20.066754 | mon1 | Monday 06 July 2026  02:37:20 +0000 (0:00:00.062)       0:01:41.685 ***********
2026-07-06 02:37:26.108853 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:37:26.108925 | mon1 |
2026-07-06 02:37:26.109146 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-07-06 02:37:26.109216 | mon1 | Monday 06 July 2026  02:37:26 +0000 (0:00:06.042)       0:01:47.727 ***********
2026-07-06 02:37:26.160988 | mon1 | ok: [osd1] => (item=osd1)
2026-07-06 02:37:26.161098 | mon1 |
2026-07-06 02:37:26.161191 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-07-06 02:37:26.161286 | mon1 | Monday 06 July 2026  02:37:26 +0000 (0:00:00.052)       0:01:47.780 ***********
2026-07-06 02:37:26.408771 | mon1 | ok: [osd1]
2026-07-06 02:37:26.408997 | mon1 |
2026-07-06 02:37:26.409228 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-07-06 02:37:26.409443 | mon1 | Monday 06 July 2026  02:37:26 +0000 (0:00:00.247)       0:01:48.027 ***********
2026-07-06 02:37:32.788176 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:37:32.788402 | mon1 |
2026-07-06 02:37:32.788663 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-07-06 02:37:32.788915 | mon1 | Monday 06 July 2026  02:37:32 +0000 (0:00:06.379)       0:01:54.406 ***********
2026-07-06 02:37:38.209762 | mon1 | ok: [osd1]
2026-07-06 02:37:38.209882 | mon1 |
2026-07-06 02:37:38.210120 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-07-06 02:37:38.210383 | mon1 | Monday 06 July 2026  02:37:38 +0000 (0:00:05.421)       0:01:59.828 ***********
2026-07-06 02:38:00.337533 | mon1 | ok: [osd1]
2026-07-06 02:38:00.337711 | mon1 |
2026-07-06 02:38:00.337950 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-07-06 02:38:00.338186 | mon1 | Monday 06 July 2026  02:38:00 +0000 (0:00:22.127)       0:02:21.956 ***********
2026-07-06 02:38:00.396348 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data)
2026-07-06 02:38:00.396544 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data)
2026-07-06 02:38:00.396768 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data)
2026-07-06 02:38:00.396989 | mon1 | skipping: [osd1]
2026-07-06 02:38:00.397317 | mon1 |
2026-07-06 02:38:00.397589 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-07-06 02:38:00.397820 | mon1 | Monday 06 July 2026  02:38:00 +0000 (0:00:00.058)       0:02:22.015 ***********
2026-07-06 02:38:06.555541 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:38:06.555666 | mon1 |
2026-07-06 02:38:06.555825 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-07-06 02:38:06.555979 | mon1 | Monday 06 July 2026  02:38:06 +0000 (0:00:06.159)       0:02:28.174 ***********
2026-07-06 02:38:12.530065 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:38:12.530152 | mon1 |
2026-07-06 02:38:12.530170 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-07-06 02:38:12.530183 | mon1 | Monday 06 July 2026  02:38:12 +0000 (0:00:05.973)       0:02:34.147 ***********
2026-07-06 02:38:12.581887 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-07-06 02:38:12.581960 | mon1 |
2026-07-06 02:38:12.582021 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-07-06 02:38:12.582142 | mon1 | Monday 06 July 2026  02:38:12 +0000 (0:00:00.053)       0:02:34.201 ***********
2026-07-06 02:38:12.628903 | mon1 | ok: [osd1]
2026-07-06 02:38:12.629202 | mon1 |
2026-07-06 02:38:12.629276 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-07-06 02:38:12.629294 | mon1 | Monday 06 July 2026  02:38:12 +0000 (0:00:00.046)       0:02:34.247 ***********
2026-07-06 02:38:18.621864 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-07-06 02:38:18.621941 | mon1 |
2026-07-06 02:38:18.622141 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-07-06 02:38:18.622178 | mon1 | Monday 06 July 2026  02:38:18 +0000 (0:00:05.992)       0:02:40.240 ***********
2026-07-06 02:38:18.666616 | mon1 | ok: [osd1]
2026-07-06 02:38:18.666655 | mon1 |
2026-07-06 02:38:18.666906 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-07-06 02:38:18.666952 | mon1 | Monday 06 July 2026  02:38:18 +0000 (0:00:00.044)       0:02:40.285 ***********
2026-07-06 02:38:18.705001 | mon1 | skipping: [osd1] => (item=1)
2026-07-06 02:38:18.705247 | mon1 | skipping: [osd1] => (item=1)
2026-07-06 02:38:18.705835 | mon1 | skipping: [osd1] => (item=1)
2026-07-06 02:38:18.705849 | mon1 | skipping: [osd1]
2026-07-06 02:38:18.705854 | mon1 |
2026-07-06 02:38:18.705859 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-07-06 02:38:18.705863 | mon1 | Monday 06 July 2026  02:38:18 +0000 (0:00:00.039)       0:02:40.324 ***********
2026-07-06 02:38:18.762722 | mon1 | skipping: [osd1]
2026-07-06 02:38:18.762761 | mon1 |
2026-07-06 02:38:18.763232 | mon1 | PLAY [Deploy Ceph exporters] ***************************************************
2026-07-06 02:38:18.763283 | mon1 |
2026-07-06 02:38:18.763290 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:38:18.763299 | mon1 | Monday 06 July 2026  02:38:18 +0000 (0:00:00.057)       0:02:40.381 ***********
2026-07-06 02:38:19.676581 | mon1 | ok: [mon1]
2026-07-06 02:38:19.676676 | mon1 |
2026-07-06 02:38:19.677033 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:38:19.677120 | mon1 | Monday 06 July 2026  02:38:19 +0000 (0:00:00.913)       0:02:41.295 ***********
2026-07-06 02:38:19.891436 | mon1 | ok: [mon1]
2026-07-06 02:38:19.891515 | mon1 |
2026-07-06 02:38:19.891850 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:38:19.891929 | mon1 | Monday 06 July 2026  02:38:19 +0000 (0:00:00.215)       0:02:41.510 ***********
2026-07-06 02:38:19.932858 | mon1 | skipping: [mon1]
2026-07-06 02:38:19.932966 | mon1 |
2026-07-06 02:38:19.933398 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-07-06 02:38:19.933429 | mon1 | Monday 06 July 2026  02:38:19 +0000 (0:00:00.041)       0:02:41.551 ***********
2026-07-06 02:38:20.161670 | mon1 | ok: [mon1]
2026-07-06 02:38:20.161722 | mon1 |
2026-07-06 02:38:20.161730 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:38:20.161737 | mon1 | Monday 06 July 2026  02:38:20 +0000 (0:00:00.228)       0:02:41.779 ***********
2026-07-06 02:38:20.236099 | mon1 | ok: [mon1] => {
2026-07-06 02:38:20.236180 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-07-06 02:38:20.236580 | mon1 | }
2026-07-06 02:38:20.236640 | mon1 |
2026-07-06 02:38:20.236645 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:38:20.236650 | mon1 | Monday 06 July 2026  02:38:20 +0000 (0:00:00.074)       0:02:41.854 ***********
2026-07-06 02:38:20.557737 | mon1 | ok: [mon1]
2026-07-06 02:38:20.557812 | mon1 |
2026-07-06 02:38:20.558127 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:38:20.558173 | mon1 | Monday 06 July 2026  02:38:20 +0000 (0:00:00.321)       0:02:42.176 ***********
2026-07-06 02:38:20.600172 | mon1 | skipping: [mon1]
2026-07-06 02:38:20.600262 | mon1 |
2026-07-06 02:38:20.600481 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:38:20.600526 | mon1 | Monday 06 July 2026  02:38:20 +0000 (0:00:00.042)       0:02:42.219 ***********
2026-07-06 02:38:20.641839 | mon1 | skipping: [mon1]
2026-07-06 02:38:20.641886 | mon1 |
2026-07-06 02:38:20.642119 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:38:20.642142 | mon1 | Monday 06 July 2026  02:38:20 +0000 (0:00:00.041)       0:02:42.260 ***********
2026-07-06 02:38:20.852848 | mon1 | ok: [mon1]
2026-07-06 02:38:20.852935 | mon1 |
2026-07-06 02:38:20.852950 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-07-06 02:38:20.853125 | mon1 | Monday 06 July 2026  02:38:20 +0000 (0:00:00.210)       0:02:42.471 ***********
2026-07-06 02:38:22.301312 | mon1 | ok: [mon1]
2026-07-06 02:38:22.301376 | mon1 |
2026-07-06 02:38:22.301473 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:38:22.301564 | mon1 | Monday 06 July 2026  02:38:22 +0000 (0:00:01.448)       0:02:43.920 ***********
2026-07-06 02:38:22.377361 | mon1 | ok: [mon1] => {
2026-07-06 02:38:22.377580 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-07-06 02:38:22.377770 | mon1 | }
2026-07-06 02:38:22.377946 | mon1 |
2026-07-06 02:38:22.378150 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:38:22.378345 | mon1 | Monday 06 July 2026  02:38:22 +0000 (0:00:00.076)       0:02:43.996 ***********
2026-07-06 02:38:22.727998 | mon1 | ok: [mon1]
2026-07-06 02:38:22.728158 | mon1 |
2026-07-06 02:38:22.728438 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:38:22.728651 | mon1 | Monday 06 July 2026  02:38:22 +0000 (0:00:00.350)       0:02:44.346 ***********
2026-07-06 02:38:24.767458 | mon1 | ok: [mon1]
2026-07-06 02:38:24.767561 | mon1 |
2026-07-06 02:38:24.767573 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-07-06 02:38:24.767670 | mon1 | Monday 06 July 2026  02:38:24 +0000 (0:00:02.030)       0:02:46.376 ***********
2026-07-06 02:38:24.789284 | mon1 | skipping: [mon1]
2026-07-06 02:38:24.789460 | mon1 |
2026-07-06 02:38:24.789675 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-07-06 02:38:24.789879 | mon1 | Monday 06 July 2026  02:38:24 +0000 (0:00:00.031)       0:02:46.408 ***********
2026-07-06 02:38:24.818716 | mon1 | skipping: [mon1]
2026-07-06 02:38:24.818827 | mon1 |
2026-07-06 02:38:24.818973 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-07-06 02:38:24.819111 | mon1 | Monday 06 July 2026  02:38:24 +0000 (0:00:00.029)       0:02:46.437 ***********
2026-07-06 02:38:24.846947 | mon1 | skipping: [mon1]
2026-07-06 02:38:24.847103 | mon1 |
2026-07-06 02:38:24.847314 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-07-06 02:38:24.847517 | mon1 | Monday 06 July 2026  02:38:24 +0000 (0:00:00.028)       0:02:46.465 ***********
2026-07-06 02:38:25.928143 | mon1 | ok: [mon1]
2026-07-06 02:38:25.928303 | mon1 |
2026-07-06 02:38:25.928604 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-07-06 02:38:25.928832 | mon1 | Monday 06 July 2026  02:38:25 +0000 (0:00:01.081)       0:02:47.546 ***********
2026-07-06 02:38:26.376399 | mon1 | ok: [mon1]
2026-07-06 02:38:26.376503 | mon1 |
2026-07-06 02:38:26.376754 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-07-06 02:38:26.376963 | mon1 | Monday 06 July 2026  02:38:26 +0000 (0:00:00.448)       0:02:47.995 ***********
2026-07-06 02:38:27.313360 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-07-06 02:38:27.313433 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-07-06 02:38:27.313445 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-07-06 02:38:27.313462 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-07-06 02:38:27.314298 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-07-06 02:38:27.314549 | mon1 |
2026-07-06 02:38:27.314562 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-07-06 02:38:27.314572 | mon1 | Monday 06 July 2026  02:38:27 +0000 (0:00:00.936)       0:02:48.931 ***********
2026-07-06 02:38:27.847978 | mon1 | ok: [mon1]
2026-07-06 02:38:27.848090 | mon1 |
2026-07-06 02:38:27.848853 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-07-06 02:38:27.848909 | mon1 | Monday 06 July 2026  02:38:27 +0000 (0:00:00.527)       0:02:49.458 ***********
2026-07-06 02:38:27.848918 | mon1 |
2026-07-06 02:38:27.848924 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-07-06 02:38:27.848929 | mon1 | Monday 06 July 2026  02:38:27 +0000 (0:00:00.007)       0:02:49.466 ***********
2026-07-06 02:38:28.199569 | mon1 | ok: [mon1]
2026-07-06 02:38:28.199641 | mon1 |
2026-07-06 02:38:28.199712 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-07-06 02:38:28.199842 | mon1 | Monday 06 July 2026  02:38:28 +0000 (0:00:00.352)       0:02:49.818 ***********
2026-07-06 02:38:28.400739 | mon1 | ok: [mon1]
2026-07-06 02:38:28.400801 | mon1 |
2026-07-06 02:38:28.401001 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-07-06 02:38:28.401079 | mon1 | Monday 06 July 2026  02:38:28 +0000 (0:00:00.201)       0:02:50.019 ***********
2026-07-06 02:38:28.481543 | mon1 | ok: [mon1] => {
2026-07-06 02:38:28.481632 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-07-06 02:38:28.482057 | mon1 | }
2026-07-06 02:38:28.482128 | mon1 |
2026-07-06 02:38:28.482134 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-07-06 02:38:28.482139 | mon1 | Monday 06 July 2026  02:38:28 +0000 (0:00:00.080)       0:02:50.100 ***********
2026-07-06 02:38:28.841602 | mon1 | ok: [mon1]
2026-07-06 02:38:28.842134 | mon1 |
2026-07-06 02:38:28.842155 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-07-06 02:38:28.842165 | mon1 | Monday 06 July 2026  02:38:28 +0000 (0:00:00.360)       0:02:50.460 ***********
2026-07-06 02:38:31.982427 | mon1 | ok: [mon1]
2026-07-06 02:38:31.982495 | mon1 |
2026-07-06 02:38:31.982580 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-07-06 02:38:31.982712 | mon1 | Monday 06 July 2026  02:38:31 +0000 (0:00:03.140)       0:02:53.601 ***********
2026-07-06 02:38:33.017182 | mon1 | ok: [mon1]
2026-07-06 02:38:33.017259 | mon1 |
2026-07-06 02:38:33.017453 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-07-06 02:38:33.017500 | mon1 | Monday 06 July 2026  02:38:33 +0000 (0:00:01.034)       0:02:54.636 ***********
2026-07-06 02:38:33.213590 | mon1 | ok: [mon1]
2026-07-06 02:38:33.213686 | mon1 |
2026-07-06 02:38:33.213874 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-07-06 02:38:33.213912 | mon1 | Monday 06 July 2026  02:38:33 +0000 (0:00:00.196)       0:02:54.832 ***********
2026-07-06 02:38:33.637670 | mon1 | ok: [mon1]
2026-07-06 02:38:33.637741 | mon1 |
2026-07-06 02:38:33.638060 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-07-06 02:38:33.638108 | mon1 | Monday 06 July 2026  02:38:33 +0000 (0:00:00.423)       0:02:55.256 ***********
2026-07-06 02:38:34.222034 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-07-06 02:38:34.222134 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-07-06 02:38:34.222653 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-07-06 02:38:34.222689 | mon1 |
2026-07-06 02:38:34.222696 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-07-06 02:38:34.222702 | mon1 | Monday 06 July 2026  02:38:34 +0000 (0:00:00.584)       0:02:55.841 ***********
2026-07-06 02:38:34.645703 | mon1 | ok: [mon1]
2026-07-06 02:38:34.645776 | mon1 |
2026-07-06 02:38:34.645853 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-07-06 02:38:34.645964 | mon1 | Monday 06 July 2026  02:38:34 +0000 (0:00:00.423)       0:02:56.264 ***********
2026-07-06 02:38:35.081527 | mon1 | ok: [mon1]
2026-07-06 02:38:35.081620 | mon1 |
2026-07-06 02:38:35.081650 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-07-06 02:38:35.082028 | mon1 | Monday 06 July 2026  02:38:35 +0000 (0:00:00.429)       0:02:56.694 ***********
2026-07-06 02:38:35.082074 | mon1 |
2026-07-06 02:38:35.082080 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-07-06 02:38:35.082084 | mon1 | Monday 06 July 2026  02:38:35 +0000 (0:00:00.005)       0:02:56.700 ***********
2026-07-06 02:38:35.459156 | mon1 | ok: [mon1]
2026-07-06 02:38:35.459228 | mon1 |
2026-07-06 02:38:35.459635 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-07-06 02:38:35.459677 | mon1 | Monday 06 July 2026  02:38:35 +0000 (0:00:00.377)       0:02:57.078 ***********
2026-07-06 02:38:35.504392 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-07-06 02:38:35.504820 | mon1 |
2026-07-06 02:38:35.504872 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-07-06 02:38:35.504881 | mon1 | Monday 06 July 2026  02:38:35 +0000 (0:00:00.044)       0:02:57.123 ***********
2026-07-06 02:38:36.542112 | mon1 | ok: [mon1]
2026-07-06 02:38:36.542189 | mon1 |
2026-07-06 02:38:36.542520 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-07-06 02:38:36.542568 | mon1 | Monday 06 July 2026  02:38:36 +0000 (0:00:01.037)       0:02:58.160 ***********
2026-07-06 02:38:37.245234 | mon1 | ok: [mon1] => (item=chronyd)
2026-07-06 02:38:37.245303 | mon1 | ok: [mon1] => (item=sshd)
2026-07-06 02:38:37.245598 | mon1 |
2026-07-06 02:38:37.245642 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-07-06 02:38:37.245648 | mon1 | Monday 06 July 2026  02:38:37 +0000 (0:00:00.703)       0:02:58.864 ***********
2026-07-06 02:38:37.553867 | mon1 | ok: [mon1]
2026-07-06 02:38:37.553979 | mon1 |
2026-07-06 02:38:37.553992 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-07-06 02:38:37.554112 | mon1 | Monday 06 July 2026  02:38:37 +0000 (0:00:00.308)       0:02:59.172 ***********
2026-07-06 02:38:37.768829 | mon1 | ok: [mon1]
2026-07-06 02:38:37.768876 | mon1 |
2026-07-06 02:38:37.768881 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-07-06 02:38:37.768886 | mon1 | Monday 06 July 2026  02:38:37 +0000 (0:00:00.214)       0:02:59.387 ***********
2026-07-06 02:38:38.015375 | mon1 | ok: [mon1]
2026-07-06 02:38:38.015577 | mon1 |
2026-07-06 02:38:38.015583 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-07-06 02:38:38.015688 | mon1 | Monday 06 July 2026  02:38:38 +0000 (0:00:00.246)       0:02:59.634 ***********
2026-07-06 02:38:38.228102 | mon1 | ok: [mon1]
2026-07-06 02:38:38.228171 | mon1 |
2026-07-06 02:38:38.228380 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] ***********
2026-07-06 02:38:38.228424 | mon1 | Monday 06 July 2026  02:38:38 +0000 (0:00:00.212)       0:02:59.847 ***********
2026-07-06 02:38:44.358190 | mon1 | ok: [mon1]
2026-07-06 02:38:44.358279 | mon1 |
2026-07-06 02:38:44.360918 | mon1 | PLAY RECAP *********************************************************************
2026-07-06 02:38:44.360962 | mon1 | mon1                       : ok=83   changed=0    unreachable=0    failed=0    skipped=15   rescued=0    ignored=0
2026-07-06 02:38:44.360968 | mon1 | osd1                       : ok=48   changed=0    unreachable=0    failed=0    skipped=9    rescued=0    ignored=0
2026-07-06 02:38:44.360983 | mon1 |
2026-07-06 02:38:44.360988 | mon1 |
2026-07-06 02:38:44.360992 | mon1 | TASKS RECAP ********************************************************************
2026-07-06 02:38:44.360996 | mon1 | Monday 06 July 2026  02:38:44 +0000 (0:00:06.130)       0:03:05.977 ***********
2026-07-06 02:38:44.361006 | mon1 | ===============================================================================
2026-07-06 02:38:44.361010 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.13s
2026-07-06 02:38:44.361014 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.79s
2026-07-06 02:38:44.361018 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.21s
2026-07-06 02:38:44.361022 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.67s
2026-07-06 02:38:44.361026 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.54s
2026-07-06 02:38:44.361029 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.40s
2026-07-06 02:38:44.361033 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.38s
2026-07-06 02:38:44.361060 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.16s
2026-07-06 02:38:44.361069 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 6.13s
2026-07-06 02:38:44.361074 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.04s
2026-07-06 02:38:44.361080 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.04s
2026-07-06 02:38:44.361085 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.02s
2026-07-06 02:38:44.361090 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.00s
2026-07-06 02:38:44.361095 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 5.99s
2026-07-06 02:38:44.361100 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 5.97s
2026-07-06 02:38:44.361105 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.42s
2026-07-06 02:38:44.361111 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.21s
2026-07-06 02:38:44.361116 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.14s
2026-07-06 02:38:44.361121 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.06s
2026-07-06 02:38:44.361127 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.03s
2026-07-06 02:38:44.460121 | mon1 | INFO     [default > idempotence] Executed: Successful
2026-07-06 02:38:44.470100 | mon1 | INFO     [default > side_effect] Executing
2026-07-06 02:38:44.471060 | mon1 | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-07-06 02:38:44.480745 | mon1 | INFO     [default > verify] Executing
2026-07-06 02:38:45.140357 | mon1 |
2026-07-06 02:38:45.140767 | mon1 | PLAY [Verify] ******************************************************************
2026-07-06 02:38:45.141099 | mon1 |
2026-07-06 02:38:45.141387 | mon1 | TASK [Gathering Facts] *********************************************************
2026-07-06 02:38:45.141641 | mon1 | Monday 06 July 2026  02:38:45 +0000 (0:00:00.007)       0:00:00.007 ***********
2026-07-06 02:38:46.282633 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-07-06 02:38:46.282706 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-07-06 02:38:46.282721 | mon1 | interpreter could change the meaning of that path. See
2026-07-06 02:38:46.282733 | mon1 | https://docs.ansible.com/ansible-
2026-07-06 02:38:46.282747 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-07-06 02:38:46.290748 | mon1 | ok: [mon1]
2026-07-06 02:38:46.290796 | mon1 |
2026-07-06 02:38:46.290805 | mon1 | TASK [Get cluster health status] ***********************************************
2026-07-06 02:38:46.290813 | mon1 | Monday 06 July 2026  02:38:46 +0000 (0:00:01.150)       0:00:01.157 ***********
2026-07-06 02:38:56.440323 | mon1 | ok: [mon1]
2026-07-06 02:38:56.440400 | mon1 |
2026-07-06 02:38:56.440412 | mon1 | TASK [Print cluster health status] *********************************************
2026-07-06 02:38:56.440423 | mon1 | Monday 06 July 2026  02:38:56 +0000 (0:00:10.149)       0:00:11.306 ***********
2026-07-06 02:38:56.473484 | mon1 | ok: [mon1] => {
2026-07-06 02:38:56.473508 | mon1 |     "_ceph_health": {
2026-07-06 02:38:56.473513 | mon1 |         "changed": false,
2026-07-06 02:38:56.473517 | mon1 |         "cmd": [
2026-07-06 02:38:56.473521 | mon1 |             "cephadm",
2026-07-06 02:38:56.473525 | mon1 |             "shell",
2026-07-06 02:38:56.473529 | mon1 |             "--",
2026-07-06 02:38:56.473532 | mon1 |             "ceph",
2026-07-06 02:38:56.473536 | mon1 |             "health"
2026-07-06 02:38:56.473608 | mon1 |         ],
2026-07-06 02:38:56.473823 | mon1 |         "delta": "0:00:09.868017",
2026-07-06 02:38:56.474016 | mon1 |         "end": "2026-07-06 02:38:56.404840",
2026-07-06 02:38:56.474201 | mon1 |         "failed": false,
2026-07-06 02:38:56.474383 | mon1 |         "msg": "",
2026-07-06 02:38:56.474565 | mon1 |         "rc": 0,
2026-07-06 02:38:56.474756 | mon1 |         "start": "2026-07-06 02:38:46.536823",
2026-07-06 02:38:56.474967 | mon1 |         "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config",
2026-07-06 02:38:56.475153 | mon1 |         "stderr_lines": [
2026-07-06 02:38:56.475347 | mon1 |             "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2",
2026-07-06 02:38:56.475551 | mon1 |             "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config"
2026-07-06 02:38:56.475737 | mon1 |         ],
2026-07-06 02:38:56.475921 | mon1 |         "stdout": "HEALTH_OK",
2026-07-06 02:38:56.476110 | mon1 |         "stdout_lines": [
2026-07-06 02:38:56.476290 | mon1 |             "HEALTH_OK"
2026-07-06 02:38:56.476475 | mon1 |         ]
2026-07-06 02:38:56.476653 | mon1 |     }
2026-07-06 02:38:56.476834 | mon1 | }
2026-07-06 02:38:56.477011 | mon1 |
2026-07-06 02:38:56.477233 | mon1 | TASK [Assert that the cluster status is healthy] *******************************
2026-07-06 02:38:56.477427 | mon1 | Monday 06 July 2026  02:38:56 +0000 (0:00:00.032)       0:00:11.339 ***********
2026-07-06 02:38:56.499269 | mon1 | ok: [mon1] => {
2026-07-06 02:38:56.499510 | mon1 |     "changed": false,
2026-07-06 02:38:56.499718 | mon1 |     "msg": "All assertions passed"
2026-07-06 02:38:56.499946 | mon1 | }
2026-07-06 02:38:56.500144 | mon1 |
2026-07-06 02:38:56.500355 | mon1 | TASK [Create a test Ceph pool] *************************************************
2026-07-06 02:38:56.500566 | mon1 | Monday 06 July 2026  02:38:56 +0000 (0:00:00.027)       0:00:11.366 ***********
2026-07-06 02:39:03.305190 | mon1 | changed: [mon1]
2026-07-06 02:39:03.305277 | mon1 |
2026-07-06 02:39:03.305291 | mon1 | TASK [Create a test Ceph key] **************************************************
2026-07-06 02:39:03.305423 | mon1 | Monday 06 July 2026  02:39:03 +0000 (0:00:06.805)       0:00:18.172 ***********
2026-07-06 02:39:05.358630 | mon1 | changed: [mon1]
2026-07-06 02:39:05.358700 | mon1 |
2026-07-06 02:39:05.358713 | mon1 | TASK [Retrieve info for the test Ceph key] *************************************
2026-07-06 02:39:05.358723 | mon1 | Monday 06 July 2026  02:39:05 +0000 (0:00:02.052)       0:00:20.225 ***********
2026-07-06 02:39:06.353784 | mon1 | ok: [mon1]
2026-07-06 02:39:06.353861 | mon1 |
2026-07-06 02:39:06.354223 | mon1 | TASK [Assert that key_info returns the correct key] ****************************
2026-07-06 02:39:06.354300 | mon1 | Monday 06 July 2026  02:39:06 +0000 (0:00:00.995)       0:00:21.220 ***********
2026-07-06 02:39:06.394751 | mon1 | ok: [mon1] => {
2026-07-06 02:39:06.394843 | mon1 |     "changed": false,
2026-07-06 02:39:06.395327 | mon1 |     "msg": "All assertions passed"
2026-07-06 02:39:06.395363 | mon1 | }
2026-07-06 02:39:06.395368 | mon1 |
2026-07-06 02:39:06.395373 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] *********
2026-07-06 02:39:06.395378 | mon1 | Monday 06 July 2026  02:39:06 +0000 (0:00:00.041)       0:00:21.262 ***********
2026-07-06 02:39:07.341167 | mon1 | ok: [mon1]
2026-07-06 02:39:07.341228 | mon1 |
2026-07-06 02:39:07.341666 | mon1 | TASK [Assert that the legacy key module info state returns the correct key] ****
2026-07-06 02:39:07.341741 | mon1 | Monday 06 July 2026  02:39:07 +0000 (0:00:00.945)       0:00:22.207 ***********
2026-07-06 02:39:07.374184 | mon1 | ok: [mon1] => {
2026-07-06 02:39:07.377126 | mon1 |     "changed": false,
2026-07-06 02:39:07.377183 | mon1 |     "msg": "All assertions passed"
2026-07-06 02:39:07.377190 | mon1 | }
2026-07-06 02:39:07.377196 | mon1 |
2026-07-06 02:39:07.377203 | mon1 | PLAY RECAP *********************************************************************
2026-07-06 02:39:07.377209 | mon1 | mon1                       : ok=10   changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-07-06 02:39:07.377215 | mon1 |
2026-07-06 02:39:07.377221 | mon1 |
2026-07-06 02:39:07.377226 | mon1 | TASKS RECAP ********************************************************************
2026-07-06 02:39:07.377232 | mon1 | Monday 06 July 2026  02:39:07 +0000 (0:00:00.033)       0:00:22.241 ***********
2026-07-06 02:39:07.377237 | mon1 | ===============================================================================
2026-07-06 02:39:07.377243 | mon1 | Get cluster health status ---------------------------------------------- 10.15s
2026-07-06 02:39:07.377248 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.81s
2026-07-06 02:39:07.377253 | mon1 | Create a test Ceph key -------------------------------------------------- 2.05s
2026-07-06 02:39:07.377259 | mon1 | Gathering Facts --------------------------------------------------------- 1.15s
2026-07-06 02:39:07.377264 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.00s
2026-07-06 02:39:07.377356 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 0.95s
2026-07-06 02:39:07.377532 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s
2026-07-06 02:39:07.377702 | mon1 | Assert that the legacy key module info state returns the correct key ---- 0.03s
2026-07-06 02:39:07.377868 | mon1 | Print cluster health status --------------------------------------------- 0.03s
2026-07-06 02:39:07.378033 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s
2026-07-06 02:39:07.447613 | mon1 | INFO     [default > verify] Executed: Successful
2026-07-06 02:39:07.457272 | mon1 | INFO     [default > cleanup] Executing
2026-07-06 02:39:07.457704 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-07-06 02:39:07.464747 | mon1 | INFO     [default > destroy] Executing
2026-07-06 02:39:07.464842 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-07-06 02:39:07.464926 | mon1 | INFO     [default > destroy] Executed: Successful
2026-07-06 02:39:07.465222 | mon1 | WARNING  Molecule executed 1 scenario (1 missing files)
2026-07-06 02:39:07.831068 | mon1 | ok: Runtime: 0:15:23.931107
2026-07-06 02:39:07.850892 | 
2026-07-06 02:39:07.850950 | PLAY RECAP
2026-07-06 02:39:07.850997 | mon1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-06 02:39:07.851020 | 
2026-07-06 02:39:07.996616 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-07-06 02:39:08.002984 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-07-06 02:39:08.579055 | 
2026-07-06 02:39:08.579442 | PLAY [all]
2026-07-06 02:39:08.591051 | 
2026-07-06 02:39:08.591132 | TASK [fetch-output : Set log path for multiple nodes]
2026-07-06 02:39:08.646076 | mon1 | ok
2026-07-06 02:39:08.650619 | osd1 | ok
2026-07-06 02:39:08.654932 | 
2026-07-06 02:39:08.655002 | TASK [fetch-output : Set log path for single node]
2026-07-06 02:39:08.678699 | mon1 | skipping: Conditional result was False
2026-07-06 02:39:08.689966 | osd1 | skipping: Conditional result was False
2026-07-06 02:39:08.696545 | 
2026-07-06 02:39:08.696633 | LOOP [fetch-output : Ensure local output dirs]
2026-07-06 02:39:09.088583 | osd1 -> localhost | changed: "/var/lib/zuul/builds/424277dfe0b6410487cd474957978173/work/logs/osd1"
2026-07-06 02:39:09.089688 | mon1 -> localhost | changed: "/var/lib/zuul/builds/424277dfe0b6410487cd474957978173/work/logs/mon1"
2026-07-06 02:39:09.286056 | osd1 -> localhost | changed: "/var/lib/zuul/builds/424277dfe0b6410487cd474957978173/work/artifacts"
2026-07-06 02:39:09.294733 | mon1 -> localhost | ok: "/var/lib/zuul/builds/424277dfe0b6410487cd474957978173/work/artifacts"
2026-07-06 02:39:09.491285 | osd1 -> localhost | changed: "/var/lib/zuul/builds/424277dfe0b6410487cd474957978173/work/docs"
2026-07-06 02:39:09.499594 | mon1 -> localhost | ok: "/var/lib/zuul/builds/424277dfe0b6410487cd474957978173/work/docs"
2026-07-06 02:39:09.499669 | mon1 -> localhost | changed: All items complete
2026-07-06 02:39:09.499706 | 
2026-07-06 02:39:09.520793 | 
2026-07-06 02:39:09.520980 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-07-06 02:39:10.134758 | mon1 | changed: .d..t...... ./
2026-07-06 02:39:10.139725 | osd1 | changed: .d..t...... ./
2026-07-06 02:39:10.568697 | osd1 | changed: .d..t...... ./
2026-07-06 02:39:10.591371 | mon1 | ok
2026-07-06 02:39:10.999310 | osd1 | changed: .d..t...... ./
2026-07-06 02:39:11.053643 | mon1 | ok
2026-07-06 02:39:11.053770 | mon1 | changed: All items complete
2026-07-06 02:39:11.053824 | 
2026-07-06 02:39:11.081760 | 
2026-07-06 02:39:11.081914 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-07-06 02:39:11.511796 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008675
2026-07-06 02:39:11.760855 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.008917
2026-07-06 02:39:11.778281 | 
2026-07-06 02:39:11.778377 | PLAY [all]
2026-07-06 02:39:11.785107 | 
2026-07-06 02:39:11.785181 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-07-06 02:39:12.211838 | mon1 | changed
2026-07-06 02:39:12.405783 | osd1 | changed
2026-07-06 02:39:12.416454 | 
2026-07-06 02:39:12.416505 | PLAY RECAP
2026-07-06 02:39:12.416553 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-07-06 02:39:12.416582 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-07-06 02:39:12.416601 | 
2026-07-06 02:39:12.555344 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-07-06 02:39:12.561237 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-07-06 02:39:13.140416 | 
2026-07-06 02:39:13.140539 | PLAY [localhost]
2026-07-06 02:39:13.150178 | 
2026-07-06 02:39:13.150246 | TASK [Generate Zuul manifest]
2026-07-06 02:39:13.170778 | localhost | ok
2026-07-06 02:39:13.188224 | 
2026-07-06 02:39:13.188302 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-07-06 02:39:13.560054 | localhost | changed
2026-07-06 02:39:13.571368 | 
2026-07-06 02:39:13.571442 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-07-06 02:39:13.603324 | localhost | ok
2026-07-06 02:39:13.610112 | 
2026-07-06 02:39:13.610172 | TASK [Upload logs]
2026-07-06 02:39:13.630918 | localhost | ok
2026-07-06 02:39:13.694770 | 
2026-07-06 02:39:13.694929 | TASK [Set zuul-log-path fact]
2026-07-06 02:39:13.718393 | localhost | ok
2026-07-06 02:39:13.731476 | 
2026-07-06 02:39:13.731541 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-07-06 02:39:13.763419 | localhost | ok
2026-07-06 02:39:13.771742 | 
2026-07-06 02:39:13.771803 | TASK [upload-logs : Create log directories]
2026-07-06 02:39:14.164793 | localhost | changed
2026-07-06 02:39:14.170262 | 
2026-07-06 02:39:14.170327 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-07-06 02:39:14.572913 | localhost -> localhost | ok: Runtime: 0:00:00.005360
2026-07-06 02:39:14.577874 | 
2026-07-06 02:39:14.577938 | TASK [upload-logs : Upload logs to log server]
2026-07-06 02:39:15.020582 | localhost | Output suppressed because no_log was given
2026-07-06 02:39:15.025575 | 
2026-07-06 02:39:15.025662 | LOOP [upload-logs : Compress console log and json output]
2026-07-06 02:39:15.112863 | localhost | skipping: Conditional result was False
2026-07-06 02:39:15.120188 | localhost | skipping: Conditional result was False
2026-07-06 02:39:15.134424 | 
2026-07-06 02:39:15.134598 | LOOP [upload-logs : Upload compressed console log and json output]
2026-07-06 02:39:15.217656 | localhost | skipping: Conditional result was False
2026-07-06 02:39:15.218041 | 
2026-07-06 02:39:15.221663 | localhost | skipping: Conditional result was False
2026-07-06 02:39:15.269923 | 
2026-07-06 02:39:15.270055 | LOOP [upload-logs : Upload console log and json output]