2026-08-31 07:12:04.375316 | Job console starting 2026-08-31 07:12:04.397718 | Updating git repos 2026-08-31 07:12:04.428314 | Cloning repos into workspace 2026-08-31 07:12:04.658604 | Restoring repo states 2026-08-31 07:12:04.668104 | Merging changes 2026-08-31 07:12:05.023090 | Checking out repos 2026-08-31 07:12:05.088687 | Preparing playbooks 2026-08-31 07:12:07.211561 | Running Ansible setup 2026-08-31 07:12:12.303018 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-31 07:12:13.002377 | 2026-08-31 07:12:13.002527 | PLAY [localhost] 2026-08-31 07:12:13.010453 | 2026-08-31 07:12:13.010523 | TASK [Gathering Facts] 2026-08-31 07:12:14.038598 | localhost | ok 2026-08-31 07:12:14.049758 | 2026-08-31 07:12:14.049928 | TASK [Setup log path fact] 2026-08-31 07:12:14.081076 | localhost | ok 2026-08-31 07:12:14.095266 | 2026-08-31 07:12:14.095359 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-31 07:12:14.129775 | localhost | ok 2026-08-31 07:12:14.136164 | 2026-08-31 07:12:14.136244 | TASK [emit-job-header : Print job information] 2026-08-31 07:12:14.189390 | # Job Information 2026-08-31 07:12:14.189616 | Ansible Version: 2.16.18 2026-08-31 07:12:14.189680 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-08-31 07:12:14.189770 | Pipeline: check 2026-08-31 07:12:14.189808 | Executor: 2d72f0692154 2026-08-31 07:12:14.189912 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/42 2026-08-31 07:12:14.189949 | Event ID: a0ac6f60-a509-11f1-83dd-be8986908f68 2026-08-31 07:12:14.194736 | 2026-08-31 07:12:14.194835 | LOOP [emit-job-header : Print node information] 2026-08-31 07:12:14.304961 | localhost | ok: 2026-08-31 07:12:14.305217 | localhost | # Node Information 2026-08-31 07:12:14.305252 | localhost | Inventory Hostname: mon1 2026-08-31 07:12:14.305274 | localhost | Hostname: np0000191581 2026-08-31 07:12:14.305294 | localhost | Username: zuul 2026-08-31 07:12:14.305316 | localhost | Distro: Ubuntu 22.04 2026-08-31 07:12:14.305420 | localhost | Provider: yul1 2026-08-31 07:12:14.305450 | localhost | Region: ca-ymq-1 2026-08-31 07:12:14.305469 | localhost | Label: ubuntu-jammy 2026-08-31 07:12:14.305487 | localhost | Product Name: OpenStack Nova 2026-08-31 07:12:14.305507 | localhost | Interface IP: 162.253.55.210 2026-08-31 07:12:14.355337 | localhost | ok: 2026-08-31 07:12:14.355461 | localhost | # Node Information 2026-08-31 07:12:14.355488 | localhost | Inventory Hostname: osd1 2026-08-31 07:12:14.355509 | localhost | Hostname: np0000191582 2026-08-31 07:12:14.355528 | localhost | Username: zuul 2026-08-31 07:12:14.355547 | localhost | Distro: Ubuntu 22.04 2026-08-31 07:12:14.355565 | localhost | Provider: yul1 2026-08-31 07:12:14.355584 | localhost | Region: ca-ymq-1 2026-08-31 07:12:14.355603 | localhost | Label: ubuntu-jammy 2026-08-31 07:12:14.355621 | localhost | Product Name: OpenStack Nova 2026-08-31 07:12:14.355640 | localhost | Interface IP: 162.253.55.14 2026-08-31 07:12:14.366613 | 2026-08-31 07:12:14.367530 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-08-31 07:12:14.807943 | localhost -> localhost | changed 2026-08-31 07:12:14.817721 | 2026-08-31 07:12:14.818167 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-08-31 07:12:15.934457 | localhost -> localhost | changed 2026-08-31 07:12:15.942621 | 2026-08-31 07:12:15.942679 | PLAY [all] 2026-08-31 07:12:15.951692 | 2026-08-31 07:12:15.951759 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-08-31 07:12:16.242043 | mon1 -> localhost | ok 2026-08-31 07:12:16.255287 | 2026-08-31 07:12:16.255787 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-08-31 07:12:16.302360 | mon1 | ok 2026-08-31 07:12:16.309633 | osd1 | ok 2026-08-31 07:12:16.342822 | mon1 | included: /var/lib/zuul/builds/5572f2eb761c43b78477d2c2dc5d9864/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-31 07:12:16.342994 | osd1 | included: /var/lib/zuul/builds/5572f2eb761c43b78477d2c2dc5d9864/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-31 07:12:16.355718 | 2026-08-31 07:12:16.355836 | TASK [add-build-sshkey : Create Temp SSH key] 2026-08-31 07:12:17.449125 | mon1 -> localhost | Generating public/private rsa key pair. 2026-08-31 07:12:17.449308 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/5572f2eb761c43b78477d2c2dc5d9864/work/5572f2eb761c43b78477d2c2dc5d9864_id_rsa 2026-08-31 07:12:17.449340 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/5572f2eb761c43b78477d2c2dc5d9864/work/5572f2eb761c43b78477d2c2dc5d9864_id_rsa.pub 2026-08-31 07:12:17.449365 | mon1 -> localhost | The key fingerprint is: 2026-08-31 07:12:17.449388 | mon1 -> localhost | SHA256:WgRWrGr644XwStNmbgb2FNSGs1Oc67EAvQYLqzuFBoU zuul-build-sshkey 2026-08-31 07:12:17.449409 | mon1 -> localhost | The key's randomart image is: 2026-08-31 07:12:17.449430 | mon1 -> localhost | +---[RSA 3072]----+ 2026-08-31 07:12:17.449450 | mon1 -> localhost | | . . +o+. | 2026-08-31 07:12:17.449471 | mon1 -> localhost | |E + =.*.. | 2026-08-31 07:12:17.449491 | mon1 -> localhost | | + = * o. | 2026-08-31 07:12:17.449512 | mon1 -> localhost | |o . B +. | 2026-08-31 07:12:17.449532 | mon1 -> localhost | |o... * oS | 2026-08-31 07:12:17.449551 | mon1 -> localhost | |o.+++.oo | 2026-08-31 07:12:17.449571 | mon1 -> localhost | |.+o** o | 2026-08-31 07:12:17.449590 | mon1 -> localhost | |o..*=. | 2026-08-31 07:12:17.449609 | mon1 -> localhost | | ..=+. | 2026-08-31 07:12:17.449627 | mon1 -> localhost | +----[SHA256]-----+ 2026-08-31 07:12:17.449677 | mon1 -> localhost | ok: Runtime: 0:00:00.665960 2026-08-31 07:12:17.454892 | 2026-08-31 07:12:17.454958 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-08-31 07:12:17.487809 | mon1 | ok 2026-08-31 07:12:17.492759 | osd1 | ok 2026-08-31 07:12:17.504909 | mon1 | included: /var/lib/zuul/builds/5572f2eb761c43b78477d2c2dc5d9864/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-31 07:12:17.504974 | osd1 | included: /var/lib/zuul/builds/5572f2eb761c43b78477d2c2dc5d9864/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-31 07:12:17.515058 | 2026-08-31 07:12:17.515121 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-08-31 07:12:17.542549 | mon1 | skipping: Conditional result was False 2026-08-31 07:12:17.553770 | osd1 | skipping: Conditional result was False 2026-08-31 07:12:17.563559 | 2026-08-31 07:12:17.563663 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-08-31 07:12:18.093336 | osd1 | changed 2026-08-31 07:12:18.169621 | mon1 | changed 2026-08-31 07:12:18.174796 | 2026-08-31 07:12:18.174862 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-08-31 07:12:18.376532 | mon1 | ok 2026-08-31 07:12:18.403893 | osd1 | ok 2026-08-31 07:12:18.408987 | 2026-08-31 07:12:18.409055 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-08-31 07:12:18.944485 | osd1 | changed 2026-08-31 07:12:18.986769 | mon1 | changed 2026-08-31 07:12:18.992232 | 2026-08-31 07:12:18.992302 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-08-31 07:12:19.612244 | osd1 | changed 2026-08-31 07:12:19.618734 | mon1 | changed 2026-08-31 07:12:19.624867 | 2026-08-31 07:12:19.624932 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-08-31 07:12:19.661453 | mon1 | skipping: Conditional result was False 2026-08-31 07:12:19.672517 | osd1 | skipping: Conditional result was False 2026-08-31 07:12:19.685509 | 2026-08-31 07:12:19.685582 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-08-31 07:12:20.146580 | mon1 -> localhost | changed 2026-08-31 07:12:20.170617 | 2026-08-31 07:12:20.170898 | TASK [add-build-sshkey : Add back temp key] 2026-08-31 07:12:20.563200 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/5572f2eb761c43b78477d2c2dc5d9864/work/5572f2eb761c43b78477d2c2dc5d9864_id_rsa (zuul-build-sshkey) 2026-08-31 07:12:20.563479 | mon1 -> localhost | ok: Runtime: 0:00:00.035977 2026-08-31 07:12:20.569829 | 2026-08-31 07:12:20.569930 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-08-31 07:12:20.908124 | mon1 | ok 2026-08-31 07:12:20.915984 | osd1 | ok 2026-08-31 07:12:20.920604 | 2026-08-31 07:12:20.920670 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-08-31 07:12:20.954899 | mon1 | skipping: Conditional result was False 2026-08-31 07:12:20.966616 | osd1 | skipping: Conditional result was False 2026-08-31 07:12:20.985170 | 2026-08-31 07:12:20.985241 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-08-31 07:12:21.282662 | mon1 | ok 2026-08-31 07:12:21.300427 | osd1 | ok 2026-08-31 07:12:21.307441 | 2026-08-31 07:12:21.307524 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-08-31 07:12:22.299421 | osd1 | Output suppressed because no_log was given 2026-08-31 07:12:22.315225 | mon1 | Output suppressed because no_log was given 2026-08-31 07:12:22.345388 | 2026-08-31 07:12:22.345553 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-08-31 07:12:22.578138 | mon1 | ok: "logs" 2026-08-31 07:12:22.578472 | mon1 | ok: All items complete 2026-08-31 07:12:22.578505 | 2026-08-31 07:12:22.614683 | osd1 | ok: "logs" 2026-08-31 07:12:22.755173 | mon1 | ok: "artifacts" 2026-08-31 07:12:22.793819 | osd1 | ok: "artifacts" 2026-08-31 07:12:22.943677 | mon1 | ok: "docs" 2026-08-31 07:12:22.955704 | osd1 | ok: "docs" 2026-08-31 07:12:22.966009 | 2026-08-31 07:12:22.966163 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-08-31 07:12:23.194534 | mon1 | changed: "logs" 2026-08-31 07:12:23.194798 | mon1 | ok: All items complete 2026-08-31 07:12:23.194826 | 2026-08-31 07:12:23.199578 | osd1 | changed: "logs" 2026-08-31 07:12:23.352215 | osd1 | changed: "artifacts" 2026-08-31 07:12:23.385980 | mon1 | changed: "artifacts" 2026-08-31 07:12:23.509897 | osd1 | changed: "docs" 2026-08-31 07:12:23.560144 | mon1 | changed: "docs" 2026-08-31 07:12:23.578953 | 2026-08-31 07:12:23.579119 | PLAY RECAP 2026-08-31 07:12:23.579178 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-31 07:12:23.579211 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-31 07:12:23.579278 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-31 07:12:23.579307 | 2026-08-31 07:12:23.774107 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-31 07:12:23.776693 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-31 07:12:24.570953 | 2026-08-31 07:12:24.571111 | PLAY [all] 2026-08-31 07:12:24.582907 | 2026-08-31 07:12:24.583004 | TASK [setup-uv : Extract archive] 2026-08-31 07:12:26.993762 | osd1 | changed 2026-08-31 07:12:27.017796 | mon1 | changed 2026-08-31 07:12:27.028467 | 2026-08-31 07:12:27.028802 | TASK [setup-uv : Print version] 2026-08-31 07:12:27.672366 | osd1 | uv 0.8.13 2026-08-31 07:12:27.672111 | mon1 | uv 0.8.13 2026-08-31 07:12:28.107140 | mon1 | ok: Runtime: 0:00:00.013446 2026-08-31 07:12:28.116664 | osd1 | ok: Runtime: 0:00:00.012827 2026-08-31 07:12:28.133588 | 2026-08-31 07:12:28.133777 | TASK [Install Ansible collection siblings] 2026-08-31 07:12:28.817358 | mon1 | ok: 2026-08-31 07:12:28.817546 | mon1 | Skipping community.general: no checked-out sibling 2026-08-31 07:12:28.817574 | mon1 | Skipping ansible.utils: no checked-out sibling 2026-08-31 07:12:28.817595 | mon1 | Skipping vexxhost.containers: no checked-out sibling 2026-08-31 07:12:28.820371 | 2026-08-31 07:12:28.820429 | PLAY RECAP 2026-08-31 07:12:28.820483 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-31 07:12:28.820524 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-31 07:12:28.820545 | 2026-08-31 07:12:29.025719 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-31 07:12:29.029849 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-31 07:12:29.821664 | 2026-08-31 07:12:29.821949 | PLAY [all] 2026-08-31 07:12:29.835888 | 2026-08-31 07:12:29.836019 | LOOP [Check inventory directories] 2026-08-31 07:12:30.244362 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-31 07:12:30.431995 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-08-31 07:12:30.620647 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-08-31 07:12:30.635617 | 2026-08-31 07:12:30.635822 | LOOP [Copy inventory file for Zuul] 2026-08-31 07:12:31.568610 | mon1 | changed: 2026-08-31 07:12:31.568815 | mon1 | { 2026-08-31 07:12:31.568844 | mon1 | "ansible_loop_var": "item", 2026-08-31 07:12:31.568870 | mon1 | "changed": false, 2026-08-31 07:12:31.568891 | mon1 | "failed": false, 2026-08-31 07:12:31.568914 | mon1 | "invocation": { 2026-08-31 07:12:31.568935 | mon1 | "module_args": { 2026-08-31 07:12:31.568970 | mon1 | "checksum_algorithm": "sha1", 2026-08-31 07:12:31.568993 | mon1 | "follow": true, 2026-08-31 07:12:31.569013 | mon1 | "get_attributes": true, 2026-08-31 07:12:31.569033 | mon1 | "get_checksum": true, 2026-08-31 07:12:31.569051 | mon1 | "get_mime": true, 2026-08-31 07:12:31.569069 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-31 07:12:31.569087 | mon1 | } 2026-08-31 07:12:31.569105 | mon1 | }, 2026-08-31 07:12:31.569122 | mon1 | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-31 07:12:31.569140 | mon1 | "stat": { 2026-08-31 07:12:31.569158 | mon1 | "atime": 1788160342.1846137, 2026-08-31 07:12:31.569177 | mon1 | "attr_flags": "e", 2026-08-31 07:12:31.569195 | mon1 | "attributes": [ 2026-08-31 07:12:31.569213 | mon1 | "extents" 2026-08-31 07:12:31.569231 | mon1 | ], 2026-08-31 07:12:31.569249 | mon1 | "block_size": 4096, 2026-08-31 07:12:31.569267 | mon1 | "blocks": 8, 2026-08-31 07:12:31.569284 | mon1 | "charset": "unknown", 2026-08-31 07:12:31.569303 | mon1 | "ctime": 1788160342.2006145, 2026-08-31 07:12:31.569322 | mon1 | "dev": 64513, 2026-08-31 07:12:31.569339 | mon1 | "device_type": 0, 2026-08-31 07:12:31.569357 | mon1 | "executable": true, 2026-08-31 07:12:31.569374 | mon1 | "exists": true, 2026-08-31 07:12:31.569391 | mon1 | "gid": 1000, 2026-08-31 07:12:31.569408 | mon1 | "gr_name": "zuul", 2026-08-31 07:12:31.569425 | mon1 | "inode": 1042461, 2026-08-31 07:12:31.569442 | mon1 | "isblk": false, 2026-08-31 07:12:31.569460 | mon1 | "ischr": false, 2026-08-31 07:12:31.569477 | mon1 | "isdir": true, 2026-08-31 07:12:31.569495 | mon1 | "isfifo": false, 2026-08-31 07:12:31.569512 | mon1 | "isgid": false, 2026-08-31 07:12:31.569530 | mon1 | "islnk": false, 2026-08-31 07:12:31.569548 | mon1 | "isreg": false, 2026-08-31 07:12:31.569565 | mon1 | "issock": false, 2026-08-31 07:12:31.569584 | mon1 | "isuid": false, 2026-08-31 07:12:31.569652 | mon1 | "mimetype": "unknown", 2026-08-31 07:12:31.569675 | mon1 | "mode": "0755", 2026-08-31 07:12:31.569693 | mon1 | "mtime": 1788160324.6931467, 2026-08-31 07:12:31.569712 | mon1 | "nlink": 10, 2026-08-31 07:12:31.569730 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-31 07:12:31.569749 | mon1 | "pw_name": "zuul", 2026-08-31 07:12:31.569769 | mon1 | "readable": true, 2026-08-31 07:12:31.569791 | mon1 | "rgrp": true, 2026-08-31 07:12:31.569809 | mon1 | "roth": true, 2026-08-31 07:12:31.569828 | mon1 | "rusr": true, 2026-08-31 07:12:31.569846 | mon1 | "size": 4096, 2026-08-31 07:12:31.569878 | mon1 | "uid": 1000, 2026-08-31 07:12:31.569897 | mon1 | "version": "2951568293", 2026-08-31 07:12:31.569916 | mon1 | "wgrp": false, 2026-08-31 07:12:31.569935 | mon1 | "woth": false, 2026-08-31 07:12:31.569953 | mon1 | "writeable": true, 2026-08-31 07:12:31.569971 | mon1 | "wusr": true, 2026-08-31 07:12:31.569989 | mon1 | "xgrp": true, 2026-08-31 07:12:31.570006 | mon1 | "xoth": true, 2026-08-31 07:12:31.570024 | mon1 | "xusr": true 2026-08-31 07:12:31.570042 | mon1 | } 2026-08-31 07:12:31.570059 | mon1 | } 2026-08-31 07:12:31.570093 | mon1 | ok: All items complete 2026-08-31 07:12:31.570115 | 2026-08-31 07:12:31.571437 | mon1 | skipping: Conditional result was False 2026-08-31 07:12:31.574277 | mon1 | skipping: Conditional result was False 2026-08-31 07:12:31.593574 | 2026-08-31 07:12:31.593766 | LOOP [Switch "ansible_host" to private IP] 2026-08-31 07:12:32.055609 | mon1 | changed: 2 replacements made 2026-08-31 07:12:32.057014 | mon1 | skipping: Conditional result was False 2026-08-31 07:12:32.059575 | mon1 | skipping: Conditional result was False 2026-08-31 07:12:32.079290 | 2026-08-31 07:12:32.079422 | TASK [Run Molecule scenario] 2026-08-31 07:12:32.797802 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-08-31 07:12:33.489612 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-08-31 07:12:33.690109 | mon1 | Using CPython 3.13.7 2026-08-31 07:12:33.690203 | mon1 | Creating virtual environment at: .venv 2026-08-31 07:12:34.898022 | mon1 | Downloading netaddr (2.2MiB) 2026-08-31 07:12:34.899399 | mon1 | Downloading pygments (1.2MiB) 2026-08-31 07:12:34.900313 | mon1 | Downloading cryptography (4.3MiB) 2026-08-31 07:12:34.901047 | mon1 | Downloading ansible-core (2.1MiB) 2026-08-31 07:12:35.097823 | mon1 | Downloading netaddr 2026-08-31 07:12:35.108440 | mon1 | Downloading cryptography 2026-08-31 07:12:35.154585 | mon1 | Downloading pygments 2026-08-31 07:12:35.290943 | mon1 | Downloading ansible-core 2026-08-31 07:12:35.332877 | mon1 | Installed 36 packages in 41ms 2026-08-31 07:12:36.519622 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-08-31 07:12:36.519727 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-08-31 07:12:37.207316 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-08-31 07:12:37.207413 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-08-31 07:13:10.263477 | mon1 | INFO [default > dependency] Executing 2026-08-31 07:13:10.263843 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-08-31 07:13:10.264201 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-08-31 07:13:10.264403 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-08-31 07:13:10.274331 | mon1 | INFO [default > cleanup] Executing 2026-08-31 07:13:10.274873 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-31 07:13:10.284481 | mon1 | INFO [default > destroy] Executing 2026-08-31 07:13:10.284585 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-31 07:13:10.284722 | mon1 | INFO [default > destroy] Executed: Successful 2026-08-31 07:13:10.294296 | mon1 | INFO [default > syntax] Executing 2026-08-31 07:13:11.301591 | mon1 | 2026-08-31 07:13:11.301829 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-08-31 07:13:11.394602 | mon1 | INFO [default > syntax] Executed: Successful 2026-08-31 07:13:11.405798 | mon1 | INFO [default > create] Executing 2026-08-31 07:13:11.412035 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-31 07:13:11.422166 | mon1 | INFO [default > prepare] Executing 2026-08-31 07:13:12.124390 | mon1 | 2026-08-31 07:13:12.124500 | mon1 | PLAY [Prepare] ***************************************************************** 2026-08-31 07:13:12.124652 | mon1 | 2026-08-31 07:13:12.124802 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:13:12.124941 | mon1 | Monday 31 August 2026 07:13:12 +0000 (0:00:00.029) 0:00:00.029 ********* 2026-08-31 07:13:13.404591 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-31 07:13:13.404672 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-31 07:13:13.404823 | mon1 | interpreter could change the meaning of that path. See 2026-08-31 07:13:13.404947 | mon1 | https://docs.ansible.com/ansible- 2026-08-31 07:13:13.405078 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-31 07:13:13.410500 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-31 07:13:13.410625 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-31 07:13:13.410743 | mon1 | interpreter could change the meaning of that path. See 2026-08-31 07:13:13.410859 | mon1 | https://docs.ansible.com/ansible- 2026-08-31 07:13:13.410971 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-31 07:13:13.419974 | mon1 | ok: [osd1] 2026-08-31 07:13:13.420101 | mon1 | ok: [mon1] 2026-08-31 07:13:13.420216 | mon1 | 2026-08-31 07:13:13.420331 | mon1 | TASK [Configure short hostname] ************************************************ 2026-08-31 07:13:13.420470 | mon1 | Monday 31 August 2026 07:13:13 +0000 (0:00:01.296) 0:00:01.325 ********* 2026-08-31 07:13:14.190646 | mon1 | changed: [mon1] 2026-08-31 07:13:14.190770 | mon1 | changed: [osd1] 2026-08-31 07:13:14.190892 | mon1 | 2026-08-31 07:13:14.191029 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-08-31 07:13:14.191172 | mon1 | Monday 31 August 2026 07:13:14 +0000 (0:00:00.770) 0:00:02.096 ********* 2026-08-31 07:13:14.470191 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-08-31 07:13:14.470294 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-08-31 07:13:14.470444 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-08-31 07:13:14.508433 | mon1 | changed: [mon1] 2026-08-31 07:13:14.508516 | mon1 | changed: [osd1] 2026-08-31 07:13:14.508674 | mon1 | 2026-08-31 07:13:14.508813 | mon1 | TASK [Update apt cache] ******************************************************** 2026-08-31 07:13:14.508955 | mon1 | Monday 31 August 2026 07:13:14 +0000 (0:00:00.317) 0:00:02.414 ********* 2026-08-31 07:13:21.805553 | mon1 | changed: [mon1] 2026-08-31 07:13:21.805714 | mon1 | changed: [osd1] 2026-08-31 07:13:21.805869 | mon1 | 2026-08-31 07:13:21.806045 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-08-31 07:13:21.806201 | mon1 | 2026-08-31 07:13:21.806382 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:13:21.806590 | mon1 | Monday 31 August 2026 07:13:21 +0000 (0:00:07.297) 0:00:09.711 ********* 2026-08-31 07:13:22.593281 | mon1 | ok: [osd1] 2026-08-31 07:13:22.593400 | mon1 | 2026-08-31 07:13:22.593618 | mon1 | TASK [Install depedencies] ***************************************************** 2026-08-31 07:13:22.593791 | mon1 | Monday 31 August 2026 07:13:22 +0000 (0:00:00.787) 0:00:10.499 ********* 2026-08-31 07:13:46.443397 | mon1 | changed: [osd1] 2026-08-31 07:13:46.443491 | mon1 | 2026-08-31 07:13:46.443640 | mon1 | TASK [Start up service] ******************************************************** 2026-08-31 07:13:46.443810 | mon1 | Monday 31 August 2026 07:13:46 +0000 (0:00:23.850) 0:00:34.349 ********* 2026-08-31 07:13:47.014156 | mon1 | ok: [osd1] 2026-08-31 07:13:47.014209 | mon1 | 2026-08-31 07:13:47.014225 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-08-31 07:13:47.014239 | mon1 | Monday 31 August 2026 07:13:47 +0000 (0:00:00.570) 0:00:34.919 ********* 2026-08-31 07:13:47.353993 | mon1 | ok: [osd1] 2026-08-31 07:13:47.354133 | mon1 | 2026-08-31 07:13:47.354317 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-08-31 07:13:47.354502 | mon1 | Monday 31 August 2026 07:13:47 +0000 (0:00:00.340) 0:00:35.259 ********* 2026-08-31 07:13:48.116028 | mon1 | changed: [osd1] 2026-08-31 07:13:48.116094 | mon1 | 2026-08-31 07:13:48.116105 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-08-31 07:13:48.116176 | mon1 | Monday 31 August 2026 07:13:48 +0000 (0:00:00.761) 0:00:36.021 ********* 2026-08-31 07:13:48.333693 | mon1 | ok: [osd1] 2026-08-31 07:13:48.333746 | mon1 | 2026-08-31 07:13:48.333760 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-08-31 07:13:48.333770 | mon1 | Monday 31 August 2026 07:13:48 +0000 (0:00:00.217) 0:00:36.238 ********* 2026-08-31 07:13:48.357161 | mon1 | skipping: [osd1] 2026-08-31 07:13:48.357215 | mon1 | 2026-08-31 07:13:48.357226 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-08-31 07:13:48.357237 | mon1 | Monday 31 August 2026 07:13:48 +0000 (0:00:00.023) 0:00:36.262 ********* 2026-08-31 07:13:48.939411 | mon1 | changed: [osd1] => (item=osd0) 2026-08-31 07:13:48.939548 | mon1 | changed: [osd1] => (item=osd1) 2026-08-31 07:13:48.939711 | mon1 | changed: [osd1] => (item=osd2) 2026-08-31 07:13:48.939909 | mon1 | 2026-08-31 07:13:48.940120 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-08-31 07:13:48.940308 | mon1 | Monday 31 August 2026 07:13:48 +0000 (0:00:00.582) 0:00:36.845 ********* 2026-08-31 07:13:49.606000 | mon1 | changed: [osd1] => (item=osd0) 2026-08-31 07:13:49.606056 | mon1 | changed: [osd1] => (item=osd1) 2026-08-31 07:13:49.606069 | mon1 | changed: [osd1] => (item=osd2) 2026-08-31 07:13:49.606080 | mon1 | 2026-08-31 07:13:49.606091 | mon1 | TASK [Start loop devices] ****************************************************** 2026-08-31 07:13:49.606102 | mon1 | Monday 31 August 2026 07:13:49 +0000 (0:00:00.665) 0:00:37.511 ********* 2026-08-31 07:13:50.398543 | mon1 | changed: [osd1] => (item=osd0) 2026-08-31 07:13:50.398603 | mon1 | changed: [osd1] => (item=osd1) 2026-08-31 07:13:50.398614 | mon1 | changed: [osd1] => (item=osd2) 2026-08-31 07:13:50.398623 | mon1 | 2026-08-31 07:13:50.398634 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-08-31 07:13:50.398644 | mon1 | Monday 31 August 2026 07:13:50 +0000 (0:00:00.792) 0:00:38.303 ********* 2026-08-31 07:13:53.580817 | mon1 | changed: [osd1] => (item=osd0) 2026-08-31 07:13:53.580883 | mon1 | changed: [osd1] => (item=osd1) 2026-08-31 07:13:53.580913 | mon1 | changed: [osd1] => (item=osd2) 2026-08-31 07:13:53.580922 | mon1 | 2026-08-31 07:13:53.580932 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-08-31 07:13:53.580942 | mon1 | Monday 31 August 2026 07:13:53 +0000 (0:00:03.182) 0:00:41.485 ********* 2026-08-31 07:13:55.548094 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-08-31 07:13:55.553935 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-08-31 07:13:55.553982 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-08-31 07:13:55.553993 | mon1 | 2026-08-31 07:13:55.554005 | mon1 | PLAY RECAP ********************************************************************* 2026-08-31 07:13:55.554016 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-08-31 07:13:55.554027 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-31 07:13:55.554036 | mon1 | 2026-08-31 07:13:55.554045 | mon1 | 2026-08-31 07:13:55.554054 | mon1 | TASKS RECAP ******************************************************************** 2026-08-31 07:13:55.554063 | mon1 | Monday 31 August 2026 07:13:55 +0000 (0:00:01.966) 0:00:43.452 ********* 2026-08-31 07:13:55.554085 | mon1 | =============================================================================== 2026-08-31 07:13:55.554095 | mon1 | Install depedencies ---------------------------------------------------- 23.85s 2026-08-31 07:13:55.554104 | mon1 | Update apt cache -------------------------------------------------------- 7.30s 2026-08-31 07:13:55.554113 | mon1 | Create a volume group for each loop device ------------------------------ 3.18s 2026-08-31 07:13:55.554123 | mon1 | Create a logical volume for each loop device ---------------------------- 1.97s 2026-08-31 07:13:55.554131 | mon1 | Gathering Facts --------------------------------------------------------- 1.30s 2026-08-31 07:13:55.554140 | mon1 | Start loop devices ------------------------------------------------------ 0.79s 2026-08-31 07:13:55.554148 | mon1 | Gathering Facts --------------------------------------------------------- 0.79s 2026-08-31 07:13:55.554157 | mon1 | Configure short hostname ------------------------------------------------ 0.77s 2026-08-31 07:13:55.554166 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.76s 2026-08-31 07:13:55.554175 | mon1 | Set permissions on loopback devices ------------------------------------- 0.67s 2026-08-31 07:13:55.554184 | mon1 | Create devices for Ceph ------------------------------------------------- 0.58s 2026-08-31 07:13:55.554193 | mon1 | Start up service -------------------------------------------------------- 0.57s 2026-08-31 07:13:55.554202 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.34s 2026-08-31 07:13:55.554211 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.32s 2026-08-31 07:13:55.554219 | mon1 | Get list of all loopback devices ---------------------------------------- 0.22s 2026-08-31 07:13:55.554228 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-08-31 07:13:55.632213 | mon1 | INFO [default > prepare] Executed: Successful 2026-08-31 07:13:55.644066 | mon1 | INFO [default > converge] Executing 2026-08-31 07:13:56.541235 | mon1 | 2026-08-31 07:13:56.541359 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-31 07:13:56.541536 | mon1 | 2026-08-31 07:13:56.541926 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:13:56.542110 | mon1 | Monday 31 August 2026 07:13:56 +0000 (0:00:00.042) 0:00:00.042 ********* 2026-08-31 07:13:57.632804 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-31 07:13:57.633004 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-31 07:13:57.633191 | mon1 | interpreter could change the meaning of that path. See 2026-08-31 07:13:57.633371 | mon1 | https://docs.ansible.com/ansible- 2026-08-31 07:13:57.633551 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-31 07:13:57.647173 | mon1 | ok: [mon1] 2026-08-31 07:13:57.647322 | mon1 | 2026-08-31 07:13:57.647505 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:13:57.647681 | mon1 | Monday 31 August 2026 07:13:57 +0000 (0:00:01.105) 0:00:01.148 ********* 2026-08-31 07:13:57.960976 | mon1 | ok: [mon1] 2026-08-31 07:13:57.961166 | mon1 | 2026-08-31 07:13:57.961405 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:13:57.961638 | mon1 | Monday 31 August 2026 07:13:57 +0000 (0:00:00.313) 0:00:01.461 ********* 2026-08-31 07:13:58.005320 | mon1 | skipping: [mon1] 2026-08-31 07:13:58.005426 | mon1 | 2026-08-31 07:13:58.005625 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:13:58.005739 | mon1 | Monday 31 August 2026 07:13:58 +0000 (0:00:00.045) 0:00:01.506 ********* 2026-08-31 07:13:58.310381 | mon1 | changed: [mon1] 2026-08-31 07:13:58.310457 | mon1 | 2026-08-31 07:13:58.310489 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:13:58.310598 | mon1 | Monday 31 August 2026 07:13:58 +0000 (0:00:00.304) 0:00:01.811 ********* 2026-08-31 07:13:58.425339 | mon1 | ok: [mon1] => { 2026-08-31 07:13:58.425492 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:13:58.425654 | mon1 | } 2026-08-31 07:13:58.425832 | mon1 | 2026-08-31 07:13:58.426073 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:13:58.426306 | mon1 | Monday 31 August 2026 07:13:58 +0000 (0:00:00.114) 0:00:01.926 ********* 2026-08-31 07:13:59.202578 | mon1 | changed: [mon1] 2026-08-31 07:13:59.202694 | mon1 | 2026-08-31 07:13:59.202912 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:13:59.203090 | mon1 | Monday 31 August 2026 07:13:59 +0000 (0:00:00.776) 0:00:02.703 ********* 2026-08-31 07:13:59.251717 | mon1 | skipping: [mon1] 2026-08-31 07:13:59.251889 | mon1 | 2026-08-31 07:13:59.252103 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:13:59.252288 | mon1 | Monday 31 August 2026 07:13:59 +0000 (0:00:00.049) 0:00:02.753 ********* 2026-08-31 07:13:59.295766 | mon1 | skipping: [mon1] 2026-08-31 07:13:59.295889 | mon1 | 2026-08-31 07:13:59.296108 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:13:59.296293 | mon1 | Monday 31 August 2026 07:13:59 +0000 (0:00:00.044) 0:00:02.797 ********* 2026-08-31 07:13:59.516285 | mon1 | ok: [mon1] 2026-08-31 07:13:59.516355 | mon1 | 2026-08-31 07:13:59.516488 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:13:59.516607 | mon1 | Monday 31 August 2026 07:13:59 +0000 (0:00:00.219) 0:00:03.017 ********* 2026-08-31 07:14:00.866724 | mon1 | ok: [mon1] 2026-08-31 07:14:00.867128 | mon1 | 2026-08-31 07:14:00.867304 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:14:00.867471 | mon1 | Monday 31 August 2026 07:14:00 +0000 (0:00:01.350) 0:00:04.367 ********* 2026-08-31 07:14:00.940698 | mon1 | ok: [mon1] => { 2026-08-31 07:14:00.941076 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:14:00.941305 | mon1 | } 2026-08-31 07:14:00.941515 | mon1 | 2026-08-31 07:14:00.941747 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:14:00.941998 | mon1 | Monday 31 August 2026 07:14:00 +0000 (0:00:00.073) 0:00:04.441 ********* 2026-08-31 07:14:01.648476 | mon1 | changed: [mon1] 2026-08-31 07:14:01.648592 | mon1 | 2026-08-31 07:14:01.648888 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:14:01.649243 | mon1 | Monday 31 August 2026 07:14:01 +0000 (0:00:00.706) 0:00:05.147 ********* 2026-08-31 07:14:04.624466 | mon1 | changed: [mon1] 2026-08-31 07:14:04.624794 | mon1 | 2026-08-31 07:14:04.625059 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:14:04.625308 | mon1 | Monday 31 August 2026 07:14:04 +0000 (0:00:02.977) 0:00:08.125 ********* 2026-08-31 07:14:04.656742 | mon1 | skipping: [mon1] 2026-08-31 07:14:04.657098 | mon1 | 2026-08-31 07:14:04.657371 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:14:04.657637 | mon1 | Monday 31 August 2026 07:14:04 +0000 (0:00:00.032) 0:00:08.157 ********* 2026-08-31 07:14:04.692520 | mon1 | skipping: [mon1] 2026-08-31 07:14:04.692934 | mon1 | 2026-08-31 07:14:04.693099 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:14:04.693255 | mon1 | Monday 31 August 2026 07:14:04 +0000 (0:00:00.033) 0:00:08.190 ********* 2026-08-31 07:14:04.721744 | mon1 | skipping: [mon1] 2026-08-31 07:14:04.721766 | mon1 | 2026-08-31 07:14:04.721773 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:14:04.721780 | mon1 | Monday 31 August 2026 07:14:04 +0000 (0:00:00.031) 0:00:08.222 ********* 2026-08-31 07:14:10.602331 | mon1 | changed: [mon1] 2026-08-31 07:14:10.602387 | mon1 | 2026-08-31 07:14:10.602396 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:14:10.602403 | mon1 | Monday 31 August 2026 07:14:10 +0000 (0:00:05.880) 0:00:14.103 ********* 2026-08-31 07:14:11.205351 | mon1 | changed: [mon1] 2026-08-31 07:14:11.205404 | mon1 | 2026-08-31 07:14:11.205425 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:14:11.205432 | mon1 | Monday 31 August 2026 07:14:11 +0000 (0:00:00.603) 0:00:14.706 ********* 2026-08-31 07:14:12.197784 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:14:12.197839 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:14:12.197849 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:14:12.197856 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:14:12.197862 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:14:12.197869 | mon1 | 2026-08-31 07:14:12.197875 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:14:12.197881 | mon1 | Monday 31 August 2026 07:14:12 +0000 (0:00:00.991) 0:00:15.697 ********* 2026-08-31 07:14:12.853546 | mon1 | changed: [mon1] 2026-08-31 07:14:12.853668 | mon1 | 2026-08-31 07:14:12.854604 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:14:12.854660 | mon1 | Monday 31 August 2026 07:14:12 +0000 (0:00:00.644) 0:00:16.342 ********* 2026-08-31 07:14:12.854672 | mon1 | 2026-08-31 07:14:12.854682 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-31 07:14:12.854691 | mon1 | Monday 31 August 2026 07:14:12 +0000 (0:00:00.012) 0:00:16.354 ********* 2026-08-31 07:14:13.790038 | mon1 | ok: [mon1] 2026-08-31 07:14:13.790645 | mon1 | 2026-08-31 07:14:13.790698 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-31 07:14:13.790710 | mon1 | Monday 31 August 2026 07:14:13 +0000 (0:00:00.936) 0:00:17.290 ********* 2026-08-31 07:14:14.252912 | mon1 | changed: [mon1] 2026-08-31 07:14:14.252999 | mon1 | 2026-08-31 07:14:14.253257 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:14:14.253306 | mon1 | Monday 31 August 2026 07:14:14 +0000 (0:00:00.463) 0:00:17.754 ********* 2026-08-31 07:14:14.842766 | mon1 | changed: [mon1] 2026-08-31 07:14:14.842915 | mon1 | 2026-08-31 07:14:14.843327 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:14:14.843390 | mon1 | Monday 31 August 2026 07:14:14 +0000 (0:00:00.589) 0:00:18.343 ********* 2026-08-31 07:14:15.074628 | mon1 | ok: [mon1] 2026-08-31 07:14:15.074760 | mon1 | 2026-08-31 07:14:15.075165 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:14:15.075226 | mon1 | Monday 31 August 2026 07:14:15 +0000 (0:00:00.231) 0:00:18.575 ********* 2026-08-31 07:14:15.195575 | mon1 | ok: [mon1] => { 2026-08-31 07:14:15.195958 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:14:15.196014 | mon1 | } 2026-08-31 07:14:15.196711 | mon1 | 2026-08-31 07:14:15.196768 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:14:15.196780 | mon1 | Monday 31 August 2026 07:14:15 +0000 (0:00:00.120) 0:00:18.696 ********* 2026-08-31 07:15:36.087925 | mon1 | changed: [mon1] 2026-08-31 07:15:36.088610 | mon1 | 2026-08-31 07:15:36.088690 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:15:36.088703 | mon1 | Monday 31 August 2026 07:15:36 +0000 (0:01:20.892) 0:01:39.588 ********* 2026-08-31 07:15:40.556962 | mon1 | changed: [mon1] 2026-08-31 07:15:40.557038 | mon1 | 2026-08-31 07:15:40.557286 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:15:40.557340 | mon1 | Monday 31 August 2026 07:15:40 +0000 (0:00:04.469) 0:01:44.058 ********* 2026-08-31 07:15:41.757172 | mon1 | ok: [mon1] 2026-08-31 07:15:41.757235 | mon1 | 2026-08-31 07:15:41.757426 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:15:41.757571 | mon1 | Monday 31 August 2026 07:15:41 +0000 (0:00:01.200) 0:01:45.258 ********* 2026-08-31 07:15:42.103008 | mon1 | changed: [mon1] 2026-08-31 07:15:42.103124 | mon1 | 2026-08-31 07:15:42.103141 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:15:42.103252 | mon1 | Monday 31 August 2026 07:15:42 +0000 (0:00:00.345) 0:01:45.604 ********* 2026-08-31 07:15:42.583440 | mon1 | changed: [mon1] 2026-08-31 07:15:42.583915 | mon1 | 2026-08-31 07:15:42.583955 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:15:42.584056 | mon1 | Monday 31 August 2026 07:15:42 +0000 (0:00:00.480) 0:01:46.084 ********* 2026-08-31 07:15:43.251447 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-08-31 07:15:43.251922 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:15:43.252637 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:15:43.252664 | mon1 | 2026-08-31 07:15:43.252676 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:15:43.252686 | mon1 | Monday 31 August 2026 07:15:43 +0000 (0:00:00.667) 0:01:46.752 ********* 2026-08-31 07:15:43.763327 | mon1 | changed: [mon1] 2026-08-31 07:15:43.763398 | mon1 | 2026-08-31 07:15:43.763412 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:15:43.763554 | mon1 | Monday 31 August 2026 07:15:43 +0000 (0:00:00.512) 0:01:47.264 ********* 2026-08-31 07:15:44.309025 | mon1 | changed: [mon1] 2026-08-31 07:15:44.309181 | mon1 | 2026-08-31 07:15:44.310253 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:15:44.310339 | mon1 | Monday 31 August 2026 07:15:44 +0000 (0:00:00.533) 0:01:47.798 ********* 2026-08-31 07:15:44.310352 | mon1 | 2026-08-31 07:15:44.310363 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-31 07:15:44.310394 | mon1 | Monday 31 August 2026 07:15:44 +0000 (0:00:00.011) 0:01:47.809 ********* 2026-08-31 07:15:45.084491 | mon1 | ok: [mon1] 2026-08-31 07:15:45.085104 | mon1 | 2026-08-31 07:15:45.085166 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-31 07:15:45.085178 | mon1 | Monday 31 August 2026 07:15:45 +0000 (0:00:00.775) 0:01:48.585 ********* 2026-08-31 07:15:45.901634 | mon1 | changed: [mon1] 2026-08-31 07:15:45.902415 | mon1 | 2026-08-31 07:15:45.902521 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:15:45.902538 | mon1 | Monday 31 August 2026 07:15:45 +0000 (0:00:00.816) 0:01:49.401 ********* 2026-08-31 07:15:46.468017 | mon1 | changed: [mon1] 2026-08-31 07:15:46.468107 | mon1 | 2026-08-31 07:15:46.468130 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:15:46.468361 | mon1 | Monday 31 August 2026 07:15:46 +0000 (0:00:00.566) 0:01:49.968 ********* 2026-08-31 07:15:46.526450 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-31 07:15:46.526833 | mon1 | 2026-08-31 07:15:46.526880 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:15:46.526889 | mon1 | Monday 31 August 2026 07:15:46 +0000 (0:00:00.059) 0:01:50.027 ********* 2026-08-31 07:16:12.997712 | mon1 | changed: [mon1] 2026-08-31 07:16:12.998281 | mon1 | 2026-08-31 07:16:12.998343 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:16:12.998355 | mon1 | Monday 31 August 2026 07:16:12 +0000 (0:00:26.470) 0:02:16.498 ********* 2026-08-31 07:16:13.652255 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-31 07:16:13.653051 | mon1 | ok: [mon1] => (item=sshd) 2026-08-31 07:16:13.653195 | mon1 | 2026-08-31 07:16:13.653208 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:16:13.653218 | mon1 | Monday 31 August 2026 07:16:13 +0000 (0:00:00.654) 0:02:17.153 ********* 2026-08-31 07:16:14.533233 | mon1 | changed: [mon1] 2026-08-31 07:16:14.533823 | mon1 | 2026-08-31 07:16:14.533883 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:16:14.533895 | mon1 | Monday 31 August 2026 07:16:14 +0000 (0:00:00.880) 0:02:18.034 ********* 2026-08-31 07:16:14.744273 | mon1 | ok: [mon1] 2026-08-31 07:16:14.744346 | mon1 | 2026-08-31 07:16:14.744691 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:16:14.744749 | mon1 | Monday 31 August 2026 07:16:14 +0000 (0:00:00.211) 0:02:18.245 ********* 2026-08-31 07:16:15.183803 | mon1 | changed: [mon1] 2026-08-31 07:16:15.184486 | mon1 | 2026-08-31 07:16:15.184720 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:16:15.184734 | mon1 | Monday 31 August 2026 07:16:15 +0000 (0:00:00.439) 0:02:18.684 ********* 2026-08-31 07:16:15.495202 | mon1 | changed: [mon1] 2026-08-31 07:16:15.495339 | mon1 | 2026-08-31 07:16:15.495822 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-08-31 07:16:15.495906 | mon1 | Monday 31 August 2026 07:16:15 +0000 (0:00:00.311) 0:02:18.996 ********* 2026-08-31 07:16:15.608644 | mon1 | ok: [mon1] 2026-08-31 07:16:15.609266 | mon1 | 2026-08-31 07:16:15.609328 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-08-31 07:16:15.609345 | mon1 | Monday 31 August 2026 07:16:15 +0000 (0:00:00.113) 0:02:19.109 ********* 2026-08-31 07:16:15.823738 | mon1 | ok: [mon1] => (item=mon1) 2026-08-31 07:16:15.824365 | mon1 | 2026-08-31 07:16:15.824429 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-08-31 07:16:15.824441 | mon1 | Monday 31 August 2026 07:16:15 +0000 (0:00:00.215) 0:02:19.324 ********* 2026-08-31 07:16:15.875267 | mon1 | ok: [mon1] 2026-08-31 07:16:15.875333 | mon1 | 2026-08-31 07:16:15.875616 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-08-31 07:16:15.875655 | mon1 | Monday 31 August 2026 07:16:15 +0000 (0:00:00.051) 0:02:19.376 ********* 2026-08-31 07:16:15.970791 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-08-31 07:16:15.970839 | mon1 | 2026-08-31 07:16:15.971028 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-08-31 07:16:15.971071 | mon1 | Monday 31 August 2026 07:16:15 +0000 (0:00:00.095) 0:02:19.472 ********* 2026-08-31 07:16:16.267738 | mon1 | changed: [mon1] 2026-08-31 07:16:16.267807 | mon1 | 2026-08-31 07:16:16.267954 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-08-31 07:16:16.268017 | mon1 | Monday 31 August 2026 07:16:16 +0000 (0:00:00.297) 0:02:19.769 ********* 2026-08-31 07:16:16.930852 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-08-31 07:16:16.930928 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-08-31 07:16:16.931356 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-08-31 07:16:16.931460 | mon1 | 2026-08-31 07:16:16.931468 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-08-31 07:16:16.931474 | mon1 | Monday 31 August 2026 07:16:16 +0000 (0:00:00.662) 0:02:20.432 ********* 2026-08-31 07:17:45.059113 | mon1 | ok: [mon1] 2026-08-31 07:17:45.059784 | mon1 | 2026-08-31 07:17:45.062740 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-08-31 07:17:45.062787 | mon1 | Monday 31 August 2026 07:17:45 +0000 (0:01:28.127) 0:03:48.559 ********* 2026-08-31 07:17:45.279654 | mon1 | changed: [mon1] 2026-08-31 07:17:45.279794 | mon1 | 2026-08-31 07:17:45.280040 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-08-31 07:17:45.280221 | mon1 | Monday 31 August 2026 07:17:45 +0000 (0:00:00.220) 0:03:48.780 ********* 2026-08-31 07:17:45.316823 | mon1 | ok: [mon1] 2026-08-31 07:17:45.316989 | mon1 | 2026-08-31 07:17:45.317183 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-31 07:17:45.317358 | mon1 | Monday 31 August 2026 07:17:45 +0000 (0:00:00.037) 0:03:48.818 ********* 2026-08-31 07:17:45.390659 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-31 07:17:45.390744 | mon1 | 2026-08-31 07:17:45.390759 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-31 07:17:45.390893 | mon1 | Monday 31 August 2026 07:17:45 +0000 (0:00:00.074) 0:03:48.892 ********* 2026-08-31 07:17:46.924802 | mon1 | ok: [mon1] 2026-08-31 07:17:46.924979 | mon1 | 2026-08-31 07:17:46.925186 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-31 07:17:46.925378 | mon1 | Monday 31 August 2026 07:17:46 +0000 (0:00:01.533) 0:03:50.425 ********* 2026-08-31 07:17:46.988657 | mon1 | ok: [mon1] => (item=mon1) 2026-08-31 07:17:46.988843 | mon1 | 2026-08-31 07:17:46.989031 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-31 07:17:46.989205 | mon1 | Monday 31 August 2026 07:17:46 +0000 (0:00:00.063) 0:03:50.489 ********* 2026-08-31 07:17:47.376379 | mon1 | ok: [mon1] 2026-08-31 07:17:47.376644 | mon1 | 2026-08-31 07:17:47.376718 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-31 07:17:47.376984 | mon1 | Monday 31 August 2026 07:17:47 +0000 (0:00:00.387) 0:03:50.877 ********* 2026-08-31 07:17:49.560713 | mon1 | ok: [mon1] 2026-08-31 07:17:49.561577 | mon1 | 2026-08-31 07:17:49.561653 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-08-31 07:17:49.561669 | mon1 | Monday 31 August 2026 07:17:49 +0000 (0:00:02.184) 0:03:53.061 ********* 2026-08-31 07:17:52.357856 | mon1 | changed: [mon1] 2026-08-31 07:17:52.358383 | mon1 | 2026-08-31 07:17:52.358443 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-08-31 07:17:52.358454 | mon1 | Monday 31 August 2026 07:17:52 +0000 (0:00:02.797) 0:03:55.858 ********* 2026-08-31 07:17:53.906877 | mon1 | ok: [mon1] 2026-08-31 07:17:53.906963 | mon1 | 2026-08-31 07:17:53.907089 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-31 07:17:53.907207 | mon1 | Monday 31 August 2026 07:17:53 +0000 (0:00:01.549) 0:03:57.408 ********* 2026-08-31 07:17:53.976187 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-31 07:17:53.976234 | mon1 | 2026-08-31 07:17:53.976329 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-31 07:17:53.976444 | mon1 | Monday 31 August 2026 07:17:53 +0000 (0:00:00.069) 0:03:57.477 ********* 2026-08-31 07:17:54.015257 | mon1 | skipping: [mon1] 2026-08-31 07:17:54.015352 | mon1 | 2026-08-31 07:17:54.015484 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-31 07:17:54.015600 | mon1 | Monday 31 August 2026 07:17:54 +0000 (0:00:00.038) 0:03:57.516 ********* 2026-08-31 07:17:54.076775 | mon1 | skipping: [mon1] => (item=mon1) 2026-08-31 07:17:54.077004 | mon1 | skipping: [mon1] 2026-08-31 07:17:54.077208 | mon1 | 2026-08-31 07:17:54.077411 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-31 07:17:54.077596 | mon1 | Monday 31 August 2026 07:17:54 +0000 (0:00:00.060) 0:03:57.577 ********* 2026-08-31 07:17:54.319617 | mon1 | ok: [mon1] 2026-08-31 07:17:54.319672 | mon1 | 2026-08-31 07:17:54.319820 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-31 07:17:54.319955 | mon1 | Monday 31 August 2026 07:17:54 +0000 (0:00:00.243) 0:03:57.821 ********* 2026-08-31 07:17:56.505748 | mon1 | ok: [mon1] 2026-08-31 07:17:56.505903 | mon1 | 2026-08-31 07:17:56.506142 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-08-31 07:17:56.506203 | mon1 | Monday 31 August 2026 07:17:56 +0000 (0:00:02.185) 0:04:00.006 ********* 2026-08-31 07:17:59.362104 | mon1 | changed: [mon1] 2026-08-31 07:17:59.362884 | mon1 | 2026-08-31 07:17:59.362956 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-08-31 07:17:59.362971 | mon1 | Monday 31 August 2026 07:17:59 +0000 (0:00:02.856) 0:04:02.862 ********* 2026-08-31 07:18:00.894557 | mon1 | ok: [mon1] 2026-08-31 07:18:00.895175 | mon1 | 2026-08-31 07:18:00.895210 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-08-31 07:18:00.895223 | mon1 | Monday 31 August 2026 07:18:00 +0000 (0:00:01.532) 0:04:04.395 ********* 2026-08-31 07:18:06.835666 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-08-31 07:18:06.835748 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-08-31 07:18:06.835798 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-08-31 07:18:06.835951 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-08-31 07:18:06.836057 | mon1 | 2026-08-31 07:18:06.836133 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-31 07:18:06.836227 | mon1 | 2026-08-31 07:18:06.836295 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:18:06.836390 | mon1 | Monday 31 August 2026 07:18:06 +0000 (0:00:05.941) 0:04:10.337 ********* 2026-08-31 07:18:08.036331 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-31 07:18:08.036409 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-31 07:18:08.036545 | mon1 | interpreter could change the meaning of that path. See 2026-08-31 07:18:08.036674 | mon1 | https://docs.ansible.com/ansible- 2026-08-31 07:18:08.037034 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-31 07:18:08.038369 | mon1 | ok: [osd1] 2026-08-31 07:18:08.038444 | mon1 | 2026-08-31 07:18:08.038612 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:18:08.038760 | mon1 | Monday 31 August 2026 07:18:08 +0000 (0:00:01.202) 0:04:11.540 ********* 2026-08-31 07:18:08.268804 | mon1 | ok: [osd1] 2026-08-31 07:18:08.268989 | mon1 | 2026-08-31 07:18:08.269183 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:18:08.269306 | mon1 | Monday 31 August 2026 07:18:08 +0000 (0:00:00.230) 0:04:11.770 ********* 2026-08-31 07:18:08.308237 | mon1 | skipping: [osd1] 2026-08-31 07:18:08.308382 | mon1 | 2026-08-31 07:18:08.308570 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:18:08.308774 | mon1 | Monday 31 August 2026 07:18:08 +0000 (0:00:00.039) 0:04:11.809 ********* 2026-08-31 07:18:08.535951 | mon1 | changed: [osd1] 2026-08-31 07:18:08.536116 | mon1 | 2026-08-31 07:18:08.536307 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:18:08.536484 | mon1 | Monday 31 August 2026 07:18:08 +0000 (0:00:00.227) 0:04:12.036 ********* 2026-08-31 07:18:08.610248 | mon1 | ok: [osd1] => { 2026-08-31 07:18:08.610429 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:18:08.610608 | mon1 | } 2026-08-31 07:18:08.610777 | mon1 | 2026-08-31 07:18:08.610992 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:18:08.611169 | mon1 | Monday 31 August 2026 07:18:08 +0000 (0:00:00.074) 0:04:12.111 ********* 2026-08-31 07:18:09.062378 | mon1 | changed: [osd1] 2026-08-31 07:18:09.062530 | mon1 | 2026-08-31 07:18:09.062745 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:18:09.062996 | mon1 | Monday 31 August 2026 07:18:09 +0000 (0:00:00.452) 0:04:12.563 ********* 2026-08-31 07:18:09.111086 | mon1 | skipping: [osd1] 2026-08-31 07:18:09.111166 | mon1 | 2026-08-31 07:18:09.111273 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:18:09.111398 | mon1 | Monday 31 August 2026 07:18:09 +0000 (0:00:00.049) 0:04:12.612 ********* 2026-08-31 07:18:09.147664 | mon1 | skipping: [osd1] 2026-08-31 07:18:09.147879 | mon1 | 2026-08-31 07:18:09.148194 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:18:09.148270 | mon1 | Monday 31 August 2026 07:18:09 +0000 (0:00:00.036) 0:04:12.649 ********* 2026-08-31 07:18:09.383123 | mon1 | ok: [osd1] 2026-08-31 07:18:09.383729 | mon1 | 2026-08-31 07:18:09.383790 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:18:09.383802 | mon1 | Monday 31 August 2026 07:18:09 +0000 (0:00:00.234) 0:04:12.883 ********* 2026-08-31 07:18:10.621803 | mon1 | ok: [osd1] 2026-08-31 07:18:10.622482 | mon1 | 2026-08-31 07:18:10.622545 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:18:10.622557 | mon1 | Monday 31 August 2026 07:18:10 +0000 (0:00:01.238) 0:04:14.122 ********* 2026-08-31 07:18:10.708417 | mon1 | ok: [osd1] => { 2026-08-31 07:18:10.709372 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:18:10.709417 | mon1 | } 2026-08-31 07:18:10.709428 | mon1 | 2026-08-31 07:18:10.709438 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:18:10.709448 | mon1 | Monday 31 August 2026 07:18:10 +0000 (0:00:00.086) 0:04:14.209 ********* 2026-08-31 07:18:11.430233 | mon1 | changed: [osd1] 2026-08-31 07:18:11.430366 | mon1 | 2026-08-31 07:18:11.430778 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:18:11.430856 | mon1 | Monday 31 August 2026 07:18:11 +0000 (0:00:00.721) 0:04:14.931 ********* 2026-08-31 07:18:14.162908 | mon1 | changed: [osd1] 2026-08-31 07:18:14.163433 | mon1 | 2026-08-31 07:18:14.163534 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:18:14.163737 | mon1 | Monday 31 August 2026 07:18:14 +0000 (0:00:02.732) 0:04:17.663 ********* 2026-08-31 07:18:14.199607 | mon1 | skipping: [osd1] 2026-08-31 07:18:14.199953 | mon1 | 2026-08-31 07:18:14.200328 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:18:14.200395 | mon1 | Monday 31 August 2026 07:18:14 +0000 (0:00:00.036) 0:04:17.700 ********* 2026-08-31 07:18:14.231566 | mon1 | skipping: [osd1] 2026-08-31 07:18:14.231952 | mon1 | 2026-08-31 07:18:14.232033 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:18:14.232202 | mon1 | Monday 31 August 2026 07:18:14 +0000 (0:00:00.032) 0:04:17.732 ********* 2026-08-31 07:18:14.264379 | mon1 | skipping: [osd1] 2026-08-31 07:18:14.264513 | mon1 | 2026-08-31 07:18:14.264955 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:18:14.265012 | mon1 | Monday 31 August 2026 07:18:14 +0000 (0:00:00.032) 0:04:17.765 ********* 2026-08-31 07:18:20.585435 | mon1 | changed: [osd1] 2026-08-31 07:18:20.585799 | mon1 | 2026-08-31 07:18:20.587205 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:18:20.587217 | mon1 | Monday 31 August 2026 07:18:20 +0000 (0:00:06.321) 0:04:24.086 ********* 2026-08-31 07:18:21.122280 | mon1 | changed: [osd1] 2026-08-31 07:18:21.122435 | mon1 | 2026-08-31 07:18:21.122637 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:18:21.122852 | mon1 | Monday 31 August 2026 07:18:21 +0000 (0:00:00.536) 0:04:24.622 ********* 2026-08-31 07:18:22.144097 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:18:22.144407 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:18:22.144636 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:18:22.144911 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:18:22.145163 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:18:22.145367 | mon1 | 2026-08-31 07:18:22.145602 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:18:22.145840 | mon1 | Monday 31 August 2026 07:18:22 +0000 (0:00:01.021) 0:04:25.644 ********* 2026-08-31 07:18:22.792041 | mon1 | changed: [osd1] 2026-08-31 07:18:22.792275 | mon1 | 2026-08-31 07:18:22.792543 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:18:22.792796 | mon1 | Monday 31 August 2026 07:18:22 +0000 (0:00:00.638) 0:04:26.283 ********* 2026-08-31 07:18:22.793061 | mon1 | 2026-08-31 07:18:22.793319 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-31 07:18:22.793564 | mon1 | Monday 31 August 2026 07:18:22 +0000 (0:00:00.009) 0:04:26.292 ********* 2026-08-31 07:18:23.574662 | mon1 | ok: [osd1] 2026-08-31 07:18:23.575053 | mon1 | 2026-08-31 07:18:23.575351 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-31 07:18:23.575627 | mon1 | Monday 31 August 2026 07:18:23 +0000 (0:00:00.782) 0:04:27.075 ********* 2026-08-31 07:18:24.129212 | mon1 | changed: [osd1] 2026-08-31 07:18:24.129327 | mon1 | 2026-08-31 07:18:24.129599 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:18:24.129870 | mon1 | Monday 31 August 2026 07:18:24 +0000 (0:00:00.554) 0:04:27.630 ********* 2026-08-31 07:18:24.744482 | mon1 | changed: [osd1] 2026-08-31 07:18:24.744763 | mon1 | 2026-08-31 07:18:24.745048 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:18:24.745285 | mon1 | Monday 31 August 2026 07:18:24 +0000 (0:00:00.614) 0:04:28.244 ********* 2026-08-31 07:18:24.959956 | mon1 | ok: [osd1] 2026-08-31 07:18:24.960268 | mon1 | 2026-08-31 07:18:24.960608 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:18:24.960908 | mon1 | Monday 31 August 2026 07:18:24 +0000 (0:00:00.213) 0:04:28.458 ********* 2026-08-31 07:18:25.027167 | mon1 | ok: [osd1] => { 2026-08-31 07:18:25.027215 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:18:25.027222 | mon1 | } 2026-08-31 07:18:25.027228 | mon1 | 2026-08-31 07:18:25.027234 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:18:25.027240 | mon1 | Monday 31 August 2026 07:18:25 +0000 (0:00:00.069) 0:04:28.527 ********* 2026-08-31 07:19:45.878836 | mon1 | changed: [osd1] 2026-08-31 07:19:45.878902 | mon1 | 2026-08-31 07:19:45.878911 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:19:45.878918 | mon1 | Monday 31 August 2026 07:19:45 +0000 (0:01:20.851) 0:05:49.379 ********* 2026-08-31 07:19:50.380617 | mon1 | changed: [osd1] 2026-08-31 07:19:50.380689 | mon1 | 2026-08-31 07:19:50.380703 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:19:50.380715 | mon1 | Monday 31 August 2026 07:19:50 +0000 (0:00:04.501) 0:05:53.880 ********* 2026-08-31 07:19:51.760009 | mon1 | ok: [osd1] 2026-08-31 07:19:51.760116 | mon1 | 2026-08-31 07:19:51.760529 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:19:51.760588 | mon1 | Monday 31 August 2026 07:19:51 +0000 (0:00:01.380) 0:05:55.261 ********* 2026-08-31 07:19:52.009258 | mon1 | changed: [osd1] 2026-08-31 07:19:52.009359 | mon1 | 2026-08-31 07:19:52.009735 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:19:52.009766 | mon1 | Monday 31 August 2026 07:19:52 +0000 (0:00:00.249) 0:05:55.510 ********* 2026-08-31 07:19:52.548390 | mon1 | changed: [osd1] 2026-08-31 07:19:52.549351 | mon1 | 2026-08-31 07:19:52.549418 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:19:52.549431 | mon1 | Monday 31 August 2026 07:19:52 +0000 (0:00:00.538) 0:05:56.049 ********* 2026-08-31 07:19:53.180328 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-08-31 07:19:53.180497 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:19:53.180849 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:19:53.181090 | mon1 | 2026-08-31 07:19:53.181339 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:19:53.181585 | mon1 | Monday 31 August 2026 07:19:53 +0000 (0:00:00.632) 0:05:56.681 ********* 2026-08-31 07:19:53.695606 | mon1 | changed: [osd1] 2026-08-31 07:19:53.695739 | mon1 | 2026-08-31 07:19:53.696218 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:19:53.696278 | mon1 | Monday 31 August 2026 07:19:53 +0000 (0:00:00.515) 0:05:57.196 ********* 2026-08-31 07:19:54.239900 | mon1 | changed: [osd1] 2026-08-31 07:19:54.241043 | mon1 | 2026-08-31 07:19:54.241103 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:19:54.241115 | mon1 | Monday 31 August 2026 07:19:54 +0000 (0:00:00.533) 0:05:57.729 ********* 2026-08-31 07:19:54.241125 | mon1 | 2026-08-31 07:19:54.241134 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-31 07:19:54.241143 | mon1 | Monday 31 August 2026 07:19:54 +0000 (0:00:00.011) 0:05:57.740 ********* 2026-08-31 07:19:55.090550 | mon1 | ok: [osd1] 2026-08-31 07:19:55.090602 | mon1 | 2026-08-31 07:19:55.090661 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-31 07:19:55.090749 | mon1 | Monday 31 August 2026 07:19:55 +0000 (0:00:00.851) 0:05:58.592 ********* 2026-08-31 07:19:56.063031 | mon1 | changed: [osd1] 2026-08-31 07:19:56.063154 | mon1 | 2026-08-31 07:19:56.063715 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:19:56.063786 | mon1 | Monday 31 August 2026 07:19:56 +0000 (0:00:00.971) 0:05:59.563 ********* 2026-08-31 07:19:56.722186 | mon1 | changed: [osd1] 2026-08-31 07:19:56.722318 | mon1 | 2026-08-31 07:19:56.722552 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:19:56.722919 | mon1 | Monday 31 August 2026 07:19:56 +0000 (0:00:00.659) 0:06:00.222 ********* 2026-08-31 07:19:56.781526 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-31 07:19:56.781616 | mon1 | 2026-08-31 07:19:56.781686 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:19:56.781864 | mon1 | Monday 31 August 2026 07:19:56 +0000 (0:00:00.059) 0:06:00.282 ********* 2026-08-31 07:20:03.096350 | mon1 | changed: [osd1] 2026-08-31 07:20:03.096513 | mon1 | 2026-08-31 07:20:03.096850 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:20:03.097105 | mon1 | Monday 31 August 2026 07:20:03 +0000 (0:00:06.314) 0:06:06.597 ********* 2026-08-31 07:20:03.768094 | mon1 | ok: [osd1] => (item=chronyd) 2026-08-31 07:20:03.768223 | mon1 | ok: [osd1] => (item=sshd) 2026-08-31 07:20:03.768836 | mon1 | 2026-08-31 07:20:03.768894 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:20:03.768907 | mon1 | Monday 31 August 2026 07:20:03 +0000 (0:00:00.671) 0:06:07.269 ********* 2026-08-31 07:20:04.852756 | mon1 | changed: [osd1] 2026-08-31 07:20:04.852876 | mon1 | 2026-08-31 07:20:04.853289 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:20:04.853322 | mon1 | Monday 31 August 2026 07:20:04 +0000 (0:00:01.084) 0:06:08.353 ********* 2026-08-31 07:20:05.082334 | mon1 | ok: [osd1] 2026-08-31 07:20:05.083544 | mon1 | 2026-08-31 07:20:05.083577 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:20:05.083589 | mon1 | Monday 31 August 2026 07:20:05 +0000 (0:00:00.229) 0:06:08.583 ********* 2026-08-31 07:20:05.446099 | mon1 | changed: [osd1] 2026-08-31 07:20:05.446675 | mon1 | 2026-08-31 07:20:05.446707 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:20:05.446718 | mon1 | Monday 31 August 2026 07:20:05 +0000 (0:00:00.363) 0:06:08.946 ********* 2026-08-31 07:20:05.700851 | mon1 | changed: [osd1] 2026-08-31 07:20:05.700999 | mon1 | 2026-08-31 07:20:05.701311 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-08-31 07:20:05.701568 | mon1 | Monday 31 August 2026 07:20:05 +0000 (0:00:00.254) 0:06:09.201 ********* 2026-08-31 07:20:06.120610 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-08-31 07:20:06.120672 | mon1 | 2026-08-31 07:20:06.120684 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-08-31 07:20:06.120694 | mon1 | Monday 31 August 2026 07:20:06 +0000 (0:00:00.419) 0:06:09.621 ********* 2026-08-31 07:20:06.167913 | mon1 | ok: [osd1] 2026-08-31 07:20:06.168009 | mon1 | 2026-08-31 07:20:06.168292 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-31 07:20:06.168338 | mon1 | Monday 31 August 2026 07:20:06 +0000 (0:00:00.048) 0:06:09.669 ********* 2026-08-31 07:20:06.237551 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-08-31 07:20:06.237985 | mon1 | 2026-08-31 07:20:06.238036 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-31 07:20:06.238045 | mon1 | Monday 31 August 2026 07:20:06 +0000 (0:00:00.069) 0:06:09.738 ********* 2026-08-31 07:20:07.745603 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:20:07.746239 | mon1 | 2026-08-31 07:20:07.746289 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-31 07:20:07.746301 | mon1 | Monday 31 August 2026 07:20:07 +0000 (0:00:01.507) 0:06:11.246 ********* 2026-08-31 07:20:07.803008 | mon1 | ok: [osd1] => (item=osd1) 2026-08-31 07:20:07.803069 | mon1 | 2026-08-31 07:20:07.803315 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-31 07:20:07.803338 | mon1 | Monday 31 August 2026 07:20:07 +0000 (0:00:00.057) 0:06:11.304 ********* 2026-08-31 07:20:08.092713 | mon1 | changed: [osd1] 2026-08-31 07:20:08.093287 | mon1 | 2026-08-31 07:20:08.093345 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-31 07:20:08.093357 | mon1 | Monday 31 August 2026 07:20:08 +0000 (0:00:00.289) 0:06:11.593 ********* 2026-08-31 07:20:13.180890 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:20:13.181052 | mon1 | 2026-08-31 07:20:13.181227 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-08-31 07:20:13.181420 | mon1 | Monday 31 August 2026 07:20:13 +0000 (0:00:05.084) 0:06:16.677 ********* 2026-08-31 07:20:13.934231 | mon1 | ok: [osd1] 2026-08-31 07:20:13.934383 | mon1 | 2026-08-31 07:20:13.934574 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-08-31 07:20:13.934757 | mon1 | Monday 31 August 2026 07:20:13 +0000 (0:00:00.756) 0:06:17.434 ********* 2026-08-31 07:20:59.338370 | mon1 | ok: [osd1] 2026-08-31 07:20:59.338548 | mon1 | 2026-08-31 07:20:59.338785 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-08-31 07:20:59.339057 | mon1 | Monday 31 August 2026 07:20:59 +0000 (0:00:45.404) 0:07:02.839 ********* 2026-08-31 07:23:43.851942 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-08-31 07:23:43.852018 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-08-31 07:23:43.852459 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-08-31 07:23:43.852521 | mon1 | 2026-08-31 07:23:43.852529 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-08-31 07:23:43.852536 | mon1 | Monday 31 August 2026 07:23:43 +0000 (0:02:44.513) 0:09:47.352 ********* 2026-08-31 07:23:45.406213 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:23:45.406790 | mon1 | 2026-08-31 07:23:45.406824 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-08-31 07:23:45.406836 | mon1 | Monday 31 August 2026 07:23:45 +0000 (0:00:01.554) 0:09:48.907 ********* 2026-08-31 07:23:46.946352 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:23:46.947058 | mon1 | 2026-08-31 07:23:46.947117 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-08-31 07:23:46.947130 | mon1 | Monday 31 August 2026 07:23:46 +0000 (0:00:01.539) 0:09:50.447 ********* 2026-08-31 07:23:47.013245 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-08-31 07:23:47.013314 | mon1 | 2026-08-31 07:23:47.013609 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-08-31 07:23:47.013665 | mon1 | Monday 31 August 2026 07:23:47 +0000 (0:00:00.067) 0:09:50.514 ********* 2026-08-31 07:23:47.049043 | mon1 | ok: [osd1] 2026-08-31 07:23:47.049148 | mon1 | 2026-08-31 07:23:47.049417 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-08-31 07:23:47.049441 | mon1 | Monday 31 August 2026 07:23:47 +0000 (0:00:00.035) 0:09:50.550 ********* 2026-08-31 07:23:48.622710 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:23:48.623293 | mon1 | 2026-08-31 07:23:48.623326 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-08-31 07:23:48.623338 | mon1 | Monday 31 August 2026 07:23:48 +0000 (0:00:01.573) 0:09:52.123 ********* 2026-08-31 07:23:48.662749 | mon1 | ok: [osd1] 2026-08-31 07:23:48.662820 | mon1 | 2026-08-31 07:23:48.663206 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-08-31 07:23:48.663250 | mon1 | Monday 31 August 2026 07:23:48 +0000 (0:00:00.040) 0:09:52.164 ********* 2026-08-31 07:23:48.697461 | mon1 | failed: [osd1] (item=2) => {"ansible_loop_var": "item", "changed": false, "item": 2, "msg": "Failed as requested from task"} 2026-08-31 07:23:48.709513 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:23:48.710050 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:23:48.710103 | mon1 | 2026-08-31 07:23:48.710111 | mon1 | TASK [vexxhost.ceph.osd : Failed after retry] ********************************** 2026-08-31 07:23:48.710118 | mon1 | Monday 31 August 2026 07:23:48 +0000 (0:00:00.046) 0:09:52.210 ********* 2026-08-31 07:23:48.749152 | mon1 | skipping: [osd1] 2026-08-31 07:23:48.749720 | mon1 | 2026-08-31 07:23:48.749742 | mon1 | TASK [vexxhost.ceph.osd : Give 5 seconds pause before retry] ******************* 2026-08-31 07:23:48.750161 | mon1 | Monday 31 August 2026 07:23:48 +0000 (0:00:00.038) 0:09:52.249 ********* 2026-08-31 07:23:53.798744 | mon1 | Pausing for 5 seconds 2026-08-31 07:23:53.798832 | mon1 | ok: [osd1] 2026-08-31 07:23:53.799459 | mon1 | 2026-08-31 07:23:53.799516 | mon1 | TASK [vexxhost.ceph.osd : Recheck OSDs] **************************************** 2026-08-31 07:23:53.799528 | mon1 | Monday 31 August 2026 07:23:53 +0000 (0:00:05.049) 0:09:57.299 ********* 2026-08-31 07:23:53.868467 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-08-31 07:23:53.869098 | mon1 | 2026-08-31 07:23:53.869132 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-08-31 07:23:53.869143 | mon1 | Monday 31 August 2026 07:23:53 +0000 (0:00:00.069) 0:09:57.369 ********* 2026-08-31 07:23:53.913487 | mon1 | ok: [osd1] 2026-08-31 07:23:53.913553 | mon1 | 2026-08-31 07:23:53.913886 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-08-31 07:23:53.913938 | mon1 | Monday 31 August 2026 07:23:53 +0000 (0:00:00.045) 0:09:57.414 ********* 2026-08-31 07:23:55.381318 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:23:55.381889 | mon1 | 2026-08-31 07:23:55.381923 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-08-31 07:23:55.381935 | mon1 | Monday 31 August 2026 07:23:55 +0000 (0:00:01.467) 0:09:58.882 ********* 2026-08-31 07:23:55.426179 | mon1 | ok: [osd1] 2026-08-31 07:23:55.426251 | mon1 | 2026-08-31 07:23:55.426478 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-08-31 07:23:55.426529 | mon1 | Monday 31 August 2026 07:23:55 +0000 (0:00:00.045) 0:09:58.927 ********* 2026-08-31 07:23:55.470005 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:23:55.471175 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:23:55.471234 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:23:55.471245 | mon1 | skipping: [osd1] 2026-08-31 07:23:55.471254 | mon1 | 2026-08-31 07:23:55.471264 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-08-31 07:23:55.471274 | mon1 | Monday 31 August 2026 07:23:55 +0000 (0:00:00.043) 0:09:58.970 ********* 2026-08-31 07:23:55.534426 | mon1 | skipping: [osd1] 2026-08-31 07:23:55.534490 | mon1 | 2026-08-31 07:23:55.535022 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-08-31 07:23:55.535070 | mon1 | 2026-08-31 07:23:55.535078 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:23:55.535085 | mon1 | Monday 31 August 2026 07:23:55 +0000 (0:00:00.064) 0:09:59.035 ********* 2026-08-31 07:23:56.485719 | mon1 | ok: [mon1] 2026-08-31 07:23:56.485794 | mon1 | 2026-08-31 07:23:56.485852 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:23:56.486040 | mon1 | Monday 31 August 2026 07:23:56 +0000 (0:00:00.951) 0:09:59.987 ********* 2026-08-31 07:23:56.711648 | mon1 | ok: [mon1] 2026-08-31 07:23:56.711994 | mon1 | 2026-08-31 07:23:56.712108 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:23:56.712360 | mon1 | Monday 31 August 2026 07:23:56 +0000 (0:00:00.225) 0:10:00.212 ********* 2026-08-31 07:23:56.748772 | mon1 | skipping: [mon1] 2026-08-31 07:23:56.748835 | mon1 | 2026-08-31 07:23:56.749138 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:23:56.749190 | mon1 | Monday 31 August 2026 07:23:56 +0000 (0:00:00.037) 0:10:00.250 ********* 2026-08-31 07:23:56.963424 | mon1 | ok: [mon1] 2026-08-31 07:23:56.963491 | mon1 | 2026-08-31 07:23:56.963549 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:23:56.963623 | mon1 | Monday 31 August 2026 07:23:56 +0000 (0:00:00.214) 0:10:00.465 ********* 2026-08-31 07:23:57.029824 | mon1 | ok: [mon1] => { 2026-08-31 07:23:57.030749 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:23:57.030782 | mon1 | } 2026-08-31 07:23:57.030793 | mon1 | 2026-08-31 07:23:57.030803 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:23:57.030812 | mon1 | Monday 31 August 2026 07:23:57 +0000 (0:00:00.065) 0:10:00.530 ********* 2026-08-31 07:23:57.344554 | mon1 | ok: [mon1] 2026-08-31 07:23:57.344632 | mon1 | 2026-08-31 07:23:57.344938 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:23:57.344985 | mon1 | Monday 31 August 2026 07:23:57 +0000 (0:00:00.315) 0:10:00.845 ********* 2026-08-31 07:23:57.380375 | mon1 | skipping: [mon1] 2026-08-31 07:23:57.380475 | mon1 | 2026-08-31 07:23:57.380790 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:23:57.380846 | mon1 | Monday 31 August 2026 07:23:57 +0000 (0:00:00.035) 0:10:00.881 ********* 2026-08-31 07:23:57.413591 | mon1 | skipping: [mon1] 2026-08-31 07:23:57.413658 | mon1 | 2026-08-31 07:23:57.413951 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:23:57.414003 | mon1 | Monday 31 August 2026 07:23:57 +0000 (0:00:00.033) 0:10:00.914 ********* 2026-08-31 07:23:57.640507 | mon1 | ok: [mon1] 2026-08-31 07:23:57.640571 | mon1 | 2026-08-31 07:23:57.640656 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:23:57.640782 | mon1 | Monday 31 August 2026 07:23:57 +0000 (0:00:00.227) 0:10:01.142 ********* 2026-08-31 07:23:58.752290 | mon1 | ok: [mon1] 2026-08-31 07:23:58.752433 | mon1 | 2026-08-31 07:23:58.752852 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:23:58.752942 | mon1 | Monday 31 August 2026 07:23:58 +0000 (0:00:01.110) 0:10:02.252 ********* 2026-08-31 07:23:58.846786 | mon1 | ok: [mon1] => { 2026-08-31 07:23:58.847755 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:23:58.847813 | mon1 | } 2026-08-31 07:23:58.847853 | mon1 | 2026-08-31 07:23:58.847883 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:23:58.847895 | mon1 | Monday 31 August 2026 07:23:58 +0000 (0:00:00.094) 0:10:02.347 ********* 2026-08-31 07:23:59.204627 | mon1 | ok: [mon1] 2026-08-31 07:23:59.204713 | mon1 | 2026-08-31 07:23:59.204732 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:23:59.204875 | mon1 | Monday 31 August 2026 07:23:59 +0000 (0:00:00.358) 0:10:02.706 ********* 2026-08-31 07:24:01.130138 | mon1 | ok: [mon1] 2026-08-31 07:24:01.130620 | mon1 | 2026-08-31 07:24:01.130643 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:24:01.130653 | mon1 | Monday 31 August 2026 07:24:01 +0000 (0:00:01.925) 0:10:04.631 ********* 2026-08-31 07:24:01.166743 | mon1 | skipping: [mon1] 2026-08-31 07:24:01.167221 | mon1 | 2026-08-31 07:24:01.167245 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:24:01.167254 | mon1 | Monday 31 August 2026 07:24:01 +0000 (0:00:00.036) 0:10:04.668 ********* 2026-08-31 07:24:01.198839 | mon1 | skipping: [mon1] 2026-08-31 07:24:01.199008 | mon1 | 2026-08-31 07:24:01.199189 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:24:01.199362 | mon1 | Monday 31 August 2026 07:24:01 +0000 (0:00:00.031) 0:10:04.699 ********* 2026-08-31 07:24:01.230017 | mon1 | skipping: [mon1] 2026-08-31 07:24:01.230150 | mon1 | 2026-08-31 07:24:01.230331 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:24:01.230507 | mon1 | Monday 31 August 2026 07:24:01 +0000 (0:00:00.031) 0:10:04.731 ********* 2026-08-31 07:24:02.353448 | mon1 | ok: [mon1] 2026-08-31 07:24:02.353526 | mon1 | 2026-08-31 07:24:02.353647 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:24:02.353780 | mon1 | Monday 31 August 2026 07:24:02 +0000 (0:00:01.123) 0:10:05.854 ********* 2026-08-31 07:24:02.793836 | mon1 | ok: [mon1] 2026-08-31 07:24:02.794011 | mon1 | 2026-08-31 07:24:02.794196 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:24:02.794378 | mon1 | Monday 31 August 2026 07:24:02 +0000 (0:00:00.441) 0:10:06.295 ********* 2026-08-31 07:24:03.746506 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:24:03.746792 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:24:03.746806 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:24:03.746816 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:24:03.746825 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:24:03.746857 | mon1 | 2026-08-31 07:24:03.746886 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:24:03.746895 | mon1 | Monday 31 August 2026 07:24:03 +0000 (0:00:00.950) 0:10:07.245 ********* 2026-08-31 07:24:04.283975 | mon1 | ok: [mon1] 2026-08-31 07:24:04.284035 | mon1 | 2026-08-31 07:24:04.284047 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:24:04.284063 | mon1 | Monday 31 August 2026 07:24:04 +0000 (0:00:00.529) 0:10:07.775 ********* 2026-08-31 07:24:04.284598 | mon1 | 2026-08-31 07:24:04.284629 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:24:04.284640 | mon1 | Monday 31 August 2026 07:24:04 +0000 (0:00:00.008) 0:10:07.784 ********* 2026-08-31 07:24:04.691597 | mon1 | ok: [mon1] 2026-08-31 07:24:04.691672 | mon1 | 2026-08-31 07:24:04.691972 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:24:04.692041 | mon1 | Monday 31 August 2026 07:24:04 +0000 (0:00:00.408) 0:10:08.193 ********* 2026-08-31 07:24:04.904728 | mon1 | ok: [mon1] 2026-08-31 07:24:04.904802 | mon1 | 2026-08-31 07:24:04.904838 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:24:04.904978 | mon1 | Monday 31 August 2026 07:24:04 +0000 (0:00:00.213) 0:10:08.406 ********* 2026-08-31 07:24:04.966097 | mon1 | ok: [mon1] => { 2026-08-31 07:24:04.966896 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:24:04.966923 | mon1 | } 2026-08-31 07:24:04.966933 | mon1 | 2026-08-31 07:24:04.966941 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:24:04.966950 | mon1 | Monday 31 August 2026 07:24:04 +0000 (0:00:00.061) 0:10:08.467 ********* 2026-08-31 07:24:05.336706 | mon1 | ok: [mon1] 2026-08-31 07:24:05.337364 | mon1 | 2026-08-31 07:24:05.337426 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:24:05.337438 | mon1 | Monday 31 August 2026 07:24:05 +0000 (0:00:00.370) 0:10:08.837 ********* 2026-08-31 07:24:08.442252 | mon1 | ok: [mon1] 2026-08-31 07:24:08.442823 | mon1 | 2026-08-31 07:24:08.442906 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:24:08.442918 | mon1 | Monday 31 August 2026 07:24:08 +0000 (0:00:03.105) 0:10:11.943 ********* 2026-08-31 07:24:09.588148 | mon1 | ok: [mon1] 2026-08-31 07:24:09.588219 | mon1 | 2026-08-31 07:24:09.588428 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:24:09.588471 | mon1 | Monday 31 August 2026 07:24:09 +0000 (0:00:01.146) 0:10:13.089 ********* 2026-08-31 07:24:09.788889 | mon1 | ok: [mon1] 2026-08-31 07:24:09.789582 | mon1 | 2026-08-31 07:24:09.789643 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:24:09.789655 | mon1 | Monday 31 August 2026 07:24:09 +0000 (0:00:00.200) 0:10:13.289 ********* 2026-08-31 07:24:10.201355 | mon1 | ok: [mon1] 2026-08-31 07:24:10.201943 | mon1 | 2026-08-31 07:24:10.202001 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:24:10.202013 | mon1 | Monday 31 August 2026 07:24:10 +0000 (0:00:00.412) 0:10:13.702 ********* 2026-08-31 07:24:10.810538 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-31 07:24:10.811503 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:24:10.811562 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:24:10.811573 | mon1 | 2026-08-31 07:24:10.811584 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:24:10.811594 | mon1 | Monday 31 August 2026 07:24:10 +0000 (0:00:00.609) 0:10:14.311 ********* 2026-08-31 07:24:11.230851 | mon1 | ok: [mon1] 2026-08-31 07:24:11.231360 | mon1 | 2026-08-31 07:24:11.231387 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:24:11.231399 | mon1 | Monday 31 August 2026 07:24:11 +0000 (0:00:00.420) 0:10:14.731 ********* 2026-08-31 07:24:11.660622 | mon1 | ok: [mon1] 2026-08-31 07:24:11.661746 | mon1 | 2026-08-31 07:24:11.661801 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:24:11.661813 | mon1 | Monday 31 August 2026 07:24:11 +0000 (0:00:00.424) 0:10:15.156 ********* 2026-08-31 07:24:11.661822 | mon1 | 2026-08-31 07:24:11.661831 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:24:11.661840 | mon1 | Monday 31 August 2026 07:24:11 +0000 (0:00:00.005) 0:10:15.162 ********* 2026-08-31 07:24:12.015993 | mon1 | ok: [mon1] 2026-08-31 07:24:12.016525 | mon1 | 2026-08-31 07:24:12.016744 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:24:12.016758 | mon1 | Monday 31 August 2026 07:24:12 +0000 (0:00:00.355) 0:10:15.517 ********* 2026-08-31 07:24:12.074960 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-31 07:24:12.075513 | mon1 | 2026-08-31 07:24:12.075545 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:24:12.075557 | mon1 | Monday 31 August 2026 07:24:12 +0000 (0:00:00.058) 0:10:15.576 ********* 2026-08-31 07:24:13.228007 | mon1 | ok: [mon1] 2026-08-31 07:24:13.228074 | mon1 | 2026-08-31 07:24:13.228082 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:24:13.228199 | mon1 | Monday 31 August 2026 07:24:13 +0000 (0:00:01.153) 0:10:16.729 ********* 2026-08-31 07:24:13.862271 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-31 07:24:13.863052 | mon1 | ok: [mon1] => (item=sshd) 2026-08-31 07:24:13.863118 | mon1 | 2026-08-31 07:24:13.863130 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:24:13.863140 | mon1 | Monday 31 August 2026 07:24:13 +0000 (0:00:00.633) 0:10:17.363 ********* 2026-08-31 07:24:14.846866 | mon1 | ok: [mon1] 2026-08-31 07:24:14.847478 | mon1 | 2026-08-31 07:24:14.847538 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:24:14.847550 | mon1 | Monday 31 August 2026 07:24:14 +0000 (0:00:00.984) 0:10:18.347 ********* 2026-08-31 07:24:15.072713 | mon1 | ok: [mon1] 2026-08-31 07:24:15.072783 | mon1 | 2026-08-31 07:24:15.073092 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:24:15.073142 | mon1 | Monday 31 August 2026 07:24:15 +0000 (0:00:00.226) 0:10:18.574 ********* 2026-08-31 07:24:15.322923 | mon1 | ok: [mon1] 2026-08-31 07:24:15.323503 | mon1 | 2026-08-31 07:24:15.323561 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:24:15.323573 | mon1 | Monday 31 August 2026 07:24:15 +0000 (0:00:00.249) 0:10:18.824 ********* 2026-08-31 07:24:15.534960 | mon1 | ok: [mon1] 2026-08-31 07:24:15.535033 | mon1 | 2026-08-31 07:24:15.535340 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-08-31 07:24:15.535393 | mon1 | Monday 31 August 2026 07:24:15 +0000 (0:00:00.212) 0:10:19.036 ********* 2026-08-31 07:24:18.300901 | mon1 | changed: [mon1] 2026-08-31 07:24:18.301125 | mon1 | 2026-08-31 07:24:18.301135 | mon1 | PLAY [Upgrade check] *********************************************************** 2026-08-31 07:24:18.301144 | mon1 | 2026-08-31 07:24:18.301270 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:24:18.301381 | mon1 | Monday 31 August 2026 07:24:18 +0000 (0:00:02.766) 0:10:21.802 ********* 2026-08-31 07:24:19.240625 | mon1 | ok: [mon1] 2026-08-31 07:24:19.240682 | mon1 | 2026-08-31 07:24:19.240694 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:24:19.240705 | mon1 | Monday 31 August 2026 07:24:19 +0000 (0:00:00.938) 0:10:22.741 ********* 2026-08-31 07:24:19.454744 | mon1 | ok: [mon1] 2026-08-31 07:24:19.455537 | mon1 | 2026-08-31 07:24:19.455576 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:24:19.455590 | mon1 | Monday 31 August 2026 07:24:19 +0000 (0:00:00.214) 0:10:22.955 ********* 2026-08-31 07:24:19.490145 | mon1 | skipping: [mon1] 2026-08-31 07:24:19.490706 | mon1 | 2026-08-31 07:24:19.490758 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:24:19.490770 | mon1 | Monday 31 August 2026 07:24:19 +0000 (0:00:00.035) 0:10:22.991 ********* 2026-08-31 07:24:19.726101 | mon1 | ok: [mon1] 2026-08-31 07:24:19.726176 | mon1 | 2026-08-31 07:24:19.726193 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:24:19.726317 | mon1 | Monday 31 August 2026 07:24:19 +0000 (0:00:00.236) 0:10:23.227 ********* 2026-08-31 07:24:19.791547 | mon1 | ok: [mon1] => { 2026-08-31 07:24:19.791593 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:24:19.791599 | mon1 | } 2026-08-31 07:24:19.791603 | mon1 | 2026-08-31 07:24:19.791608 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:24:19.791612 | mon1 | Monday 31 August 2026 07:24:19 +0000 (0:00:00.065) 0:10:23.292 ********* 2026-08-31 07:24:20.114625 | mon1 | ok: [mon1] 2026-08-31 07:24:20.114668 | mon1 | 2026-08-31 07:24:20.114673 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:24:20.114679 | mon1 | Monday 31 August 2026 07:24:20 +0000 (0:00:00.323) 0:10:23.615 ********* 2026-08-31 07:24:20.143897 | mon1 | skipping: [mon1] 2026-08-31 07:24:20.143939 | mon1 | 2026-08-31 07:24:20.143945 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:24:20.143950 | mon1 | Monday 31 August 2026 07:24:20 +0000 (0:00:00.029) 0:10:23.645 ********* 2026-08-31 07:24:20.204840 | mon1 | skipping: [mon1] 2026-08-31 07:24:20.204982 | mon1 | 2026-08-31 07:24:20.204996 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:24:20.205008 | mon1 | Monday 31 August 2026 07:24:20 +0000 (0:00:00.058) 0:10:23.703 ********* 2026-08-31 07:24:20.434972 | mon1 | ok: [mon1] 2026-08-31 07:24:20.435082 | mon1 | 2026-08-31 07:24:20.435094 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:24:20.435161 | mon1 | Monday 31 August 2026 07:24:20 +0000 (0:00:00.232) 0:10:23.936 ********* 2026-08-31 07:24:22.045020 | mon1 | ok: [mon1] 2026-08-31 07:24:22.045148 | mon1 | 2026-08-31 07:24:22.045160 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:24:22.045268 | mon1 | Monday 31 August 2026 07:24:22 +0000 (0:00:01.609) 0:10:25.546 ********* 2026-08-31 07:24:22.136577 | mon1 | ok: [mon1] => { 2026-08-31 07:24:22.137603 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:24:22.137698 | mon1 | } 2026-08-31 07:24:22.137711 | mon1 | 2026-08-31 07:24:22.137721 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:24:22.137731 | mon1 | Monday 31 August 2026 07:24:22 +0000 (0:00:00.090) 0:10:25.636 ********* 2026-08-31 07:24:22.489734 | mon1 | ok: [mon1] 2026-08-31 07:24:22.489801 | mon1 | 2026-08-31 07:24:22.490084 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:24:22.490108 | mon1 | Monday 31 August 2026 07:24:22 +0000 (0:00:00.354) 0:10:25.991 ********* 2026-08-31 07:24:24.467823 | mon1 | ok: [mon1] 2026-08-31 07:24:24.468543 | mon1 | 2026-08-31 07:24:24.468574 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:24:24.468586 | mon1 | Monday 31 August 2026 07:24:24 +0000 (0:00:01.977) 0:10:27.968 ********* 2026-08-31 07:24:24.494737 | mon1 | skipping: [mon1] 2026-08-31 07:24:24.494807 | mon1 | 2026-08-31 07:24:24.495139 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:24:24.495189 | mon1 | Monday 31 August 2026 07:24:24 +0000 (0:00:00.027) 0:10:27.996 ********* 2026-08-31 07:24:24.523588 | mon1 | skipping: [mon1] 2026-08-31 07:24:24.524079 | mon1 | 2026-08-31 07:24:24.524154 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:24:24.524341 | mon1 | Monday 31 August 2026 07:24:24 +0000 (0:00:00.028) 0:10:28.024 ********* 2026-08-31 07:24:24.549729 | mon1 | skipping: [mon1] 2026-08-31 07:24:24.549821 | mon1 | 2026-08-31 07:24:24.550149 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:24:24.550203 | mon1 | Monday 31 August 2026 07:24:24 +0000 (0:00:00.026) 0:10:28.050 ********* 2026-08-31 07:24:25.737326 | mon1 | ok: [mon1] 2026-08-31 07:24:25.737565 | mon1 | 2026-08-31 07:24:25.737797 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:24:25.737858 | mon1 | Monday 31 August 2026 07:24:25 +0000 (0:00:01.186) 0:10:29.237 ********* 2026-08-31 07:24:26.176775 | mon1 | ok: [mon1] 2026-08-31 07:24:26.176844 | mon1 | 2026-08-31 07:24:26.176922 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:24:26.177046 | mon1 | Monday 31 August 2026 07:24:26 +0000 (0:00:00.440) 0:10:29.678 ********* 2026-08-31 07:24:27.195332 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:24:27.195512 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:24:27.195710 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:24:27.196047 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:24:27.196246 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:24:27.196417 | mon1 | 2026-08-31 07:24:27.196618 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:24:27.196811 | mon1 | Monday 31 August 2026 07:24:27 +0000 (0:00:01.014) 0:10:30.692 ********* 2026-08-31 07:24:27.737725 | mon1 | ok: [mon1] 2026-08-31 07:24:27.737801 | mon1 | 2026-08-31 07:24:27.737870 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:24:27.737990 | mon1 | Monday 31 August 2026 07:24:27 +0000 (0:00:00.538) 0:10:31.231 ********* 2026-08-31 07:24:27.738068 | mon1 | 2026-08-31 07:24:27.738165 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:24:27.738237 | mon1 | Monday 31 August 2026 07:24:27 +0000 (0:00:00.007) 0:10:31.238 ********* 2026-08-31 07:24:28.123313 | mon1 | ok: [mon1] 2026-08-31 07:24:28.123450 | mon1 | 2026-08-31 07:24:28.123638 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:24:28.123821 | mon1 | Monday 31 August 2026 07:24:28 +0000 (0:00:00.385) 0:10:31.624 ********* 2026-08-31 07:24:28.345199 | mon1 | ok: [mon1] 2026-08-31 07:24:28.345349 | mon1 | 2026-08-31 07:24:28.345550 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:24:28.345739 | mon1 | Monday 31 August 2026 07:24:28 +0000 (0:00:00.221) 0:10:31.845 ********* 2026-08-31 07:24:28.421732 | mon1 | ok: [mon1] => { 2026-08-31 07:24:28.421864 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:24:28.422075 | mon1 | } 2026-08-31 07:24:28.422270 | mon1 | 2026-08-31 07:24:28.422467 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:24:28.422653 | mon1 | Monday 31 August 2026 07:24:28 +0000 (0:00:00.076) 0:10:31.922 ********* 2026-08-31 07:24:28.774803 | mon1 | ok: [mon1] 2026-08-31 07:24:28.774873 | mon1 | 2026-08-31 07:24:28.774964 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:24:28.775058 | mon1 | Monday 31 August 2026 07:24:28 +0000 (0:00:00.353) 0:10:32.275 ********* 2026-08-31 07:24:32.020086 | mon1 | ok: [mon1] 2026-08-31 07:24:32.020260 | mon1 | 2026-08-31 07:24:32.020473 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:24:32.020670 | mon1 | Monday 31 August 2026 07:24:32 +0000 (0:00:03.245) 0:10:35.521 ********* 2026-08-31 07:24:33.184726 | mon1 | ok: [mon1] 2026-08-31 07:24:33.184767 | mon1 | 2026-08-31 07:24:33.184775 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:24:33.184782 | mon1 | Monday 31 August 2026 07:24:33 +0000 (0:00:01.164) 0:10:36.685 ********* 2026-08-31 07:24:33.385287 | mon1 | ok: [mon1] 2026-08-31 07:24:33.385704 | mon1 | 2026-08-31 07:24:33.385762 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:24:33.385931 | mon1 | Monday 31 August 2026 07:24:33 +0000 (0:00:00.200) 0:10:36.886 ********* 2026-08-31 07:24:33.825573 | mon1 | ok: [mon1] 2026-08-31 07:24:33.826194 | mon1 | 2026-08-31 07:24:33.826255 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:24:33.826267 | mon1 | Monday 31 August 2026 07:24:33 +0000 (0:00:00.440) 0:10:37.326 ********* 2026-08-31 07:24:34.506090 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-31 07:24:34.506154 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:24:34.506497 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:24:34.506542 | mon1 | 2026-08-31 07:24:34.506548 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:24:34.506553 | mon1 | Monday 31 August 2026 07:24:34 +0000 (0:00:00.681) 0:10:38.007 ********* 2026-08-31 07:24:34.947912 | mon1 | ok: [mon1] 2026-08-31 07:24:34.947970 | mon1 | 2026-08-31 07:24:34.947982 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:24:34.947992 | mon1 | Monday 31 August 2026 07:24:34 +0000 (0:00:00.440) 0:10:38.448 ********* 2026-08-31 07:24:35.390630 | mon1 | ok: [mon1] 2026-08-31 07:24:35.390685 | mon1 | 2026-08-31 07:24:35.391203 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:24:35.391220 | mon1 | Monday 31 August 2026 07:24:35 +0000 (0:00:00.439) 0:10:38.887 ********* 2026-08-31 07:24:35.391225 | mon1 | 2026-08-31 07:24:35.391230 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:24:35.391234 | mon1 | Monday 31 August 2026 07:24:35 +0000 (0:00:00.004) 0:10:38.892 ********* 2026-08-31 07:24:35.781684 | mon1 | ok: [mon1] 2026-08-31 07:24:35.781832 | mon1 | 2026-08-31 07:24:35.782070 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:24:35.782263 | mon1 | Monday 31 August 2026 07:24:35 +0000 (0:00:00.390) 0:10:39.282 ********* 2026-08-31 07:24:35.843107 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-31 07:24:35.843234 | mon1 | 2026-08-31 07:24:35.843424 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:24:35.843608 | mon1 | Monday 31 August 2026 07:24:35 +0000 (0:00:00.061) 0:10:39.344 ********* 2026-08-31 07:24:37.036564 | mon1 | ok: [mon1] 2026-08-31 07:24:37.036906 | mon1 | 2026-08-31 07:24:37.036944 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:24:37.037216 | mon1 | Monday 31 August 2026 07:24:37 +0000 (0:00:01.193) 0:10:40.537 ********* 2026-08-31 07:24:37.714287 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-31 07:24:37.714501 | mon1 | ok: [mon1] => (item=sshd) 2026-08-31 07:24:37.714587 | mon1 | 2026-08-31 07:24:37.714649 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:24:37.714744 | mon1 | Monday 31 August 2026 07:24:37 +0000 (0:00:00.677) 0:10:41.215 ********* 2026-08-31 07:24:38.226186 | mon1 | ok: [mon1] 2026-08-31 07:24:38.226398 | mon1 | 2026-08-31 07:24:38.226669 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:24:38.227000 | mon1 | Monday 31 August 2026 07:24:38 +0000 (0:00:00.511) 0:10:41.727 ********* 2026-08-31 07:24:38.428627 | mon1 | ok: [mon1] 2026-08-31 07:24:38.428780 | mon1 | 2026-08-31 07:24:38.428995 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:24:38.429186 | mon1 | Monday 31 August 2026 07:24:38 +0000 (0:00:00.203) 0:10:41.930 ********* 2026-08-31 07:24:38.663652 | mon1 | ok: [mon1] 2026-08-31 07:24:38.663800 | mon1 | 2026-08-31 07:24:38.664127 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:24:38.664343 | mon1 | Monday 31 August 2026 07:24:38 +0000 (0:00:00.235) 0:10:42.165 ********* 2026-08-31 07:24:38.893244 | mon1 | ok: [mon1] 2026-08-31 07:24:38.893464 | mon1 | 2026-08-31 07:24:38.893739 | mon1 | TASK [vexxhost.ceph.upgrade_check : Get ceph version] ************************** 2026-08-31 07:24:38.893951 | mon1 | Monday 31 August 2026 07:24:38 +0000 (0:00:00.228) 0:10:42.393 ********* 2026-08-31 07:24:40.503986 | mon1 | ok: [mon1] 2026-08-31 07:24:40.504077 | mon1 | 2026-08-31 07:24:40.504090 | mon1 | TASK [vexxhost.ceph.upgrade_check : Check upgrade version] ********************* 2026-08-31 07:24:40.504102 | mon1 | Monday 31 August 2026 07:24:40 +0000 (0:00:01.610) 0:10:44.003 ********* 2026-08-31 07:24:40.559873 | mon1 | ok: [mon1] 2026-08-31 07:24:40.560561 | mon1 | 2026-08-31 07:24:40.560622 | mon1 | TASK [vexxhost.ceph.upgrade_check : Run upgrade] ******************************* 2026-08-31 07:24:40.560635 | mon1 | Monday 31 August 2026 07:24:40 +0000 (0:00:00.056) 0:10:44.060 ********* 2026-08-31 07:24:40.589657 | mon1 | skipping: [mon1] 2026-08-31 07:24:40.590467 | mon1 | 2026-08-31 07:24:40.590543 | mon1 | TASK [vexxhost.ceph.upgrade_check : Wait until Ceph upgraded] ****************** 2026-08-31 07:24:40.590566 | mon1 | Monday 31 August 2026 07:24:40 +0000 (0:00:00.029) 0:10:44.090 ********* 2026-08-31 07:24:40.623993 | mon1 | skipping: [mon1] 2026-08-31 07:24:40.624171 | mon1 | 2026-08-31 07:24:40.624476 | mon1 | PLAY RECAP ********************************************************************* 2026-08-31 07:24:40.624763 | mon1 | mon1 : ok=128 changed=30 unreachable=0 failed=0 skipped=22 rescued=0 ignored=0 2026-08-31 07:24:40.625077 | mon1 | osd1 : ok=58 changed=24 unreachable=0 failed=0 skipped=9 rescued=1 ignored=0 2026-08-31 07:24:40.625314 | mon1 | 2026-08-31 07:24:40.625546 | mon1 | 2026-08-31 07:24:40.625797 | mon1 | TASKS RECAP ******************************************************************** 2026-08-31 07:24:40.626077 | mon1 | Monday 31 August 2026 07:24:40 +0000 (0:00:00.034) 0:10:44.124 ********* 2026-08-31 07:24:40.626318 | mon1 | =============================================================================== 2026-08-31 07:24:40.626567 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 164.51s 2026-08-31 07:24:40.626815 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 88.13s 2026-08-31 07:24:40.627087 | mon1 | vexxhost.containers.download_artifact : Download item ------------------ 80.89s 2026-08-31 07:24:40.627340 | mon1 | vexxhost.containers.download_artifact : Download item ------------------ 80.85s 2026-08-31 07:24:40.627602 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 45.40s 2026-08-31 07:24:40.627918 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 26.47s 2026-08-31 07:24:40.628229 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.32s 2026-08-31 07:24:40.628485 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 6.31s 2026-08-31 07:24:40.628736 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 5.94s 2026-08-31 07:24:40.629006 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.88s 2026-08-31 07:24:40.629265 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 5.08s 2026-08-31 07:24:40.629515 | mon1 | vexxhost.ceph.osd : Give 5 seconds pause before retry ------------------- 5.05s 2026-08-31 07:24:40.629760 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.50s 2026-08-31 07:24:40.630036 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.47s 2026-08-31 07:24:40.630285 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.25s 2026-08-31 07:24:40.630531 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.11s 2026-08-31 07:24:40.630777 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.98s 2026-08-31 07:24:40.631051 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 2.86s 2026-08-31 07:24:40.631301 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 2.80s 2026-08-31 07:24:40.631627 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 2.77s 2026-08-31 07:24:40.755559 | mon1 | INFO [default > converge] Executed: Successful 2026-08-31 07:24:40.767550 | mon1 | INFO [default > idempotence] Executing 2026-08-31 07:24:41.680339 | mon1 | 2026-08-31 07:24:41.680413 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-31 07:24:41.680427 | mon1 | 2026-08-31 07:24:41.680438 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:24:41.680449 | mon1 | Monday 31 August 2026 07:24:41 +0000 (0:00:00.044) 0:00:00.044 ********* 2026-08-31 07:24:42.944000 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-31 07:24:42.944108 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-31 07:24:42.944120 | mon1 | interpreter could change the meaning of that path. See 2026-08-31 07:24:42.944142 | mon1 | https://docs.ansible.com/ansible- 2026-08-31 07:24:42.944330 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-31 07:24:42.958882 | mon1 | ok: [mon1] 2026-08-31 07:24:42.959161 | mon1 | 2026-08-31 07:24:42.959294 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:24:42.959484 | mon1 | Monday 31 August 2026 07:24:42 +0000 (0:00:01.279) 0:00:01.324 ********* 2026-08-31 07:24:43.306307 | mon1 | ok: [mon1] 2026-08-31 07:24:43.306461 | mon1 | 2026-08-31 07:24:43.306654 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:24:43.306860 | mon1 | Monday 31 August 2026 07:24:43 +0000 (0:00:00.347) 0:00:01.671 ********* 2026-08-31 07:24:43.347870 | mon1 | skipping: [mon1] 2026-08-31 07:24:43.348118 | mon1 | 2026-08-31 07:24:43.348410 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:24:43.348704 | mon1 | Monday 31 August 2026 07:24:43 +0000 (0:00:00.041) 0:00:01.713 ********* 2026-08-31 07:24:43.648211 | mon1 | ok: [mon1] 2026-08-31 07:24:43.648346 | mon1 | 2026-08-31 07:24:43.648644 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:24:43.648933 | mon1 | Monday 31 August 2026 07:24:43 +0000 (0:00:00.300) 0:00:02.013 ********* 2026-08-31 07:24:43.739101 | mon1 | ok: [mon1] => { 2026-08-31 07:24:43.739411 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:24:43.739618 | mon1 | } 2026-08-31 07:24:43.739968 | mon1 | 2026-08-31 07:24:43.740281 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:24:43.740584 | mon1 | Monday 31 August 2026 07:24:43 +0000 (0:00:00.090) 0:00:02.103 ********* 2026-08-31 07:24:44.161686 | mon1 | ok: [mon1] 2026-08-31 07:24:44.161747 | mon1 | 2026-08-31 07:24:44.161760 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:24:44.161771 | mon1 | Monday 31 August 2026 07:24:44 +0000 (0:00:00.422) 0:00:02.526 ********* 2026-08-31 07:24:44.211505 | mon1 | skipping: [mon1] 2026-08-31 07:24:44.211578 | mon1 | 2026-08-31 07:24:44.211812 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:24:44.211905 | mon1 | Monday 31 August 2026 07:24:44 +0000 (0:00:00.051) 0:00:02.577 ********* 2026-08-31 07:24:44.265845 | mon1 | skipping: [mon1] 2026-08-31 07:24:44.265933 | mon1 | 2026-08-31 07:24:44.265947 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:24:44.266187 | mon1 | Monday 31 August 2026 07:24:44 +0000 (0:00:00.053) 0:00:02.630 ********* 2026-08-31 07:24:44.485974 | mon1 | ok: [mon1] 2026-08-31 07:24:44.486038 | mon1 | 2026-08-31 07:24:44.486304 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:24:44.486357 | mon1 | Monday 31 August 2026 07:24:44 +0000 (0:00:00.221) 0:00:02.851 ********* 2026-08-31 07:24:45.722222 | mon1 | ok: [mon1] 2026-08-31 07:24:45.722344 | mon1 | 2026-08-31 07:24:45.722783 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:24:45.722854 | mon1 | Monday 31 August 2026 07:24:45 +0000 (0:00:01.235) 0:00:04.087 ********* 2026-08-31 07:24:45.811716 | mon1 | ok: [mon1] => { 2026-08-31 07:24:45.812989 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:24:45.813057 | mon1 | } 2026-08-31 07:24:45.813069 | mon1 | 2026-08-31 07:24:45.813078 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:24:45.813088 | mon1 | Monday 31 August 2026 07:24:45 +0000 (0:00:00.089) 0:00:04.176 ********* 2026-08-31 07:24:46.211743 | mon1 | ok: [mon1] 2026-08-31 07:24:46.212511 | mon1 | 2026-08-31 07:24:46.212568 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:24:46.212579 | mon1 | Monday 31 August 2026 07:24:46 +0000 (0:00:00.400) 0:00:04.576 ********* 2026-08-31 07:24:49.481189 | mon1 | ok: [mon1] 2026-08-31 07:24:49.481870 | mon1 | 2026-08-31 07:24:49.481954 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:24:49.481966 | mon1 | Monday 31 August 2026 07:24:49 +0000 (0:00:03.269) 0:00:07.846 ********* 2026-08-31 07:24:49.508927 | mon1 | skipping: [mon1] 2026-08-31 07:24:49.509595 | mon1 | 2026-08-31 07:24:49.509649 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:24:49.509661 | mon1 | Monday 31 August 2026 07:24:49 +0000 (0:00:00.027) 0:00:07.873 ********* 2026-08-31 07:24:49.536233 | mon1 | skipping: [mon1] 2026-08-31 07:24:49.536925 | mon1 | 2026-08-31 07:24:49.536982 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:24:49.536992 | mon1 | Monday 31 August 2026 07:24:49 +0000 (0:00:00.027) 0:00:07.901 ********* 2026-08-31 07:24:49.564737 | mon1 | skipping: [mon1] 2026-08-31 07:24:49.565408 | mon1 | 2026-08-31 07:24:49.565461 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:24:49.565473 | mon1 | Monday 31 August 2026 07:24:49 +0000 (0:00:00.028) 0:00:07.929 ********* 2026-08-31 07:24:50.751773 | mon1 | ok: [mon1] 2026-08-31 07:24:50.752335 | mon1 | 2026-08-31 07:24:50.753140 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:24:50.753176 | mon1 | Monday 31 August 2026 07:24:50 +0000 (0:00:01.186) 0:00:09.116 ********* 2026-08-31 07:24:51.234098 | mon1 | ok: [mon1] 2026-08-31 07:24:51.234673 | mon1 | 2026-08-31 07:24:51.234730 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:24:51.234742 | mon1 | Monday 31 August 2026 07:24:51 +0000 (0:00:00.482) 0:00:09.599 ********* 2026-08-31 07:24:52.214010 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:24:52.214109 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:24:52.214124 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:24:52.214541 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:24:52.214585 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:24:52.214592 | mon1 | 2026-08-31 07:24:52.214597 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:24:52.214602 | mon1 | Monday 31 August 2026 07:24:52 +0000 (0:00:00.980) 0:00:10.579 ********* 2026-08-31 07:24:52.869038 | mon1 | ok: [mon1] 2026-08-31 07:24:52.869795 | mon1 | 2026-08-31 07:24:52.869848 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:24:52.869857 | mon1 | Monday 31 August 2026 07:24:52 +0000 (0:00:00.642) 0:00:11.222 ********* 2026-08-31 07:24:52.869863 | mon1 | 2026-08-31 07:24:52.869869 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:24:52.869874 | mon1 | Monday 31 August 2026 07:24:52 +0000 (0:00:00.011) 0:00:11.234 ********* 2026-08-31 07:24:53.494924 | mon1 | ok: [mon1] 2026-08-31 07:24:53.494993 | mon1 | 2026-08-31 07:24:53.495383 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:24:53.495444 | mon1 | Monday 31 August 2026 07:24:53 +0000 (0:00:00.625) 0:00:11.860 ********* 2026-08-31 07:24:53.743496 | mon1 | ok: [mon1] 2026-08-31 07:24:53.743931 | mon1 | 2026-08-31 07:24:53.744024 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:24:53.744269 | mon1 | Monday 31 August 2026 07:24:53 +0000 (0:00:00.248) 0:00:12.108 ********* 2026-08-31 07:24:53.887951 | mon1 | ok: [mon1] => { 2026-08-31 07:24:53.888247 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:24:53.888490 | mon1 | } 2026-08-31 07:24:53.888721 | mon1 | 2026-08-31 07:24:53.889012 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:24:53.889242 | mon1 | Monday 31 August 2026 07:24:53 +0000 (0:00:00.144) 0:00:12.252 ********* 2026-08-31 07:24:54.327606 | mon1 | ok: [mon1] 2026-08-31 07:24:54.327711 | mon1 | 2026-08-31 07:24:54.328000 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:24:54.328210 | mon1 | Monday 31 August 2026 07:24:54 +0000 (0:00:00.439) 0:00:12.692 ********* 2026-08-31 07:24:57.599316 | mon1 | ok: [mon1] 2026-08-31 07:24:57.599530 | mon1 | 2026-08-31 07:24:57.599820 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:24:57.600207 | mon1 | Monday 31 August 2026 07:24:57 +0000 (0:00:03.272) 0:00:15.964 ********* 2026-08-31 07:24:58.682101 | mon1 | ok: [mon1] 2026-08-31 07:24:58.682166 | mon1 | 2026-08-31 07:24:58.682180 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:24:58.682190 | mon1 | Monday 31 August 2026 07:24:58 +0000 (0:00:01.082) 0:00:17.046 ********* 2026-08-31 07:24:59.046994 | mon1 | ok: [mon1] 2026-08-31 07:24:59.047591 | mon1 | 2026-08-31 07:24:59.047625 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:24:59.047638 | mon1 | Monday 31 August 2026 07:24:59 +0000 (0:00:00.365) 0:00:17.412 ********* 2026-08-31 07:24:59.500098 | mon1 | ok: [mon1] 2026-08-31 07:24:59.500198 | mon1 | 2026-08-31 07:24:59.500444 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:24:59.500632 | mon1 | Monday 31 August 2026 07:24:59 +0000 (0:00:00.452) 0:00:17.865 ********* 2026-08-31 07:25:00.178754 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-31 07:25:00.178863 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:25:00.179180 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:25:00.179368 | mon1 | 2026-08-31 07:25:00.179671 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:25:00.179980 | mon1 | Monday 31 August 2026 07:25:00 +0000 (0:00:00.679) 0:00:18.544 ********* 2026-08-31 07:25:00.662344 | mon1 | ok: [mon1] 2026-08-31 07:25:00.662493 | mon1 | 2026-08-31 07:25:00.662707 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:25:00.662968 | mon1 | Monday 31 August 2026 07:25:00 +0000 (0:00:00.483) 0:00:19.027 ********* 2026-08-31 07:25:01.125643 | mon1 | ok: [mon1] 2026-08-31 07:25:01.125811 | mon1 | 2026-08-31 07:25:01.126098 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:25:01.126313 | mon1 | Monday 31 August 2026 07:25:01 +0000 (0:00:00.450) 0:00:19.478 ********* 2026-08-31 07:25:01.126495 | mon1 | 2026-08-31 07:25:01.126709 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:25:01.127011 | mon1 | Monday 31 August 2026 07:25:01 +0000 (0:00:00.011) 0:00:19.490 ********* 2026-08-31 07:25:01.518657 | mon1 | ok: [mon1] 2026-08-31 07:25:01.518861 | mon1 | 2026-08-31 07:25:01.519218 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:25:01.519471 | mon1 | Monday 31 August 2026 07:25:01 +0000 (0:00:00.393) 0:00:19.883 ********* 2026-08-31 07:25:01.572343 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-31 07:25:01.572558 | mon1 | 2026-08-31 07:25:01.572828 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:25:01.573132 | mon1 | Monday 31 August 2026 07:25:01 +0000 (0:00:00.053) 0:00:19.937 ********* 2026-08-31 07:25:02.619956 | mon1 | ok: [mon1] 2026-08-31 07:25:02.620034 | mon1 | 2026-08-31 07:25:02.620215 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:25:02.620384 | mon1 | Monday 31 August 2026 07:25:02 +0000 (0:00:01.047) 0:00:20.984 ********* 2026-08-31 07:25:03.314255 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-31 07:25:03.314342 | mon1 | ok: [mon1] => (item=sshd) 2026-08-31 07:25:03.314489 | mon1 | 2026-08-31 07:25:03.314598 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:25:03.314749 | mon1 | Monday 31 August 2026 07:25:03 +0000 (0:00:00.694) 0:00:21.679 ********* 2026-08-31 07:25:03.835018 | mon1 | ok: [mon1] 2026-08-31 07:25:03.835093 | mon1 | 2026-08-31 07:25:03.835193 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:25:03.835291 | mon1 | Monday 31 August 2026 07:25:03 +0000 (0:00:00.520) 0:00:22.199 ********* 2026-08-31 07:25:04.020875 | mon1 | ok: [mon1] 2026-08-31 07:25:04.021139 | mon1 | 2026-08-31 07:25:04.021469 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:25:04.021754 | mon1 | Monday 31 August 2026 07:25:04 +0000 (0:00:00.186) 0:00:22.385 ********* 2026-08-31 07:25:04.402253 | mon1 | ok: [mon1] 2026-08-31 07:25:04.402431 | mon1 | 2026-08-31 07:25:04.402650 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:25:04.402844 | mon1 | Monday 31 August 2026 07:25:04 +0000 (0:00:00.381) 0:00:22.767 ********* 2026-08-31 07:25:04.747965 | mon1 | ok: [mon1] 2026-08-31 07:25:04.748042 | mon1 | 2026-08-31 07:25:04.748054 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-08-31 07:25:04.748136 | mon1 | Monday 31 August 2026 07:25:04 +0000 (0:00:00.346) 0:00:23.113 ********* 2026-08-31 07:25:04.847007 | mon1 | ok: [mon1] 2026-08-31 07:25:04.847064 | mon1 | 2026-08-31 07:25:04.847071 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-08-31 07:25:04.847078 | mon1 | Monday 31 August 2026 07:25:04 +0000 (0:00:00.098) 0:00:23.211 ********* 2026-08-31 07:25:05.088565 | mon1 | ok: [mon1] => (item=mon1) 2026-08-31 07:25:05.088635 | mon1 | 2026-08-31 07:25:05.088689 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-08-31 07:25:05.088814 | mon1 | Monday 31 August 2026 07:25:05 +0000 (0:00:00.242) 0:00:23.454 ********* 2026-08-31 07:25:05.147813 | mon1 | ok: [mon1] 2026-08-31 07:25:05.147953 | mon1 | 2026-08-31 07:25:05.148373 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-08-31 07:25:05.148422 | mon1 | Monday 31 August 2026 07:25:05 +0000 (0:00:00.058) 0:00:23.512 ********* 2026-08-31 07:25:05.195602 | mon1 | skipping: [mon1] 2026-08-31 07:25:05.196110 | mon1 | 2026-08-31 07:25:05.196198 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-31 07:25:05.196215 | mon1 | Monday 31 August 2026 07:25:05 +0000 (0:00:00.048) 0:00:23.560 ********* 2026-08-31 07:25:05.275268 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-31 07:25:05.275366 | mon1 | 2026-08-31 07:25:05.275385 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-31 07:25:05.275403 | mon1 | Monday 31 August 2026 07:25:05 +0000 (0:00:00.080) 0:00:23.640 ********* 2026-08-31 07:25:06.879306 | mon1 | ok: [mon1] 2026-08-31 07:25:06.879910 | mon1 | 2026-08-31 07:25:06.879938 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-31 07:25:06.879948 | mon1 | Monday 31 August 2026 07:25:06 +0000 (0:00:01.603) 0:00:25.244 ********* 2026-08-31 07:25:06.938030 | mon1 | ok: [mon1] => (item=mon1) 2026-08-31 07:25:06.938636 | mon1 | 2026-08-31 07:25:06.938697 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-31 07:25:06.938710 | mon1 | Monday 31 August 2026 07:25:06 +0000 (0:00:00.058) 0:00:25.303 ********* 2026-08-31 07:25:07.303931 | mon1 | ok: [mon1] 2026-08-31 07:25:07.304526 | mon1 | 2026-08-31 07:25:07.304557 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-31 07:25:07.304568 | mon1 | Monday 31 August 2026 07:25:07 +0000 (0:00:00.365) 0:00:25.669 ********* 2026-08-31 07:25:09.418711 | mon1 | ok: [mon1] 2026-08-31 07:25:09.418780 | mon1 | 2026-08-31 07:25:09.418792 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-08-31 07:25:09.418803 | mon1 | Monday 31 August 2026 07:25:09 +0000 (0:00:02.113) 0:00:27.782 ********* 2026-08-31 07:25:10.954746 | mon1 | ok: [mon1] 2026-08-31 07:25:10.955345 | mon1 | 2026-08-31 07:25:10.955395 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-08-31 07:25:10.955407 | mon1 | Monday 31 August 2026 07:25:10 +0000 (0:00:01.536) 0:00:29.319 ********* 2026-08-31 07:25:12.461067 | mon1 | ok: [mon1] 2026-08-31 07:25:12.461142 | mon1 | 2026-08-31 07:25:12.461345 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-31 07:25:12.461366 | mon1 | Monday 31 August 2026 07:25:12 +0000 (0:00:01.506) 0:00:30.826 ********* 2026-08-31 07:25:12.534148 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-31 07:25:12.534205 | mon1 | 2026-08-31 07:25:12.534301 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-31 07:25:12.534389 | mon1 | Monday 31 August 2026 07:25:12 +0000 (0:00:00.073) 0:00:30.899 ********* 2026-08-31 07:25:12.588730 | mon1 | skipping: [mon1] 2026-08-31 07:25:12.589324 | mon1 | 2026-08-31 07:25:12.589355 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-31 07:25:12.589367 | mon1 | Monday 31 August 2026 07:25:12 +0000 (0:00:00.053) 0:00:30.953 ********* 2026-08-31 07:25:12.647543 | mon1 | skipping: [mon1] => (item=mon1) 2026-08-31 07:25:12.647922 | mon1 | skipping: [mon1] 2026-08-31 07:25:12.648747 | mon1 | 2026-08-31 07:25:12.648824 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-31 07:25:12.648842 | mon1 | Monday 31 August 2026 07:25:12 +0000 (0:00:00.058) 0:00:31.012 ********* 2026-08-31 07:25:12.912093 | mon1 | ok: [mon1] 2026-08-31 07:25:12.912166 | mon1 | 2026-08-31 07:25:12.912224 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-31 07:25:12.912344 | mon1 | Monday 31 August 2026 07:25:12 +0000 (0:00:00.265) 0:00:31.277 ********* 2026-08-31 07:25:15.010959 | mon1 | ok: [mon1] 2026-08-31 07:25:15.011060 | mon1 | 2026-08-31 07:25:15.011307 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-08-31 07:25:15.011330 | mon1 | Monday 31 August 2026 07:25:15 +0000 (0:00:02.098) 0:00:33.376 ********* 2026-08-31 07:25:16.668369 | mon1 | ok: [mon1] 2026-08-31 07:25:16.668965 | mon1 | 2026-08-31 07:25:16.669005 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-08-31 07:25:16.669021 | mon1 | Monday 31 August 2026 07:25:16 +0000 (0:00:01.657) 0:00:35.033 ********* 2026-08-31 07:25:18.176367 | mon1 | ok: [mon1] 2026-08-31 07:25:18.176942 | mon1 | 2026-08-31 07:25:18.177004 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-08-31 07:25:18.177016 | mon1 | Monday 31 August 2026 07:25:18 +0000 (0:00:01.508) 0:00:36.541 ********* 2026-08-31 07:25:25.698504 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-08-31 07:25:25.698587 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-08-31 07:25:25.699409 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-08-31 07:25:25.699461 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-08-31 07:25:25.699469 | mon1 | 2026-08-31 07:25:25.699476 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-31 07:25:25.699482 | mon1 | 2026-08-31 07:25:25.699488 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:25:25.699494 | mon1 | Monday 31 August 2026 07:25:25 +0000 (0:00:07.522) 0:00:44.063 ********* 2026-08-31 07:25:26.940371 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-31 07:25:26.940510 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-31 07:25:26.941311 | mon1 | interpreter could change the meaning of that path. See 2026-08-31 07:25:26.941399 | mon1 | https://docs.ansible.com/ansible- 2026-08-31 07:25:26.941415 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-31 07:25:26.960732 | mon1 | ok: [osd1] 2026-08-31 07:25:26.961562 | mon1 | 2026-08-31 07:25:26.961640 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:25:26.961656 | mon1 | Monday 31 August 2026 07:25:26 +0000 (0:00:01.261) 0:00:45.324 ********* 2026-08-31 07:25:27.182504 | mon1 | ok: [osd1] 2026-08-31 07:25:27.182622 | mon1 | 2026-08-31 07:25:27.182639 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:25:27.182822 | mon1 | Monday 31 August 2026 07:25:27 +0000 (0:00:00.223) 0:00:45.547 ********* 2026-08-31 07:25:27.233598 | mon1 | skipping: [osd1] 2026-08-31 07:25:27.234303 | mon1 | 2026-08-31 07:25:27.234362 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:25:27.234374 | mon1 | Monday 31 August 2026 07:25:27 +0000 (0:00:00.050) 0:00:45.598 ********* 2026-08-31 07:25:27.470977 | mon1 | ok: [osd1] 2026-08-31 07:25:27.471059 | mon1 | 2026-08-31 07:25:27.471138 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:25:27.471274 | mon1 | Monday 31 August 2026 07:25:27 +0000 (0:00:00.238) 0:00:45.836 ********* 2026-08-31 07:25:27.587370 | mon1 | ok: [osd1] => { 2026-08-31 07:25:27.587587 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:25:27.587600 | mon1 | } 2026-08-31 07:25:27.587609 | mon1 | 2026-08-31 07:25:27.587618 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:25:27.587629 | mon1 | Monday 31 August 2026 07:25:27 +0000 (0:00:00.114) 0:00:45.950 ********* 2026-08-31 07:25:27.916358 | mon1 | ok: [osd1] 2026-08-31 07:25:27.916477 | mon1 | 2026-08-31 07:25:27.916666 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:25:27.916845 | mon1 | Monday 31 August 2026 07:25:27 +0000 (0:00:00.330) 0:00:46.281 ********* 2026-08-31 07:25:27.964804 | mon1 | skipping: [osd1] 2026-08-31 07:25:27.964891 | mon1 | 2026-08-31 07:25:27.965051 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:25:27.965182 | mon1 | Monday 31 August 2026 07:25:27 +0000 (0:00:00.048) 0:00:46.330 ********* 2026-08-31 07:25:28.002327 | mon1 | skipping: [osd1] 2026-08-31 07:25:28.002410 | mon1 | 2026-08-31 07:25:28.002547 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:25:28.002668 | mon1 | Monday 31 August 2026 07:25:28 +0000 (0:00:00.037) 0:00:46.367 ********* 2026-08-31 07:25:28.250143 | mon1 | ok: [osd1] 2026-08-31 07:25:28.250297 | mon1 | 2026-08-31 07:25:28.250595 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:25:28.250780 | mon1 | Monday 31 August 2026 07:25:28 +0000 (0:00:00.247) 0:00:46.614 ********* 2026-08-31 07:25:29.433551 | mon1 | ok: [osd1] 2026-08-31 07:25:29.433637 | mon1 | 2026-08-31 07:25:29.433650 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:25:29.433659 | mon1 | Monday 31 August 2026 07:25:29 +0000 (0:00:01.182) 0:00:47.797 ********* 2026-08-31 07:25:29.529402 | mon1 | ok: [osd1] => { 2026-08-31 07:25:29.530364 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:25:29.530423 | mon1 | } 2026-08-31 07:25:29.530435 | mon1 | 2026-08-31 07:25:29.530444 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:25:29.530454 | mon1 | Monday 31 August 2026 07:25:29 +0000 (0:00:00.096) 0:00:47.894 ********* 2026-08-31 07:25:29.934070 | mon1 | ok: [osd1] 2026-08-31 07:25:29.934126 | mon1 | 2026-08-31 07:25:29.934137 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:25:29.934147 | mon1 | Monday 31 August 2026 07:25:29 +0000 (0:00:00.404) 0:00:48.298 ********* 2026-08-31 07:25:31.992022 | mon1 | ok: [osd1] 2026-08-31 07:25:31.992091 | mon1 | 2026-08-31 07:25:31.992102 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:25:31.992120 | mon1 | Monday 31 August 2026 07:25:31 +0000 (0:00:02.057) 0:00:50.356 ********* 2026-08-31 07:25:32.028482 | mon1 | skipping: [osd1] 2026-08-31 07:25:32.028645 | mon1 | 2026-08-31 07:25:32.029138 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:25:32.029203 | mon1 | Monday 31 August 2026 07:25:32 +0000 (0:00:00.036) 0:00:50.393 ********* 2026-08-31 07:25:32.060303 | mon1 | skipping: [osd1] 2026-08-31 07:25:32.060856 | mon1 | 2026-08-31 07:25:32.060897 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:25:32.060930 | mon1 | Monday 31 August 2026 07:25:32 +0000 (0:00:00.031) 0:00:50.425 ********* 2026-08-31 07:25:32.094658 | mon1 | skipping: [osd1] 2026-08-31 07:25:32.095273 | mon1 | 2026-08-31 07:25:32.095334 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:25:32.095348 | mon1 | Monday 31 August 2026 07:25:32 +0000 (0:00:00.034) 0:00:50.459 ********* 2026-08-31 07:25:33.266400 | mon1 | ok: [osd1] 2026-08-31 07:25:33.266609 | mon1 | 2026-08-31 07:25:33.267088 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:25:33.267373 | mon1 | Monday 31 August 2026 07:25:33 +0000 (0:00:01.171) 0:00:51.630 ********* 2026-08-31 07:25:33.763362 | mon1 | ok: [osd1] 2026-08-31 07:25:33.763472 | mon1 | 2026-08-31 07:25:33.764028 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:25:33.764141 | mon1 | Monday 31 August 2026 07:25:33 +0000 (0:00:00.497) 0:00:52.128 ********* 2026-08-31 07:25:34.834358 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:25:34.834485 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:25:34.834502 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:25:34.835159 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:25:34.835224 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:25:34.835232 | mon1 | 2026-08-31 07:25:34.835239 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:25:34.835246 | mon1 | Monday 31 August 2026 07:25:34 +0000 (0:00:01.071) 0:00:53.199 ********* 2026-08-31 07:25:35.459873 | mon1 | ok: [osd1] 2026-08-31 07:25:35.461079 | mon1 | 2026-08-31 07:25:35.461112 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:25:35.461125 | mon1 | Monday 31 August 2026 07:25:35 +0000 (0:00:00.614) 0:00:53.814 ********* 2026-08-31 07:25:35.461135 | mon1 | 2026-08-31 07:25:35.461145 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:25:35.461155 | mon1 | Monday 31 August 2026 07:25:35 +0000 (0:00:00.010) 0:00:53.824 ********* 2026-08-31 07:25:35.855785 | mon1 | ok: [osd1] 2026-08-31 07:25:35.855944 | mon1 | 2026-08-31 07:25:35.856399 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:25:35.856492 | mon1 | Monday 31 August 2026 07:25:35 +0000 (0:00:00.395) 0:00:54.219 ********* 2026-08-31 07:25:36.102003 | mon1 | ok: [osd1] 2026-08-31 07:25:36.102173 | mon1 | 2026-08-31 07:25:36.102424 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:25:36.102787 | mon1 | Monday 31 August 2026 07:25:36 +0000 (0:00:00.246) 0:00:54.466 ********* 2026-08-31 07:25:36.209982 | mon1 | ok: [osd1] => { 2026-08-31 07:25:36.210178 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:25:36.210490 | mon1 | } 2026-08-31 07:25:36.210719 | mon1 | 2026-08-31 07:25:36.210988 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:25:36.211232 | mon1 | Monday 31 August 2026 07:25:36 +0000 (0:00:00.108) 0:00:54.574 ********* 2026-08-31 07:25:36.631738 | mon1 | ok: [osd1] 2026-08-31 07:25:36.631901 | mon1 | 2026-08-31 07:25:36.632183 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:25:36.632530 | mon1 | Monday 31 August 2026 07:25:36 +0000 (0:00:00.421) 0:00:54.996 ********* 2026-08-31 07:25:39.797479 | mon1 | ok: [osd1] 2026-08-31 07:25:39.797575 | mon1 | 2026-08-31 07:25:39.797587 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:25:39.797597 | mon1 | Monday 31 August 2026 07:25:39 +0000 (0:00:03.164) 0:00:58.161 ********* 2026-08-31 07:25:40.909510 | mon1 | ok: [osd1] 2026-08-31 07:25:40.909575 | mon1 | 2026-08-31 07:25:40.909586 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:25:40.909596 | mon1 | Monday 31 August 2026 07:25:40 +0000 (0:00:01.112) 0:00:59.273 ********* 2026-08-31 07:25:41.134543 | mon1 | ok: [osd1] 2026-08-31 07:25:41.134618 | mon1 | 2026-08-31 07:25:41.134922 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:25:41.134983 | mon1 | Monday 31 August 2026 07:25:41 +0000 (0:00:00.225) 0:00:59.499 ********* 2026-08-31 07:25:41.630495 | mon1 | ok: [osd1] 2026-08-31 07:25:41.630634 | mon1 | 2026-08-31 07:25:41.631179 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:25:41.631276 | mon1 | Monday 31 August 2026 07:25:41 +0000 (0:00:00.495) 0:00:59.995 ********* 2026-08-31 07:25:42.253461 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-08-31 07:25:42.254345 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:25:42.254380 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:25:42.254392 | mon1 | 2026-08-31 07:25:42.254402 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:25:42.254411 | mon1 | Monday 31 August 2026 07:25:42 +0000 (0:00:00.622) 0:01:00.617 ********* 2026-08-31 07:25:42.723949 | mon1 | ok: [osd1] 2026-08-31 07:25:42.724535 | mon1 | 2026-08-31 07:25:42.724568 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:25:42.724581 | mon1 | Monday 31 August 2026 07:25:42 +0000 (0:00:00.471) 0:01:01.088 ********* 2026-08-31 07:25:43.222334 | mon1 | ok: [osd1] 2026-08-31 07:25:43.222445 | mon1 | 2026-08-31 07:25:43.223542 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:25:43.223605 | mon1 | Monday 31 August 2026 07:25:43 +0000 (0:00:00.487) 0:01:01.576 ********* 2026-08-31 07:25:43.223617 | mon1 | 2026-08-31 07:25:43.223627 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:25:43.223636 | mon1 | Monday 31 August 2026 07:25:43 +0000 (0:00:00.011) 0:01:01.587 ********* 2026-08-31 07:25:43.603747 | mon1 | ok: [osd1] 2026-08-31 07:25:43.604539 | mon1 | 2026-08-31 07:25:43.604578 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:25:43.604591 | mon1 | Monday 31 August 2026 07:25:43 +0000 (0:00:00.381) 0:01:01.968 ********* 2026-08-31 07:25:43.666250 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-31 07:25:43.666340 | mon1 | 2026-08-31 07:25:43.666348 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:25:43.666355 | mon1 | Monday 31 August 2026 07:25:43 +0000 (0:00:00.062) 0:01:02.030 ********* 2026-08-31 07:25:44.829037 | mon1 | ok: [osd1] 2026-08-31 07:25:44.829162 | mon1 | 2026-08-31 07:25:44.829482 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:25:44.829549 | mon1 | Monday 31 August 2026 07:25:44 +0000 (0:00:01.163) 0:01:03.193 ********* 2026-08-31 07:25:45.547573 | mon1 | ok: [osd1] => (item=chronyd) 2026-08-31 07:25:45.547632 | mon1 | ok: [osd1] => (item=sshd) 2026-08-31 07:25:45.547643 | mon1 | 2026-08-31 07:25:45.547652 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:25:45.547662 | mon1 | Monday 31 August 2026 07:25:45 +0000 (0:00:00.717) 0:01:03.911 ********* 2026-08-31 07:25:56.105082 | mon1 | ok: [osd1] 2026-08-31 07:25:56.105158 | mon1 | 2026-08-31 07:25:56.105471 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:25:56.105522 | mon1 | Monday 31 August 2026 07:25:56 +0000 (0:00:10.558) 0:01:14.470 ********* 2026-08-31 07:25:56.324076 | mon1 | ok: [osd1] 2026-08-31 07:25:56.324294 | mon1 | 2026-08-31 07:25:56.324391 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:25:56.324606 | mon1 | Monday 31 August 2026 07:25:56 +0000 (0:00:00.218) 0:01:14.689 ********* 2026-08-31 07:25:56.584238 | mon1 | ok: [osd1] 2026-08-31 07:25:56.584322 | mon1 | 2026-08-31 07:25:56.584550 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:25:56.584804 | mon1 | Monday 31 August 2026 07:25:56 +0000 (0:00:00.259) 0:01:14.949 ********* 2026-08-31 07:25:56.801837 | mon1 | ok: [osd1] 2026-08-31 07:25:56.801929 | mon1 | 2026-08-31 07:25:56.801985 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-08-31 07:25:56.802465 | mon1 | Monday 31 August 2026 07:25:56 +0000 (0:00:00.217) 0:01:15.166 ********* 2026-08-31 07:25:57.042321 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-08-31 07:25:57.042403 | mon1 | 2026-08-31 07:25:57.042544 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-08-31 07:25:57.042673 | mon1 | Monday 31 August 2026 07:25:57 +0000 (0:00:00.240) 0:01:15.407 ********* 2026-08-31 07:25:57.101985 | mon1 | ok: [osd1] 2026-08-31 07:25:57.102081 | mon1 | 2026-08-31 07:25:57.102203 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-31 07:25:57.102324 | mon1 | Monday 31 August 2026 07:25:57 +0000 (0:00:00.059) 0:01:15.467 ********* 2026-08-31 07:25:57.164159 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-08-31 07:25:57.164316 | mon1 | 2026-08-31 07:25:57.164576 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-31 07:25:57.164788 | mon1 | Monday 31 August 2026 07:25:57 +0000 (0:00:00.062) 0:01:15.529 ********* 2026-08-31 07:25:58.702447 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:25:58.702586 | mon1 | 2026-08-31 07:25:58.702803 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-31 07:25:58.703021 | mon1 | Monday 31 August 2026 07:25:58 +0000 (0:00:01.538) 0:01:17.067 ********* 2026-08-31 07:25:58.765549 | mon1 | ok: [osd1] => (item=osd1) 2026-08-31 07:25:58.765701 | mon1 | 2026-08-31 07:25:58.765905 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-31 07:25:58.766125 | mon1 | Monday 31 August 2026 07:25:58 +0000 (0:00:00.062) 0:01:17.130 ********* 2026-08-31 07:25:59.037351 | mon1 | ok: [osd1] 2026-08-31 07:25:59.037458 | mon1 | 2026-08-31 07:25:59.037647 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-31 07:25:59.037830 | mon1 | Monday 31 August 2026 07:25:59 +0000 (0:00:00.271) 0:01:17.402 ********* 2026-08-31 07:26:01.194308 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:26:01.194428 | mon1 | 2026-08-31 07:26:01.194441 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-08-31 07:26:01.194511 | mon1 | Monday 31 August 2026 07:26:01 +0000 (0:00:02.157) 0:01:19.559 ********* 2026-08-31 07:26:07.104749 | mon1 | ok: [osd1] 2026-08-31 07:26:07.104844 | mon1 | 2026-08-31 07:26:07.104856 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-08-31 07:26:07.104867 | mon1 | Monday 31 August 2026 07:26:07 +0000 (0:00:05.909) 0:01:25.468 ********* 2026-08-31 07:26:08.418276 | mon1 | ok: [osd1] 2026-08-31 07:26:08.418409 | mon1 | 2026-08-31 07:26:08.418818 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-08-31 07:26:08.418891 | mon1 | Monday 31 August 2026 07:26:08 +0000 (0:00:01.314) 0:01:26.783 ********* 2026-08-31 07:26:08.520552 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-08-31 07:26:08.521772 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-08-31 07:26:08.521831 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-08-31 07:26:08.521845 | mon1 | skipping: [osd1] 2026-08-31 07:26:08.521855 | mon1 | 2026-08-31 07:26:08.521867 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-08-31 07:26:08.521878 | mon1 | Monday 31 August 2026 07:26:08 +0000 (0:00:00.101) 0:01:26.885 ********* 2026-08-31 07:26:10.444302 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:26:10.444394 | mon1 | 2026-08-31 07:26:10.444709 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-08-31 07:26:10.444764 | mon1 | Monday 31 August 2026 07:26:10 +0000 (0:00:01.924) 0:01:28.809 ********* 2026-08-31 07:26:12.270172 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:26:12.270312 | mon1 | 2026-08-31 07:26:12.270852 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-08-31 07:26:12.270987 | mon1 | Monday 31 August 2026 07:26:12 +0000 (0:00:01.825) 0:01:30.634 ********* 2026-08-31 07:26:12.335602 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-08-31 07:26:12.335714 | mon1 | 2026-08-31 07:26:12.335726 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-08-31 07:26:12.335946 | mon1 | Monday 31 August 2026 07:26:12 +0000 (0:00:00.065) 0:01:30.700 ********* 2026-08-31 07:26:12.391185 | mon1 | ok: [osd1] 2026-08-31 07:26:12.391256 | mon1 | 2026-08-31 07:26:12.391570 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-08-31 07:26:12.391654 | mon1 | Monday 31 August 2026 07:26:12 +0000 (0:00:00.055) 0:01:30.756 ********* 2026-08-31 07:26:13.955203 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:26:13.955965 | mon1 | 2026-08-31 07:26:13.956065 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-08-31 07:26:13.956078 | mon1 | Monday 31 August 2026 07:26:13 +0000 (0:00:01.563) 0:01:32.319 ********* 2026-08-31 07:26:14.007726 | mon1 | ok: [osd1] 2026-08-31 07:26:14.007877 | mon1 | 2026-08-31 07:26:14.008242 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-08-31 07:26:14.008329 | mon1 | Monday 31 August 2026 07:26:14 +0000 (0:00:00.053) 0:01:32.372 ********* 2026-08-31 07:26:14.063186 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:26:14.064000 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:26:14.064038 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:26:14.064048 | mon1 | skipping: [osd1] 2026-08-31 07:26:14.064059 | mon1 | 2026-08-31 07:26:14.064378 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-08-31 07:26:14.064443 | mon1 | Monday 31 August 2026 07:26:14 +0000 (0:00:00.055) 0:01:32.427 ********* 2026-08-31 07:26:14.138794 | mon1 | skipping: [osd1] 2026-08-31 07:26:14.138886 | mon1 | 2026-08-31 07:26:14.139015 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-08-31 07:26:14.139174 | mon1 | 2026-08-31 07:26:14.139289 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:26:14.139402 | mon1 | Monday 31 August 2026 07:26:14 +0000 (0:00:00.076) 0:01:32.504 ********* 2026-08-31 07:26:15.159793 | mon1 | ok: [mon1] 2026-08-31 07:26:15.159884 | mon1 | 2026-08-31 07:26:15.160088 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:26:15.160216 | mon1 | Monday 31 August 2026 07:26:15 +0000 (0:00:01.020) 0:01:33.524 ********* 2026-08-31 07:26:15.386052 | mon1 | ok: [mon1] 2026-08-31 07:26:15.386196 | mon1 | 2026-08-31 07:26:15.386403 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:26:15.386600 | mon1 | Monday 31 August 2026 07:26:15 +0000 (0:00:00.226) 0:01:33.750 ********* 2026-08-31 07:26:15.414651 | mon1 | skipping: [mon1] 2026-08-31 07:26:15.414814 | mon1 | 2026-08-31 07:26:15.415055 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:26:15.415254 | mon1 | Monday 31 August 2026 07:26:15 +0000 (0:00:00.029) 0:01:33.780 ********* 2026-08-31 07:26:15.660075 | mon1 | ok: [mon1] 2026-08-31 07:26:15.660232 | mon1 | 2026-08-31 07:26:15.660440 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:26:15.660651 | mon1 | Monday 31 August 2026 07:26:15 +0000 (0:00:00.244) 0:01:34.024 ********* 2026-08-31 07:26:15.732666 | mon1 | ok: [mon1] => { 2026-08-31 07:26:15.732840 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:26:15.733043 | mon1 | } 2026-08-31 07:26:15.733207 | mon1 | 2026-08-31 07:26:15.733381 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:26:15.733562 | mon1 | Monday 31 August 2026 07:26:15 +0000 (0:00:00.073) 0:01:34.097 ********* 2026-08-31 07:26:16.052227 | mon1 | ok: [mon1] 2026-08-31 07:26:16.052365 | mon1 | 2026-08-31 07:26:16.052583 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:26:16.052764 | mon1 | Monday 31 August 2026 07:26:16 +0000 (0:00:00.319) 0:01:34.417 ********* 2026-08-31 07:26:16.093091 | mon1 | skipping: [mon1] 2026-08-31 07:26:16.093198 | mon1 | 2026-08-31 07:26:16.093417 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:26:16.093621 | mon1 | Monday 31 August 2026 07:26:16 +0000 (0:00:00.041) 0:01:34.458 ********* 2026-08-31 07:26:16.128635 | mon1 | skipping: [mon1] 2026-08-31 07:26:16.128713 | mon1 | 2026-08-31 07:26:16.128913 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:26:16.129133 | mon1 | Monday 31 August 2026 07:26:16 +0000 (0:00:00.035) 0:01:34.493 ********* 2026-08-31 07:26:16.320828 | mon1 | ok: [mon1] 2026-08-31 07:26:16.320969 | mon1 | 2026-08-31 07:26:16.321235 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:26:16.321454 | mon1 | Monday 31 August 2026 07:26:16 +0000 (0:00:00.192) 0:01:34.685 ********* 2026-08-31 07:26:17.868033 | mon1 | ok: [mon1] 2026-08-31 07:26:17.868143 | mon1 | 2026-08-31 07:26:17.868166 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:26:17.868322 | mon1 | Monday 31 August 2026 07:26:17 +0000 (0:00:01.546) 0:01:36.232 ********* 2026-08-31 07:26:17.965996 | mon1 | ok: [mon1] => { 2026-08-31 07:26:17.966120 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:26:17.966139 | mon1 | } 2026-08-31 07:26:17.966579 | mon1 | 2026-08-31 07:26:17.966648 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:26:17.966657 | mon1 | Monday 31 August 2026 07:26:17 +0000 (0:00:00.098) 0:01:36.331 ********* 2026-08-31 07:26:18.351802 | mon1 | ok: [mon1] 2026-08-31 07:26:18.351947 | mon1 | 2026-08-31 07:26:18.351969 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:26:18.352100 | mon1 | Monday 31 August 2026 07:26:18 +0000 (0:00:00.385) 0:01:36.717 ********* 2026-08-31 07:26:20.425618 | mon1 | ok: [mon1] 2026-08-31 07:26:20.425725 | mon1 | 2026-08-31 07:26:20.426178 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:26:20.426249 | mon1 | Monday 31 August 2026 07:26:20 +0000 (0:00:02.073) 0:01:38.790 ********* 2026-08-31 07:26:20.457896 | mon1 | skipping: [mon1] 2026-08-31 07:26:20.458050 | mon1 | 2026-08-31 07:26:20.458470 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:26:20.458529 | mon1 | Monday 31 August 2026 07:26:20 +0000 (0:00:00.032) 0:01:38.822 ********* 2026-08-31 07:26:20.492651 | mon1 | skipping: [mon1] 2026-08-31 07:26:20.492736 | mon1 | 2026-08-31 07:26:20.493033 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:26:20.493107 | mon1 | Monday 31 August 2026 07:26:20 +0000 (0:00:00.034) 0:01:38.857 ********* 2026-08-31 07:26:20.521311 | mon1 | skipping: [mon1] 2026-08-31 07:26:20.521373 | mon1 | 2026-08-31 07:26:20.521577 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:26:20.521648 | mon1 | Monday 31 August 2026 07:26:20 +0000 (0:00:00.029) 0:01:38.886 ********* 2026-08-31 07:26:21.645796 | mon1 | ok: [mon1] 2026-08-31 07:26:21.646082 | mon1 | 2026-08-31 07:26:21.646482 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:26:21.646583 | mon1 | Monday 31 August 2026 07:26:21 +0000 (0:00:01.123) 0:01:40.010 ********* 2026-08-31 07:26:22.103641 | mon1 | ok: [mon1] 2026-08-31 07:26:22.103748 | mon1 | 2026-08-31 07:26:22.104213 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:26:22.104282 | mon1 | Monday 31 August 2026 07:26:22 +0000 (0:00:00.458) 0:01:40.468 ********* 2026-08-31 07:26:23.104263 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:26:23.105683 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:26:23.105775 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:26:23.105790 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:26:23.105801 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:26:23.105814 | mon1 | 2026-08-31 07:26:23.105824 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:26:23.105833 | mon1 | Monday 31 August 2026 07:26:23 +0000 (0:00:01.000) 0:01:41.468 ********* 2026-08-31 07:26:23.656587 | mon1 | ok: [mon1] 2026-08-31 07:26:23.656709 | mon1 | 2026-08-31 07:26:23.657840 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:26:23.657916 | mon1 | Monday 31 August 2026 07:26:23 +0000 (0:00:00.536) 0:01:42.005 ********* 2026-08-31 07:26:23.657954 | mon1 | 2026-08-31 07:26:23.657967 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:26:23.657977 | mon1 | Monday 31 August 2026 07:26:23 +0000 (0:00:00.015) 0:01:42.021 ********* 2026-08-31 07:26:24.026976 | mon1 | ok: [mon1] 2026-08-31 07:26:24.027038 | mon1 | 2026-08-31 07:26:24.027045 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:26:24.027051 | mon1 | Monday 31 August 2026 07:26:24 +0000 (0:00:00.369) 0:01:42.391 ********* 2026-08-31 07:26:24.256631 | mon1 | ok: [mon1] 2026-08-31 07:26:24.256718 | mon1 | 2026-08-31 07:26:24.257300 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:26:24.257398 | mon1 | Monday 31 August 2026 07:26:24 +0000 (0:00:00.230) 0:01:42.621 ********* 2026-08-31 07:26:24.335645 | mon1 | ok: [mon1] => { 2026-08-31 07:26:24.335960 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:26:24.336856 | mon1 | } 2026-08-31 07:26:24.336870 | mon1 | 2026-08-31 07:26:24.336880 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:26:24.336889 | mon1 | Monday 31 August 2026 07:26:24 +0000 (0:00:00.078) 0:01:42.700 ********* 2026-08-31 07:26:24.728894 | mon1 | ok: [mon1] 2026-08-31 07:26:24.729022 | mon1 | 2026-08-31 07:26:24.729242 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:26:24.729432 | mon1 | Monday 31 August 2026 07:26:24 +0000 (0:00:00.393) 0:01:43.093 ********* 2026-08-31 07:26:27.954787 | mon1 | ok: [mon1] 2026-08-31 07:26:27.954966 | mon1 | 2026-08-31 07:26:27.955172 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:26:27.955361 | mon1 | Monday 31 August 2026 07:26:27 +0000 (0:00:03.225) 0:01:46.319 ********* 2026-08-31 07:26:29.274206 | mon1 | ok: [mon1] 2026-08-31 07:26:29.274272 | mon1 | 2026-08-31 07:26:29.274284 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:26:29.274294 | mon1 | Monday 31 August 2026 07:26:29 +0000 (0:00:01.318) 0:01:47.638 ********* 2026-08-31 07:26:29.499439 | mon1 | ok: [mon1] 2026-08-31 07:26:29.499973 | mon1 | 2026-08-31 07:26:29.500070 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:26:29.500090 | mon1 | Monday 31 August 2026 07:26:29 +0000 (0:00:00.226) 0:01:47.864 ********* 2026-08-31 07:26:29.988687 | mon1 | ok: [mon1] 2026-08-31 07:26:29.988786 | mon1 | 2026-08-31 07:26:29.989270 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:26:29.989355 | mon1 | Monday 31 August 2026 07:26:29 +0000 (0:00:00.488) 0:01:48.353 ********* 2026-08-31 07:26:30.649634 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-31 07:26:30.649749 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:26:30.649762 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:26:30.650087 | mon1 | 2026-08-31 07:26:30.650260 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:26:30.650267 | mon1 | Monday 31 August 2026 07:26:30 +0000 (0:00:00.661) 0:01:49.015 ********* 2026-08-31 07:26:31.118510 | mon1 | ok: [mon1] 2026-08-31 07:26:31.118579 | mon1 | 2026-08-31 07:26:31.118640 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:26:31.118789 | mon1 | Monday 31 August 2026 07:26:31 +0000 (0:00:00.468) 0:01:49.483 ********* 2026-08-31 07:26:31.597818 | mon1 | ok: [mon1] 2026-08-31 07:26:31.598999 | mon1 | 2026-08-31 07:26:31.599037 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:26:31.599049 | mon1 | Monday 31 August 2026 07:26:31 +0000 (0:00:00.469) 0:01:49.952 ********* 2026-08-31 07:26:31.599058 | mon1 | 2026-08-31 07:26:31.599066 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:26:31.599075 | mon1 | Monday 31 August 2026 07:26:31 +0000 (0:00:00.010) 0:01:49.962 ********* 2026-08-31 07:26:31.979334 | mon1 | ok: [mon1] 2026-08-31 07:26:31.979950 | mon1 | 2026-08-31 07:26:31.980011 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:26:31.980025 | mon1 | Monday 31 August 2026 07:26:31 +0000 (0:00:00.381) 0:01:50.344 ********* 2026-08-31 07:26:32.021496 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-31 07:26:32.021630 | mon1 | 2026-08-31 07:26:32.021818 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:26:32.022033 | mon1 | Monday 31 August 2026 07:26:32 +0000 (0:00:00.041) 0:01:50.386 ********* 2026-08-31 07:26:33.431256 | mon1 | ok: [mon1] 2026-08-31 07:26:33.431395 | mon1 | 2026-08-31 07:26:33.431592 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:26:33.431784 | mon1 | Monday 31 August 2026 07:26:33 +0000 (0:00:01.409) 0:01:51.796 ********* 2026-08-31 07:26:34.109051 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-31 07:26:34.109222 | mon1 | ok: [mon1] => (item=sshd) 2026-08-31 07:26:34.109386 | mon1 | 2026-08-31 07:26:34.109594 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:26:34.109771 | mon1 | Monday 31 August 2026 07:26:34 +0000 (0:00:00.678) 0:01:52.474 ********* 2026-08-31 07:26:35.652829 | mon1 | ok: [mon1] 2026-08-31 07:26:35.652891 | mon1 | 2026-08-31 07:26:35.652898 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:26:35.652904 | mon1 | Monday 31 August 2026 07:26:35 +0000 (0:00:01.543) 0:01:54.017 ********* 2026-08-31 07:26:35.870037 | mon1 | ok: [mon1] 2026-08-31 07:26:35.870496 | mon1 | 2026-08-31 07:26:35.870578 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:26:35.870587 | mon1 | Monday 31 August 2026 07:26:35 +0000 (0:00:00.217) 0:01:54.234 ********* 2026-08-31 07:26:36.128639 | mon1 | ok: [mon1] 2026-08-31 07:26:36.128757 | mon1 | 2026-08-31 07:26:36.129076 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:26:36.129147 | mon1 | Monday 31 August 2026 07:26:36 +0000 (0:00:00.258) 0:01:54.493 ********* 2026-08-31 07:26:36.364549 | mon1 | ok: [mon1] 2026-08-31 07:26:36.364613 | mon1 | 2026-08-31 07:26:36.364625 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-08-31 07:26:36.364650 | mon1 | Monday 31 August 2026 07:26:36 +0000 (0:00:00.235) 0:01:54.728 ********* 2026-08-31 07:26:38.630398 | mon1 | ok: [mon1] 2026-08-31 07:26:38.630486 | mon1 | 2026-08-31 07:26:38.630983 | mon1 | PLAY [Upgrade check] *********************************************************** 2026-08-31 07:26:38.631062 | mon1 | 2026-08-31 07:26:38.631070 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:26:38.631085 | mon1 | Monday 31 August 2026 07:26:38 +0000 (0:00:02.266) 0:01:56.995 ********* 2026-08-31 07:26:39.617777 | mon1 | ok: [mon1] 2026-08-31 07:26:39.617942 | mon1 | 2026-08-31 07:26:39.618362 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:26:39.618452 | mon1 | Monday 31 August 2026 07:26:39 +0000 (0:00:00.986) 0:01:57.982 ********* 2026-08-31 07:26:39.853094 | mon1 | ok: [mon1] 2026-08-31 07:26:39.853201 | mon1 | 2026-08-31 07:26:39.853213 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:26:39.853352 | mon1 | Monday 31 August 2026 07:26:39 +0000 (0:00:00.236) 0:01:58.218 ********* 2026-08-31 07:26:39.900760 | mon1 | skipping: [mon1] 2026-08-31 07:26:39.900853 | mon1 | 2026-08-31 07:26:39.900865 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:26:39.900876 | mon1 | Monday 31 August 2026 07:26:39 +0000 (0:00:00.046) 0:01:58.264 ********* 2026-08-31 07:26:40.140787 | mon1 | ok: [mon1] 2026-08-31 07:26:40.140901 | mon1 | 2026-08-31 07:26:40.140991 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:26:40.141169 | mon1 | Monday 31 August 2026 07:26:40 +0000 (0:00:00.241) 0:01:58.505 ********* 2026-08-31 07:26:40.247590 | mon1 | ok: [mon1] => { 2026-08-31 07:26:40.247784 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:26:40.248430 | mon1 | } 2026-08-31 07:26:40.248656 | mon1 | 2026-08-31 07:26:40.248854 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:26:40.249098 | mon1 | Monday 31 August 2026 07:26:40 +0000 (0:00:00.105) 0:01:58.611 ********* 2026-08-31 07:26:40.623413 | mon1 | ok: [mon1] 2026-08-31 07:26:40.623547 | mon1 | 2026-08-31 07:26:40.623778 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:26:40.624075 | mon1 | Monday 31 August 2026 07:26:40 +0000 (0:00:00.376) 0:01:58.988 ********* 2026-08-31 07:26:40.658301 | mon1 | skipping: [mon1] 2026-08-31 07:26:40.658455 | mon1 | 2026-08-31 07:26:40.658669 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:26:40.658865 | mon1 | Monday 31 August 2026 07:26:40 +0000 (0:00:00.035) 0:01:59.023 ********* 2026-08-31 07:26:40.691364 | mon1 | skipping: [mon1] 2026-08-31 07:26:40.691501 | mon1 | 2026-08-31 07:26:40.691724 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:26:40.691972 | mon1 | Monday 31 August 2026 07:26:40 +0000 (0:00:00.033) 0:01:59.056 ********* 2026-08-31 07:26:40.894002 | mon1 | ok: [mon1] 2026-08-31 07:26:40.894158 | mon1 | 2026-08-31 07:26:40.894404 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:26:40.894642 | mon1 | Monday 31 August 2026 07:26:40 +0000 (0:00:00.202) 0:01:59.258 ********* 2026-08-31 07:26:42.265497 | mon1 | ok: [mon1] 2026-08-31 07:26:42.265653 | mon1 | 2026-08-31 07:26:42.265860 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:26:42.266103 | mon1 | Monday 31 August 2026 07:26:42 +0000 (0:00:01.371) 0:02:00.630 ********* 2026-08-31 07:26:42.361731 | mon1 | ok: [mon1] => { 2026-08-31 07:26:42.361979 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:26:42.362210 | mon1 | } 2026-08-31 07:26:42.362419 | mon1 | 2026-08-31 07:26:42.362578 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:26:42.362779 | mon1 | Monday 31 August 2026 07:26:42 +0000 (0:00:00.096) 0:02:00.726 ********* 2026-08-31 07:26:42.716274 | mon1 | ok: [mon1] 2026-08-31 07:26:42.716372 | mon1 | 2026-08-31 07:26:42.716635 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:26:42.716857 | mon1 | Monday 31 August 2026 07:26:42 +0000 (0:00:00.354) 0:02:01.081 ********* 2026-08-31 07:26:44.755600 | mon1 | ok: [mon1] 2026-08-31 07:26:44.755688 | mon1 | 2026-08-31 07:26:44.755894 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:26:44.756045 | mon1 | Monday 31 August 2026 07:26:44 +0000 (0:00:02.039) 0:02:03.120 ********* 2026-08-31 07:26:44.789217 | mon1 | skipping: [mon1] 2026-08-31 07:26:44.789403 | mon1 | 2026-08-31 07:26:44.789606 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:26:44.789812 | mon1 | Monday 31 August 2026 07:26:44 +0000 (0:00:00.033) 0:02:03.154 ********* 2026-08-31 07:26:44.821783 | mon1 | skipping: [mon1] 2026-08-31 07:26:44.821910 | mon1 | 2026-08-31 07:26:44.822137 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:26:44.822315 | mon1 | Monday 31 August 2026 07:26:44 +0000 (0:00:00.032) 0:02:03.186 ********* 2026-08-31 07:26:44.854162 | mon1 | skipping: [mon1] 2026-08-31 07:26:44.854303 | mon1 | 2026-08-31 07:26:44.854497 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:26:44.854671 | mon1 | Monday 31 August 2026 07:26:44 +0000 (0:00:00.032) 0:02:03.219 ********* 2026-08-31 07:26:46.176666 | mon1 | ok: [mon1] 2026-08-31 07:26:46.176753 | mon1 | 2026-08-31 07:26:46.176765 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:26:46.176776 | mon1 | Monday 31 August 2026 07:26:46 +0000 (0:00:01.321) 0:02:04.540 ********* 2026-08-31 07:26:46.672604 | mon1 | ok: [mon1] 2026-08-31 07:26:46.672992 | mon1 | 2026-08-31 07:26:46.673006 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:26:46.673017 | mon1 | Monday 31 August 2026 07:26:46 +0000 (0:00:00.496) 0:02:05.036 ********* 2026-08-31 07:26:47.768879 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:26:47.769035 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:26:47.769058 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:26:47.769755 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:26:47.769818 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:26:47.769827 | mon1 | 2026-08-31 07:26:47.769834 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:26:47.769840 | mon1 | Monday 31 August 2026 07:26:47 +0000 (0:00:01.097) 0:02:06.134 ********* 2026-08-31 07:26:48.329910 | mon1 | ok: [mon1] 2026-08-31 07:26:48.330005 | mon1 | 2026-08-31 07:26:48.330020 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:26:48.330399 | mon1 | Monday 31 August 2026 07:26:48 +0000 (0:00:00.556) 0:02:06.690 ********* 2026-08-31 07:26:48.330447 | mon1 | 2026-08-31 07:26:48.330453 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:26:48.330458 | mon1 | Monday 31 August 2026 07:26:48 +0000 (0:00:00.004) 0:02:06.695 ********* 2026-08-31 07:26:48.744892 | mon1 | ok: [mon1] 2026-08-31 07:26:48.745506 | mon1 | 2026-08-31 07:26:48.745598 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:26:48.745611 | mon1 | Monday 31 August 2026 07:26:48 +0000 (0:00:00.414) 0:02:07.109 ********* 2026-08-31 07:26:49.000993 | mon1 | ok: [mon1] 2026-08-31 07:26:49.001084 | mon1 | 2026-08-31 07:26:49.001557 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:26:49.001628 | mon1 | Monday 31 August 2026 07:26:48 +0000 (0:00:00.256) 0:02:07.365 ********* 2026-08-31 07:26:49.092152 | mon1 | ok: [mon1] => { 2026-08-31 07:26:49.092256 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:26:49.092368 | mon1 | } 2026-08-31 07:26:49.092466 | mon1 | 2026-08-31 07:26:49.092583 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:26:49.092694 | mon1 | Monday 31 August 2026 07:26:49 +0000 (0:00:00.091) 0:02:07.456 ********* 2026-08-31 07:26:49.504093 | mon1 | ok: [mon1] 2026-08-31 07:26:49.504251 | mon1 | 2026-08-31 07:26:49.504451 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:26:49.504615 | mon1 | Monday 31 August 2026 07:26:49 +0000 (0:00:00.411) 0:02:07.868 ********* 2026-08-31 07:26:52.655983 | mon1 | ok: [mon1] 2026-08-31 07:26:52.656155 | mon1 | 2026-08-31 07:26:52.656280 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:26:52.656463 | mon1 | Monday 31 August 2026 07:26:52 +0000 (0:00:03.152) 0:02:11.020 ********* 2026-08-31 07:26:53.802002 | mon1 | ok: [mon1] 2026-08-31 07:26:53.802121 | mon1 | 2026-08-31 07:26:53.802263 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:26:53.802452 | mon1 | Monday 31 August 2026 07:26:53 +0000 (0:00:01.146) 0:02:12.167 ********* 2026-08-31 07:26:54.022584 | mon1 | ok: [mon1] 2026-08-31 07:26:54.022684 | mon1 | 2026-08-31 07:26:54.022871 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:26:54.023080 | mon1 | Monday 31 August 2026 07:26:54 +0000 (0:00:00.220) 0:02:12.387 ********* 2026-08-31 07:26:54.498123 | mon1 | ok: [mon1] 2026-08-31 07:26:54.498266 | mon1 | 2026-08-31 07:26:54.498470 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:26:54.498668 | mon1 | Monday 31 August 2026 07:26:54 +0000 (0:00:00.475) 0:02:12.862 ********* 2026-08-31 07:26:55.106293 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-31 07:26:55.106359 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:26:55.106371 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:26:55.106380 | mon1 | 2026-08-31 07:26:55.106390 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:26:55.106399 | mon1 | Monday 31 August 2026 07:26:55 +0000 (0:00:00.607) 0:02:13.470 ********* 2026-08-31 07:26:55.539925 | mon1 | ok: [mon1] 2026-08-31 07:26:55.540013 | mon1 | 2026-08-31 07:26:55.540074 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:26:55.540173 | mon1 | Monday 31 August 2026 07:26:55 +0000 (0:00:00.435) 0:02:13.905 ********* 2026-08-31 07:26:56.033644 | mon1 | ok: [mon1] 2026-08-31 07:26:56.033712 | mon1 | 2026-08-31 07:26:56.033727 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:26:56.033740 | mon1 | Monday 31 August 2026 07:26:56 +0000 (0:00:00.482) 0:02:14.388 ********* 2026-08-31 07:26:56.033753 | mon1 | 2026-08-31 07:26:56.033764 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:26:56.033776 | mon1 | Monday 31 August 2026 07:26:56 +0000 (0:00:00.009) 0:02:14.397 ********* 2026-08-31 07:26:56.410028 | mon1 | ok: [mon1] 2026-08-31 07:26:56.410816 | mon1 | 2026-08-31 07:26:56.410890 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:26:56.410906 | mon1 | Monday 31 August 2026 07:26:56 +0000 (0:00:00.377) 0:02:14.774 ********* 2026-08-31 07:26:56.466480 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-31 07:26:56.466537 | mon1 | 2026-08-31 07:26:56.466805 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:26:56.466855 | mon1 | Monday 31 August 2026 07:26:56 +0000 (0:00:00.056) 0:02:14.831 ********* 2026-08-31 07:26:57.615008 | mon1 | ok: [mon1] 2026-08-31 07:26:57.615122 | mon1 | 2026-08-31 07:26:57.615135 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:26:57.615294 | mon1 | Monday 31 August 2026 07:26:57 +0000 (0:00:01.148) 0:02:15.980 ********* 2026-08-31 07:26:58.295898 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-31 07:26:58.296030 | mon1 | ok: [mon1] => (item=sshd) 2026-08-31 07:26:58.296210 | mon1 | 2026-08-31 07:26:58.296401 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:26:58.296587 | mon1 | Monday 31 August 2026 07:26:58 +0000 (0:00:00.680) 0:02:16.660 ********* 2026-08-31 07:26:59.984874 | mon1 | ok: [mon1] 2026-08-31 07:26:59.985061 | mon1 | 2026-08-31 07:26:59.985264 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:26:59.985460 | mon1 | Monday 31 August 2026 07:26:59 +0000 (0:00:01.688) 0:02:18.349 ********* 2026-08-31 07:27:00.209062 | mon1 | ok: [mon1] 2026-08-31 07:27:00.209133 | mon1 | 2026-08-31 07:27:00.209272 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:27:00.209393 | mon1 | Monday 31 August 2026 07:27:00 +0000 (0:00:00.224) 0:02:18.573 ********* 2026-08-31 07:27:00.487547 | mon1 | ok: [mon1] 2026-08-31 07:27:00.487691 | mon1 | 2026-08-31 07:27:00.488065 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:27:00.488264 | mon1 | Monday 31 August 2026 07:27:00 +0000 (0:00:00.278) 0:02:18.852 ********* 2026-08-31 07:27:00.699809 | mon1 | ok: [mon1] 2026-08-31 07:27:00.700011 | mon1 | 2026-08-31 07:27:00.700223 | mon1 | TASK [vexxhost.ceph.upgrade_check : Get ceph version] ************************** 2026-08-31 07:27:00.700407 | mon1 | Monday 31 August 2026 07:27:00 +0000 (0:00:00.212) 0:02:19.064 ********* 2026-08-31 07:27:02.249027 | mon1 | ok: [mon1] 2026-08-31 07:27:02.249092 | mon1 | 2026-08-31 07:27:02.249103 | mon1 | TASK [vexxhost.ceph.upgrade_check : Check upgrade version] ********************* 2026-08-31 07:27:02.249113 | mon1 | Monday 31 August 2026 07:27:02 +0000 (0:00:01.548) 0:02:20.613 ********* 2026-08-31 07:27:02.295098 | mon1 | ok: [mon1] 2026-08-31 07:27:02.295482 | mon1 | 2026-08-31 07:27:02.295533 | mon1 | TASK [vexxhost.ceph.upgrade_check : Run upgrade] ******************************* 2026-08-31 07:27:02.295541 | mon1 | Monday 31 August 2026 07:27:02 +0000 (0:00:00.047) 0:02:20.660 ********* 2026-08-31 07:27:02.325267 | mon1 | skipping: [mon1] 2026-08-31 07:27:02.325850 | mon1 | 2026-08-31 07:27:02.325904 | mon1 | TASK [vexxhost.ceph.upgrade_check : Wait until Ceph upgraded] ****************** 2026-08-31 07:27:02.325915 | mon1 | Monday 31 August 2026 07:27:02 +0000 (0:00:00.029) 0:02:20.690 ********* 2026-08-31 07:27:02.358107 | mon1 | skipping: [mon1] 2026-08-31 07:27:02.363518 | mon1 | 2026-08-31 07:27:02.363572 | mon1 | PLAY RECAP ********************************************************************* 2026-08-31 07:27:02.363584 | mon1 | mon1 : ok=118 changed=0 unreachable=0 failed=0 skipped=23 rescued=0 ignored=0 2026-08-31 07:27:02.363594 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-08-31 07:27:02.363602 | mon1 | 2026-08-31 07:27:02.363611 | mon1 | 2026-08-31 07:27:02.363620 | mon1 | TASKS RECAP ******************************************************************** 2026-08-31 07:27:02.363628 | mon1 | Monday 31 August 2026 07:27:02 +0000 (0:00:00.032) 0:02:20.723 ********* 2026-08-31 07:27:02.363637 | mon1 | =============================================================================== 2026-08-31 07:27:02.363646 | mon1 | vexxhost.ceph.cephadm : Download "cephadm" ----------------------------- 10.56s 2026-08-31 07:27:02.363654 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.52s 2026-08-31 07:27:02.363663 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.91s 2026-08-31 07:27:02.363671 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.27s 2026-08-31 07:27:02.363680 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.27s 2026-08-31 07:27:02.363688 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.23s 2026-08-31 07:27:02.363696 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.16s 2026-08-31 07:27:02.363706 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.15s 2026-08-31 07:27:02.363715 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 2.27s 2026-08-31 07:27:02.363743 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.16s 2026-08-31 07:27:02.363752 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.11s 2026-08-31 07:27:02.363760 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.10s 2026-08-31 07:27:02.363769 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.07s 2026-08-31 07:27:02.363777 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.06s 2026-08-31 07:27:02.363786 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.04s 2026-08-31 07:27:02.363794 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 1.92s 2026-08-31 07:27:02.363802 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 1.83s 2026-08-31 07:27:02.363811 | mon1 | vexxhost.ceph.cephadm : Download "cephadm" ------------------------------ 1.69s 2026-08-31 07:27:02.363819 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 1.66s 2026-08-31 07:27:02.363854 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.60s 2026-08-31 07:27:02.474642 | mon1 | INFO [default > idempotence] Executed: Successful 2026-08-31 07:27:02.485364 | mon1 | INFO [default > side_effect] Executing 2026-08-31 07:27:02.485996 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-31 07:27:02.496802 | mon1 | INFO [default > verify] Executing 2026-08-31 07:27:03.071869 | mon1 | 2026-08-31 07:27:03.072083 | mon1 | PLAY [Verify] ****************************************************************** 2026-08-31 07:27:03.072217 | mon1 | 2026-08-31 07:27:03.072363 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:27:03.072506 | mon1 | Monday 31 August 2026 07:27:03 +0000 (0:00:00.006) 0:00:00.006 ********* 2026-08-31 07:27:04.289725 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-31 07:27:04.289786 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-31 07:27:04.289797 | mon1 | interpreter could change the meaning of that path. See 2026-08-31 07:27:04.289807 | mon1 | https://docs.ansible.com/ansible- 2026-08-31 07:27:04.289816 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-31 07:27:04.298316 | mon1 | ok: [mon1] 2026-08-31 07:27:04.298348 | mon1 | 2026-08-31 07:27:04.298358 | mon1 | TASK [List locally deployed Ceph daemons] ************************************** 2026-08-31 07:27:04.298367 | mon1 | Monday 31 August 2026 07:27:04 +0000 (0:00:01.225) 0:00:01.231 ********* 2026-08-31 07:27:10.073644 | mon1 | ok: [mon1] 2026-08-31 07:27:10.073739 | mon1 | 2026-08-31 07:27:10.073751 | mon1 | TASK [Collect deployed Ceph container images] ********************************** 2026-08-31 07:27:10.073762 | mon1 | Monday 31 August 2026 07:27:10 +0000 (0:00:05.774) 0:00:07.006 ********* 2026-08-31 07:27:10.123810 | mon1 | ok: [mon1] 2026-08-31 07:27:10.123885 | mon1 | 2026-08-31 07:27:10.123897 | mon1 | TASK [Assert that a deployed Ceph container image was found] ******************* 2026-08-31 07:27:10.123906 | mon1 | Monday 31 August 2026 07:27:10 +0000 (0:00:00.050) 0:00:07.057 ********* 2026-08-31 07:27:10.159382 | mon1 | ok: [mon1] => { 2026-08-31 07:27:10.159419 | mon1 | "changed": false, 2026-08-31 07:27:10.159431 | mon1 | "msg": "All assertions passed" 2026-08-31 07:27:10.159441 | mon1 | } 2026-08-31 07:27:10.159450 | mon1 | 2026-08-31 07:27:10.159459 | mon1 | TASK [Get cluster health status] *********************************************** 2026-08-31 07:27:10.159468 | mon1 | Monday 31 August 2026 07:27:10 +0000 (0:00:00.035) 0:00:07.092 ********* 2026-08-31 07:27:11.741005 | mon1 | ok: [mon1] 2026-08-31 07:27:11.741110 | mon1 | 2026-08-31 07:27:11.741122 | mon1 | TASK [Print cluster health status] ********************************************* 2026-08-31 07:27:11.741132 | mon1 | Monday 31 August 2026 07:27:11 +0000 (0:00:01.581) 0:00:08.673 ********* 2026-08-31 07:27:11.771168 | mon1 | ok: [mon1] => { 2026-08-31 07:27:11.771253 | mon1 | "_ceph_health": { 2026-08-31 07:27:11.771266 | mon1 | "changed": false, 2026-08-31 07:27:11.771275 | mon1 | "cmd": [ 2026-08-31 07:27:11.771284 | mon1 | "cephadm", 2026-08-31 07:27:11.771292 | mon1 | "shell", 2026-08-31 07:27:11.771301 | mon1 | "--", 2026-08-31 07:27:11.771309 | mon1 | "ceph", 2026-08-31 07:27:11.771317 | mon1 | "health" 2026-08-31 07:27:11.771336 | mon1 | ], 2026-08-31 07:27:11.771346 | mon1 | "delta": "0:00:01.319518", 2026-08-31 07:27:11.771537 | mon1 | "end": "2026-08-31 07:27:11.697991", 2026-08-31 07:27:11.771692 | mon1 | "failed": false, 2026-08-31 07:27:11.771878 | mon1 | "msg": "", 2026-08-31 07:27:11.772087 | mon1 | "rc": 0, 2026-08-31 07:27:11.772246 | mon1 | "start": "2026-08-31 07:27:10.378473", 2026-08-31 07:27:11.772446 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-08-31 07:27:11.772614 | mon1 | "stderr_lines": [ 2026-08-31 07:27:11.772786 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-08-31 07:27:11.772980 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-08-31 07:27:11.773143 | mon1 | ], 2026-08-31 07:27:11.773316 | mon1 | "stdout": "HEALTH_OK", 2026-08-31 07:27:11.773474 | mon1 | "stdout_lines": [ 2026-08-31 07:27:11.773636 | mon1 | "HEALTH_OK" 2026-08-31 07:27:11.773797 | mon1 | ] 2026-08-31 07:27:11.774004 | mon1 | } 2026-08-31 07:27:11.774223 | mon1 | } 2026-08-31 07:27:11.774441 | mon1 | 2026-08-31 07:27:11.774684 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-08-31 07:27:11.774840 | mon1 | Monday 31 August 2026 07:27:11 +0000 (0:00:00.029) 0:00:08.703 ********* 2026-08-31 07:27:11.800510 | mon1 | ok: [mon1] => { 2026-08-31 07:27:11.800680 | mon1 | "changed": false, 2026-08-31 07:27:11.800851 | mon1 | "msg": "All assertions passed" 2026-08-31 07:27:11.801096 | mon1 | } 2026-08-31 07:27:11.801260 | mon1 | 2026-08-31 07:27:11.801430 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-08-31 07:27:11.801607 | mon1 | Monday 31 August 2026 07:27:11 +0000 (0:00:00.030) 0:00:08.734 ********* 2026-08-31 07:27:17.881115 | mon1 | changed: [mon1] 2026-08-31 07:27:17.881171 | mon1 | 2026-08-31 07:27:17.881176 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-08-31 07:27:17.881193 | mon1 | Monday 31 August 2026 07:27:17 +0000 (0:00:06.080) 0:00:14.814 ********* 2026-08-31 07:27:20.172319 | mon1 | changed: [mon1] 2026-08-31 07:27:20.172931 | mon1 | 2026-08-31 07:27:20.173014 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-08-31 07:27:20.173028 | mon1 | Monday 31 August 2026 07:27:20 +0000 (0:00:02.291) 0:00:17.106 ********* 2026-08-31 07:27:21.357775 | mon1 | ok: [mon1] 2026-08-31 07:27:21.358351 | mon1 | 2026-08-31 07:27:21.358410 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-08-31 07:27:21.358422 | mon1 | Monday 31 August 2026 07:27:21 +0000 (0:00:01.185) 0:00:18.291 ********* 2026-08-31 07:27:21.414844 | mon1 | ok: [mon1] => { 2026-08-31 07:27:21.415955 | mon1 | "changed": false, 2026-08-31 07:27:21.416023 | mon1 | "msg": "All assertions passed" 2026-08-31 07:27:21.416035 | mon1 | } 2026-08-31 07:27:21.416045 | mon1 | 2026-08-31 07:27:21.416054 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] ********* 2026-08-31 07:27:21.416070 | mon1 | Monday 31 August 2026 07:27:21 +0000 (0:00:00.057) 0:00:18.348 ********* 2026-08-31 07:27:22.514632 | mon1 | ok: [mon1] 2026-08-31 07:27:22.515225 | mon1 | 2026-08-31 07:27:22.515285 | mon1 | TASK [Assert that the legacy key module info state returns the correct key] **** 2026-08-31 07:27:22.515297 | mon1 | Monday 31 August 2026 07:27:22 +0000 (0:00:01.099) 0:00:19.448 ********* 2026-08-31 07:27:22.566284 | mon1 | ok: [mon1] => { 2026-08-31 07:27:22.566332 | mon1 | "changed": false, 2026-08-31 07:27:22.567885 | mon1 | "msg": "All assertions passed" 2026-08-31 07:27:22.567913 | mon1 | } 2026-08-31 07:27:22.567959 | mon1 | 2026-08-31 07:27:22.567970 | mon1 | PLAY RECAP ********************************************************************* 2026-08-31 07:27:22.567978 | mon1 | mon1 : ok=13 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-08-31 07:27:22.567987 | mon1 | 2026-08-31 07:27:22.567994 | mon1 | 2026-08-31 07:27:22.568002 | mon1 | TASKS RECAP ******************************************************************** 2026-08-31 07:27:22.568014 | mon1 | Monday 31 August 2026 07:27:22 +0000 (0:00:00.051) 0:00:19.500 ********* 2026-08-31 07:27:22.570351 | mon1 | =============================================================================== 2026-08-31 07:27:22.570407 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.08s 2026-08-31 07:27:22.570418 | mon1 | List locally deployed Ceph daemons -------------------------------------- 5.77s 2026-08-31 07:27:22.570427 | mon1 | Create a test Ceph key -------------------------------------------------- 2.29s 2026-08-31 07:27:22.570436 | mon1 | Get cluster health status ----------------------------------------------- 1.58s 2026-08-31 07:27:22.570444 | mon1 | Gathering Facts --------------------------------------------------------- 1.23s 2026-08-31 07:27:22.570453 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.19s 2026-08-31 07:27:22.570461 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 1.10s 2026-08-31 07:27:22.570470 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.06s 2026-08-31 07:27:22.570478 | mon1 | Assert that the legacy key module info state returns the correct key ---- 0.05s 2026-08-31 07:27:22.570487 | mon1 | Collect deployed Ceph container images ---------------------------------- 0.05s 2026-08-31 07:27:22.570495 | mon1 | Assert that a deployed Ceph container image was found ------------------- 0.04s 2026-08-31 07:27:22.570503 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-08-31 07:27:22.570511 | mon1 | Print cluster health status --------------------------------------------- 0.03s 2026-08-31 07:27:22.657033 | mon1 | INFO [default > verify] Executed: Successful 2026-08-31 07:27:22.667545 | mon1 | INFO [default > cleanup] Executing 2026-08-31 07:27:22.668230 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-31 07:27:22.678432 | mon1 | INFO [default > destroy] Executing 2026-08-31 07:27:22.678622 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-31 07:27:22.678794 | mon1 | INFO [default > destroy] Executed: Successful 2026-08-31 07:27:22.679372 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-08-31 07:27:33.058589 | mon1 | ok: Runtime: 0:14:50.224341 2026-08-31 07:27:33.077077 | 2026-08-31 07:27:33.077134 | PLAY RECAP 2026-08-31 07:27:33.077182 | mon1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-31 07:27:33.077205 | 2026-08-31 07:27:33.205837 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-31 07:27:33.212310 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-31 07:27:33.940877 | 2026-08-31 07:27:33.941067 | PLAY [all] 2026-08-31 07:27:33.956027 | 2026-08-31 07:27:33.956107 | TASK [fetch-output : Set log path for multiple nodes] 2026-08-31 07:27:34.014550 | mon1 | ok 2026-08-31 07:27:34.019110 | osd1 | ok 2026-08-31 07:27:34.023602 | 2026-08-31 07:27:34.023686 | TASK [fetch-output : Set log path for single node] 2026-08-31 07:27:34.051302 | mon1 | skipping: Conditional result was False 2026-08-31 07:27:34.073189 | osd1 | skipping: Conditional result was False 2026-08-31 07:27:34.082371 | 2026-08-31 07:27:34.082482 | LOOP [fetch-output : Ensure local output dirs] 2026-08-31 07:27:34.496023 | mon1 -> localhost | changed: "/var/lib/zuul/builds/5572f2eb761c43b78477d2c2dc5d9864/work/logs/mon1" 2026-08-31 07:27:34.519917 | osd1 -> localhost | changed: "/var/lib/zuul/builds/5572f2eb761c43b78477d2c2dc5d9864/work/logs/osd1" 2026-08-31 07:27:34.725404 | osd1 -> localhost | ok: "/var/lib/zuul/builds/5572f2eb761c43b78477d2c2dc5d9864/work/artifacts" 2026-08-31 07:27:34.785729 | mon1 -> localhost | changed: "/var/lib/zuul/builds/5572f2eb761c43b78477d2c2dc5d9864/work/artifacts" 2026-08-31 07:27:34.929805 | osd1 -> localhost | changed: "/var/lib/zuul/builds/5572f2eb761c43b78477d2c2dc5d9864/work/docs" 2026-08-31 07:27:35.030780 | mon1 -> localhost | ok: "/var/lib/zuul/builds/5572f2eb761c43b78477d2c2dc5d9864/work/docs" 2026-08-31 07:27:35.030924 | mon1 -> localhost | changed: All items complete 2026-08-31 07:27:35.030997 | 2026-08-31 07:27:35.045889 | 2026-08-31 07:27:35.046077 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-08-31 07:27:35.734198 | osd1 | changed: .d..t...... ./ 2026-08-31 07:27:35.740885 | mon1 | changed: .d..t...... ./ 2026-08-31 07:27:36.221497 | osd1 | changed: .d..t...... ./ 2026-08-31 07:27:36.227508 | mon1 | ok 2026-08-31 07:27:36.694759 | osd1 | changed: .d..t...... ./ 2026-08-31 07:27:36.721056 | mon1 | ok 2026-08-31 07:27:36.721175 | mon1 | changed: All items complete 2026-08-31 07:27:36.721232 | 2026-08-31 07:27:36.749468 | 2026-08-31 07:27:36.749618 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-08-31 07:27:37.189029 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.012950 2026-08-31 07:27:37.421882 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.008535 2026-08-31 07:27:37.435360 | 2026-08-31 07:27:37.435947 | PLAY [all] 2026-08-31 07:27:37.443258 | 2026-08-31 07:27:37.443328 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-08-31 07:27:37.882429 | mon1 | changed 2026-08-31 07:27:38.146263 | osd1 | changed 2026-08-31 07:27:38.158857 | 2026-08-31 07:27:38.158913 | PLAY RECAP 2026-08-31 07:27:38.158959 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-31 07:27:38.158989 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-31 07:27:38.159010 | 2026-08-31 07:27:38.326369 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-31 07:27:38.329401 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-08-31 07:27:38.922712 | 2026-08-31 07:27:38.922871 | PLAY [localhost] 2026-08-31 07:27:38.933349 | 2026-08-31 07:27:38.933424 | TASK [Generate Zuul manifest] 2026-08-31 07:27:38.954778 | localhost | ok 2026-08-31 07:27:38.974345 | 2026-08-31 07:27:38.974429 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-08-31 07:27:39.349425 | localhost | changed 2026-08-31 07:27:39.362235 | 2026-08-31 07:27:39.362312 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-08-31 07:27:39.394824 | localhost | ok 2026-08-31 07:27:39.403940 | 2026-08-31 07:27:39.404026 | TASK [Upload logs] 2026-08-31 07:27:39.425465 | localhost | ok 2026-08-31 07:27:39.490045 | 2026-08-31 07:27:39.490178 | TASK [Set zuul-log-path fact] 2026-08-31 07:27:39.513229 | localhost | ok 2026-08-31 07:27:39.526398 | 2026-08-31 07:27:39.526467 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-31 07:27:39.558202 | localhost | ok 2026-08-31 07:27:39.567575 | 2026-08-31 07:27:39.567669 | TASK [upload-logs : Create log directories] 2026-08-31 07:27:39.984633 | localhost | changed 2026-08-31 07:27:39.991630 | 2026-08-31 07:27:39.991725 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-08-31 07:27:40.410860 | localhost -> localhost | ok: Runtime: 0:00:00.005862 2026-08-31 07:27:40.416949 | 2026-08-31 07:27:40.417068 | TASK [upload-logs : Upload logs to log server] 2026-08-31 07:27:40.925323 | localhost | Output suppressed because no_log was given 2026-08-31 07:27:40.931379 | 2026-08-31 07:27:40.931445 | LOOP [upload-logs : Compress console log and json output] 2026-08-31 07:27:41.029400 | localhost | skipping: Conditional result was False 2026-08-31 07:27:41.037007 | localhost | skipping: Conditional result was False 2026-08-31 07:27:41.047430 | 2026-08-31 07:27:41.047567 | LOOP [upload-logs : Upload compressed console log and json output] 2026-08-31 07:27:41.134777 | localhost | skipping: Conditional result was False 2026-08-31 07:27:41.135285 | 2026-08-31 07:27:41.138547 | localhost | skipping: Conditional result was False 2026-08-31 07:27:41.196180 | 2026-08-31 07:27:41.196345 | LOOP [upload-logs : Upload console log and json output]