2026-03-06 01:19:18.555327 | Job console starting
2026-03-06 01:19:18.567529 | Updating git repos
2026-03-06 01:19:18.588080 | Cloning repos into workspace
2026-03-06 01:19:18.621348 | Restoring repo states
2026-03-06 01:19:18.628004 | Merging changes
2026-03-06 01:19:18.881022 | Checking out repos
2026-03-06 01:19:18.950196 | Preparing playbooks
2026-03-06 01:19:19.931280 | Running Ansible setup
2026-03-06 01:19:23.209977 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-06 01:19:23.764224 | 
2026-03-06 01:19:23.764333 | PLAY [localhost]
2026-03-06 01:19:23.771420 | 
2026-03-06 01:19:23.771490 | TASK [Gathering Facts]
2026-03-06 01:19:24.596860 | localhost | ok
2026-03-06 01:19:24.604440 | 
2026-03-06 01:19:24.604512 | TASK [Setup log path fact]
2026-03-06 01:19:24.621401 | localhost | ok
2026-03-06 01:19:24.634265 | 
2026-03-06 01:19:24.634328 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-06 01:19:24.662339 | localhost | ok
2026-03-06 01:19:24.670034 | 
2026-03-06 01:19:24.670117 | TASK [emit-job-header : Print job information]
2026-03-06 01:19:24.709906 | # Job Information
2026-03-06 01:19:24.710105 | Ansible Version: 2.16.16
2026-03-06 01:19:24.710175 | Job: ansible-collection-ceph-molecule-aio-ubuntu-jammy
2026-03-06 01:19:24.710225 | Pipeline: check
2026-03-06 01:19:24.710271 | Executor: 0a8996d2b663
2026-03-06 01:19:24.710314 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/96
2026-03-06 01:19:24.710365 | Event ID: 61bdb7f0-18fa-11f1-8961-149ac14c4b20
2026-03-06 01:19:24.715238 | 
2026-03-06 01:19:24.715325 | LOOP [emit-job-header : Print node information]
2026-03-06 01:19:24.810391 | localhost | ok:
2026-03-06 01:19:24.810651 | localhost | # Node Information
2026-03-06 01:19:24.810713 | localhost | Inventory Hostname: aio
2026-03-06 01:19:24.810762 | localhost | Hostname: np0000158004
2026-03-06 01:19:24.810806 | localhost | Username: zuul
2026-03-06 01:19:24.810869 | localhost | Distro: Ubuntu 22.04
2026-03-06 01:19:24.810915 | localhost | Provider: yul1
2026-03-06 01:19:24.810957 | localhost | Region: ca-ymq-1
2026-03-06 01:19:24.810998 | localhost | Label: ubuntu-jammy
2026-03-06 01:19:24.811040 | localhost | Product Name: OpenStack Nova
2026-03-06 01:19:24.811097 | localhost | Interface IP: 199.204.45.244
2026-03-06 01:19:24.822798 | 
2026-03-06 01:19:24.822884 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-06 01:19:25.197487 | localhost -> localhost | changed
2026-03-06 01:19:25.207348 | 
2026-03-06 01:19:25.207501 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-06 01:19:25.999588 | localhost -> localhost | changed
2026-03-06 01:19:26.010344 | 
2026-03-06 01:19:26.010421 | PLAY [all]
2026-03-06 01:19:26.019357 | 
2026-03-06 01:19:26.019432 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-06 01:19:26.250998 | aio -> localhost | ok
2026-03-06 01:19:26.261977 | 
2026-03-06 01:19:26.262042 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-06 01:19:26.292262 | aio | ok
2026-03-06 01:19:26.316335 | aio | included: /var/lib/zuul/builds/902f03b19e7442c9961cb57bf8e937ef/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-06 01:19:26.324499 | 
2026-03-06 01:19:26.324591 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-06 01:19:27.189247 | aio -> localhost | Generating public/private rsa key pair.
2026-03-06 01:19:27.189430 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/902f03b19e7442c9961cb57bf8e937ef/work/902f03b19e7442c9961cb57bf8e937ef_id_rsa
2026-03-06 01:19:27.189472 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/902f03b19e7442c9961cb57bf8e937ef/work/902f03b19e7442c9961cb57bf8e937ef_id_rsa.pub
2026-03-06 01:19:27.189503 | aio -> localhost | The key fingerprint is:
2026-03-06 01:19:27.189533 | aio -> localhost | SHA256:cYEReHo7f81cgv14ChzcA2hUbkKzDqqmLqGcyvIV8UM zuul-build-sshkey
2026-03-06 01:19:27.189574 | aio -> localhost | The key's randomart image is:
2026-03-06 01:19:27.189604 | aio -> localhost | +---[RSA 3072]----+
2026-03-06 01:19:27.189639 | aio -> localhost | |       .o+=..    |
2026-03-06 01:19:27.189669 | aio -> localhost | |      . oo *     |
2026-03-06 01:19:27.189697 | aio -> localhost | |    . Eoo * +    |
2026-03-06 01:19:27.189724 | aio -> localhost | |     +...* + o   |
2026-03-06 01:19:27.189751 | aio -> localhost | |    . +.S.. ooo  |
2026-03-06 01:19:27.189777 | aio -> localhost | |.    o .o  ...o..|
2026-03-06 01:19:27.189803 | aio -> localhost | |o.. +    o  o+ = |
2026-03-06 01:19:27.189829 | aio -> localhost | |=o +      . ..= o|
2026-03-06 01:19:27.189859 | aio -> localhost | |+=+        .  .o |
2026-03-06 01:19:27.189887 | aio -> localhost | +----[SHA256]-----+
2026-03-06 01:19:27.189945 | aio -> localhost | ok: Runtime: 0:00:00.465757
2026-03-06 01:19:27.196801 | 
2026-03-06 01:19:27.196884 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-06 01:19:27.230688 | aio | ok
2026-03-06 01:19:27.241431 | aio | included: /var/lib/zuul/builds/902f03b19e7442c9961cb57bf8e937ef/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-06 01:19:27.249118 | 
2026-03-06 01:19:27.249187 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-06 01:19:27.273370 | aio | skipping: Conditional result was False
2026-03-06 01:19:27.285446 | 
2026-03-06 01:19:27.285580 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-06 01:19:27.857880 | aio | changed
2026-03-06 01:19:27.864355 | 
2026-03-06 01:19:27.864423 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-06 01:19:28.049686 | aio | ok
2026-03-06 01:19:28.055931 | 
2026-03-06 01:19:28.055993 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-06 01:19:28.509212 | aio | changed
2026-03-06 01:19:28.514284 | 
2026-03-06 01:19:28.514347 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-06 01:19:28.973074 | aio | changed
2026-03-06 01:19:28.979383 | 
2026-03-06 01:19:28.979453 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-06 01:19:29.002916 | aio | skipping: Conditional result was False
2026-03-06 01:19:29.015130 | 
2026-03-06 01:19:29.015192 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-06 01:19:29.364296 | aio -> localhost | changed
2026-03-06 01:19:29.378377 | 
2026-03-06 01:19:29.378502 | TASK [add-build-sshkey : Add back temp key]
2026-03-06 01:19:29.655504 | aio -> localhost | Identity added: /var/lib/zuul/builds/902f03b19e7442c9961cb57bf8e937ef/work/902f03b19e7442c9961cb57bf8e937ef_id_rsa (zuul-build-sshkey)
2026-03-06 01:19:29.655672 | aio -> localhost | ok: Runtime: 0:00:00.012948
2026-03-06 01:19:29.660549 | 
2026-03-06 01:19:29.660611 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-06 01:19:29.995275 | aio | ok
2026-03-06 01:19:30.002488 | 
2026-03-06 01:19:30.002560 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-06 01:19:30.026299 | aio | skipping: Conditional result was False
2026-03-06 01:19:30.039867 | 
2026-03-06 01:19:30.039943 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-06 01:19:30.364383 | aio | ok
2026-03-06 01:19:30.372124 | 
2026-03-06 01:19:30.372191 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-06 01:19:31.070381 | aio | Output suppressed because no_log was given
2026-03-06 01:19:31.081314 | 
2026-03-06 01:19:31.081393 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-06 01:19:31.267232 | aio | ok: "logs"
2026-03-06 01:19:31.267465 | aio | ok: All items complete
2026-03-06 01:19:31.267508 | 
2026-03-06 01:19:31.430091 | aio | ok: "artifacts"
2026-03-06 01:19:31.581866 | aio | ok: "docs"
2026-03-06 01:19:31.588536 | 
2026-03-06 01:19:31.588672 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-06 01:19:31.800602 | aio | changed: "logs"
2026-03-06 01:19:31.921750 | aio | changed: "artifacts"
2026-03-06 01:19:32.072780 | aio | changed: "docs"
2026-03-06 01:19:32.089893 | 
2026-03-06 01:19:32.090046 | PLAY RECAP
2026-03-06 01:19:32.090107 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-06 01:19:32.090163 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-06 01:19:32.090185 | 
2026-03-06 01:19:32.205162 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-06 01:19:32.208506 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-06 01:19:32.778974 | 
2026-03-06 01:19:32.779085 | PLAY [all]
2026-03-06 01:19:32.789914 | 
2026-03-06 01:19:32.789992 | TASK [setup-uv : Extract archive]
2026-03-06 01:19:35.073323 | aio | changed
2026-03-06 01:19:35.080336 | 
2026-03-06 01:19:35.080412 | TASK [setup-uv : Print version]
2026-03-06 01:19:35.706051 | aio | uv 0.8.13
2026-03-06 01:19:35.615990 | aio | ok: Runtime: 0:00:00.029984
2026-03-06 01:19:35.622817 | 
2026-03-06 01:19:35.622866 | PLAY RECAP
2026-03-06 01:19:35.622910 | aio | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-06 01:19:35.622938 | 
2026-03-06 01:19:35.713803 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-06 01:19:35.718530 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-06 01:19:36.286972 | 
2026-03-06 01:19:36.287193 | PLAY [all]
2026-03-06 01:19:36.299411 | 
2026-03-06 01:19:36.299541 | TASK [Copy inventory file for Zuul]
2026-03-06 01:19:37.105633 | aio | changed
2026-03-06 01:19:37.112008 | 
2026-03-06 01:19:37.112143 | TASK [Switch "ansible_host" to private IP]
2026-03-06 01:19:37.375591 | aio | changed: 1 replacements made
2026-03-06 01:19:37.382751 | 
2026-03-06 01:19:37.382839 | TASK [Run Molecule scenario]
2026-03-06 01:19:38.177784 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-03-06 01:19:38.981906 | aio |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-03-06 01:19:39.197825 | aio | Using CPython 3.13.7
2026-03-06 01:19:39.197890 | aio | Creating virtual environment at: .venv
2026-03-06 01:19:39.500260 | aio | Downloading pygments (1.2MiB)
2026-03-06 01:19:39.510008 | aio | Downloading cryptography (4.3MiB)
2026-03-06 01:19:39.512002 | aio | Downloading ansible-core (2.1MiB)
2026-03-06 01:19:39.512431 | aio | Downloading netaddr (2.2MiB)
2026-03-06 01:19:39.692563 | aio |  Downloading netaddr
2026-03-06 01:19:39.701856 | aio |  Downloading cryptography
2026-03-06 01:19:39.740352 | aio |  Downloading pygments
2026-03-06 01:19:39.865165 | aio |  Downloading ansible-core
2026-03-06 01:19:39.892969 | aio | Installed 36 packages in 27ms
2026-03-06 01:19:41.007498 | aio | INFO     Collection 'vexxhost.ceph' detected.
2026-03-06 01:19:41.007619 | aio | INFO     Scenarios will be used from 'extensions/molecule'
2026-03-06 01:19:41.766502 | aio | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-03-06 01:19:41.766652 | aio | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-03-06 01:19:55.585293 | aio | INFO     [default > dependency] Executing
2026-03-06 01:19:55.585454 | aio | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-03-06 01:19:55.585620 | aio | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-03-06 01:19:55.585734 | aio | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-03-06 01:19:55.594743 | aio | INFO     [default > cleanup] Executing
2026-03-06 01:19:55.594851 | aio | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-06 01:19:55.597119 | aio | INFO     [default > destroy] Executing
2026-03-06 01:19:55.597154 | aio | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-03-06 01:19:55.597267 | aio | INFO     [default > destroy] Executed: Successful
2026-03-06 01:19:55.602161 | aio | INFO     [default > syntax] Executing
2026-03-06 01:19:56.652739 | aio |
2026-03-06 01:19:56.652976 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-03-06 01:19:56.748503 | aio | INFO     [default > syntax] Executed: Successful
2026-03-06 01:19:56.759119 | aio | INFO     [default > create] Executing
2026-03-06 01:19:56.760436 | aio | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-06 01:19:56.765461 | aio | INFO     [default > prepare] Executing
2026-03-06 01:19:57.548786 | aio |
2026-03-06 01:19:57.548865 | aio | PLAY [Prepare] *****************************************************************
2026-03-06 01:19:57.549014 | aio |
2026-03-06 01:19:57.549203 | aio | TASK [Gathering Facts] *********************************************************
2026-03-06 01:19:57.549335 | aio | Friday 06 March 2026  01:19:57 +0000 (0:00:00.035)       0:00:00.035 **********
2026-03-06 01:19:58.753821 | aio | [WARNING]: Platform linux on host aio is using the discovered Python
2026-03-06 01:19:58.753905 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-06 01:19:58.754004 | aio | interpreter could change the meaning of that path. See
2026-03-06 01:19:58.754104 | aio | https://docs.ansible.com/ansible-
2026-03-06 01:19:58.754207 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-06 01:19:58.754326 | aio | ok: [aio]
2026-03-06 01:19:58.754417 | aio |
2026-03-06 01:19:58.754575 | aio | TASK [Configure short hostname] ************************************************
2026-03-06 01:19:58.754686 | aio | Friday 06 March 2026  01:19:58 +0000 (0:00:01.205)       0:00:01.241 **********
2026-03-06 01:19:59.445489 | aio | changed: [aio]
2026-03-06 01:19:59.445649 | aio |
2026-03-06 01:19:59.445869 | aio | TASK [Ensure hostname inside hosts file] ***************************************
2026-03-06 01:19:59.446082 | aio | Friday 06 March 2026  01:19:59 +0000 (0:00:00.691)       0:00:01.933 **********
2026-03-06 01:19:59.847680 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-03-06 01:19:59.847797 | aio | with a mode of 0700, this may cause issues when running as another user. To
2026-03-06 01:19:59.847951 | aio | avoid this, create the remote_tmp dir with the correct permissions manually
2026-03-06 01:19:59.853830 | aio | changed: [aio]
2026-03-06 01:19:59.853968 | aio |
2026-03-06 01:19:59.854111 | aio | TASK [Update apt cache] ********************************************************
2026-03-06 01:19:59.854260 | aio | Friday 06 March 2026  01:19:59 +0000 (0:00:00.408)       0:00:02.342 **********
2026-03-06 01:20:12.882091 | aio | changed: [aio]
2026-03-06 01:20:12.882830 | aio |
2026-03-06 01:20:12.882851 | aio | PLAY [Create devices for Ceph] *************************************************
2026-03-06 01:20:12.882867 | aio |
2026-03-06 01:20:12.882882 | aio | TASK [Gathering Facts] *********************************************************
2026-03-06 01:20:12.882896 | aio | Friday 06 March 2026  01:20:12 +0000 (0:00:13.027)       0:00:15.369 **********
2026-03-06 01:20:13.604929 | aio | ok: [aio]
2026-03-06 01:20:13.605011 | aio |
2026-03-06 01:20:13.605109 | aio | TASK [Install depedencies] *****************************************************
2026-03-06 01:20:13.605200 | aio | Friday 06 March 2026  01:20:13 +0000 (0:00:00.723)       0:00:16.092 **********
2026-03-06 01:20:47.274411 | aio | changed: [aio]
2026-03-06 01:20:47.274535 | aio |
2026-03-06 01:20:47.274557 | aio | TASK [Start up service] ********************************************************
2026-03-06 01:20:47.274645 | aio | Friday 06 March 2026  01:20:47 +0000 (0:00:33.669)       0:00:49.762 **********
2026-03-06 01:20:47.843007 | aio | ok: [aio]
2026-03-06 01:20:47.843179 | aio |
2026-03-06 01:20:47.843400 | aio | TASK [Generate lvm.conf] *******************************************************
2026-03-06 01:20:47.843611 | aio | Friday 06 March 2026  01:20:47 +0000 (0:00:00.568)       0:00:50.331 **********
2026-03-06 01:20:48.164375 | aio | ok: [aio]
2026-03-06 01:20:48.164609 | aio |
2026-03-06 01:20:48.164840 | aio | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-03-06 01:20:48.165132 | aio | Friday 06 March 2026  01:20:48 +0000 (0:00:00.321)       0:00:50.652 **********
2026-03-06 01:20:48.826027 | aio | changed: [aio]
2026-03-06 01:20:48.826197 | aio |
2026-03-06 01:20:48.826440 | aio | TASK [Get list of all loopback devices] ****************************************
2026-03-06 01:20:48.826723 | aio | Friday 06 March 2026  01:20:48 +0000 (0:00:00.661)       0:00:51.313 **********
2026-03-06 01:20:49.029503 | aio | ok: [aio]
2026-03-06 01:20:49.029584 | aio |
2026-03-06 01:20:49.029736 | aio | TASK [Fail if there is any existing loopback devices] **************************
2026-03-06 01:20:49.029870 | aio | Friday 06 March 2026  01:20:49 +0000 (0:00:00.203)       0:00:51.517 **********
2026-03-06 01:20:49.051606 | aio | skipping: [aio]
2026-03-06 01:20:49.051644 | aio |
2026-03-06 01:20:49.051654 | aio | TASK [Create devices for Ceph] *************************************************
2026-03-06 01:20:49.051662 | aio | Friday 06 March 2026  01:20:49 +0000 (0:00:00.021)       0:00:51.539 **********
2026-03-06 01:20:49.666478 | aio | changed: [aio] => (item=osd0)
2026-03-06 01:20:49.666567 | aio | changed: [aio] => (item=osd1)
2026-03-06 01:20:49.666575 | aio | changed: [aio] => (item=osd2)
2026-03-06 01:20:49.666582 | aio |
2026-03-06 01:20:49.666588 | aio | TASK [Set permissions on loopback devices] *************************************
2026-03-06 01:20:49.666595 | aio | Friday 06 March 2026  01:20:49 +0000 (0:00:00.614)       0:00:52.153 **********
2026-03-06 01:20:50.354800 | aio | changed: [aio] => (item=osd0)
2026-03-06 01:20:50.354880 | aio | changed: [aio] => (item=osd1)
2026-03-06 01:20:50.354892 | aio | changed: [aio] => (item=osd2)
2026-03-06 01:20:50.354902 | aio |
2026-03-06 01:20:50.354912 | aio | TASK [Start loop devices] ******************************************************
2026-03-06 01:20:50.354922 | aio | Friday 06 March 2026  01:20:50 +0000 (0:00:00.687)       0:00:52.841 **********
2026-03-06 01:20:51.068893 | aio | changed: [aio] => (item=osd0)
2026-03-06 01:20:51.068954 | aio | changed: [aio] => (item=osd1)
2026-03-06 01:20:51.068972 | aio | changed: [aio] => (item=osd2)
2026-03-06 01:20:51.068991 | aio |
2026-03-06 01:20:51.068997 | aio | TASK [Create a volume group for each loop device] ******************************
2026-03-06 01:20:51.069004 | aio | Friday 06 March 2026  01:20:51 +0000 (0:00:00.714)       0:00:53.556 **********
2026-03-06 01:20:54.141816 | aio | changed: [aio] => (item=osd0)
2026-03-06 01:20:54.141925 | aio | changed: [aio] => (item=osd1)
2026-03-06 01:20:54.141940 | aio | changed: [aio] => (item=osd2)
2026-03-06 01:20:54.142034 | aio |
2026-03-06 01:20:54.142134 | aio | TASK [Create a logical volume for each loop device] ****************************
2026-03-06 01:20:54.142238 | aio | Friday 06 March 2026  01:20:54 +0000 (0:00:03.073)       0:00:56.630 **********
2026-03-06 01:20:56.001342 | aio | changed: [aio] => (item=ceph-aio-osd0)
2026-03-06 01:20:56.001575 | aio | changed: [aio] => (item=ceph-aio-osd1)
2026-03-06 01:20:56.001824 | aio | changed: [aio] => (item=ceph-aio-osd2)
2026-03-06 01:20:56.002120 | aio |
2026-03-06 01:20:56.002353 | aio | PLAY RECAP *********************************************************************
2026-03-06 01:20:56.002629 | aio | aio                        : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-03-06 01:20:56.002820 | aio |
2026-03-06 01:20:56.003006 | aio |
2026-03-06 01:20:56.003263 | aio | TASKS RECAP ********************************************************************
2026-03-06 01:20:56.003478 | aio | Friday 06 March 2026  01:20:55 +0000 (0:00:01.859)       0:00:58.489 **********
2026-03-06 01:20:56.003671 | aio | ===============================================================================
2026-03-06 01:20:56.003871 | aio | Install depedencies ---------------------------------------------------- 33.67s
2026-03-06 01:20:56.004068 | aio | Update apt cache ------------------------------------------------------- 13.03s
2026-03-06 01:20:56.004380 | aio | Create a volume group for each loop device ------------------------------ 3.07s
2026-03-06 01:20:56.004525 | aio | Create a logical volume for each loop device ---------------------------- 1.86s
2026-03-06 01:20:56.004716 | aio | Gathering Facts --------------------------------------------------------- 1.21s
2026-03-06 01:20:56.004859 | aio | Gathering Facts --------------------------------------------------------- 0.72s
2026-03-06 01:20:56.004998 | aio | Start loop devices ------------------------------------------------------ 0.71s
2026-03-06 01:20:56.005133 | aio | Configure short hostname ------------------------------------------------ 0.69s
2026-03-06 01:20:56.005263 | aio | Set permissions on loopback devices ------------------------------------- 0.69s
2026-03-06 01:20:56.005464 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.66s
2026-03-06 01:20:56.005612 | aio | Create devices for Ceph ------------------------------------------------- 0.61s
2026-03-06 01:20:56.005793 | aio | Start up service -------------------------------------------------------- 0.57s
2026-03-06 01:20:56.005933 | aio | Ensure hostname inside hosts file --------------------------------------- 0.41s
2026-03-06 01:20:56.006068 | aio | Generate lvm.conf ------------------------------------------------------- 0.32s
2026-03-06 01:20:56.006202 | aio | Get list of all loopback devices ---------------------------------------- 0.20s
2026-03-06 01:20:56.006336 | aio | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-03-06 01:20:56.087909 | aio | INFO     [default > prepare] Executed: Successful
2026-03-06 01:20:56.093435 | aio | INFO     [default > converge] Executing
2026-03-06 01:20:56.974965 | aio |
2026-03-06 01:20:56.975056 | aio | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-03-06 01:20:56.975073 | aio |
2026-03-06 01:20:56.975215 | aio | TASK [Gathering Facts] *********************************************************
2026-03-06 01:20:56.975339 | aio | Friday 06 March 2026  01:20:56 +0000 (0:00:00.051)       0:00:00.051 **********
2026-03-06 01:20:58.164038 | aio | [WARNING]: Platform linux on host aio is using the discovered Python
2026-03-06 01:20:58.164213 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-06 01:20:58.164419 | aio | interpreter could change the meaning of that path. See
2026-03-06 01:20:58.164782 | aio | https://docs.ansible.com/ansible-
2026-03-06 01:20:58.164985 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-06 01:20:58.178224 | aio | ok: [aio]
2026-03-06 01:20:58.178470 | aio |
2026-03-06 01:20:58.178775 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-06 01:20:58.179136 | aio | Friday 06 March 2026  01:20:58 +0000 (0:00:01.203)       0:00:01.254 **********
2026-03-06 01:20:58.461641 | aio | ok: [aio]
2026-03-06 01:20:58.461733 | aio |
2026-03-06 01:20:58.461842 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-06 01:20:58.461966 | aio | Friday 06 March 2026  01:20:58 +0000 (0:00:00.283)       0:00:01.537 **********
2026-03-06 01:20:58.493396 | aio | skipping: [aio]
2026-03-06 01:20:58.493447 | aio |
2026-03-06 01:20:58.493709 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-06 01:20:58.493817 | aio | Friday 06 March 2026  01:20:58 +0000 (0:00:00.031)       0:00:01.569 **********
2026-03-06 01:20:58.792641 | aio | changed: [aio]
2026-03-06 01:20:58.792747 | aio |
2026-03-06 01:20:58.792786 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-06 01:20:58.792936 | aio | Friday 06 March 2026  01:20:58 +0000 (0:00:00.299)       0:00:01.869 **********
2026-03-06 01:20:58.891145 | aio | ok: [aio] => {
2026-03-06 01:20:58.891281 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-06 01:20:58.891487 | aio | }
2026-03-06 01:20:58.891667 | aio |
2026-03-06 01:20:58.891876 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-06 01:20:58.892078 | aio | Friday 06 March 2026  01:20:58 +0000 (0:00:00.098)       0:00:01.967 **********
2026-03-06 01:20:59.592099 | aio | changed: [aio]
2026-03-06 01:20:59.592257 | aio |
2026-03-06 01:20:59.592506 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-06 01:20:59.592738 | aio | Friday 06 March 2026  01:20:59 +0000 (0:00:00.701)       0:00:02.668 **********
2026-03-06 01:20:59.635377 | aio | skipping: [aio]
2026-03-06 01:20:59.635492 | aio |
2026-03-06 01:20:59.635719 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-06 01:20:59.635926 | aio | Friday 06 March 2026  01:20:59 +0000 (0:00:00.043)       0:00:02.711 **********
2026-03-06 01:20:59.677659 | aio | skipping: [aio]
2026-03-06 01:20:59.677946 | aio |
2026-03-06 01:20:59.678202 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-06 01:20:59.678407 | aio | Friday 06 March 2026  01:20:59 +0000 (0:00:00.042)       0:00:02.754 **********
2026-03-06 01:20:59.880524 | aio | ok: [aio]
2026-03-06 01:20:59.880677 | aio |
2026-03-06 01:20:59.880915 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-06 01:20:59.881137 | aio | Friday 06 March 2026  01:20:59 +0000 (0:00:00.202)       0:00:02.956 **********
2026-03-06 01:21:01.291686 | aio | ok: [aio]
2026-03-06 01:21:01.291857 | aio |
2026-03-06 01:21:01.292052 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-06 01:21:01.292259 | aio | Friday 06 March 2026  01:21:01 +0000 (0:00:01.411)       0:00:04.367 **********
2026-03-06 01:21:01.366039 | aio | ok: [aio] => {
2026-03-06 01:21:01.366127 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-06 01:21:01.366139 | aio | }
2026-03-06 01:21:01.366218 | aio |
2026-03-06 01:21:01.366307 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-06 01:21:01.366402 | aio | Friday 06 March 2026  01:21:01 +0000 (0:00:00.074)       0:00:04.442 **********
2026-03-06 01:21:02.240263 | aio | changed: [aio]
2026-03-06 01:21:02.240495 | aio |
2026-03-06 01:21:02.240661 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-06 01:21:02.240952 | aio | Friday 06 March 2026  01:21:02 +0000 (0:00:00.874)       0:00:05.316 **********
2026-03-06 01:21:05.201083 | aio | changed: [aio]
2026-03-06 01:21:05.201181 | aio |
2026-03-06 01:21:05.201194 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-06 01:21:05.201205 | aio | Friday 06 March 2026  01:21:05 +0000 (0:00:02.960)       0:00:08.276 **********
2026-03-06 01:21:05.231321 | aio | skipping: [aio]
2026-03-06 01:21:05.231448 | aio |
2026-03-06 01:21:05.231464 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-06 01:21:05.231546 | aio | Friday 06 March 2026  01:21:05 +0000 (0:00:00.031)       0:00:08.307 **********
2026-03-06 01:21:05.264355 | aio | skipping: [aio]
2026-03-06 01:21:05.264398 | aio |
2026-03-06 01:21:05.264404 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-06 01:21:05.264409 | aio | Friday 06 March 2026  01:21:05 +0000 (0:00:00.032)       0:00:08.340 **********
2026-03-06 01:21:05.294594 | aio | skipping: [aio]
2026-03-06 01:21:05.294614 | aio |
2026-03-06 01:21:05.294855 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-06 01:21:05.294866 | aio | Friday 06 March 2026  01:21:05 +0000 (0:00:00.031)       0:00:08.371 **********
2026-03-06 01:21:10.807752 | aio | changed: [aio]
2026-03-06 01:21:10.807826 | aio |
2026-03-06 01:21:10.808134 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-06 01:21:10.808156 | aio | Friday 06 March 2026  01:21:10 +0000 (0:00:05.512)       0:00:13.884 **********
2026-03-06 01:21:11.361145 | aio | changed: [aio]
2026-03-06 01:21:11.361227 | aio |
2026-03-06 01:21:11.361281 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-06 01:21:11.361431 | aio | Friday 06 March 2026  01:21:11 +0000 (0:00:00.553)       0:00:14.437 **********
2026-03-06 01:21:12.270304 | aio | changed: [aio] => (item={'path': '/etc/containerd'})
2026-03-06 01:21:12.270400 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-06 01:21:12.270625 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-06 01:21:12.270836 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-06 01:21:12.270851 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-06 01:21:12.270864 | aio |
2026-03-06 01:21:12.270878 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-06 01:21:12.271042 | aio | Friday 06 March 2026  01:21:12 +0000 (0:00:00.909)       0:00:15.346 **********
2026-03-06 01:21:12.812609 | aio | changed: [aio]
2026-03-06 01:21:12.812719 | aio |
2026-03-06 01:21:12.812735 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-06 01:21:12.812793 | aio | Friday 06 March 2026  01:21:12 +0000 (0:00:00.535)       0:00:15.882 **********
2026-03-06 01:21:12.813102 | aio |
2026-03-06 01:21:12.813169 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-03-06 01:21:12.813176 | aio | Friday 06 March 2026  01:21:12 +0000 (0:00:00.006)       0:00:15.889 **********
2026-03-06 01:21:13.727012 | aio | ok: [aio]
2026-03-06 01:21:13.727105 | aio |
2026-03-06 01:21:13.727389 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-03-06 01:21:13.727442 | aio | Friday 06 March 2026  01:21:13 +0000 (0:00:00.914)       0:00:16.803 **********
2026-03-06 01:21:14.162869 | aio | changed: [aio]
2026-03-06 01:21:14.162968 | aio |
2026-03-06 01:21:14.162984 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-06 01:21:14.163143 | aio | Friday 06 March 2026  01:21:14 +0000 (0:00:00.435)       0:00:17.239 **********
2026-03-06 01:21:14.708681 | aio | changed: [aio]
2026-03-06 01:21:14.708780 | aio |
2026-03-06 01:21:14.708798 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-06 01:21:14.708952 | aio | Friday 06 March 2026  01:21:14 +0000 (0:00:00.545)       0:00:17.785 **********
2026-03-06 01:21:14.907878 | aio | ok: [aio]
2026-03-06 01:21:14.907978 | aio |
2026-03-06 01:21:14.907992 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-06 01:21:14.908156 | aio | Friday 06 March 2026  01:21:14 +0000 (0:00:00.199)       0:00:17.984 **********
2026-03-06 01:21:14.972618 | aio | ok: [aio] => {
2026-03-06 01:21:14.972717 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-06 01:21:14.972732 | aio | }
2026-03-06 01:21:14.973073 | aio |
2026-03-06 01:21:14.973139 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-06 01:21:14.973146 | aio | Friday 06 March 2026  01:21:14 +0000 (0:00:00.064)       0:00:18.049 **********
2026-03-06 01:21:15.783821 | aio | changed: [aio]
2026-03-06 01:21:15.783914 | aio |
2026-03-06 01:21:15.783929 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-06 01:21:15.784090 | aio | Friday 06 March 2026  01:21:15 +0000 (0:00:00.811)       0:00:18.860 **********
2026-03-06 01:21:21.123213 | aio | changed: [aio]
2026-03-06 01:21:21.123298 | aio |
2026-03-06 01:21:21.123359 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-06 01:21:21.123487 | aio | Friday 06 March 2026  01:21:21 +0000 (0:00:05.339)       0:00:24.199 **********
2026-03-06 01:21:22.146724 | aio | ok: [aio]
2026-03-06 01:21:22.146817 | aio |
2026-03-06 01:21:22.147169 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-06 01:21:22.147243 | aio | Friday 06 March 2026  01:21:22 +0000 (0:00:01.023)       0:00:25.222 **********
2026-03-06 01:21:23.422194 | aio | changed: [aio]
2026-03-06 01:21:23.422276 | aio |
2026-03-06 01:21:23.422484 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-06 01:21:23.422565 | aio | Friday 06 March 2026  01:21:23 +0000 (0:00:01.275)       0:00:26.498 **********
2026-03-06 01:21:23.886607 | aio | changed: [aio]
2026-03-06 01:21:23.886663 | aio |
2026-03-06 01:21:23.886669 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-06 01:21:23.886674 | aio | Friday 06 March 2026  01:21:23 +0000 (0:00:00.464)       0:00:26.963 **********
2026-03-06 01:21:24.442843 | aio | changed: [aio] => (item={'path': '/etc/docker'})
2026-03-06 01:21:24.442924 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-06 01:21:24.443315 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-06 01:21:24.443382 | aio |
2026-03-06 01:21:24.443389 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-06 01:21:24.443394 | aio | Friday 06 March 2026  01:21:24 +0000 (0:00:00.556)       0:00:27.519 **********
2026-03-06 01:21:24.904404 | aio | changed: [aio]
2026-03-06 01:21:24.904461 | aio |
2026-03-06 01:21:24.904467 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-06 01:21:24.904472 | aio | Friday 06 March 2026  01:21:24 +0000 (0:00:00.461)       0:00:27.980 **********
2026-03-06 01:21:25.384787 | aio | changed: [aio]
2026-03-06 01:21:25.384880 | aio |
2026-03-06 01:21:25.384941 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-06 01:21:25.385351 | aio | Friday 06 March 2026  01:21:25 +0000 (0:00:00.473)       0:00:28.454 **********
2026-03-06 01:21:25.385578 | aio |
2026-03-06 01:21:25.385588 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-03-06 01:21:25.385593 | aio | Friday 06 March 2026  01:21:25 +0000 (0:00:00.007)       0:00:28.461 **********
2026-03-06 01:21:26.072868 | aio | ok: [aio]
2026-03-06 01:21:26.072929 | aio |
2026-03-06 01:21:26.072936 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-03-06 01:21:26.072942 | aio | Friday 06 March 2026  01:21:26 +0000 (0:00:00.687)       0:00:29.149 **********
2026-03-06 01:21:28.852631 | aio | changed: [aio]
2026-03-06 01:21:28.852769 | aio |
2026-03-06 01:21:28.852789 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-06 01:21:28.852801 | aio | Friday 06 March 2026  01:21:28 +0000 (0:00:02.771)       0:00:31.920 **********
2026-03-06 01:21:29.416507 | aio | changed: [aio]
2026-03-06 01:21:29.416666 | aio |
2026-03-06 01:21:29.416893 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-06 01:21:29.417110 | aio | Friday 06 March 2026  01:21:29 +0000 (0:00:00.572)       0:00:32.492 **********
2026-03-06 01:21:29.464223 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-03-06 01:21:29.464318 | aio |
2026-03-06 01:21:29.464590 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-06 01:21:29.464780 | aio | Friday 06 March 2026  01:21:29 +0000 (0:00:00.047)       0:00:32.540 **********
2026-03-06 01:21:38.926918 | aio | changed: [aio]
2026-03-06 01:21:38.926995 | aio |
2026-03-06 01:21:38.927129 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-06 01:21:38.927259 | aio | Friday 06 March 2026  01:21:38 +0000 (0:00:09.453)       0:00:41.993 **********
2026-03-06 01:21:39.579565 | aio | ok: [aio] => (item=chronyd)
2026-03-06 01:21:39.579685 | aio | ok: [aio] => (item=sshd)
2026-03-06 01:21:39.579896 | aio |
2026-03-06 01:21:39.580137 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-06 01:21:39.580419 | aio | Friday 06 March 2026  01:21:39 +0000 (0:00:00.661)       0:00:42.655 **********
2026-03-06 01:21:39.876763 | aio | changed: [aio]
2026-03-06 01:21:39.876839 | aio |
2026-03-06 01:21:39.876972 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-03-06 01:21:39.877104 | aio | Friday 06 March 2026  01:21:39 +0000 (0:00:00.297)       0:00:42.953 **********
2026-03-06 01:21:40.066592 | aio | ok: [aio]
2026-03-06 01:21:40.066660 | aio |
2026-03-06 01:21:40.067151 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-03-06 01:21:40.067325 | aio | Friday 06 March 2026  01:21:40 +0000 (0:00:00.189)       0:00:43.142 **********
2026-03-06 01:21:40.531938 | aio | changed: [aio]
2026-03-06 01:21:40.532019 | aio |
2026-03-06 01:21:40.532090 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-03-06 01:21:40.532236 | aio | Friday 06 March 2026  01:21:40 +0000 (0:00:00.465)       0:00:43.608 **********
2026-03-06 01:21:40.872586 | aio | changed: [aio]
2026-03-06 01:21:40.872656 | aio |
2026-03-06 01:21:40.872854 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-03-06 01:21:40.872895 | aio | Friday 06 March 2026  01:21:40 +0000 (0:00:00.340)       0:00:43.949 **********
2026-03-06 01:21:41.020159 | aio | ok: [aio]
2026-03-06 01:21:41.020204 | aio |
2026-03-06 01:21:41.020211 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-03-06 01:21:41.020216 | aio | Friday 06 March 2026  01:21:41 +0000 (0:00:00.147)       0:00:44.096 **********
2026-03-06 01:21:41.235539 | aio | ok: [aio] => (item=aio)
2026-03-06 01:21:41.235613 | aio |
2026-03-06 01:21:41.235939 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-03-06 01:21:41.236091 | aio | Friday 06 March 2026  01:21:41 +0000 (0:00:00.215)       0:00:44.312 **********
2026-03-06 01:21:41.270052 | aio | ok: [aio]
2026-03-06 01:21:41.270128 | aio |
2026-03-06 01:21:41.270372 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-03-06 01:21:41.270419 | aio | Friday 06 March 2026  01:21:41 +0000 (0:00:00.034)       0:00:44.346 **********
2026-03-06 01:21:41.362358 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for aio
2026-03-06 01:21:41.362427 | aio |
2026-03-06 01:21:41.362479 | aio | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-03-06 01:21:41.362613 | aio | Friday 06 March 2026  01:21:41 +0000 (0:00:00.092)       0:00:44.439 **********
2026-03-06 01:21:41.653959 | aio | changed: [aio]
2026-03-06 01:21:41.654028 | aio |
2026-03-06 01:21:41.654181 | aio | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-03-06 01:21:41.654343 | aio | Friday 06 March 2026  01:21:41 +0000 (0:00:00.291)       0:00:44.730 **********
2026-03-06 01:21:42.312064 | aio | changed: [aio] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-03-06 01:21:42.312131 | aio | changed: [aio] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-03-06 01:21:42.312639 | aio | changed: [aio] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-03-06 01:21:42.312689 | aio |
2026-03-06 01:21:42.312695 | aio | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-03-06 01:21:42.312700 | aio | Friday 06 March 2026  01:21:42 +0000 (0:00:00.658)       0:00:45.388 **********
2026-03-06 01:25:29.968273 | aio | ok: [aio]
2026-03-06 01:25:29.968357 | aio |
2026-03-06 01:25:29.968651 | aio | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-03-06 01:25:29.968717 | aio | Friday 06 March 2026  01:25:29 +0000 (0:03:47.655)       0:04:33.044 **********
2026-03-06 01:25:30.170931 | aio | changed: [aio]
2026-03-06 01:25:30.170975 | aio |
2026-03-06 01:25:30.170981 | aio | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-03-06 01:25:30.170986 | aio | Friday 06 March 2026  01:25:30 +0000 (0:00:00.202)       0:04:33.247 **********
2026-03-06 01:25:30.207294 | aio | ok: [aio]
2026-03-06 01:25:30.207316 | aio |
2026-03-06 01:25:30.207322 | aio | TASK [Install Ceph host] *******************************************************
2026-03-06 01:25:30.207326 | aio | Friday 06 March 2026  01:25:30 +0000 (0:00:00.036)       0:04:33.284 **********
2026-03-06 01:25:30.271856 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-06 01:25:30.271884 | aio |
2026-03-06 01:25:30.271890 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-06 01:25:30.271894 | aio | Friday 06 March 2026  01:25:30 +0000 (0:00:00.064)       0:04:33.348 **********
2026-03-06 01:25:35.753426 | aio | ok: [aio]
2026-03-06 01:25:35.753762 | aio |
2026-03-06 01:25:35.753782 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-06 01:25:35.753797 | aio | Friday 06 March 2026  01:25:35 +0000 (0:00:05.480)       0:04:38.829 **********
2026-03-06 01:25:35.806446 | aio | ok: [aio] => (item=aio)
2026-03-06 01:25:35.806557 | aio |
2026-03-06 01:25:35.806574 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-06 01:25:35.806584 | aio | Friday 06 March 2026  01:25:35 +0000 (0:00:00.052)       0:04:38.882 **********
2026-03-06 01:25:36.163871 | aio | ok: [aio]
2026-03-06 01:25:36.163937 | aio |
2026-03-06 01:25:36.163949 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-06 01:25:36.163960 | aio | Friday 06 March 2026  01:25:36 +0000 (0:00:00.357)       0:04:39.239 **********
2026-03-06 01:25:42.770486 | aio | ok: [aio]
2026-03-06 01:25:42.770568 | aio |
2026-03-06 01:25:42.770576 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-03-06 01:25:42.770583 | aio | Friday 06 March 2026  01:25:42 +0000 (0:00:06.606)       0:04:45.846 **********
2026-03-06 01:25:54.761479 | aio | changed: [aio]
2026-03-06 01:25:54.761600 | aio |
2026-03-06 01:25:54.761876 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-03-06 01:25:54.761904 | aio | Friday 06 March 2026  01:25:54 +0000 (0:00:11.991)       0:04:57.837 **********
2026-03-06 01:26:08.999865 | aio | ok: [aio]
2026-03-06 01:26:08.999929 | aio |
2026-03-06 01:26:09.000035 | aio | TASK [Install Ceph host] *******************************************************
2026-03-06 01:26:09.000333 | aio | Friday 06 March 2026  01:26:08 +0000 (0:00:14.238)       0:05:12.076 **********
2026-03-06 01:26:09.067253 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-06 01:26:09.067345 | aio |
2026-03-06 01:26:09.067434 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-06 01:26:09.067540 | aio | Friday 06 March 2026  01:26:09 +0000 (0:00:00.067)       0:05:12.143 **********
2026-03-06 01:26:09.107769 | aio | skipping: [aio]
2026-03-06 01:26:09.107835 | aio |
2026-03-06 01:26:09.107958 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-06 01:26:09.108086 | aio | Friday 06 March 2026  01:26:09 +0000 (0:00:00.040)       0:05:12.184 **********
2026-03-06 01:26:09.150027 | aio | skipping: [aio] => (item=aio)
2026-03-06 01:26:09.150111 | aio | skipping: [aio]
2026-03-06 01:26:09.150430 | aio |
2026-03-06 01:26:09.150476 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-06 01:26:09.150484 | aio | Friday 06 March 2026  01:26:09 +0000 (0:00:00.042)       0:05:12.226 **********
2026-03-06 01:26:09.403204 | aio | ok: [aio]
2026-03-06 01:26:09.403271 | aio |
2026-03-06 01:26:09.403614 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-06 01:26:09.403663 | aio | Friday 06 March 2026  01:26:09 +0000 (0:00:00.253)       0:05:12.479 **********
2026-03-06 01:26:15.989102 | aio | ok: [aio]
2026-03-06 01:26:15.989183 | aio |
2026-03-06 01:26:15.989411 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-03-06 01:26:15.989457 | aio | Friday 06 March 2026  01:26:15 +0000 (0:00:06.585)       0:05:19.065 **********
2026-03-06 01:26:31.270926 | aio | changed: [aio]
2026-03-06 01:26:31.270998 | aio |
2026-03-06 01:26:31.271096 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-03-06 01:26:31.271199 | aio | Friday 06 March 2026  01:26:31 +0000 (0:00:15.281)       0:05:34.347 **********
2026-03-06 01:26:37.631291 | aio | ok: [aio]
2026-03-06 01:26:37.631373 | aio |
2026-03-06 01:26:37.631453 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-03-06 01:26:37.631575 | aio | Friday 06 March 2026  01:26:37 +0000 (0:00:06.360)       0:05:40.707 **********
2026-03-06 01:26:45.782914 | aio | changed: [aio] => (item={'name': 'diskprediction_local'})
2026-03-06 01:26:45.783143 | aio | ok: [aio] => (item={'name': 'dashboard'})
2026-03-06 01:26:45.783154 | aio | changed: [aio] => (item={'name': 'prometheus'})
2026-03-06 01:26:45.783163 | aio | ok: [aio] => (item={'name': 'iostat'})
2026-03-06 01:26:45.783273 | aio |
2026-03-06 01:26:45.783474 | aio | PLAY [Deploy Ceph OSDs] ********************************************************
2026-03-06 01:26:45.783540 | aio |
2026-03-06 01:26:45.783552 | aio | TASK [Gathering Facts] *********************************************************
2026-03-06 01:26:45.783642 | aio | Friday 06 March 2026  01:26:45 +0000 (0:00:08.151)       0:05:48.859 **********
2026-03-06 01:26:46.616539 | aio | ok: [aio]
2026-03-06 01:26:46.616614 | aio |
2026-03-06 01:26:46.616679 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-06 01:26:46.616773 | aio | Friday 06 March 2026  01:26:46 +0000 (0:00:00.833)       0:05:49.693 **********
2026-03-06 01:26:46.807445 | aio | ok: [aio]
2026-03-06 01:26:46.807525 | aio |
2026-03-06 01:26:46.807609 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-06 01:26:46.807695 | aio | Friday 06 March 2026  01:26:46 +0000 (0:00:00.190)       0:05:49.884 **********
2026-03-06 01:26:46.836337 | aio | skipping: [aio]
2026-03-06 01:26:46.836380 | aio |
2026-03-06 01:26:46.836500 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-06 01:26:46.836597 | aio | Friday 06 March 2026  01:26:46 +0000 (0:00:00.029)       0:05:49.913 **********
2026-03-06 01:26:47.035727 | aio | ok: [aio]
2026-03-06 01:26:47.035787 | aio |
2026-03-06 01:26:47.035884 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-06 01:26:47.035979 | aio | Friday 06 March 2026  01:26:47 +0000 (0:00:00.199)       0:05:50.112 **********
2026-03-06 01:26:47.087902 | aio | ok: [aio] => {
2026-03-06 01:26:47.087976 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-06 01:26:47.088022 | aio | }
2026-03-06 01:26:47.088129 | aio |
2026-03-06 01:26:47.088228 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-06 01:26:47.088325 | aio | Friday 06 March 2026  01:26:47 +0000 (0:00:00.052)       0:05:50.164 **********
2026-03-06 01:26:47.406031 | aio | ok: [aio]
2026-03-06 01:26:47.406089 | aio |
2026-03-06 01:26:47.406302 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-06 01:26:47.406428 | aio | Friday 06 March 2026  01:26:47 +0000 (0:00:00.317)       0:05:50.482 **********
2026-03-06 01:26:47.445359 | aio | skipping: [aio]
2026-03-06 01:26:47.445439 | aio |
2026-03-06 01:26:47.445639 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-06 01:26:47.445684 | aio | Friday 06 March 2026  01:26:47 +0000 (0:00:00.039)       0:05:50.522 **********
2026-03-06 01:26:47.483908 | aio | skipping: [aio]
2026-03-06 01:26:47.483981 | aio |
2026-03-06 01:26:47.484041 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-06 01:26:47.484144 | aio | Friday 06 March 2026  01:26:47 +0000 (0:00:00.038)       0:05:50.560 **********
2026-03-06 01:26:47.685484 | aio | ok: [aio]
2026-03-06 01:26:47.685606 | aio |
2026-03-06 01:26:47.685763 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-06 01:26:47.685940 | aio | Friday 06 March 2026  01:26:47 +0000 (0:00:00.201)       0:05:50.762 **********
2026-03-06 01:26:48.738377 | aio | ok: [aio]
2026-03-06 01:26:48.738446 | aio |
2026-03-06 01:26:48.738609 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-06 01:26:48.738710 | aio | Friday 06 March 2026  01:26:48 +0000 (0:00:01.053)       0:05:51.815 **********
2026-03-06 01:26:48.795756 | aio | ok: [aio] => {
2026-03-06 01:26:48.795840 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-06 01:26:48.796000 | aio | }
2026-03-06 01:26:48.796116 | aio |
2026-03-06 01:26:48.796265 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-06 01:26:48.796408 | aio | Friday 06 March 2026  01:26:48 +0000 (0:00:00.057)       0:05:51.872 **********
2026-03-06 01:26:49.107994 | aio | ok: [aio]
2026-03-06 01:26:49.108087 | aio |
2026-03-06 01:26:49.108242 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-06 01:26:49.108384 | aio | Friday 06 March 2026  01:26:49 +0000 (0:00:00.312)       0:05:52.184 **********
2026-03-06 01:26:51.047305 | aio | ok: [aio]
2026-03-06 01:26:51.047373 | aio |
2026-03-06 01:26:51.047452 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-06 01:26:51.047546 | aio | Friday 06 March 2026  01:26:51 +0000 (0:00:01.939)       0:05:54.123 **********
2026-03-06 01:26:51.073947 | aio | skipping: [aio]
2026-03-06 01:26:51.074055 | aio |
2026-03-06 01:26:51.074192 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-06 01:26:51.074324 | aio | Friday 06 March 2026  01:26:51 +0000 (0:00:00.026)       0:05:54.150 **********
2026-03-06 01:26:51.104588 | aio | skipping: [aio]
2026-03-06 01:26:51.104633 | aio |
2026-03-06 01:26:51.104736 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-06 01:26:51.104825 | aio | Friday 06 March 2026  01:26:51 +0000 (0:00:00.030)       0:05:54.181 **********
2026-03-06 01:26:51.129863 | aio | skipping: [aio]
2026-03-06 01:26:51.129971 | aio |
2026-03-06 01:26:51.130109 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-06 01:26:51.130243 | aio | Friday 06 March 2026  01:26:51 +0000 (0:00:00.025)       0:05:54.206 **********
2026-03-06 01:26:52.289601 | aio | ok: [aio]
2026-03-06 01:26:52.289675 | aio |
2026-03-06 01:26:52.289785 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-06 01:26:52.289918 | aio | Friday 06 March 2026  01:26:52 +0000 (0:00:01.159)       0:05:55.366 **********
2026-03-06 01:26:52.727566 | aio | ok: [aio]
2026-03-06 01:26:52.727636 | aio |
2026-03-06 01:26:52.727803 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-06 01:26:52.727945 | aio | Friday 06 March 2026  01:26:52 +0000 (0:00:00.437)       0:05:55.804 **********
2026-03-06 01:26:53.592382 | aio | ok: [aio] => (item={'path': '/etc/containerd'})
2026-03-06 01:26:53.592462 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-06 01:26:53.592550 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-06 01:26:53.592693 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-06 01:26:53.592876 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-06 01:26:53.592974 | aio |
2026-03-06 01:26:53.593068 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-06 01:26:53.593164 | aio | Friday 06 March 2026  01:26:53 +0000 (0:00:00.864)       0:05:56.669 **********
2026-03-06 01:26:54.059830 | aio | ok: [aio]
2026-03-06 01:26:54.059895 | aio |
2026-03-06 01:26:54.059976 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-06 01:26:54.060069 | aio | Friday 06 March 2026  01:26:54 +0000 (0:00:00.461)       0:05:57.131 **********
2026-03-06 01:26:54.060158 | aio |
2026-03-06 01:26:54.060265 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-06 01:26:54.060357 | aio | Friday 06 March 2026  01:26:54 +0000 (0:00:00.005)       0:05:57.136 **********
2026-03-06 01:26:54.401262 | aio | ok: [aio]
2026-03-06 01:26:54.401326 | aio |
2026-03-06 01:26:54.401398 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-06 01:26:54.401492 | aio | Friday 06 March 2026  01:26:54 +0000 (0:00:00.341)       0:05:57.478 **********
2026-03-06 01:26:54.603944 | aio | ok: [aio]
2026-03-06 01:26:54.604043 | aio |
2026-03-06 01:26:54.604217 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-06 01:26:54.604359 | aio | Friday 06 March 2026  01:26:54 +0000 (0:00:00.202)       0:05:57.680 **********
2026-03-06 01:26:54.655608 | aio | ok: [aio] => {
2026-03-06 01:26:54.655950 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-06 01:26:54.656098 | aio | }
2026-03-06 01:26:54.656232 | aio |
2026-03-06 01:26:54.656386 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-06 01:26:54.656543 | aio | Friday 06 March 2026  01:26:54 +0000 (0:00:00.051)       0:05:57.732 **********
2026-03-06 01:26:55.023376 | aio | ok: [aio]
2026-03-06 01:26:55.023500 | aio |
2026-03-06 01:26:55.023676 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-06 01:26:55.023854 | aio | Friday 06 March 2026  01:26:55 +0000 (0:00:00.367)       0:05:58.099 **********
2026-03-06 01:26:58.011851 | aio | ok: [aio]
2026-03-06 01:26:58.011918 | aio |
2026-03-06 01:26:58.011998 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-06 01:26:58.012144 | aio | Friday 06 March 2026  01:26:58 +0000 (0:00:02.988)       0:06:01.088 **********
2026-03-06 01:26:59.129464 | aio | ok: [aio]
2026-03-06 01:26:59.129554 | aio |
2026-03-06 01:26:59.129704 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-06 01:26:59.129843 | aio | Friday 06 March 2026  01:26:59 +0000 (0:00:01.117)       0:06:02.206 **********
2026-03-06 01:26:59.322449 | aio | ok: [aio]
2026-03-06 01:26:59.322558 | aio |
2026-03-06 01:26:59.322720 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-06 01:26:59.322859 | aio | Friday 06 March 2026  01:26:59 +0000 (0:00:00.192)       0:06:02.398 **********
2026-03-06 01:26:59.732433 | aio | ok: [aio]
2026-03-06 01:26:59.732534 | aio |
2026-03-06 01:26:59.732693 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-06 01:26:59.732841 | aio | Friday 06 March 2026  01:26:59 +0000 (0:00:00.410)       0:06:02.809 **********
2026-03-06 01:27:00.273986 | aio | ok: [aio] => (item={'path': '/etc/docker'})
2026-03-06 01:27:00.274055 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-06 01:27:00.274114 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-06 01:27:00.274195 | aio |
2026-03-06 01:27:00.274297 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-06 01:27:00.274393 | aio | Friday 06 March 2026  01:27:00 +0000 (0:00:00.541)       0:06:03.350 **********
2026-03-06 01:27:00.661749 | aio | ok: [aio]
2026-03-06 01:27:00.661816 | aio |
2026-03-06 01:27:00.661956 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-06 01:27:00.662082 | aio | Friday 06 March 2026  01:27:00 +0000 (0:00:00.387)       0:06:03.738 **********
2026-03-06 01:27:01.084724 | aio | ok: [aio]
2026-03-06 01:27:01.084794 | aio |
2026-03-06 01:27:01.084871 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-06 01:27:01.084961 | aio | Friday 06 March 2026  01:27:01 +0000 (0:00:00.416)       0:06:04.154 **********
2026-03-06 01:27:01.085053 | aio |
2026-03-06 01:27:01.085140 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-06 01:27:01.085226 | aio | Friday 06 March 2026  01:27:01 +0000 (0:00:00.006)       0:06:04.161 **********
2026-03-06 01:27:01.459770 | aio | ok: [aio]
2026-03-06 01:27:01.459832 | aio |
2026-03-06 01:27:01.459927 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-06 01:27:01.460033 | aio | Friday 06 March 2026  01:27:01 +0000 (0:00:00.374)       0:06:04.536 **********
2026-03-06 01:27:01.505079 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-03-06 01:27:01.505186 | aio |
2026-03-06 01:27:01.505340 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-06 01:27:01.505486 | aio | Friday 06 March 2026  01:27:01 +0000 (0:00:00.045)       0:06:04.581 **********
2026-03-06 01:27:02.608498 | aio | ok: [aio]
2026-03-06 01:27:02.608576 | aio |
2026-03-06 01:27:02.608672 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-06 01:27:02.608763 | aio | Friday 06 March 2026  01:27:02 +0000 (0:00:01.103)       0:06:05.685 **********
2026-03-06 01:27:03.272641 | aio | ok: [aio] => (item=chronyd)
2026-03-06 01:27:03.272712 | aio | ok: [aio] => (item=sshd)
2026-03-06 01:27:03.272795 | aio |
2026-03-06 01:27:03.272888 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-06 01:27:03.272985 | aio | Friday 06 March 2026  01:27:03 +0000 (0:00:00.664)       0:06:06.349 **********
2026-03-06 01:27:03.769921 | aio | ok: [aio]
2026-03-06 01:27:03.770172 | aio |
2026-03-06 01:27:03.770293 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-03-06 01:27:03.770407 | aio | Friday 06 March 2026  01:27:03 +0000 (0:00:00.497)       0:06:06.846 **********
2026-03-06 01:27:03.962187 | aio | ok: [aio]
2026-03-06 01:27:03.962260 | aio |
2026-03-06 01:27:03.962407 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-03-06 01:27:03.962559 | aio | Friday 06 March 2026  01:27:03 +0000 (0:00:00.192)       0:06:07.038 **********
2026-03-06 01:27:04.197197 | aio | ok: [aio]
2026-03-06 01:27:04.197253 | aio |
2026-03-06 01:27:04.197366 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-03-06 01:27:04.197469 | aio | Friday 06 March 2026  01:27:04 +0000 (0:00:00.235)       0:06:07.273 **********
2026-03-06 01:27:04.397291 | aio | ok: [aio]
2026-03-06 01:27:04.397365 | aio |
2026-03-06 01:27:04.397434 | aio | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-03-06 01:27:04.397529 | aio | Friday 06 March 2026  01:27:04 +0000 (0:00:00.200)       0:06:07.473 **********
2026-03-06 01:27:04.619959 | aio | ok: [aio] => (item=aio)
2026-03-06 01:27:04.620052 | aio |
2026-03-06 01:27:04.620225 | aio | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-03-06 01:27:04.620363 | aio | Friday 06 March 2026  01:27:04 +0000 (0:00:00.222)       0:06:07.696 **********
2026-03-06 01:27:04.661065 | aio | ok: [aio]
2026-03-06 01:27:04.661116 | aio |
2026-03-06 01:27:04.661229 | aio | TASK [Install Ceph host] *******************************************************
2026-03-06 01:27:04.661326 | aio | Friday 06 March 2026  01:27:04 +0000 (0:00:00.041)       0:06:07.737 **********
2026-03-06 01:27:04.718265 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-06 01:27:04.718345 | aio |
2026-03-06 01:27:04.718554 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-06 01:27:04.718690 | aio | Friday 06 March 2026  01:27:04 +0000 (0:00:00.056)       0:06:07.794 **********
2026-03-06 01:27:04.761050 | aio | skipping: [aio]
2026-03-06 01:27:04.761095 | aio |
2026-03-06 01:27:04.761187 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-06 01:27:04.761285 | aio | Friday 06 March 2026  01:27:04 +0000 (0:00:00.042)       0:06:07.837 **********
2026-03-06 01:27:04.801071 | aio | skipping: [aio] => (item=aio)
2026-03-06 01:27:04.801118 | aio | skipping: [aio]
2026-03-06 01:27:04.801201 | aio |
2026-03-06 01:27:04.801300 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-06 01:27:04.801395 | aio | Friday 06 March 2026  01:27:04 +0000 (0:00:00.039)       0:06:07.877 **********
2026-03-06 01:27:05.046133 | aio | ok: [aio]
2026-03-06 01:27:05.046491 | aio |
2026-03-06 01:27:05.046639 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-06 01:27:05.046742 | aio | Friday 06 March 2026  01:27:05 +0000 (0:00:00.245)       0:06:08.122 **********
2026-03-06 01:27:18.267178 | aio | ok: [aio]
2026-03-06 01:27:18.267260 | aio |
2026-03-06 01:27:18.267299 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-03-06 01:27:18.267450 | aio | Friday 06 March 2026  01:27:18 +0000 (0:00:13.220)       0:06:21.343 **********
2026-03-06 01:27:23.180903 | aio | ok: [aio]
2026-03-06 01:27:23.180976 | aio |
2026-03-06 01:27:23.181256 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-03-06 01:27:23.181302 | aio | Friday 06 March 2026  01:27:23 +0000 (0:00:04.913)       0:06:26.257 **********
2026-03-06 01:27:37.733987 | aio | ok: [aio]
2026-03-06 01:27:37.734066 | aio |
2026-03-06 01:27:37.734263 | aio | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-03-06 01:27:37.734311 | aio | Friday 06 March 2026  01:27:37 +0000 (0:00:14.553)       0:06:40.810 **********
2026-03-06 01:29:40.520194 | aio | ok: [aio] => (item=/dev/ceph-aio-osd0/data)
2026-03-06 01:29:40.520271 | aio | ok: [aio] => (item=/dev/ceph-aio-osd1/data)
2026-03-06 01:29:40.520366 | aio | ok: [aio] => (item=/dev/ceph-aio-osd2/data)
2026-03-06 01:29:40.520460 | aio |
2026-03-06 01:29:40.520564 | aio | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-03-06 01:29:40.520672 | aio | Friday 06 March 2026  01:29:40 +0000 (0:02:02.786)       0:08:43.596 **********
2026-03-06 01:29:46.537160 | aio | ok: [aio]
2026-03-06 01:29:46.537253 | aio |
2026-03-06 01:29:46.537312 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-03-06 01:29:46.537442 | aio | Friday 06 March 2026  01:29:46 +0000 (0:00:06.016)       0:08:49.613 **********
2026-03-06 01:29:54.009711 | aio | ok: [aio]
2026-03-06 01:29:54.009792 | aio |
2026-03-06 01:29:54.010007 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-03-06 01:29:54.010058 | aio | Friday 06 March 2026  01:29:54 +0000 (0:00:07.472)       0:08:57.086 **********
2026-03-06 01:29:54.062744 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio
2026-03-06 01:29:54.062800 | aio |
2026-03-06 01:29:54.063047 | aio | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-03-06 01:29:54.063092 | aio | Friday 06 March 2026  01:29:54 +0000 (0:00:00.053)       0:08:57.139 **********
2026-03-06 01:29:54.102675 | aio | ok: [aio]
2026-03-06 01:29:54.102749 | aio |
2026-03-06 01:29:54.102984 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-03-06 01:29:54.103016 | aio | Friday 06 March 2026  01:29:54 +0000 (0:00:00.039)       0:08:57.179 **********
2026-03-06 01:30:02.270645 | aio | ok: [aio]
2026-03-06 01:30:02.270776 | aio |
2026-03-06 01:30:02.271052 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-03-06 01:30:02.271112 | aio | Friday 06 March 2026  01:30:02 +0000 (0:00:08.167)       0:09:05.347 **********
2026-03-06 01:30:02.304931 | aio | ok: [aio]
2026-03-06 01:30:02.304984 | aio |
2026-03-06 01:30:02.305225 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-03-06 01:30:02.305267 | aio | Friday 06 March 2026  01:30:02 +0000 (0:00:00.034)       0:09:05.381 **********
2026-03-06 01:30:02.348572 | aio | skipping: [aio] => (item=1)
2026-03-06 01:30:02.348631 | aio | skipping: [aio] => (item=1)
2026-03-06 01:30:02.349191 | aio | skipping: [aio] => (item=1)
2026-03-06 01:30:02.349233 | aio | skipping: [aio]
2026-03-06 01:30:02.349240 | aio |
2026-03-06 01:30:02.349244 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-03-06 01:30:02.349249 | aio | Friday 06 March 2026  01:30:02 +0000 (0:00:00.043)       0:09:05.424 **********
2026-03-06 01:30:02.375663 | aio | skipping: [aio]
2026-03-06 01:30:02.377473 | aio |
2026-03-06 01:30:02.377544 | aio | PLAY RECAP *********************************************************************
2026-03-06 01:30:02.377558 | aio | aio                        : ok=106  changed=29   unreachable=0    failed=0    skipped=18   rescued=0    ignored=0
2026-03-06 01:30:02.377572 | aio |
2026-03-06 01:30:02.377585 | aio |
2026-03-06 01:30:02.377595 | aio | TASKS RECAP ********************************************************************
2026-03-06 01:30:02.377604 | aio | Friday 06 March 2026  01:30:02 +0000 (0:00:00.027)       0:09:05.452 **********
2026-03-06 01:30:02.377614 | aio | ===============================================================================
2026-03-06 01:30:02.377623 | aio | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 227.66s
2026-03-06 01:30:02.377632 | aio | vexxhost.ceph.osd : Install OSDs -------------------------------------- 122.79s
2026-03-06 01:30:02.377641 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 15.28s
2026-03-06 01:30:02.377650 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.55s
2026-03-06 01:30:02.377659 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.24s
2026-03-06 01:30:02.377668 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 13.22s
2026-03-06 01:30:02.377686 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 11.99s
2026-03-06 01:30:02.377695 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 9.45s
2026-03-06 01:30:02.377704 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 8.17s
2026-03-06 01:30:02.377744 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.15s
2026-03-06 01:30:02.377863 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 7.47s
2026-03-06 01:30:02.378033 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.61s
2026-03-06 01:30:02.378157 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.59s
2026-03-06 01:30:02.378280 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.36s
2026-03-06 01:30:02.378402 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.02s
2026-03-06 01:30:02.378546 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.51s
2026-03-06 01:30:02.378675 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.48s
2026-03-06 01:30:02.378798 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 5.34s
2026-03-06 01:30:02.378921 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 4.91s
2026-03-06 01:30:02.379044 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.99s
2026-03-06 01:30:02.472014 | aio | INFO     [default > converge] Executed: Successful
2026-03-06 01:30:02.479178 | aio | INFO     [default > idempotence] Executing
2026-03-06 01:30:03.312393 | aio |
2026-03-06 01:30:03.312823 | aio | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-03-06 01:30:03.313110 | aio |
2026-03-06 01:30:03.313408 | aio | TASK [Gathering Facts] *********************************************************
2026-03-06 01:30:03.313702 | aio | Friday 06 March 2026  01:30:03 +0000 (0:00:00.050)       0:00:00.050 **********
2026-03-06 01:30:04.470583 | aio | [WARNING]: Platform linux on host aio is using the discovered Python
2026-03-06 01:30:04.470732 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-06 01:30:04.470951 | aio | interpreter could change the meaning of that path. See
2026-03-06 01:30:04.471159 | aio | https://docs.ansible.com/ansible-
2026-03-06 01:30:04.471367 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-06 01:30:04.482446 | aio | ok: [aio]
2026-03-06 01:30:04.482673 | aio |
2026-03-06 01:30:04.482882 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-06 01:30:04.483085 | aio | Friday 06 March 2026  01:30:04 +0000 (0:00:01.170)       0:00:01.221 **********
2026-03-06 01:30:04.761124 | aio | ok: [aio]
2026-03-06 01:30:04.761294 | aio |
2026-03-06 01:30:04.761530 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-06 01:30:04.761760 | aio | Friday 06 March 2026  01:30:04 +0000 (0:00:00.278)       0:00:01.499 **********
2026-03-06 01:30:04.790487 | aio | skipping: [aio]
2026-03-06 01:30:04.790693 | aio |
2026-03-06 01:30:04.790926 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-06 01:30:04.791143 | aio | Friday 06 March 2026  01:30:04 +0000 (0:00:00.029)       0:00:01.529 **********
2026-03-06 01:30:05.096415 | aio | ok: [aio]
2026-03-06 01:30:05.096661 | aio |
2026-03-06 01:30:05.096952 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-06 01:30:05.097221 | aio | Friday 06 March 2026  01:30:05 +0000 (0:00:00.305)       0:00:01.834 **********
2026-03-06 01:30:05.168246 | aio | ok: [aio] => {
2026-03-06 01:30:05.168473 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-06 01:30:05.168678 | aio | }
2026-03-06 01:30:05.168868 | aio |
2026-03-06 01:30:05.169083 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-06 01:30:05.169290 | aio | Friday 06 March 2026  01:30:05 +0000 (0:00:00.072)       0:00:01.906 **********
2026-03-06 01:30:05.569589 | aio | ok: [aio]
2026-03-06 01:30:05.569634 | aio |
2026-03-06 01:30:05.569642 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-06 01:30:05.569649 | aio | Friday 06 March 2026  01:30:05 +0000 (0:00:00.400)       0:00:02.307 **********
2026-03-06 01:30:05.611014 | aio | skipping: [aio]
2026-03-06 01:30:05.611091 | aio |
2026-03-06 01:30:05.611202 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-06 01:30:05.611301 | aio | Friday 06 March 2026  01:30:05 +0000 (0:00:00.042)       0:00:02.349 **********
2026-03-06 01:30:05.653914 | aio | skipping: [aio]
2026-03-06 01:30:05.653985 | aio |
2026-03-06 01:30:05.654070 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-06 01:30:05.654220 | aio | Friday 06 March 2026  01:30:05 +0000 (0:00:00.042)       0:00:02.392 **********
2026-03-06 01:30:05.855798 | aio | ok: [aio]
2026-03-06 01:30:05.855862 | aio |
2026-03-06 01:30:05.856172 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-06 01:30:05.856222 | aio | Friday 06 March 2026  01:30:05 +0000 (0:00:00.201)       0:00:02.594 **********
2026-03-06 01:30:06.946638 | aio | ok: [aio]
2026-03-06 01:30:06.946709 | aio |
2026-03-06 01:30:06.946938 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-06 01:30:06.946980 | aio | Friday 06 March 2026  01:30:06 +0000 (0:00:01.090)       0:00:03.685 **********
2026-03-06 01:30:07.019651 | aio | ok: [aio] => {
2026-03-06 01:30:07.019728 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-06 01:30:07.019789 | aio | }
2026-03-06 01:30:07.020076 | aio |
2026-03-06 01:30:07.020126 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-06 01:30:07.020133 | aio | Friday 06 March 2026  01:30:07 +0000 (0:00:00.072)       0:00:03.758 **********
2026-03-06 01:30:07.362624 | aio | ok: [aio]
2026-03-06 01:30:07.362693 | aio |
2026-03-06 01:30:07.362706 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-06 01:30:07.362725 | aio | Friday 06 March 2026  01:30:07 +0000 (0:00:00.342)       0:00:04.100 **********
2026-03-06 01:30:09.582491 | aio | ok: [aio]
2026-03-06 01:30:09.582590 | aio |
2026-03-06 01:30:09.582793 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-06 01:30:09.582854 | aio | Friday 06 March 2026  01:30:09 +0000 (0:00:02.220)       0:00:06.321 **********
2026-03-06 01:30:09.612301 | aio | skipping: [aio]
2026-03-06 01:30:09.612367 | aio |
2026-03-06 01:30:09.612568 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-06 01:30:09.612595 | aio | Friday 06 March 2026  01:30:09 +0000 (0:00:00.029)       0:00:06.351 **********
2026-03-06 01:30:09.642271 | aio | skipping: [aio]
2026-03-06 01:30:09.642577 | aio |
2026-03-06 01:30:09.642619 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-06 01:30:09.642710 | aio | Friday 06 March 2026  01:30:09 +0000 (0:00:00.029)       0:00:06.380 **********
2026-03-06 01:30:09.672541 | aio | skipping: [aio]
2026-03-06 01:30:09.672652 | aio |
2026-03-06 01:30:09.672966 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-06 01:30:09.673012 | aio | Friday 06 March 2026  01:30:09 +0000 (0:00:00.030)       0:00:06.411 **********
2026-03-06 01:30:10.646413 | aio | ok: [aio]
2026-03-06 01:30:10.646536 | aio |
2026-03-06 01:30:10.646730 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-06 01:30:10.646774 | aio | Friday 06 March 2026  01:30:10 +0000 (0:00:00.973)       0:00:07.384 **********
2026-03-06 01:30:11.064510 | aio | ok: [aio]
2026-03-06 01:30:11.065016 | aio |
2026-03-06 01:30:11.065060 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-06 01:30:11.065065 | aio | Friday 06 March 2026  01:30:11 +0000 (0:00:00.418)       0:00:07.802 **********
2026-03-06 01:30:12.002032 | aio | ok: [aio] => (item={'path': '/etc/containerd'})
2026-03-06 01:30:12.002106 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-06 01:30:12.002592 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-06 01:30:12.002617 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-06 01:30:12.002625 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-06 01:30:12.003006 | aio |
2026-03-06 01:30:12.003086 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-06 01:30:12.003095 | aio | Friday 06 March 2026  01:30:11 +0000 (0:00:00.937)       0:00:08.740 **********
2026-03-06 01:30:12.488793 | aio | ok: [aio]
2026-03-06 01:30:12.488868 | aio |
2026-03-06 01:30:12.489405 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-06 01:30:12.489448 | aio | Friday 06 March 2026  01:30:12 +0000 (0:00:00.477)       0:00:09.218 **********
2026-03-06 01:30:12.489454 | aio |
2026-03-06 01:30:12.489458 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-06 01:30:12.489463 | aio | Friday 06 March 2026  01:30:12 +0000 (0:00:00.009)       0:00:09.227 **********
2026-03-06 01:30:13.133801 | aio | ok: [aio]
2026-03-06 01:30:13.133881 | aio |
2026-03-06 01:30:13.134107 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-06 01:30:13.134186 | aio | Friday 06 March 2026  01:30:13 +0000 (0:00:00.644)       0:00:09.872 **********
2026-03-06 01:30:13.336690 | aio | ok: [aio]
2026-03-06 01:30:13.336794 | aio |
2026-03-06 01:30:13.336807 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-06 01:30:13.336954 | aio | Friday 06 March 2026  01:30:13 +0000 (0:00:00.203)       0:00:10.075 **********
2026-03-06 01:30:13.407617 | aio | ok: [aio] => {
2026-03-06 01:30:13.407740 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-06 01:30:13.408304 | aio | }
2026-03-06 01:30:13.408356 | aio |
2026-03-06 01:30:13.408365 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-06 01:30:13.408373 | aio | Friday 06 March 2026  01:30:13 +0000 (0:00:00.070)       0:00:10.145 **********
2026-03-06 01:30:13.782701 | aio | ok: [aio]
2026-03-06 01:30:13.782787 | aio |
2026-03-06 01:30:13.783093 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-06 01:30:13.783142 | aio | Friday 06 March 2026  01:30:13 +0000 (0:00:00.375)       0:00:10.521 **********
2026-03-06 01:30:16.849119 | aio | ok: [aio]
2026-03-06 01:30:16.849192 | aio |
2026-03-06 01:30:16.849411 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-06 01:30:16.849457 | aio | Friday 06 March 2026  01:30:16 +0000 (0:00:03.066)       0:00:13.587 **********
2026-03-06 01:30:17.799428 | aio | ok: [aio]
2026-03-06 01:30:17.799502 | aio |
2026-03-06 01:30:17.799803 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-06 01:30:17.799850 | aio | Friday 06 March 2026  01:30:17 +0000 (0:00:00.950)       0:00:14.537 **********
2026-03-06 01:30:18.071192 | aio | ok: [aio]
2026-03-06 01:30:18.071259 | aio |
2026-03-06 01:30:18.071512 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-06 01:30:18.071558 | aio | Friday 06 March 2026  01:30:18 +0000 (0:00:00.271)       0:00:14.809 **********
2026-03-06 01:30:18.497411 | aio | ok: [aio]
2026-03-06 01:30:18.497507 | aio |
2026-03-06 01:30:18.497795 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-06 01:30:18.497817 | aio | Friday 06 March 2026  01:30:18 +0000 (0:00:00.426)       0:00:15.236 **********
2026-03-06 01:30:19.023771 | aio | ok: [aio] => (item={'path': '/etc/docker'})
2026-03-06 01:30:19.023871 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-06 01:30:19.024473 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-06 01:30:19.024529 | aio |
2026-03-06 01:30:19.024538 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-06 01:30:19.024545 | aio | Friday 06 March 2026  01:30:19 +0000 (0:00:00.526)       0:00:15.762 **********
2026-03-06 01:30:19.433385 | aio | ok: [aio]
2026-03-06 01:30:19.433490 | aio |
2026-03-06 01:30:19.433501 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-06 01:30:19.433622 | aio | Friday 06 March 2026  01:30:19 +0000 (0:00:00.409)       0:00:16.172 **********
2026-03-06 01:30:19.880242 | aio | ok: [aio]
2026-03-06 01:30:19.880301 | aio |
2026-03-06 01:30:19.880384 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-06 01:30:19.880749 | aio | Friday 06 March 2026  01:30:19 +0000 (0:00:00.439)       0:00:16.611 **********
2026-03-06 01:30:19.880765 | aio |
2026-03-06 01:30:19.880770 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-06 01:30:19.880775 | aio | Friday 06 March 2026  01:30:19 +0000 (0:00:00.007)       0:00:16.619 **********
2026-03-06 01:30:20.227257 | aio | ok: [aio]
2026-03-06 01:30:20.227297 | aio |
2026-03-06 01:30:20.227303 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-06 01:30:20.227308 | aio | Friday 06 March 2026  01:30:20 +0000 (0:00:00.346)       0:00:16.965 **********
2026-03-06 01:30:20.276334 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-03-06 01:30:20.276376 | aio |
2026-03-06 01:30:20.276384 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-06 01:30:20.276390 | aio | Friday 06 March 2026  01:30:20 +0000 (0:00:00.048)       0:00:17.014 **********
2026-03-06 01:30:21.220481 | aio | ok: [aio]
2026-03-06 01:30:21.220557 | aio |
2026-03-06 01:30:21.220566 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-06 01:30:21.220573 | aio | Friday 06 March 2026  01:30:21 +0000 (0:00:00.943)       0:00:17.958 **********
2026-03-06 01:30:21.861324 | aio | ok: [aio] => (item=chronyd)
2026-03-06 01:30:21.861425 | aio | ok: [aio] => (item=sshd)
2026-03-06 01:30:21.861822 | aio |
2026-03-06 01:30:21.861842 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-06 01:30:21.861850 | aio | Friday 06 March 2026  01:30:21 +0000 (0:00:00.641)       0:00:18.600 **********
2026-03-06 01:30:22.140625 | aio | ok: [aio]
2026-03-06 01:30:22.140695 | aio |
2026-03-06 01:30:22.140893 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-03-06 01:30:22.140948 | aio | Friday 06 March 2026  01:30:22 +0000 (0:00:00.279)       0:00:18.879 **********
2026-03-06 01:30:22.343816 | aio | ok: [aio]
2026-03-06 01:30:22.343892 | aio |
2026-03-06 01:30:22.344231 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-03-06 01:30:22.344280 | aio | Friday 06 March 2026  01:30:22 +0000 (0:00:00.203)       0:00:19.082 **********
2026-03-06 01:30:22.743273 | aio | ok: [aio]
2026-03-06 01:30:22.743788 | aio |
2026-03-06 01:30:22.743838 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-03-06 01:30:22.743846 | aio | Friday 06 March 2026  01:30:22 +0000 (0:00:00.399)       0:00:19.481 **********
2026-03-06 01:30:23.092569 | aio | ok: [aio]
2026-03-06 01:30:23.092813 | aio |
2026-03-06 01:30:23.092826 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-03-06 01:30:23.092836 | aio | Friday 06 March 2026  01:30:23 +0000 (0:00:00.349)       0:00:19.831 **********
2026-03-06 01:30:23.164269 | aio | ok: [aio]
2026-03-06 01:30:23.164343 | aio |
2026-03-06 01:30:23.164638 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-03-06 01:30:23.164687 | aio | Friday 06 March 2026  01:30:23 +0000 (0:00:00.071)       0:00:19.902 **********
2026-03-06 01:30:23.387044 | aio | ok: [aio] => (item=aio)
2026-03-06 01:30:23.387114 | aio |
2026-03-06 01:30:23.387185 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-03-06 01:30:23.387313 | aio | Friday 06 March 2026  01:30:23 +0000 (0:00:00.222)       0:00:20.125 **********
2026-03-06 01:30:23.423045 | aio | ok: [aio]
2026-03-06 01:30:23.423415 | aio |
2026-03-06 01:30:23.423469 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-03-06 01:30:23.423478 | aio | Friday 06 March 2026  01:30:23 +0000 (0:00:00.035)       0:00:20.161 **********
2026-03-06 01:30:23.463298 | aio | skipping: [aio]
2026-03-06 01:30:23.463355 | aio |
2026-03-06 01:30:23.463417 | aio | TASK [Install Ceph host] *******************************************************
2026-03-06 01:30:23.463540 | aio | Friday 06 March 2026  01:30:23 +0000 (0:00:00.040)       0:00:20.202 **********
2026-03-06 01:30:23.526164 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-06 01:30:23.526234 | aio |
2026-03-06 01:30:23.526463 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-06 01:30:23.526516 | aio | Friday 06 March 2026  01:30:23 +0000 (0:00:00.062)       0:00:20.264 **********
2026-03-06 01:30:30.582781 | aio | ok: [aio]
2026-03-06 01:30:30.582860 | aio |
2026-03-06 01:30:30.583018 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-06 01:30:30.583145 | aio | Friday 06 March 2026  01:30:30 +0000 (0:00:07.056)       0:00:27.321 **********
2026-03-06 01:30:30.637757 | aio | ok: [aio] => (item=aio)
2026-03-06 01:30:30.637964 | aio |
2026-03-06 01:30:30.638193 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-06 01:30:30.638408 | aio | Friday 06 March 2026  01:30:30 +0000 (0:00:00.054)       0:00:27.376 **********
2026-03-06 01:30:31.031210 | aio | ok: [aio]
2026-03-06 01:30:31.031413 | aio |
2026-03-06 01:30:31.031635 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-06 01:30:31.031835 | aio | Friday 06 March 2026  01:30:31 +0000 (0:00:00.393)       0:00:27.769 **********
2026-03-06 01:30:37.683334 | aio | ok: [aio]
2026-03-06 01:30:37.683483 | aio |
2026-03-06 01:30:37.683709 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-03-06 01:30:37.683921 | aio | Friday 06 March 2026  01:30:37 +0000 (0:00:06.651)       0:00:34.421 **********
2026-03-06 01:30:45.394676 | aio | ok: [aio]
2026-03-06 01:30:45.394755 | aio |
2026-03-06 01:30:45.394780 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-03-06 01:30:45.394826 | aio | Friday 06 March 2026  01:30:45 +0000 (0:00:07.711)       0:00:42.132 **********
2026-03-06 01:30:59.708628 | aio | ok: [aio]
2026-03-06 01:30:59.708716 | aio |
2026-03-06 01:30:59.708731 | aio | TASK [Install Ceph host] *******************************************************
2026-03-06 01:30:59.708885 | aio | Friday 06 March 2026  01:30:59 +0000 (0:00:14.314)       0:00:56.447 **********
2026-03-06 01:30:59.763510 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-06 01:30:59.763570 | aio |
2026-03-06 01:30:59.763661 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-06 01:30:59.763762 | aio | Friday 06 March 2026  01:30:59 +0000 (0:00:00.055)       0:00:56.502 **********
2026-03-06 01:30:59.804974 | aio | skipping: [aio]
2026-03-06 01:30:59.805196 | aio |
2026-03-06 01:30:59.805479 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-06 01:30:59.805494 | aio | Friday 06 March 2026  01:30:59 +0000 (0:00:00.041)       0:00:56.543 **********
2026-03-06 01:30:59.845328 | aio | skipping: [aio] => (item=aio)
2026-03-06 01:30:59.845462 | aio | skipping: [aio]
2026-03-06 01:30:59.845549 | aio |
2026-03-06 01:30:59.845791 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-06 01:30:59.845807 | aio | Friday 06 March 2026  01:30:59 +0000 (0:00:00.040)       0:00:56.584 **********
2026-03-06 01:31:00.084431 | aio | ok: [aio]
2026-03-06 01:31:00.084489 | aio |
2026-03-06 01:31:00.084590 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-06 01:31:00.084716 | aio | Friday 06 March 2026  01:31:00 +0000 (0:00:00.239)       0:00:56.823 **********
2026-03-06 01:31:06.646129 | aio | ok: [aio]
2026-03-06 01:31:06.646195 | aio |
2026-03-06 01:31:06.646280 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-03-06 01:31:06.646402 | aio | Friday 06 March 2026  01:31:06 +0000 (0:00:06.561)       0:01:03.384 **********
2026-03-06 01:31:12.832267 | aio | ok: [aio]
2026-03-06 01:31:12.832385 | aio |
2026-03-06 01:31:12.832699 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-03-06 01:31:12.832751 | aio | Friday 06 March 2026  01:31:12 +0000 (0:00:06.185)       0:01:09.570 **********
2026-03-06 01:31:18.981582 | aio | ok: [aio]
2026-03-06 01:31:18.981779 | aio |
2026-03-06 01:31:18.981790 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-03-06 01:31:18.981835 | aio | Friday 06 March 2026  01:31:18 +0000 (0:00:06.149)       0:01:15.720 **********
2026-03-06 01:31:27.183727 | aio | ok: [aio] => (item={'name': 'diskprediction_local'})
2026-03-06 01:31:27.183808 | aio | ok: [aio] => (item={'name': 'dashboard'})
2026-03-06 01:31:27.183862 | aio | ok: [aio] => (item={'name': 'prometheus'})
2026-03-06 01:31:27.184413 | aio | ok: [aio] => (item={'name': 'iostat'})
2026-03-06 01:31:27.184460 | aio |
2026-03-06 01:31:27.184467 | aio | PLAY [Deploy Ceph OSDs] ********************************************************
2026-03-06 01:31:27.184472 | aio |
2026-03-06 01:31:27.184476 | aio | TASK [Gathering Facts] *********************************************************
2026-03-06 01:31:27.184480 | aio | Friday 06 March 2026  01:31:27 +0000 (0:00:08.202)       0:01:23.922 **********
2026-03-06 01:31:28.120708 | aio | ok: [aio]
2026-03-06 01:31:28.120769 | aio |
2026-03-06 01:31:28.120860 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-06 01:31:28.120998 | aio | Friday 06 March 2026  01:31:28 +0000 (0:00:00.936)       0:01:24.859 **********
2026-03-06 01:31:28.317787 | aio | ok: [aio]
2026-03-06 01:31:28.317852 | aio |
2026-03-06 01:31:28.318040 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-06 01:31:28.318057 | aio | Friday 06 March 2026  01:31:28 +0000 (0:00:00.197)       0:01:25.056 **********
2026-03-06 01:31:28.351436 | aio | skipping: [aio]
2026-03-06 01:31:28.351518 | aio |
2026-03-06 01:31:28.351738 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-06 01:31:28.351754 | aio | Friday 06 March 2026  01:31:28 +0000 (0:00:00.033)       0:01:25.089 **********
2026-03-06 01:31:28.557542 | aio | ok: [aio]
2026-03-06 01:31:28.558023 | aio |
2026-03-06 01:31:28.558261 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-06 01:31:28.558271 | aio | Friday 06 March 2026  01:31:28 +0000 (0:00:00.206)       0:01:25.296 **********
2026-03-06 01:31:28.634929 | aio | ok: [aio] => {
2026-03-06 01:31:28.635008 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-06 01:31:28.635585 | aio | }
2026-03-06 01:31:28.635635 | aio |
2026-03-06 01:31:28.635644 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-06 01:31:28.635652 | aio | Friday 06 March 2026  01:31:28 +0000 (0:00:00.077)       0:01:25.373 **********
2026-03-06 01:31:28.962357 | aio | ok: [aio]
2026-03-06 01:31:28.962573 | aio |
2026-03-06 01:31:28.962836 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-06 01:31:28.962848 | aio | Friday 06 March 2026  01:31:28 +0000 (0:00:00.327)       0:01:25.700 **********
2026-03-06 01:31:28.999758 | aio | skipping: [aio]
2026-03-06 01:31:28.999807 | aio |
2026-03-06 01:31:29.000025 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-06 01:31:29.000067 | aio | Friday 06 March 2026  01:31:28 +0000 (0:00:00.037)       0:01:25.738 **********
2026-03-06 01:31:29.039989 | aio | skipping: [aio]
2026-03-06 01:31:29.040060 | aio |
2026-03-06 01:31:29.040257 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-06 01:31:29.040294 | aio | Friday 06 March 2026  01:31:29 +0000 (0:00:00.040)       0:01:25.778 **********
2026-03-06 01:31:29.243695 | aio | ok: [aio]
2026-03-06 01:31:29.243742 | aio |
2026-03-06 01:31:29.243748 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-06 01:31:29.243753 | aio | Friday 06 March 2026  01:31:29 +0000 (0:00:00.203)       0:01:25.982 **********
2026-03-06 01:31:30.214392 | aio | ok: [aio]
2026-03-06 01:31:30.214468 | aio |
2026-03-06 01:31:30.214637 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-06 01:31:30.214727 | aio | Friday 06 March 2026  01:31:30 +0000 (0:00:00.971)       0:01:26.953 **********
2026-03-06 01:31:30.288681 | aio | ok: [aio] => {
2026-03-06 01:31:30.289321 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-06 01:31:30.289355 | aio | }
2026-03-06 01:31:30.289362 | aio |
2026-03-06 01:31:30.289369 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-06 01:31:30.289375 | aio | Friday 06 March 2026  01:31:30 +0000 (0:00:00.073)       0:01:27.027 **********
2026-03-06 01:31:30.644446 | aio | ok: [aio]
2026-03-06 01:31:30.644556 | aio |
2026-03-06 01:31:30.644866 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-06 01:31:30.644916 | aio | Friday 06 March 2026  01:31:30 +0000 (0:00:00.355)       0:01:27.383 **********
2026-03-06 01:31:32.576988 | aio | ok: [aio]
2026-03-06 01:31:32.577059 | aio |
2026-03-06 01:31:32.577129 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-06 01:31:32.577254 | aio | Friday 06 March 2026  01:31:32 +0000 (0:00:01.932)       0:01:29.315 **********
2026-03-06 01:31:32.605658 | aio | skipping: [aio]
2026-03-06 01:31:32.606026 | aio |
2026-03-06 01:31:32.606055 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-06 01:31:32.606063 | aio | Friday 06 March 2026  01:31:32 +0000 (0:00:00.028)       0:01:29.344 **********
2026-03-06 01:31:32.631329 | aio | skipping: [aio]
2026-03-06 01:31:32.631763 | aio |
2026-03-06 01:31:32.631791 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-06 01:31:32.631800 | aio | Friday 06 March 2026  01:31:32 +0000 (0:00:00.025)       0:01:29.369 **********
2026-03-06 01:31:32.656033 | aio | skipping: [aio]
2026-03-06 01:31:32.656089 | aio |
2026-03-06 01:31:32.656188 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-06 01:31:32.656328 | aio | Friday 06 March 2026  01:31:32 +0000 (0:00:00.024)       0:01:29.394 **********
2026-03-06 01:31:33.674823 | aio | ok: [aio]
2026-03-06 01:31:33.674895 | aio |
2026-03-06 01:31:33.675214 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-06 01:31:33.675269 | aio | Friday 06 March 2026  01:31:33 +0000 (0:00:01.018)       0:01:30.413 **********
2026-03-06 01:31:34.121833 | aio | ok: [aio]
2026-03-06 01:31:34.121942 | aio |
2026-03-06 01:31:34.122264 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-06 01:31:34.122311 | aio | Friday 06 March 2026  01:31:34 +0000 (0:00:00.446)       0:01:30.860 **********
2026-03-06 01:31:35.016250 | aio | ok: [aio] => (item={'path': '/etc/containerd'})
2026-03-06 01:31:35.016333 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-06 01:31:35.017001 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-06 01:31:35.017042 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-06 01:31:35.017048 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-06 01:31:35.017054 | aio |
2026-03-06 01:31:35.017059 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-06 01:31:35.017063 | aio | Friday 06 March 2026  01:31:35 +0000 (0:00:00.894)       0:01:31.754 **********
2026-03-06 01:31:35.513662 | aio | ok: [aio]
2026-03-06 01:31:35.513769 | aio |
2026-03-06 01:31:35.513783 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-06 01:31:35.514206 | aio | Friday 06 March 2026  01:31:35 +0000 (0:00:00.491)       0:01:32.246 **********
2026-03-06 01:31:35.514283 | aio |
2026-03-06 01:31:35.514296 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-06 01:31:35.514301 | aio | Friday 06 March 2026  01:31:35 +0000 (0:00:00.005)       0:01:32.252 **********
2026-03-06 01:31:35.882908 | aio | ok: [aio]
2026-03-06 01:31:35.883018 | aio |
2026-03-06 01:31:35.883033 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-06 01:31:35.883209 | aio | Friday 06 March 2026  01:31:35 +0000 (0:00:00.369)       0:01:32.621 **********
2026-03-06 01:31:36.083865 | aio | ok: [aio]
2026-03-06 01:31:36.083954 | aio |
2026-03-06 01:31:36.083963 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-06 01:31:36.083968 | aio | Friday 06 March 2026  01:31:36 +0000 (0:00:00.200)       0:01:32.821 **********
2026-03-06 01:31:36.154286 | aio | ok: [aio] => {
2026-03-06 01:31:36.154392 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-06 01:31:36.154404 | aio | }
2026-03-06 01:31:36.154689 | aio |
2026-03-06 01:31:36.154758 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-06 01:31:36.154778 | aio | Friday 06 March 2026  01:31:36 +0000 (0:00:00.070)       0:01:32.892 **********
2026-03-06 01:31:36.496738 | aio | ok: [aio]
2026-03-06 01:31:36.496800 | aio |
2026-03-06 01:31:36.496910 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-06 01:31:36.497049 | aio | Friday 06 March 2026  01:31:36 +0000 (0:00:00.343)       0:01:33.235 **********
2026-03-06 01:31:39.547216 | aio | ok: [aio]
2026-03-06 01:31:39.547296 | aio |
2026-03-06 01:31:39.547361 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-06 01:31:39.547484 | aio | Friday 06 March 2026  01:31:39 +0000 (0:00:03.050)       0:01:36.286 **********
2026-03-06 01:31:40.522612 | aio | ok: [aio]
2026-03-06 01:31:40.522714 | aio |
2026-03-06 01:31:40.523036 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-06 01:31:40.523247 | aio | Friday 06 March 2026  01:31:40 +0000 (0:00:00.975)       0:01:37.261 **********
2026-03-06 01:31:40.710070 | aio | ok: [aio]
2026-03-06 01:31:40.710136 | aio |
2026-03-06 01:31:40.710445 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-06 01:31:40.710625 | aio | Friday 06 March 2026  01:31:40 +0000 (0:00:00.187)       0:01:37.448 **********
2026-03-06 01:31:41.135299 | aio | ok: [aio]
2026-03-06 01:31:41.135373 | aio |
2026-03-06 01:31:41.135440 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-06 01:31:41.135588 | aio | Friday 06 March 2026  01:31:41 +0000 (0:00:00.424)       0:01:37.873 **********
2026-03-06 01:31:41.739973 | aio | ok: [aio] => (item={'path': '/etc/docker'})
2026-03-06 01:31:41.740118 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-06 01:31:41.740132 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-06 01:31:41.740198 | aio |
2026-03-06 01:31:41.740429 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-06 01:31:41.740481 | aio | Friday 06 March 2026  01:31:41 +0000 (0:00:00.605)       0:01:38.478 **********
2026-03-06 01:31:42.150580 | aio | ok: [aio]
2026-03-06 01:31:42.150623 | aio |
2026-03-06 01:31:42.150632 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-06 01:31:42.150638 | aio | Friday 06 March 2026  01:31:42 +0000 (0:00:00.409)       0:01:38.888 **********
2026-03-06 01:31:42.595415 | aio | ok: [aio]
2026-03-06 01:31:42.595487 | aio |
2026-03-06 01:31:42.595563 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-06 01:31:42.595965 | aio | Friday 06 March 2026  01:31:42 +0000 (0:00:00.437)       0:01:39.326 **********
2026-03-06 01:31:42.596007 | aio |
2026-03-06 01:31:42.596013 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-06 01:31:42.596018 | aio | Friday 06 March 2026  01:31:42 +0000 (0:00:00.007)       0:01:39.334 **********
2026-03-06 01:31:42.941997 | aio | ok: [aio]
2026-03-06 01:31:42.942067 | aio |
2026-03-06 01:31:42.942196 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-06 01:31:42.942317 | aio | Friday 06 March 2026  01:31:42 +0000 (0:00:00.346)       0:01:39.680 **********
2026-03-06 01:31:42.987727 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-03-06 01:31:42.987779 | aio |
2026-03-06 01:31:42.987879 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-06 01:31:42.987974 | aio | Friday 06 March 2026  01:31:42 +0000 (0:00:00.045)       0:01:39.726 **********
2026-03-06 01:31:43.938851 | aio | ok: [aio]
2026-03-06 01:31:43.938928 | aio |
2026-03-06 01:31:43.939103 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-06 01:31:43.939247 | aio | Friday 06 March 2026  01:31:43 +0000 (0:00:00.950)       0:01:40.677 **********
2026-03-06 01:31:44.570853 | aio | ok: [aio] => (item=chronyd)
2026-03-06 01:31:44.571056 | aio | ok: [aio] => (item=sshd)
2026-03-06 01:31:44.571267 | aio |
2026-03-06 01:31:44.571498 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-06 01:31:44.571720 | aio | Friday 06 March 2026  01:31:44 +0000 (0:00:00.631)       0:01:41.309 **********
2026-03-06 01:31:44.850600 | aio | ok: [aio]
2026-03-06 01:31:44.850682 | aio |
2026-03-06 01:31:44.850759 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-03-06 01:31:44.850883 | aio | Friday 06 March 2026  01:31:44 +0000 (0:00:00.280)       0:01:41.589 **********
2026-03-06 01:31:45.042949 | aio | ok: [aio]
2026-03-06 01:31:45.043079 | aio |
2026-03-06 01:31:45.043250 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-03-06 01:31:45.043411 | aio | Friday 06 March 2026  01:31:45 +0000 (0:00:00.192)       0:01:41.781 **********
2026-03-06 01:31:45.270755 | aio | ok: [aio]
2026-03-06 01:31:45.270935 | aio |
2026-03-06 01:31:45.271219 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-03-06 01:31:45.271458 | aio | Friday 06 March 2026  01:31:45 +0000 (0:00:00.227)       0:01:42.009 **********
2026-03-06 01:31:45.471281 | aio | ok: [aio]
2026-03-06 01:31:45.471354 | aio |
2026-03-06 01:31:45.471439 | aio | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-03-06 01:31:45.471549 | aio | Friday 06 March 2026  01:31:45 +0000 (0:00:00.200)       0:01:42.209 **********
2026-03-06 01:31:45.685257 | aio | ok: [aio] => (item=aio)
2026-03-06 01:31:45.685317 | aio |
2026-03-06 01:31:45.685324 | aio | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-03-06 01:31:45.685329 | aio | Friday 06 March 2026  01:31:45 +0000 (0:00:00.213)       0:01:42.423 **********
2026-03-06 01:31:45.726693 | aio | ok: [aio]
2026-03-06 01:31:45.726758 | aio |
2026-03-06 01:31:45.726991 | aio | TASK [Install Ceph host] *******************************************************
2026-03-06 01:31:45.727032 | aio | Friday 06 March 2026  01:31:45 +0000 (0:00:00.042)       0:01:42.465 **********
2026-03-06 01:31:45.786269 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-06 01:31:45.786307 | aio |
2026-03-06 01:31:45.786434 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-06 01:31:45.786575 | aio | Friday 06 March 2026  01:31:45 +0000 (0:00:00.059)       0:01:42.524 **********
2026-03-06 01:31:45.824843 | aio | skipping: [aio]
2026-03-06 01:31:45.825263 | aio |
2026-03-06 01:31:45.825314 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-06 01:31:45.825322 | aio | Friday 06 March 2026  01:31:45 +0000 (0:00:00.038)       0:01:42.563 **********
2026-03-06 01:31:45.864422 | aio | skipping: [aio] => (item=aio)
2026-03-06 01:31:45.864984 | aio | skipping: [aio]
2026-03-06 01:31:45.865029 | aio |
2026-03-06 01:31:45.865038 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-06 01:31:45.865045 | aio | Friday 06 March 2026  01:31:45 +0000 (0:00:00.039)       0:01:42.602 **********
2026-03-06 01:31:46.114909 | aio | ok: [aio]
2026-03-06 01:31:46.114970 | aio |
2026-03-06 01:31:46.115071 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-06 01:31:46.115202 | aio | Friday 06 March 2026  01:31:46 +0000 (0:00:00.250)       0:01:42.853 **********
2026-03-06 01:31:52.657821 | aio | ok: [aio]
2026-03-06 01:31:52.657892 | aio |
2026-03-06 01:31:52.657974 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-03-06 01:31:52.658072 | aio | Friday 06 March 2026  01:31:52 +0000 (0:00:06.542)       0:01:49.396 **********
2026-03-06 01:31:58.072098 | aio | ok: [aio]
2026-03-06 01:31:58.072173 | aio |
2026-03-06 01:31:58.072235 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-03-06 01:31:58.072361 | aio | Friday 06 March 2026  01:31:58 +0000 (0:00:05.414)       0:01:54.810 **********
2026-03-06 01:32:12.502397 | aio | ok: [aio]
2026-03-06 01:32:12.502471 | aio |
2026-03-06 01:32:12.502824 | aio | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-03-06 01:32:12.502846 | aio | Friday 06 March 2026  01:32:12 +0000 (0:00:14.430)       0:02:09.241 **********
2026-03-06 01:32:12.568705 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd0/data)
2026-03-06 01:32:12.568786 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd1/data)
2026-03-06 01:32:12.569432 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd2/data)
2026-03-06 01:32:12.569451 | aio | skipping: [aio]
2026-03-06 01:32:12.569459 | aio |
2026-03-06 01:32:12.569465 | aio | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-03-06 01:32:12.569472 | aio | Friday 06 March 2026  01:32:12 +0000 (0:00:00.066)       0:02:09.307 **********
2026-03-06 01:32:18.826326 | aio | ok: [aio]
2026-03-06 01:32:18.826397 | aio |
2026-03-06 01:32:18.826624 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-03-06 01:32:18.826696 | aio | Friday 06 March 2026  01:32:18 +0000 (0:00:06.257)       0:02:15.564 **********
2026-03-06 01:32:25.030078 | aio | ok: [aio]
2026-03-06 01:32:25.030156 | aio |
2026-03-06 01:32:25.030455 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-03-06 01:32:25.030525 | aio | Friday 06 March 2026  01:32:25 +0000 (0:00:06.203)       0:02:21.768 **********
2026-03-06 01:32:25.083053 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio
2026-03-06 01:32:25.083136 | aio |
2026-03-06 01:32:25.083355 | aio | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-03-06 01:32:25.083408 | aio | Friday 06 March 2026  01:32:25 +0000 (0:00:00.052)       0:02:21.821 **********
2026-03-06 01:32:25.121457 | aio | ok: [aio]
2026-03-06 01:32:25.121531 | aio |
2026-03-06 01:32:25.121789 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-03-06 01:32:25.121831 | aio | Friday 06 March 2026  01:32:25 +0000 (0:00:00.038)       0:02:21.860 **********
2026-03-06 01:32:31.345402 | aio | ok: [aio]
2026-03-06 01:32:31.345483 | aio |
2026-03-06 01:32:31.345815 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-03-06 01:32:31.345863 | aio | Friday 06 March 2026  01:32:31 +0000 (0:00:06.223)       0:02:28.083 **********
2026-03-06 01:32:31.384733 | aio | ok: [aio]
2026-03-06 01:32:31.384802 | aio |
2026-03-06 01:32:31.385115 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-03-06 01:32:31.385158 | aio | Friday 06 March 2026  01:32:31 +0000 (0:00:00.039)       0:02:28.123 **********
2026-03-06 01:32:31.416875 | aio | skipping: [aio] => (item=1)
2026-03-06 01:32:31.416989 | aio | skipping: [aio] => (item=1)
2026-03-06 01:32:31.417668 | aio | skipping: [aio] => (item=1)
2026-03-06 01:32:31.417718 | aio | skipping: [aio]
2026-03-06 01:32:31.417727 | aio |
2026-03-06 01:32:31.417734 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-03-06 01:32:31.417741 | aio | Friday 06 March 2026  01:32:31 +0000 (0:00:00.032)       0:02:28.155 **********
2026-03-06 01:32:31.442905 | aio | skipping: [aio]
2026-03-06 01:32:31.442956 | aio |
2026-03-06 01:32:31.443066 | aio | PLAY RECAP *********************************************************************
2026-03-06 01:32:31.445346 | aio | aio                        : ok=95   changed=0    unreachable=0    failed=0    skipped=20   rescued=0    ignored=0
2026-03-06 01:32:31.445393 | aio |
2026-03-06 01:32:31.445399 | aio |
2026-03-06 01:32:31.445403 | aio | TASKS RECAP ********************************************************************
2026-03-06 01:32:31.445408 | aio | Friday 06 March 2026  01:32:31 +0000 (0:00:00.026)       0:02:28.181 **********
2026-03-06 01:32:31.445413 | aio | ===============================================================================
2026-03-06 01:32:31.445417 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.43s
2026-03-06 01:32:31.445420 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.31s
2026-03-06 01:32:31.445424 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.20s
2026-03-06 01:32:31.445428 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 7.71s
2026-03-06 01:32:31.445432 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 7.06s
2026-03-06 01:32:31.445436 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.65s
2026-03-06 01:32:31.445440 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.56s
2026-03-06 01:32:31.445444 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.54s
2026-03-06 01:32:31.445448 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.26s
2026-03-06 01:32:31.445452 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.22s
2026-03-06 01:32:31.445456 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.20s
2026-03-06 01:32:31.445460 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.19s
2026-03-06 01:32:31.445463 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.15s
2026-03-06 01:32:31.445467 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.41s
2026-03-06 01:32:31.445471 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.07s
2026-03-06 01:32:31.445475 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.05s
2026-03-06 01:32:31.445479 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.22s
2026-03-06 01:32:31.445483 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 1.93s
2026-03-06 01:32:31.445486 | aio | Gathering Facts --------------------------------------------------------- 1.17s
2026-03-06 01:32:31.445490 | aio | vexxhost.containers.package : Update state for tar ---------------------- 1.09s
2026-03-06 01:32:31.534060 | aio | INFO     [default > idempotence] Executed: Successful
2026-03-06 01:32:31.544868 | aio | INFO     [default > side_effect] Executing
2026-03-06 01:32:31.545356 | aio | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-06 01:32:31.552954 | aio | INFO     [default > verify] Executing
2026-03-06 01:32:32.163132 | aio |
2026-03-06 01:32:32.163194 | aio | PLAY [Verify] ******************************************************************
2026-03-06 01:32:32.163206 | aio |
2026-03-06 01:32:32.163215 | aio | TASK [Gathering Facts] *********************************************************
2026-03-06 01:32:32.163224 | aio | Friday 06 March 2026  01:32:32 +0000 (0:00:00.006)       0:00:00.006 **********
2026-03-06 01:32:33.271581 | aio | [WARNING]: Platform linux on host aio is using the discovered Python
2026-03-06 01:32:33.271648 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-06 01:32:33.271662 | aio | interpreter could change the meaning of that path. See
2026-03-06 01:32:33.271672 | aio | https://docs.ansible.com/ansible-
2026-03-06 01:32:33.271683 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-06 01:32:33.280789 | aio | ok: [aio]
2026-03-06 01:32:33.280821 | aio |
2026-03-06 01:32:33.280832 | aio | TASK [Get cluster health status] ***********************************************
2026-03-06 01:32:33.280841 | aio | Friday 06 March 2026  01:32:33 +0000 (0:00:01.117)       0:00:01.124 **********
2026-03-06 01:32:43.559043 | aio | ok: [aio]
2026-03-06 01:32:43.559098 | aio |
2026-03-06 01:32:43.559106 | aio | TASK [Print cluster health status] *********************************************
2026-03-06 01:32:43.559113 | aio | Friday 06 March 2026  01:32:43 +0000 (0:00:10.278)       0:00:11.403 **********
2026-03-06 01:32:43.592119 | aio | ok: [aio] => {
2026-03-06 01:32:43.592158 | aio |     "_ceph_health": {
2026-03-06 01:32:43.592164 | aio |         "changed": false,
2026-03-06 01:32:43.592168 | aio |         "cmd": [
2026-03-06 01:32:43.592172 | aio |             "cephadm",
2026-03-06 01:32:43.592176 | aio |             "shell",
2026-03-06 01:32:43.592180 | aio |             "--",
2026-03-06 01:32:43.592184 | aio |             "ceph",
2026-03-06 01:32:43.592193 | aio |             "health"
2026-03-06 01:32:43.592357 | aio |         ],
2026-03-06 01:32:43.592557 | aio |         "delta": "0:00:10.007433",
2026-03-06 01:32:43.592753 | aio |         "end": "2026-03-06 01:32:43.521492",
2026-03-06 01:32:43.592946 | aio |         "failed": false,
2026-03-06 01:32:43.593137 | aio |         "msg": "",
2026-03-06 01:32:43.593437 | aio |         "rc": 0,
2026-03-06 01:32:43.593670 | aio |         "start": "2026-03-06 01:32:33.514059",
2026-03-06 01:32:43.593923 | aio |         "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config",
2026-03-06 01:32:43.594123 | aio |         "stderr_lines": [
2026-03-06 01:32:43.594323 | aio |             "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2",
2026-03-06 01:32:43.594562 | aio |             "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config"
2026-03-06 01:32:43.594764 | aio |         ],
2026-03-06 01:32:43.594959 | aio |         "stdout": "HEALTH_OK",
2026-03-06 01:32:43.595143 | aio |         "stdout_lines": [
2026-03-06 01:32:43.595332 | aio |             "HEALTH_OK"
2026-03-06 01:32:43.595514 | aio |         ]
2026-03-06 01:32:43.595699 | aio |     }
2026-03-06 01:32:43.595886 | aio | }
2026-03-06 01:32:43.596086 | aio |
2026-03-06 01:32:43.596285 | aio | TASK [Assert that the cluster status is healthy] *******************************
2026-03-06 01:32:43.596485 | aio | Friday 06 March 2026  01:32:43 +0000 (0:00:00.032)       0:00:11.435 **********
2026-03-06 01:32:43.611182 | aio | ok: [aio] => {
2026-03-06 01:32:43.611526 | aio |     "changed": false,
2026-03-06 01:32:43.611818 | aio |     "msg": "All assertions passed"
2026-03-06 01:32:43.612162 | aio | }
2026-03-06 01:32:43.612472 | aio |
2026-03-06 01:32:43.612815 | aio | TASK [Create a test Ceph pool] *************************************************
2026-03-06 01:32:43.613075 | aio | Friday 06 March 2026  01:32:43 +0000 (0:00:00.020)       0:00:11.455 **********
2026-03-06 01:32:50.791758 | aio | changed: [aio]
2026-03-06 01:32:50.791915 | aio |
2026-03-06 01:32:50.792068 | aio | TASK [Create a test Ceph key] **************************************************
2026-03-06 01:32:50.792202 | aio | Friday 06 March 2026  01:32:50 +0000 (0:00:07.180)       0:00:18.636 **********
2026-03-06 01:32:53.099204 | aio | changed: [aio]
2026-03-06 01:32:53.099271 | aio |
2026-03-06 01:32:53.099285 | aio | TASK [Retrieve info for the test Ceph key] *************************************
2026-03-06 01:32:53.099296 | aio | Friday 06 March 2026  01:32:53 +0000 (0:00:02.306)       0:00:20.942 **********
2026-03-06 01:32:54.281777 | aio | ok: [aio]
2026-03-06 01:32:54.281853 | aio |
2026-03-06 01:32:54.282189 | aio | TASK [Assert that key_info returns the correct key] ****************************
2026-03-06 01:32:54.282241 | aio | Friday 06 March 2026  01:32:54 +0000 (0:00:01.183)       0:00:22.126 **********
2026-03-06 01:32:54.311313 | aio | ok: [aio] => {
2026-03-06 01:32:54.311399 | aio |     "changed": false,
2026-03-06 01:32:54.311762 | aio |     "msg": "All assertions passed"
2026-03-06 01:32:54.311785 | aio | }
2026-03-06 01:32:54.311795 | aio |
2026-03-06 01:32:54.311805 | aio | PLAY RECAP *********************************************************************
2026-03-06 01:32:54.313134 | aio | aio                        : ok=8    changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-03-06 01:32:54.313182 | aio |
2026-03-06 01:32:54.313188 | aio |
2026-03-06 01:32:54.313193 | aio | TASKS RECAP ********************************************************************
2026-03-06 01:32:54.313197 | aio | Friday 06 March 2026  01:32:54 +0000 (0:00:00.030)       0:00:22.156 **********
2026-03-06 01:32:54.313202 | aio | ===============================================================================
2026-03-06 01:32:54.313206 | aio | Get cluster health status ---------------------------------------------- 10.28s
2026-03-06 01:32:54.313210 | aio | Create a test Ceph pool ------------------------------------------------- 7.18s
2026-03-06 01:32:54.313214 | aio | Create a test Ceph key -------------------------------------------------- 2.31s
2026-03-06 01:32:54.313217 | aio | Retrieve info for the test Ceph key ------------------------------------- 1.18s
2026-03-06 01:32:54.313221 | aio | Gathering Facts --------------------------------------------------------- 1.12s
2026-03-06 01:32:54.313225 | aio | Print cluster health status --------------------------------------------- 0.03s
2026-03-06 01:32:54.313229 | aio | Assert that key_info returns the correct key ---------------------------- 0.03s
2026-03-06 01:32:54.313233 | aio | Assert that the cluster status is healthy ------------------------------- 0.02s
2026-03-06 01:32:54.374600 | aio | INFO     [default > verify] Executed: Successful
2026-03-06 01:32:54.382488 | aio | INFO     [default > cleanup] Executing
2026-03-06 01:32:54.382779 | aio | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-06 01:32:54.387665 | aio | INFO     [default > destroy] Executing
2026-03-06 01:32:54.387737 | aio | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-03-06 01:32:54.387797 | aio | INFO     [default > destroy] Executed: Successful
2026-03-06 01:32:54.388047 | aio | WARNING  Molecule executed 1 scenario (1 missing files)
2026-03-06 01:32:54.677078 | aio | ok: Runtime: 0:13:16.496686
2026-03-06 01:32:54.692633 | 
2026-03-06 01:32:54.692683 | PLAY RECAP
2026-03-06 01:32:54.692723 | aio | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-06 01:32:54.692746 | 
2026-03-06 01:32:54.780417 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-06 01:32:54.783730 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-06 01:32:55.320525 | 
2026-03-06 01:32:55.320978 | PLAY [all]
2026-03-06 01:32:55.331828 | 
2026-03-06 01:32:55.331902 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-06 01:32:55.376184 | aio | skipping: Conditional result was False
2026-03-06 01:32:55.386523 | 
2026-03-06 01:32:55.386627 | TASK [fetch-output : Set log path for single node]
2026-03-06 01:32:55.431324 | aio | ok
2026-03-06 01:32:55.436036 | 
2026-03-06 01:32:55.436101 | LOOP [fetch-output : Ensure local output dirs]
2026-03-06 01:32:55.797994 | aio -> localhost | ok: "/var/lib/zuul/builds/902f03b19e7442c9961cb57bf8e937ef/work/logs"
2026-03-06 01:32:55.993966 | aio -> localhost | changed: "/var/lib/zuul/builds/902f03b19e7442c9961cb57bf8e937ef/work/artifacts"
2026-03-06 01:32:56.193014 | aio -> localhost | changed: "/var/lib/zuul/builds/902f03b19e7442c9961cb57bf8e937ef/work/docs"
2026-03-06 01:32:56.206761 | 
2026-03-06 01:32:56.206926 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-06 01:32:56.810384 | aio | ok
2026-03-06 01:32:56.810664 | aio | changed: All items complete
2026-03-06 01:32:56.810701 | 
2026-03-06 01:32:57.261492 | aio | changed: .d..t...... ./
2026-03-06 01:32:57.715323 | aio | changed: .d..t...... ./
2026-03-06 01:32:57.733178 | 
2026-03-06 01:32:57.733310 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-06 01:32:58.126177 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.006746
2026-03-06 01:32:58.334208 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.006972
2026-03-06 01:32:58.350158 | 
2026-03-06 01:32:58.350220 | PLAY [all]
2026-03-06 01:32:58.355775 | 
2026-03-06 01:32:58.355835 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-06 01:32:58.745492 | aio | changed
2026-03-06 01:32:58.750754 | 
2026-03-06 01:32:58.750821 | PLAY RECAP
2026-03-06 01:32:58.750865 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-06 01:32:58.750887 | 
2026-03-06 01:32:58.851327 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-06 01:32:58.853743 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-03-06 01:32:59.372005 | 
2026-03-06 01:32:59.372110 | PLAY [localhost]
2026-03-06 01:32:59.381345 | 
2026-03-06 01:32:59.381428 | TASK [Generate Zuul manifest]
2026-03-06 01:32:59.400756 | localhost | ok
2026-03-06 01:32:59.416755 | 
2026-03-06 01:32:59.416832 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-06 01:32:59.722501 | localhost | changed
2026-03-06 01:32:59.734528 | 
2026-03-06 01:32:59.734605 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-06 01:32:59.765207 | localhost | ok
2026-03-06 01:32:59.773281 | 
2026-03-06 01:32:59.773343 | TASK [Upload logs]
2026-03-06 01:32:59.793239 | localhost | ok
2026-03-06 01:32:59.850778 | 
2026-03-06 01:32:59.850892 | TASK [Set zuul-log-path fact]
2026-03-06 01:32:59.867816 | localhost | ok
2026-03-06 01:32:59.877892 | 
2026-03-06 01:32:59.877961 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-06 01:32:59.905178 | localhost | ok
2026-03-06 01:32:59.911409 | 
2026-03-06 01:32:59.911474 | TASK [upload-logs : Create log directories]
2026-03-06 01:33:00.285258 | localhost | changed
2026-03-06 01:33:00.291792 | 
2026-03-06 01:33:00.291891 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-06 01:33:00.669577 | localhost -> localhost | ok: Runtime: 0:00:00.004883
2026-03-06 01:33:00.675248 | 
2026-03-06 01:33:00.675322 | TASK [upload-logs : Upload logs to log server]
2026-03-06 01:33:01.112211 | localhost | Output suppressed because no_log was given
2026-03-06 01:33:01.117200 | 
2026-03-06 01:33:01.117296 | LOOP [upload-logs : Compress console log and json output]
2026-03-06 01:33:01.162235 | localhost | skipping: Conditional result was False
2026-03-06 01:33:01.169994 | localhost | skipping: Conditional result was False
2026-03-06 01:33:01.180089 | 
2026-03-06 01:33:01.180219 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-06 01:33:01.221547 | localhost | skipping: Conditional result was False
2026-03-06 01:33:01.221886 | 
2026-03-06 01:33:01.225812 | localhost | skipping: Conditional result was False
2026-03-06 01:33:01.244463 | 
2026-03-06 01:33:01.244559 | LOOP [upload-logs : Upload console log and json output]