2026-03-18 13:45:47.745801 | Job console starting
2026-03-18 13:45:47.752338 | Updating git repos
2026-03-18 13:45:47.800994 | Cloning repos into workspace
2026-03-18 13:45:47.937943 | Restoring repo states
2026-03-18 13:45:47.965625 | Merging changes
2026-03-18 13:45:49.146041 | Checking out repos
2026-03-18 13:45:49.241734 | Preparing playbooks
2026-03-18 13:45:51.532806 | Running Ansible setup
2026-03-18 13:45:54.755894 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-18 13:45:55.379193 | 
2026-03-18 13:45:55.379328 | PLAY [localhost]
2026-03-18 13:45:55.387203 | 
2026-03-18 13:45:55.387272 | TASK [Gathering Facts]
2026-03-18 13:45:56.279413 | localhost | ok
2026-03-18 13:45:56.288280 | 
2026-03-18 13:45:56.288357 | TASK [Setup log path fact]
2026-03-18 13:45:56.308892 | localhost | ok
2026-03-18 13:45:56.320856 | 
2026-03-18 13:45:56.320931 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-18 13:45:56.352316 | localhost | ok
2026-03-18 13:45:56.360434 | 
2026-03-18 13:45:56.360522 | TASK [emit-job-header : Print job information]
2026-03-18 13:45:56.403012 | # Job Information
2026-03-18 13:45:56.403224 | Ansible Version: 2.16.16
2026-03-18 13:45:56.403269 | Job: atmosphere-molecule-csi-rbd
2026-03-18 13:45:56.403300 | Pipeline: check
2026-03-18 13:45:56.403328 | Executor: 0a8996d2b663
2026-03-18 13:45:56.403355 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3764
2026-03-18 13:45:56.403394 | Event ID: abb788b0-22d0-11f1-880b-86301642873a
2026-03-18 13:45:56.406937 | 
2026-03-18 13:45:56.407004 | LOOP [emit-job-header : Print node information]
2026-03-18 13:45:56.497014 | localhost | ok:
2026-03-18 13:45:56.497645 | localhost | # Node Information
2026-03-18 13:45:56.497688 | localhost | Inventory Hostname: instance
2026-03-18 13:45:56.497718 | localhost | Hostname: np0000159858
2026-03-18 13:45:56.497746 | localhost | Username: zuul
2026-03-18 13:45:56.497776 | localhost | Distro: Ubuntu 22.04
2026-03-18 13:45:56.497803 | localhost | Provider: yul1
2026-03-18 13:45:56.497830 | localhost | Region: ca-ymq-1
2026-03-18 13:45:56.497856 | localhost | Label: ubuntu-jammy
2026-03-18 13:45:56.497882 | localhost | Product Name: OpenStack Nova
2026-03-18 13:45:56.497907 | localhost | Interface IP: 199.204.45.140
2026-03-18 13:45:56.512285 | 
2026-03-18 13:45:56.512461 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-18 13:45:56.887968 | localhost -> localhost | changed
2026-03-18 13:45:56.895001 | 
2026-03-18 13:45:56.895093 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-18 13:45:57.948823 | localhost -> localhost | changed
2026-03-18 13:45:57.957052 | 
2026-03-18 13:45:57.957108 | PLAY [all]
2026-03-18 13:45:57.967392 | 
2026-03-18 13:45:57.967459 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-18 13:45:58.194822 | instance -> localhost | ok
2026-03-18 13:45:58.205547 | 
2026-03-18 13:45:58.205637 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-18 13:45:58.237676 | instance | ok
2026-03-18 13:45:58.253164 | instance | included: /var/lib/zuul/builds/8950785fa893431dac847e06970941c1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-18 13:45:58.258677 | 
2026-03-18 13:45:58.258736 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-18 13:45:59.500538 | instance -> localhost | Generating public/private rsa key pair.
2026-03-18 13:45:59.500751 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/8950785fa893431dac847e06970941c1/work/8950785fa893431dac847e06970941c1_id_rsa
2026-03-18 13:45:59.500781 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/8950785fa893431dac847e06970941c1/work/8950785fa893431dac847e06970941c1_id_rsa.pub
2026-03-18 13:45:59.500804 | instance -> localhost | The key fingerprint is:
2026-03-18 13:45:59.500826 | instance -> localhost | SHA256:toWLUFwxVE+nE703VcOjPeLGPsvtIYN22plagtJGruE zuul-build-sshkey
2026-03-18 13:45:59.500868 | instance -> localhost | The key's randomart image is:
2026-03-18 13:45:59.500890 | instance -> localhost | +---[RSA 3072]----+
2026-03-18 13:45:59.500918 | instance -> localhost | |       .=o. o.o.o|
2026-03-18 13:45:59.500940 | instance -> localhost | |     . . . o +.oo|
2026-03-18 13:45:59.500961 | instance -> localhost | |      o     + o.o|
2026-03-18 13:45:59.500986 | instance -> localhost | |     .   .   +.+.|
2026-03-18 13:45:59.501683 | instance -> localhost | |    .   S.. o ..o|
2026-03-18 13:45:59.501707 | instance -> localhost | |     . o++. .+   |
2026-03-18 13:45:59.501728 | instance -> localhost | |      .oo= +o= . |
2026-03-18 13:45:59.501748 | instance -> localhost | |      . = . Bo* .|
2026-03-18 13:45:59.501771 | instance -> localhost | |       E   o.*+o |
2026-03-18 13:45:59.501792 | instance -> localhost | +----[SHA256]-----+
2026-03-18 13:45:59.501849 | instance -> localhost | ok: Runtime: 0:00:00.815963
2026-03-18 13:45:59.506990 | 
2026-03-18 13:45:59.507056 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-18 13:45:59.542005 | instance | ok
2026-03-18 13:45:59.552788 | instance | included: /var/lib/zuul/builds/8950785fa893431dac847e06970941c1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-18 13:45:59.560351 | 
2026-03-18 13:45:59.560421 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-18 13:45:59.586345 | instance | skipping: Conditional result was False
2026-03-18 13:45:59.596556 | 
2026-03-18 13:45:59.596664 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-18 13:46:00.030313 | instance | changed
2026-03-18 13:46:00.036372 | 
2026-03-18 13:46:00.036442 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-18 13:46:00.233644 | instance | ok
2026-03-18 13:46:00.240058 | 
2026-03-18 13:46:00.240126 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-18 13:46:00.690433 | instance | changed
2026-03-18 13:46:00.696883 | 
2026-03-18 13:46:00.696948 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-18 13:46:01.158753 | instance | changed
2026-03-18 13:46:01.163902 | 
2026-03-18 13:46:01.163970 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-18 13:46:01.188684 | instance | skipping: Conditional result was False
2026-03-18 13:46:01.197721 | 
2026-03-18 13:46:01.197809 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-18 13:46:01.590520 | instance -> localhost | changed
2026-03-18 13:46:01.605400 | 
2026-03-18 13:46:01.605468 | TASK [add-build-sshkey : Add back temp key]
2026-03-18 13:46:01.911532 | instance -> localhost | Identity added: /var/lib/zuul/builds/8950785fa893431dac847e06970941c1/work/8950785fa893431dac847e06970941c1_id_rsa (zuul-build-sshkey)
2026-03-18 13:46:01.912091 | instance -> localhost | ok: Runtime: 0:00:00.015859
2026-03-18 13:46:01.920687 | 
2026-03-18 13:46:01.920754 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-18 13:46:02.228328 | instance | ok
2026-03-18 13:46:02.233445 | 
2026-03-18 13:46:02.233516 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-18 13:46:02.257789 | instance | skipping: Conditional result was False
2026-03-18 13:46:02.271373 | 
2026-03-18 13:46:02.271436 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-18 13:46:02.606657 | instance | ok
2026-03-18 13:46:02.614696 | 
2026-03-18 13:46:02.614763 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-18 13:46:04.233803 | instance | Output suppressed because no_log was given
2026-03-18 13:46:04.244290 | 
2026-03-18 13:46:04.244360 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-18 13:46:04.423272 | instance | ok: "logs"
2026-03-18 13:46:04.423552 | instance | ok: All items complete
2026-03-18 13:46:04.423581 | 
2026-03-18 13:46:04.570200 | instance | ok: "artifacts"
2026-03-18 13:46:04.720732 | instance | ok: "docs"
2026-03-18 13:46:04.739172 | 
2026-03-18 13:46:04.739307 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-18 13:46:04.913012 | instance | changed: "logs"
2026-03-18 13:46:05.058926 | instance | changed: "artifacts"
2026-03-18 13:46:05.214207 | instance | changed: "docs"
2026-03-18 13:46:05.234822 | 
2026-03-18 13:46:05.234978 | PLAY RECAP
2026-03-18 13:46:05.235046 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-18 13:46:05.235085 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-18 13:46:05.235117 | 
2026-03-18 13:46:05.415981 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-18 13:46:05.418014 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-18 13:46:05.970034 | 
2026-03-18 13:46:05.970182 | PLAY [all]
2026-03-18 13:46:05.981607 | 
2026-03-18 13:46:05.981684 | TASK [setup-uv : Extract archive]
2026-03-18 13:46:08.243029 | instance | changed
2026-03-18 13:46:08.250344 | 
2026-03-18 13:46:08.250455 | TASK [setup-uv : Print version]
2026-03-18 13:46:08.285599 | instance | uv 0.8.13
2026-03-18 13:46:08.797111 | instance | ok: Runtime: 0:00:00.011741
2026-03-18 13:46:08.805375 | 
2026-03-18 13:46:08.805440 | PLAY RECAP
2026-03-18 13:46:08.805486 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-18 13:46:08.805511 | 
2026-03-18 13:46:08.921179 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-18 13:46:08.923196 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-03-18 13:46:09.506216 | 
2026-03-18 13:46:09.536596 | PLAY [all]
2026-03-18 13:46:09.554496 | 
2026-03-18 13:46:09.554612 | TASK [Install "jq" for log collection]
2026-03-18 13:46:19.784815 | instance | changed
2026-03-18 13:46:19.787169 | 
2026-03-18 13:46:19.787248 | PLAY RECAP
2026-03-18 13:46:19.787322 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-18 13:46:19.787403 | 
2026-03-18 13:46:19.908357 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-03-18 13:46:19.912555 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-18 13:46:20.481857 | 
2026-03-18 13:46:20.481999 | PLAY [all]
2026-03-18 13:46:20.495247 | 
2026-03-18 13:46:20.495343 | TASK [Copy inventory file for Zuul]
2026-03-18 13:46:21.383497 | instance | changed
2026-03-18 13:46:21.389600 | 
2026-03-18 13:46:21.389746 | TASK [Switch "ansible_host" to private IP]
2026-03-18 13:46:21.674759 | instance | changed: 1 replacements made
2026-03-18 13:46:21.682640 | 
2026-03-18 13:46:21.682714 | TASK [Run Molecule scenario]
2026-03-18 13:46:21.928979 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-03-18 13:46:21.929203 | instance | Creating virtual environment at: .venv
2026-03-18 13:46:21.954008 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-03-18 13:46:21.969250 | instance | Downloading setuptools (1.1MiB)
2026-03-18 13:46:21.987640 | instance | Downloading kubernetes (1.9MiB)
2026-03-18 13:46:21.988020 | instance | Downloading pygments (1.2MiB)
2026-03-18 13:46:21.988888 | instance | Downloading openstacksdk (1.7MiB)
2026-03-18 13:46:21.993236 | instance | Downloading ansible-core (2.1MiB)
2026-03-18 13:46:21.993804 | instance | Downloading rjsonnet (1.2MiB)
2026-03-18 13:46:21.994150 | instance | Downloading cryptography (4.2MiB)
2026-03-18 13:46:21.994459 | instance | Downloading netaddr (2.2MiB)
2026-03-18 13:46:21.995031 | instance | Downloading pydantic-core (2.0MiB)
2026-03-18 13:46:22.312409 | instance |    Building pyperclip==1.9.0
2026-03-18 13:46:22.319778 | instance |  Downloading rjsonnet
2026-03-18 13:46:22.420870 | instance |  Downloading pydantic-core
2026-03-18 13:46:22.470753 | instance |  Downloading netaddr
2026-03-18 13:46:22.489895 | instance |  Downloading pygments
2026-03-18 13:46:22.499899 | instance |  Downloading cryptography
2026-03-18 13:46:22.546966 | instance |  Downloading setuptools
2026-03-18 13:46:22.604584 | instance |  Downloading kubernetes
2026-03-18 13:46:22.642406 | instance |  Downloading ansible-core
2026-03-18 13:46:22.673756 | instance |  Downloading openstacksdk
2026-03-18 13:46:23.049178 | instance |       Built pyperclip==1.9.0
2026-03-18 13:46:23.311955 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-03-18 13:46:23.354816 | instance | Installed 83 packages in 41ms
2026-03-18 13:46:24.036300 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-03-18 13:46:24.601116 | instance | INFO     [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-03-18 13:46:24.601238 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-03-18 13:47:04.041379 | instance | INFO     [csi > dependency] Executing
2026-03-18 13:47:04.041553 | instance | WARNING  [csi > dependency] Missing roles requirements file: requirements.yml
2026-03-18 13:47:04.041665 | instance | WARNING  [csi > dependency] Missing collections requirements file: collections.yml
2026-03-18 13:47:04.041740 | instance | WARNING  [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-03-18 13:47:04.050463 | instance | INFO     [csi > cleanup] Executing
2026-03-18 13:47:04.050913 | instance | WARNING  [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-18 13:47:04.060889 | instance | INFO     [csi > destroy] Executing
2026-03-18 13:47:04.061006 | instance | WARNING  [csi > destroy] Skipping, '--destroy=never' requested.
2026-03-18 13:47:04.061121 | instance | INFO     [csi > destroy] Executed: Successful
2026-03-18 13:47:04.071713 | instance | INFO     [csi > syntax] Executing
2026-03-18 13:47:05.552328 | instance |
2026-03-18 13:47:05.552542 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-03-18 13:47:05.611627 | instance | INFO     [csi > syntax] Executed: Successful
2026-03-18 13:47:05.624250 | instance | INFO     [csi > create] Executing
2026-03-18 13:47:05.626728 | instance | WARNING  [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-18 13:47:05.634623 | instance | INFO     [csi > prepare] Executing
2026-03-18 13:47:06.403863 | instance |
2026-03-18 13:47:06.404020 | instance | PLAY [Prepare] *****************************************************************
2026-03-18 13:47:06.404218 | instance |
2026-03-18 13:47:06.404396 | instance | TASK [Gathering Facts] *********************************************************
2026-03-18 13:47:06.404595 | instance | Wednesday 18 March 2026  13:47:06 +0000 (0:00:00.029)       0:00:00.029 *******
2026-03-18 13:47:07.570126 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-03-18 13:47:07.570443 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-18 13:47:07.570770 | instance | interpreter could change the meaning of that path. See
2026-03-18 13:47:07.571077 | instance | https://docs.ansible.com/ansible-
2026-03-18 13:47:07.571391 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-03-18 13:47:07.576763 | instance | ok: [instance]
2026-03-18 13:47:07.576915 | instance |
2026-03-18 13:47:07.577082 | instance | TASK [Configure short hostname] ************************************************
2026-03-18 13:47:07.577247 | instance | Wednesday 18 March 2026  13:47:07 +0000 (0:00:01.173)       0:00:01.203 *******
2026-03-18 13:47:08.290463 | instance | changed: [instance]
2026-03-18 13:47:08.290685 | instance |
2026-03-18 13:47:08.291090 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-03-18 13:47:08.291401 | instance | Wednesday 18 March 2026  13:47:08 +0000 (0:00:00.713)       0:00:01.916 *******
2026-03-18 13:47:08.571828 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-03-18 13:47:08.572051 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-03-18 13:47:08.572322 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-03-18 13:47:08.583267 | instance | changed: [instance]
2026-03-18 13:47:08.583535 | instance |
2026-03-18 13:47:08.583818 | instance | TASK [Purge "snapd" package] ***************************************************
2026-03-18 13:47:08.584090 | instance | Wednesday 18 March 2026  13:47:08 +0000 (0:00:00.293)       0:00:02.209 *******
2026-03-18 13:47:09.478947 | instance | ok: [instance]
2026-03-18 13:47:09.479183 | instance |
2026-03-18 13:47:09.479410 | instance | PLAY [Create devices for Ceph] *************************************************
2026-03-18 13:47:09.479666 | instance |
2026-03-18 13:47:09.479947 | instance | TASK [Gathering Facts] *********************************************************
2026-03-18 13:47:09.480228 | instance | Wednesday 18 March 2026  13:47:09 +0000 (0:00:00.895)       0:00:03.104 *******
2026-03-18 13:47:10.189538 | instance | ok: [instance]
2026-03-18 13:47:10.189806 | instance |
2026-03-18 13:47:10.190193 | instance | TASK [Install depedencies] *****************************************************
2026-03-18 13:47:10.190547 | instance | Wednesday 18 March 2026  13:47:10 +0000 (0:00:00.710)       0:00:03.815 *******
2026-03-18 13:48:32.569863 | instance | changed: [instance]
2026-03-18 13:48:32.570220 | instance |
2026-03-18 13:48:32.570240 | instance | TASK [Start up service] ********************************************************
2026-03-18 13:48:32.570251 | instance | Wednesday 18 March 2026  13:48:32 +0000 (0:01:22.379)       0:01:26.195 *******
2026-03-18 13:48:33.121114 | instance | ok: [instance]
2026-03-18 13:48:33.121344 | instance |
2026-03-18 13:48:33.121623 | instance | TASK [Generate lvm.conf] *******************************************************
2026-03-18 13:48:33.121900 | instance | Wednesday 18 March 2026  13:48:33 +0000 (0:00:00.552)       0:01:26.747 *******
2026-03-18 13:48:33.409598 | instance | ok: [instance]
2026-03-18 13:48:33.409821 | instance |
2026-03-18 13:48:33.410167 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-03-18 13:48:33.410560 | instance | Wednesday 18 March 2026  13:48:33 +0000 (0:00:00.288)       0:01:27.035 *******
2026-03-18 13:48:34.061898 | instance | changed: [instance]
2026-03-18 13:48:34.062179 | instance |
2026-03-18 13:48:34.062474 | instance | TASK [Get list of all loopback devices] ****************************************
2026-03-18 13:48:34.062764 | instance | Wednesday 18 March 2026  13:48:34 +0000 (0:00:00.652)       0:01:27.687 *******
2026-03-18 13:48:34.249714 | instance | ok: [instance]
2026-03-18 13:48:34.250021 | instance |
2026-03-18 13:48:34.250312 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-03-18 13:48:34.250603 | instance | Wednesday 18 March 2026  13:48:34 +0000 (0:00:00.187)       0:01:27.875 *******
2026-03-18 13:48:34.275392 | instance | skipping: [instance]
2026-03-18 13:48:34.275578 | instance |
2026-03-18 13:48:34.275842 | instance | TASK [Create devices for Ceph] *************************************************
2026-03-18 13:48:34.276112 | instance | Wednesday 18 March 2026  13:48:34 +0000 (0:00:00.026)       0:01:27.901 *******
2026-03-18 13:48:34.820904 | instance | changed: [instance] => (item=osd0)
2026-03-18 13:48:34.821171 | instance | changed: [instance] => (item=osd1)
2026-03-18 13:48:34.821456 | instance | changed: [instance] => (item=osd2)
2026-03-18 13:48:34.821726 | instance |
2026-03-18 13:48:34.822043 | instance | TASK [Set permissions on loopback devices] *************************************
2026-03-18 13:48:34.822508 | instance | Wednesday 18 March 2026  13:48:34 +0000 (0:00:00.544)       0:01:28.446 *******
2026-03-18 13:48:35.436520 | instance | changed: [instance] => (item=osd0)
2026-03-18 13:48:35.436709 | instance | changed: [instance] => (item=osd1)
2026-03-18 13:48:35.436978 | instance | changed: [instance] => (item=osd2)
2026-03-18 13:48:35.437234 | instance |
2026-03-18 13:48:35.437507 | instance | TASK [Start loop devices] ******************************************************
2026-03-18 13:48:35.437775 | instance | Wednesday 18 March 2026  13:48:35 +0000 (0:00:00.615)       0:01:29.062 *******
2026-03-18 13:48:36.116914 | instance | changed: [instance] => (item=osd0)
2026-03-18 13:48:36.117158 | instance | changed: [instance] => (item=osd1)
2026-03-18 13:48:36.117440 | instance | changed: [instance] => (item=osd2)
2026-03-18 13:48:36.117705 | instance |
2026-03-18 13:48:36.118010 | instance | TASK [Create a volume group for each loop device] ******************************
2026-03-18 13:48:36.118298 | instance | Wednesday 18 March 2026  13:48:36 +0000 (0:00:00.680)       0:01:29.742 *******
2026-03-18 13:48:39.138107 | instance | changed: [instance] => (item=osd0)
2026-03-18 13:48:39.138187 | instance | changed: [instance] => (item=osd1)
2026-03-18 13:48:39.138199 | instance | changed: [instance] => (item=osd2)
2026-03-18 13:48:39.138208 | instance |
2026-03-18 13:48:39.138218 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-03-18 13:48:39.138379 | instance | Wednesday 18 March 2026  13:48:39 +0000 (0:00:03.019)       0:01:32.762 *******
2026-03-18 13:48:40.922193 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-03-18 13:48:40.922332 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-03-18 13:48:40.923266 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-03-18 13:48:40.923289 | instance |
2026-03-18 13:48:40.923300 | instance | PLAY RECAP *********************************************************************
2026-03-18 13:48:40.923311 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-03-18 13:48:40.923320 | instance |
2026-03-18 13:48:40.925038 | instance | Wednesday 18 March 2026  13:48:40 +0000 (0:00:01.786)       0:01:34.548 *******
2026-03-18 13:48:40.925102 | instance | ===============================================================================
2026-03-18 13:48:40.925114 | instance | Install depedencies ---------------------------------------------------- 82.38s
2026-03-18 13:48:40.925123 | instance | Create a volume group for each loop device ------------------------------ 3.02s
2026-03-18 13:48:40.925132 | instance | Create a logical volume for each loop device ---------------------------- 1.79s
2026-03-18 13:48:40.925141 | instance | Gathering Facts --------------------------------------------------------- 1.17s
2026-03-18 13:48:40.925268 | instance | Purge "snapd" package --------------------------------------------------- 0.90s
2026-03-18 13:48:40.925880 | instance | Configure short hostname ------------------------------------------------ 0.71s
2026-03-18 13:48:40.926435 | instance | Gathering Facts --------------------------------------------------------- 0.71s
2026-03-18 13:48:40.926914 | instance | Start loop devices ------------------------------------------------------ 0.68s
2026-03-18 13:48:40.927392 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.65s
2026-03-18 13:48:40.927855 | instance | Set permissions on loopback devices ------------------------------------- 0.62s
2026-03-18 13:48:40.928318 | instance | Start up service -------------------------------------------------------- 0.55s
2026-03-18 13:48:40.928780 | instance | Create devices for Ceph ------------------------------------------------- 0.54s
2026-03-18 13:48:40.929269 | instance | Ensure hostname inside hosts file --------------------------------------- 0.29s
2026-03-18 13:48:40.929830 | instance | Generate lvm.conf ------------------------------------------------------- 0.29s
2026-03-18 13:48:40.930396 | instance | Get list of all loopback devices ---------------------------------------- 0.19s
2026-03-18 13:48:40.930613 | instance | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-03-18 13:48:41.024881 | instance | INFO     [csi > prepare] Executed: Successful
2026-03-18 13:48:41.038091 | instance | INFO     [csi > converge] Executing
2026-03-18 13:48:42.615076 | instance |
2026-03-18 13:48:42.615560 | instance | PLAY [Debug CSI driver value] **************************************************
2026-03-18 13:48:42.615883 | instance |
2026-03-18 13:48:42.616213 | instance | TASK [Gathering Facts] *********************************************************
2026-03-18 13:48:42.616543 | instance | Wednesday 18 March 2026  13:48:42 +0000 (0:00:00.009)       0:00:00.009 *******
2026-03-18 13:48:43.590792 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-03-18 13:48:43.591282 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-18 13:48:43.591625 | instance | interpreter could change the meaning of that path. See
2026-03-18 13:48:43.591955 | instance | https://docs.ansible.com/ansible-
2026-03-18 13:48:43.592286 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-03-18 13:48:43.601578 | instance | ok: [instance]
2026-03-18 13:48:43.601899 | instance |
2026-03-18 13:48:43.602260 | instance | TASK [Display CSI driver value and environment variable] ***********************
2026-03-18 13:48:43.602587 | instance | Wednesday 18 March 2026  13:48:43 +0000 (0:00:00.986)       0:00:00.996 *******
2026-03-18 13:48:43.648727 | instance | ok: [instance] => {
2026-03-18 13:48:43.649153 | instance |     "msg": "csi_driver=rbd, MOLECULE_CSI_DRIVER="
2026-03-18 13:48:43.649480 | instance | }
2026-03-18 13:48:43.649787 | instance |
2026-03-18 13:48:43.650304 | instance | PLAY [all] *********************************************************************
2026-03-18 13:48:43.650721 | instance |
2026-03-18 13:48:43.651191 | instance | TASK [Gathering Facts] *********************************************************
2026-03-18 13:48:43.651625 | instance | Wednesday 18 March 2026  13:48:43 +0000 (0:00:00.047)       0:00:01.043 *******
2026-03-18 13:48:44.534538 | instance | ok: [instance]
2026-03-18 13:48:44.534948 | instance |
2026-03-18 13:48:44.535292 | instance | TASK [Fail if atmosphere_ceph_enabled is set] **********************************
2026-03-18 13:48:44.535678 | instance | Wednesday 18 March 2026  13:48:44 +0000 (0:00:00.885)       0:00:01.929 *******
2026-03-18 13:48:44.577430 | instance | skipping: [instance]
2026-03-18 13:48:44.577814 | instance |
2026-03-18 13:48:44.578212 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-03-18 13:48:44.578575 | instance | Wednesday 18 March 2026  13:48:44 +0000 (0:00:00.043)       0:00:01.972 *******
2026-03-18 13:48:44.758454 | instance | ok: [instance]
2026-03-18 13:48:44.758872 | instance |
2026-03-18 13:48:44.759232 | instance | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-03-18 13:48:44.759607 | instance |
2026-03-18 13:48:44.760017 | instance | TASK [Gathering Facts] *********************************************************
2026-03-18 13:48:44.760390 | instance | Wednesday 18 March 2026  13:48:44 +0000 (0:00:00.180)       0:00:02.153 *******
2026-03-18 13:48:45.621620 | instance | ok: [instance]
2026-03-18 13:48:45.621822 | instance |
2026-03-18 13:48:45.621996 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-18 13:48:45.622174 | instance | Wednesday 18 March 2026  13:48:45 +0000 (0:00:00.861)       0:00:03.014 *******
2026-03-18 13:48:45.916393 | instance | ok: [instance]
2026-03-18 13:48:45.916436 | instance |
2026-03-18 13:48:45.916443 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-18 13:48:45.916449 | instance | Wednesday 18 March 2026  13:48:45 +0000 (0:00:00.296)       0:00:03.311 *******
2026-03-18 13:48:45.960889 | instance | skipping: [instance]
2026-03-18 13:48:45.960939 | instance |
2026-03-18 13:48:45.960945 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-18 13:48:45.960951 | instance | Wednesday 18 March 2026  13:48:45 +0000 (0:00:00.044)       0:00:03.355 *******
2026-03-18 13:48:46.257818 | instance | changed: [instance]
2026-03-18 13:48:46.257889 | instance |
2026-03-18 13:48:46.257903 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-18 13:48:46.257914 | instance | Wednesday 18 March 2026  13:48:46 +0000 (0:00:00.295)       0:00:03.651 *******
2026-03-18 13:48:46.339718 | instance | ok: [instance] => {
2026-03-18 13:48:46.339752 | instance |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-18 13:48:46.339764 | instance | }
2026-03-18 13:48:46.339774 | instance |
2026-03-18 13:48:46.339804 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-18 13:48:46.339814 | instance | Wednesday 18 March 2026  13:48:46 +0000 (0:00:00.082)       0:00:03.733 *******
2026-03-18 13:48:47.117529 | instance | changed: [instance]
2026-03-18 13:48:47.117916 | instance |
2026-03-18 13:48:47.118308 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-18 13:48:47.118646 | instance | Wednesday 18 March 2026  13:48:47 +0000 (0:00:00.778)       0:00:04.512 *******
2026-03-18 13:48:47.167668 | instance | skipping: [instance]
2026-03-18 13:48:47.167809 | instance |
2026-03-18 13:48:47.168021 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-18 13:48:47.168183 | instance | Wednesday 18 March 2026  13:48:47 +0000 (0:00:00.050)       0:00:04.562 *******
2026-03-18 13:48:47.224729 | instance | skipping: [instance]
2026-03-18 13:48:47.224851 | instance |
2026-03-18 13:48:47.224985 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-18 13:48:47.225163 | instance | Wednesday 18 March 2026  13:48:47 +0000 (0:00:00.057)       0:00:04.619 *******
2026-03-18 13:48:47.445639 | instance | ok: [instance]
2026-03-18 13:48:47.445726 | instance |
2026-03-18 13:48:47.445871 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-18 13:48:47.446130 | instance | Wednesday 18 March 2026  13:48:47 +0000 (0:00:00.220)       0:00:04.840 *******
2026-03-18 13:48:48.842857 | instance | ok: [instance]
2026-03-18 13:48:48.843138 | instance |
2026-03-18 13:48:48.843410 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-18 13:48:48.843632 | instance | Wednesday 18 March 2026  13:48:48 +0000 (0:00:01.394)       0:00:06.234 *******
2026-03-18 13:48:48.910786 | instance | ok: [instance] => {
2026-03-18 13:48:48.910965 | instance |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-18 13:48:48.911253 | instance | }
2026-03-18 13:48:48.911465 | instance |
2026-03-18 13:48:48.911690 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-18 13:48:48.911923 | instance | Wednesday 18 March 2026  13:48:48 +0000 (0:00:00.068)       0:00:06.302 *******
2026-03-18 13:48:49.658771 | instance | changed: [instance]
2026-03-18 13:48:49.659004 | instance |
2026-03-18 13:48:49.659019 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-18 13:48:49.659225 | instance | Wednesday 18 March 2026  13:48:49 +0000 (0:00:00.750)       0:00:07.053 *******
2026-03-18 13:48:52.582976 | instance | changed: [instance]
2026-03-18 13:48:52.583381 | instance |
2026-03-18 13:48:52.583768 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-18 13:48:52.584123 | instance | Wednesday 18 March 2026  13:48:52 +0000 (0:00:02.924)       0:00:09.977 *******
2026-03-18 13:48:52.619558 | instance | skipping: [instance]
2026-03-18 13:48:52.619932 | instance |
2026-03-18 13:48:52.620153 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-18 13:48:52.620312 | instance | Wednesday 18 March 2026  13:48:52 +0000 (0:00:00.035)       0:00:10.013 *******
2026-03-18 13:48:52.659170 | instance | skipping: [instance]
2026-03-18 13:48:52.659642 | instance |
2026-03-18 13:48:52.660129 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-18 13:48:52.660541 | instance | Wednesday 18 March 2026  13:48:52 +0000 (0:00:00.039)       0:00:10.052 *******
2026-03-18 13:48:52.687298 | instance | skipping: [instance]
2026-03-18 13:48:52.687940 | instance |
2026-03-18 13:48:52.688296 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-18 13:48:52.688673 | instance | Wednesday 18 March 2026  13:48:52 +0000 (0:00:00.028)       0:00:10.080 *******
2026-03-18 13:49:02.115480 | instance | fatal: [instance]: FAILED! => {"cache_update_time": 1773841574, "cache_updated": false, "changed": false, "msg": "'/usr/bin/apt-get -y -o \"Dpkg::Options::=--force-confdef\" -o \"Dpkg::Options::=--force-confold\"       install 'apparmor=3.0.4-2ubuntu2.5' 'apparmor-utils=3.0.4-2ubuntu2.5'' failed: E: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/a/apparmor/apparmor_3.0.4-2ubuntu2.5_amd64.deb  503  Service Unavailable [IP: 91.189.91.94 80]\nE: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/a/apparmor/python3-libapparmor_3.0.4-2ubuntu2.5_amd64.deb  503  Service Unavailable [IP: 91.189.91.94 80]\nE: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/a/apparmor/python3-apparmor_3.0.4-2ubuntu2.5_all.deb  503  Service Unavailable [IP: 91.189.91.94 80]\nE: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/a/apparmor/apparmor-utils_3.0.4-2ubuntu2.5_all.deb  503  Service Unavailable [IP: 91.189.91.94 80]\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n", "rc": 100, "stderr": "E: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/a/apparmor/apparmor_3.0.4-2ubuntu2.5_amd64.deb  503  Service Unavailable [IP: 91.189.91.94 80]\nE: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/a/apparmor/python3-libapparmor_3.0.4-2ubuntu2.5_amd64.deb  503  Service Unavailable [IP: 91.189.91.94 80]\nE: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/a/apparmor/python3-apparmor_3.0.4-2ubuntu2.5_all.deb  503  Service Unavailable [IP: 91.189.91.94 80]\nE: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/a/apparmor/apparmor-utils_3.0.4-2ubuntu2.5_all.deb  503  Service Unavailable [IP: 91.189.91.94 80]\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n", "stderr_lines": ["E: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/a/apparmor/apparmor_3.0.4-2ubuntu2.5_amd64.deb  503  Service Unavailable [IP: 91.189.91.94 80]", "E: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/a/apparmor/python3-libapparmor_3.0.4-2ubuntu2.5_amd64.deb  503  Service Unavailable [IP: 91.189.91.94 80]", "E: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/a/apparmor/python3-apparmor_3.0.4-2ubuntu2.5_all.deb  503  Service Unavailable [IP: 91.189.91.94 80]", "E: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/a/apparmor/apparmor-utils_3.0.4-2ubuntu2.5_all.deb  503  Service Unavailable [IP: 91.189.91.94 80]", "E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?"], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n  python3-apparmor python3-libapparmor\nSuggested packages:\n  apparmor-profiles-extra vim-addon-manager\nThe following NEW packages will be installed:\n  apparmor apparmor-utils python3-apparmor python3-libapparmor\n0 upgraded, 4 newly installed, 0 to remove and 18 not upgraded.\nNeed to get 769 kB of archives.\nAfter this operation, 3938 kB of additional disk space will be used.\nIgn:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor amd64 3.0.4-2ubuntu2.5\nIgn:2 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-libapparmor amd64 3.0.4-2ubuntu2.5\nIgn:3 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-apparmor all 3.0.4-2ubuntu2.5\nIgn:4 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor-utils all 3.0.4-2ubuntu2.5\nIgn:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor amd64 3.0.4-2ubuntu2.5\nIgn:2 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-libapparmor amd64 3.0.4-2ubuntu2.5\nIgn:3 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-apparmor all 3.0.4-2ubuntu2.5\nIgn:4 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor-utils all 3.0.4-2ubuntu2.5\nIgn:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor amd64 3.0.4-2ubuntu2.5\nIgn:2 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-libapparmor amd64 3.0.4-2ubuntu2.5\nIgn:3 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-apparmor all 3.0.4-2ubuntu2.5\nIgn:4 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor-utils all 3.0.4-2ubuntu2.5\nErr:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor amd64 3.0.4-2ubuntu2.5\n  503  Service Unavailable [IP: 91.189.91.94 80]\nErr:2 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-libapparmor amd64 3.0.4-2ubuntu2.5\n  503  Service Unavailable [IP: 91.189.91.94 80]\nErr:3 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-apparmor all 3.0.4-2ubuntu2.5\n  503  Service Unavailable [IP: 91.189.91.94 80]\nErr:4 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor-utils all 3.0.4-2ubuntu2.5\n  503  Service Unavailable [IP: 91.189.91.94 80]\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", "  python3-apparmor python3-libapparmor", "Suggested packages:", "  apparmor-profiles-extra vim-addon-manager", "The following NEW packages will be installed:", "  apparmor apparmor-utils python3-apparmor python3-libapparmor", "0 upgraded, 4 newly installed, 0 to remove and 18 not upgraded.", "Need to get 769 kB of archives.", "After this operation, 3938 kB of additional disk space will be used.", "Ign:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor amd64 3.0.4-2ubuntu2.5", "Ign:2 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-libapparmor amd64 3.0.4-2ubuntu2.5", "Ign:3 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-apparmor all 3.0.4-2ubuntu2.5", "Ign:4 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor-utils all 3.0.4-2ubuntu2.5", "Ign:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor amd64 3.0.4-2ubuntu2.5", "Ign:2 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-libapparmor amd64 3.0.4-2ubuntu2.5", "Ign:3 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-apparmor all 3.0.4-2ubuntu2.5", "Ign:4 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor-utils all 3.0.4-2ubuntu2.5", "Ign:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor amd64 3.0.4-2ubuntu2.5", "Ign:2 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-libapparmor amd64 3.0.4-2ubuntu2.5", "Ign:3 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-apparmor all 3.0.4-2ubuntu2.5", "Ign:4 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor-utils all 3.0.4-2ubuntu2.5", "Err:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor amd64 3.0.4-2ubuntu2.5", "  503  Service Unavailable [IP: 91.189.91.94 80]", "Err:2 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-libapparmor amd64 3.0.4-2ubuntu2.5", "  503  Service Unavailable [IP: 91.189.91.94 80]", "Err:3 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-apparmor all 3.0.4-2ubuntu2.5", "  503  Service Unavailable [IP: 91.189.91.94 80]", "Err:4 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor-utils all 3.0.4-2ubuntu2.5", "  503  Service Unavailable [IP: 91.189.91.94 80]"]}
2026-03-18 13:49:02.117705 | instance |
2026-03-18 13:49:02.118063 | instance | PLAY RECAP *********************************************************************
2026-03-18 13:49:02.118492 | instance | instance                   : ok=14   changed=4    unreachable=0    failed=1    skipped=7    rescued=0    ignored=0
2026-03-18 13:49:02.118818 | instance |
2026-03-18 13:49:02.119150 | instance | Wednesday 18 March 2026  13:49:02 +0000 (0:00:09.431)       0:00:19.512 *******
2026-03-18 13:49:02.119469 | instance | ===============================================================================
2026-03-18 13:49:02.119798 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 9.43s
2026-03-18 13:49:02.120131 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.92s
2026-03-18 13:49:02.120482 | instance | vexxhost.containers.package : Update state for tar ---------------------- 1.39s
2026-03-18 13:49:02.120807 | instance | Gathering Facts --------------------------------------------------------- 0.99s
2026-03-18 13:49:02.121157 | instance | Gathering Facts --------------------------------------------------------- 0.89s
2026-03-18 13:49:02.121480 | instance | Gathering Facts --------------------------------------------------------- 0.86s
2026-03-18 13:49:02.121805 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.78s
2026-03-18 13:49:02.122186 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.75s
2026-03-18 13:49:02.122517 | instance | vexxhost.containers.forget_package : Forget package --------------------- 0.30s
2026-03-18 13:49:02.122845 | instance | vexxhost.containers.directory : Create directory (/var/lib/downloads) --- 0.30s
2026-03-18 13:49:02.123168 | instance | vexxhost.containers.forget_package : Forget package --------------------- 0.22s
2026-03-18 13:49:02.123492 | instance | Set a fact with the "atmosphere_images" for other plays ----------------- 0.18s
2026-03-18 13:49:02.123814 | instance | vexxhost.containers.download_artifact : Starting download of file ------- 0.08s
2026-03-18 13:49:02.124137 | instance | vexxhost.containers.download_artifact : Starting download of file ------- 0.07s
2026-03-18 13:49:02.124461 | instance | vexxhost.containers.package : Update state for tar ---------------------- 0.06s
2026-03-18 13:49:02.124793 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 0.05s
2026-03-18 13:49:02.125173 | instance | Display CSI driver value and environment variable ----------------------- 0.05s
2026-03-18 13:49:02.125503 | instance | vexxhost.containers.package : Update state for tar ---------------------- 0.04s
2026-03-18 13:49:02.125816 | instance | Fail if atmosphere_ceph_enabled is set ---------------------------------- 0.04s
2026-03-18 13:49:02.125975 | instance | vexxhost.containers.containerd : Set SELinux to permissive at runtime --- 0.04s
2026-03-18 13:49:02.230985 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-03-18 13:49:02.231259 | instance | ERROR    [csi > converge] Executed: Failed
2026-03-18 13:49:02.231460 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-03-18 13:49:02.376142 | instance | ERROR
2026-03-18 13:49:02.376468 | instance | {
2026-03-18 13:49:02.376534 | instance |   "delta": "0:02:40.463451",
2026-03-18 13:49:02.376585 | instance |   "end": "2026-03-18 13:49:02.318578",
2026-03-18 13:49:02.376626 | instance |   "msg": "non-zero return code",
2026-03-18 13:49:02.376666 | instance |   "rc": 2,
2026-03-18 13:49:02.376718 | instance |   "start": "2026-03-18 13:46:21.855127"
2026-03-18 13:49:02.376774 | instance | }
failure
2026-03-18 13:49:02.381617 | 
2026-03-18 13:49:02.383169 | PLAY RECAP
2026-03-18 13:49:02.383233 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-03-18 13:49:02.383258 | 
2026-03-18 13:49:02.513205 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-18 13:49:02.518761 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-03-18 13:49:03.146628 | 
2026-03-18 13:49:03.146780 | PLAY [all]
2026-03-18 13:49:03.161236 | 
2026-03-18 13:49:03.161350 | TASK [gather-host-logs : creating directory for system status]
2026-03-18 13:49:03.528401 | instance | changed
2026-03-18 13:49:03.535757 | 
2026-03-18 13:49:03.535839 | TASK [gather-host-logs : Get logs for each host]
2026-03-18 13:49:03.906605 | instance | + systemd-cgls --full --all --no-pager
2026-03-18 13:49:03.918233 | instance | + ip addr
2026-03-18 13:49:03.921219 | instance | + ip route
2026-03-18 13:49:03.923902 | instance | + lsblk
2026-03-18 13:49:03.927551 | instance | + mount
2026-03-18 13:49:03.929253 | instance | + docker images
2026-03-18 13:49:03.929698 | instance | /bin/bash: line 7: docker: command not found
2026-03-18 13:49:03.929927 | instance | + brctl show
2026-03-18 13:49:03.930409 | instance | /bin/bash: line 8: brctl: command not found
2026-03-18 13:49:03.930638 | instance | + ps aux --sort=-%mem
2026-03-18 13:49:03.941669 | instance | + dpkg -l
2026-03-18 13:49:03.949444 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-03-18 13:49:03.949904 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-03-18 13:49:03.949980 | instance | /bin/bash: line 11: docker: command not found
2026-03-18 13:49:03.950525 | instance | + '[' '!' -z '' ']'
2026-03-18 13:49:04.074247 | instance | ok: Runtime: 0:00:00.050045
2026-03-18 13:49:04.082954 | 
2026-03-18 13:49:04.083028 | TASK [gather-host-logs : Downloads logs to executor]
2026-03-18 13:49:04.759198 | instance | changed:
2026-03-18 13:49:04.759405 | instance | created directory /var/lib/zuul/builds/8950785fa893431dac847e06970941c1/work/logs/instance
2026-03-18 13:49:04.759445 | instance | cd+++++++++ system/
2026-03-18 13:49:04.759476 | instance | >f+++++++++ system/brctl-show.txt
2026-03-18 13:49:04.759505 | instance | >f+++++++++ system/docker-images.txt
2026-03-18 13:49:04.759531 | instance | >f+++++++++ system/ip-addr.txt
2026-03-18 13:49:04.759562 | instance | >f+++++++++ system/ip-route.txt
2026-03-18 13:49:04.759594 | instance | >f+++++++++ system/lsblk.txt
2026-03-18 13:49:04.759622 | instance | >f+++++++++ system/mount.txt
2026-03-18 13:49:04.759652 | instance | >f+++++++++ system/packages.txt
2026-03-18 13:49:04.759680 | instance | >f+++++++++ system/ps.txt
2026-03-18 13:49:04.759708 | instance | >f+++++++++ system/systemd-cgls.txt
2026-03-18 13:49:04.770326 | 
2026-03-18 13:49:04.770432 | LOOP [helm-release-status : creating directory for helm release status]
2026-03-18 13:49:04.970707 | instance | changed: "values"
2026-03-18 13:49:05.134093 | instance | changed: "releases"
2026-03-18 13:49:05.153144 | 
2026-03-18 13:49:05.153305 | TASK [helm-release-status : Gather get release status for helm charts]
2026-03-18 13:49:05.364092 | instance | /bin/bash: line 3: kubectl: command not found
2026-03-18 13:49:05.690515 | instance | ok: Runtime: 0:00:00.005821
2026-03-18 13:49:05.697367 | 
2026-03-18 13:49:05.697471 | TASK [helm-release-status : Downloads logs to executor]
2026-03-18 13:49:06.185959 | instance | changed:
2026-03-18 13:49:06.186163 | instance | cd+++++++++ helm/
2026-03-18 13:49:06.186201 | instance | cd+++++++++ helm/releases/
2026-03-18 13:49:06.186230 | instance | cd+++++++++ helm/values/
2026-03-18 13:49:06.197677 | 
2026-03-18 13:49:06.197766 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-03-18 13:49:06.414168 | instance | changed
2026-03-18 13:49:06.420561 | 
2026-03-18 13:49:06.420635 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-03-18 13:49:06.630254 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-18 13:49:06.630439 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-18 13:49:06.634999 | instance | environment: line 1: kubectl: command not found
2026-03-18 13:49:06.636081 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-18 13:49:06.637593 | instance | environment: line 1: kubectl: command not found
2026-03-18 13:49:06.638630 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-18 13:49:06.639707 | instance | environment: line 1: kubectl: command not found
2026-03-18 13:49:06.659424 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-18 13:49:06.659547 | instance | environment: line 1: kubectl: command not found
2026-03-18 13:49:06.659570 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-18 13:49:06.659587 | instance | environment: line 1: kubectl: command not found
2026-03-18 13:49:06.659621 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-18 13:49:06.956216 | instance | ok: Runtime: 0:00:00.036761
2026-03-18 13:49:06.961042 | 
2026-03-18 13:49:06.961102 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-03-18 13:49:07.157626 | instance | changed
2026-03-18 13:49:07.164256 | 
2026-03-18 13:49:07.164327 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-03-18 13:49:07.401005 | instance | environment: line 5: kubectl: command not found
2026-03-18 13:49:07.401872 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-18 13:49:07.402118 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-18 13:49:07.402830 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-18 13:49:07.725867 | instance | ok: Runtime: 0:00:00.008650
2026-03-18 13:49:07.731015 | 
2026-03-18 13:49:07.731077 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-03-18 13:49:08.224190 | instance | changed:
2026-03-18 13:49:08.224531 | instance | cd+++++++++ objects/
2026-03-18 13:49:08.229712 | instance | cd+++++++++ objects/cluster/
2026-03-18 13:49:08.229769 | instance | cd+++++++++ objects/namespaced/
2026-03-18 13:49:08.241865 | 
2026-03-18 13:49:08.241941 | TASK [gather-pod-logs : creating directory for pod logs]
2026-03-18 13:49:08.445894 | instance | changed
2026-03-18 13:49:08.452685 | 
2026-03-18 13:49:08.452778 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-03-18 13:49:08.647583 | instance | changed
2026-03-18 13:49:08.654636 | 
2026-03-18 13:49:08.654738 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-03-18 13:49:08.874995 | instance | environment: line 3: kubectl: command not found
2026-03-18 13:49:09.196526 | instance | ok: Runtime: 0:00:00.008667
2026-03-18 13:49:09.203681 | 
2026-03-18 13:49:09.203816 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-03-18 13:49:09.712566 | instance | changed:
2026-03-18 13:49:09.712772 | instance | cd+++++++++ pod-logs/
2026-03-18 13:49:09.712813 | instance | cd+++++++++ pod-logs/failed-pods/
2026-03-18 13:49:09.723151 | 
2026-03-18 13:49:09.723229 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-03-18 13:49:09.928972 | instance | changed
2026-03-18 13:49:09.935825 | 
2026-03-18 13:49:09.935904 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-03-18 13:49:10.155373 | instance | /bin/bash: line 2: kubectl: command not found
2026-03-18 13:49:10.472446 | instance | ok: Runtime: 0:00:00.039815
2026-03-18 13:49:10.478058 | 
2026-03-18 13:49:10.478143 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-03-18 13:49:10.689836 | instance | /bin/bash: line 2: kubectl: command not found
2026-03-18 13:49:10.717247 | instance | ceph-mgr endpoints:
2026-03-18 13:49:11.011321 | instance | ok: Runtime: 0:00:00.034584
2026-03-18 13:49:11.017197 | 
2026-03-18 13:49:11.017267 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-03-18 13:49:11.243529 | instance | /bin/bash: line 4: kubectl: command not found
2026-03-18 13:49:11.556085 | instance | ok: Runtime: 0:00:00.039059
2026-03-18 13:49:11.563861 | 
2026-03-18 13:49:11.563982 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-03-18 13:49:12.061781 | instance | changed: cd+++++++++ prometheus/
2026-03-18 13:49:12.073828 | 
2026-03-18 13:49:12.073891 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-03-18 13:49:12.302217 | instance | changed
2026-03-18 13:49:12.308511 | 
2026-03-18 13:49:12.308634 | TASK [gather-selenium-data : Get selenium data]
2026-03-18 13:49:12.532735 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-03-18 13:49:12.534404 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-03-18 13:49:12.847836 | instance | ERROR
2026-03-18 13:49:12.848082 | instance | {
2026-03-18 13:49:12.848126 | instance |   "delta": "0:00:00.007522",
2026-03-18 13:49:12.848158 | instance |   "end": "2026-03-18 13:49:12.534872",
2026-03-18 13:49:12.848185 | instance |   "msg": "non-zero return code",
2026-03-18 13:49:12.848210 | instance |   "rc": 1,
2026-03-18 13:49:12.848236 | instance |   "start": "2026-03-18 13:49:12.527350"
2026-03-18 13:49:12.848261 | instance | }
2026-03-18 13:49:12.848293 | instance | ERROR: Ignoring Errors
2026-03-18 13:49:12.855326 | 
2026-03-18 13:49:12.855395 | TASK [gather-selenium-data : Downloads logs to executor]
2026-03-18 13:49:13.374420 | instance | changed: cd+++++++++ selenium/
2026-03-18 13:49:13.381688 | 
2026-03-18 13:49:13.381749 | PLAY RECAP
2026-03-18 13:49:13.381803 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-03-18 13:49:13.381833 | 
2026-03-18 13:49:13.500805 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-03-18 13:49:13.504906 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-18 13:49:14.082719 | 
2026-03-18 13:49:14.082860 | PLAY [all]
2026-03-18 13:49:14.095118 | 
2026-03-18 13:49:14.095228 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-18 13:49:14.141408 | instance | skipping: Conditional result was False
2026-03-18 13:49:14.151135 | 
2026-03-18 13:49:14.151246 | TASK [fetch-output : Set log path for single node]
2026-03-18 13:49:14.191748 | instance | ok
2026-03-18 13:49:14.197690 | 
2026-03-18 13:49:14.197757 | LOOP [fetch-output : Ensure local output dirs]
2026-03-18 13:49:14.576542 | instance -> localhost | ok: "/var/lib/zuul/builds/8950785fa893431dac847e06970941c1/work/logs"
2026-03-18 13:49:14.782508 | instance -> localhost | changed: "/var/lib/zuul/builds/8950785fa893431dac847e06970941c1/work/artifacts"
2026-03-18 13:49:15.015489 | instance -> localhost | changed: "/var/lib/zuul/builds/8950785fa893431dac847e06970941c1/work/docs"
2026-03-18 13:49:15.034047 | 
2026-03-18 13:49:15.034214 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-18 13:49:15.663582 | instance | changed: .d..t...... ./
2026-03-18 13:49:15.663844 | instance | changed: All items complete
2026-03-18 13:49:15.663884 | 
2026-03-18 13:49:16.119229 | instance | changed: .d..t...... ./
2026-03-18 13:49:16.572650 | instance | changed: .d..t...... ./
2026-03-18 13:49:16.593266 | 
2026-03-18 13:49:16.593335 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-18 13:49:17.010605 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007549
2026-03-18 13:49:17.254446 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.008228
2026-03-18 13:49:17.269639 | 
2026-03-18 13:49:17.269764 | PLAY [all]
2026-03-18 13:49:17.276072 | 
2026-03-18 13:49:17.276141 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-18 13:49:17.744584 | instance | changed
2026-03-18 13:49:17.752230 | 
2026-03-18 13:49:17.752286 | PLAY RECAP
2026-03-18 13:49:17.752335 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-18 13:49:17.752357 | 
2026-03-18 13:49:17.865046 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-18 13:49:17.869525 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-03-18 13:49:18.471002 | 
2026-03-18 13:49:18.471142 | PLAY [localhost]
2026-03-18 13:49:18.481278 | 
2026-03-18 13:49:18.481367 | TASK [Generate Zuul manifest]
2026-03-18 13:49:18.504328 | localhost | ok
2026-03-18 13:49:18.526554 | 
2026-03-18 13:49:18.526765 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-18 13:49:18.864667 | localhost | changed
2026-03-18 13:49:18.875626 | 
2026-03-18 13:49:18.875732 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-18 13:49:18.909226 | localhost | ok
2026-03-18 13:49:18.919015 | 
2026-03-18 13:49:18.919199 | TASK [Upload logs]
2026-03-18 13:49:18.943151 | localhost | ok
2026-03-18 13:49:19.001065 | 
2026-03-18 13:49:19.001203 | TASK [Set zuul-log-path fact]
2026-03-18 13:49:19.024125 | localhost | ok
2026-03-18 13:49:19.036148 | 
2026-03-18 13:49:19.036223 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-18 13:49:19.067948 | localhost | ok
2026-03-18 13:49:19.076747 | 
2026-03-18 13:49:19.076835 | TASK [upload-logs : Create log directories]
2026-03-18 13:49:19.496392 | localhost | changed
2026-03-18 13:49:19.502849 | 
2026-03-18 13:49:19.502945 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-18 13:49:19.929975 | localhost -> localhost | ok: Runtime: 0:00:00.006207
2026-03-18 13:49:19.936689 | 
2026-03-18 13:49:19.936786 | TASK [upload-logs : Upload logs to log server]
2026-03-18 13:49:20.426146 | localhost | Output suppressed because no_log was given
2026-03-18 13:49:20.429873 | 
2026-03-18 13:49:20.429938 | LOOP [upload-logs : Compress console log and json output]
2026-03-18 13:49:20.476604 | localhost | skipping: Conditional result was False
2026-03-18 13:49:20.484012 | localhost | skipping: Conditional result was False
2026-03-18 13:49:20.500353 | 
2026-03-18 13:49:20.500543 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-18 13:49:20.647286 | localhost | skipping: Conditional result was False
2026-03-18 13:49:20.647614 | 
2026-03-18 13:49:20.653784 | localhost | skipping: Conditional result was False
2026-03-18 13:49:20.663973 | 
2026-03-18 13:49:20.664143 | LOOP [upload-logs : Upload console log and json output]