2026-04-13 03:26:04.839286 | Job console starting
2026-04-13 03:26:04.852210 | Updating git repos
2026-04-13 03:26:04.912675 | Cloning repos into workspace
2026-04-13 03:26:05.226639 | Restoring repo states
2026-04-13 03:26:05.255629 | Merging changes
2026-04-13 03:26:06.886340 | Checking out repos
2026-04-13 03:26:07.457202 | Preparing playbooks
2026-04-13 03:26:21.172896 | Running Ansible setup
2026-04-13 03:26:24.944583 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-13 03:26:25.527972 | 
2026-04-13 03:26:25.528107 | PLAY [localhost]
2026-04-13 03:26:25.536334 | 
2026-04-13 03:26:25.536415 | TASK [Gathering Facts]
2026-04-13 03:26:26.483676 | localhost | ok
2026-04-13 03:26:26.496616 | 
2026-04-13 03:26:26.496693 | TASK [Setup log path fact]
2026-04-13 03:26:26.517955 | localhost | ok
2026-04-13 03:26:26.528418 | 
2026-04-13 03:26:26.528487 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-13 03:26:26.557551 | localhost | ok
2026-04-13 03:26:26.570302 | 
2026-04-13 03:26:26.570394 | TASK [emit-job-header : Print job information]
2026-04-13 03:26:26.622509 | # Job Information
2026-04-13 03:26:26.643987 | Ansible Version: 2.16.16
2026-04-13 03:26:26.644161 | Job: atmosphere-molecule-csi-rbd
2026-04-13 03:26:26.644198 | Pipeline: check
2026-04-13 03:26:26.644230 | Executor: 0a8996d2b663
2026-04-13 03:26:26.644260 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3818
2026-04-13 03:26:26.644296 | Event ID: 6af5c400-36e8-11f1-9a0c-69c921595019
2026-04-13 03:26:26.649208 | 
2026-04-13 03:26:26.649321 | LOOP [emit-job-header : Print node information]
2026-04-13 03:26:26.761268 | localhost | ok:
2026-04-13 03:26:26.762004 | localhost | # Node Information
2026-04-13 03:26:26.762039 | localhost | Inventory Hostname: instance
2026-04-13 03:26:26.762063 | localhost | Hostname: np0000165448
2026-04-13 03:26:26.762087 | localhost | Username: zuul
2026-04-13 03:26:26.762119 | localhost | Distro: Ubuntu 22.04
2026-04-13 03:26:26.762142 | localhost | Provider: yul1
2026-04-13 03:26:26.762163 | localhost | Region: ca-ymq-1
2026-04-13 03:26:26.762183 | localhost | Label: ubuntu-jammy
2026-04-13 03:26:26.762203 | localhost | Product Name: OpenStack Nova
2026-04-13 03:26:26.762223 | localhost | Interface IP: 199.204.45.115
2026-04-13 03:26:26.780147 | 
2026-04-13 03:26:26.846162 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-13 03:26:27.243388 | localhost -> localhost | changed
2026-04-13 03:26:27.250589 | 
2026-04-13 03:26:27.250685 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-13 03:26:28.099040 | localhost -> localhost | changed
2026-04-13 03:26:28.109305 | 
2026-04-13 03:26:28.109668 | PLAY [all]
2026-04-13 03:26:28.118897 | 
2026-04-13 03:26:28.118964 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-13 03:26:28.345264 | instance -> localhost | ok
2026-04-13 03:26:28.351642 | 
2026-04-13 03:26:28.351711 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-13 03:26:28.386343 | instance | ok
2026-04-13 03:26:28.403391 | instance | included: /var/lib/zuul/builds/3fc4e5b37b9442bc9eb66252cba4f16f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-13 03:26:28.409325 | 
2026-04-13 03:26:28.409385 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-13 03:26:29.094275 | instance -> localhost | Generating public/private rsa key pair.
2026-04-13 03:26:29.094762 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/3fc4e5b37b9442bc9eb66252cba4f16f/work/3fc4e5b37b9442bc9eb66252cba4f16f_id_rsa
2026-04-13 03:26:29.094941 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/3fc4e5b37b9442bc9eb66252cba4f16f/work/3fc4e5b37b9442bc9eb66252cba4f16f_id_rsa.pub
2026-04-13 03:26:29.094975 | instance -> localhost | The key fingerprint is:
2026-04-13 03:26:29.095087 | instance -> localhost | SHA256:ts/qGviuqxGg/K1NI4a95RL4etwa9+MJmdDl90pJvAk zuul-build-sshkey
2026-04-13 03:26:29.095130 | instance -> localhost | The key's randomart image is:
2026-04-13 03:26:29.095321 | instance -> localhost | +---[RSA 3072]----+
2026-04-13 03:26:29.095431 | instance -> localhost | |                 |
2026-04-13 03:26:29.095527 | instance -> localhost | |                 |
2026-04-13 03:26:29.095769 | instance -> localhost | |.      .         |
2026-04-13 03:26:29.095842 | instance -> localhost | |o.  . o .        |
2026-04-13 03:26:29.096155 | instance -> localhost | |..o. . ES+       |
2026-04-13 03:26:29.096400 | instance -> localhost | | .+oo.o.+.=      |
2026-04-13 03:26:29.096477 | instance -> localhost | | .+*+X. .= .     |
2026-04-13 03:26:29.096505 | instance -> localhost | |  .*@o+ooo.      |
2026-04-13 03:26:29.096529 | instance -> localhost | | .+==*=*+oo      |
2026-04-13 03:26:29.096550 | instance -> localhost | +----[SHA256]-----+
2026-04-13 03:26:29.096603 | instance -> localhost | ok: Runtime: 0:00:00.189837
2026-04-13 03:26:29.102362 | 
2026-04-13 03:26:29.102428 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-13 03:26:29.134821 | instance | ok
2026-04-13 03:26:29.143453 | instance | included: /var/lib/zuul/builds/3fc4e5b37b9442bc9eb66252cba4f16f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-13 03:26:29.151092 | 
2026-04-13 03:26:29.151162 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-13 03:26:29.176584 | instance | skipping: Conditional result was False
2026-04-13 03:26:29.188460 | 
2026-04-13 03:26:29.188566 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-13 03:26:29.700280 | instance | changed
2026-04-13 03:26:29.705837 | 
2026-04-13 03:26:29.705900 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-13 03:26:29.889505 | instance | ok
2026-04-13 03:26:29.897528 | 
2026-04-13 03:26:29.897599 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-13 03:26:30.369897 | instance | changed
2026-04-13 03:26:30.383037 | 
2026-04-13 03:26:30.383446 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-13 03:26:30.862768 | instance | changed
2026-04-13 03:26:30.868996 | 
2026-04-13 03:26:30.869059 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-13 03:26:30.893162 | instance | skipping: Conditional result was False
2026-04-13 03:26:30.903572 | 
2026-04-13 03:26:30.903661 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-13 03:26:31.271479 | instance -> localhost | changed
2026-04-13 03:26:31.281359 | 
2026-04-13 03:26:31.281425 | TASK [add-build-sshkey : Add back temp key]
2026-04-13 03:26:31.546680 | instance -> localhost | Identity added: /var/lib/zuul/builds/3fc4e5b37b9442bc9eb66252cba4f16f/work/3fc4e5b37b9442bc9eb66252cba4f16f_id_rsa (zuul-build-sshkey)
2026-04-13 03:26:31.546870 | instance -> localhost | ok: Runtime: 0:00:00.012106
2026-04-13 03:26:31.553133 | 
2026-04-13 03:26:31.553197 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-13 03:26:31.862136 | instance | ok
2026-04-13 03:26:31.868268 | 
2026-04-13 03:26:31.868336 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-13 03:26:31.892462 | instance | skipping: Conditional result was False
2026-04-13 03:26:31.909053 | 
2026-04-13 03:26:31.909149 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-13 03:26:32.266338 | instance | ok
2026-04-13 03:26:32.450288 | 
2026-04-13 03:26:32.450440 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-13 03:26:34.091649 | instance | Output suppressed because no_log was given
2026-04-13 03:26:34.104369 | 
2026-04-13 03:26:34.104450 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-13 03:26:34.307732 | instance | ok: "logs"
2026-04-13 03:26:34.308238 | instance | ok: All items complete
2026-04-13 03:26:34.308283 | 
2026-04-13 03:26:34.466846 | instance | ok: "artifacts"
2026-04-13 03:26:34.641508 | instance | ok: "docs"
2026-04-13 03:26:34.660788 | 
2026-04-13 03:26:34.660947 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-13 03:26:34.861942 | instance | changed: "logs"
2026-04-13 03:26:35.024147 | instance | changed: "artifacts"
2026-04-13 03:26:35.201645 | instance | changed: "docs"
2026-04-13 03:26:35.220531 | 
2026-04-13 03:26:35.220636 | PLAY RECAP
2026-04-13 03:26:35.220684 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-13 03:26:35.220714 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:26:35.220737 | 
2026-04-13 03:26:35.330297 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-13 03:26:35.334743 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-13 03:26:35.950810 | 
2026-04-13 03:26:35.950929 | PLAY [all]
2026-04-13 03:26:35.961832 | 
2026-04-13 03:26:35.961906 | TASK [setup-uv : Extract archive]
2026-04-13 03:26:38.298356 | instance | changed
2026-04-13 03:26:38.306075 | 
2026-04-13 03:26:38.306170 | TASK [setup-uv : Print version]
2026-04-13 03:26:38.683465 | instance | uv 0.8.13
2026-04-13 03:26:38.844202 | instance | ok: Runtime: 0:00:00.012968
2026-04-13 03:26:38.853309 | 
2026-04-13 03:26:38.853384 | PLAY RECAP
2026-04-13 03:26:38.853445 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:26:38.853479 | 
2026-04-13 03:26:38.955403 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-13 03:26:38.959823 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-13 03:26:39.596858 | 
2026-04-13 03:26:39.597106 | PLAY [all]
2026-04-13 03:26:39.609688 | 
2026-04-13 03:26:39.609845 | TASK [Install "jq" for log collection]
2026-04-13 03:26:49.951660 | instance | changed
2026-04-13 03:26:49.955380 | 
2026-04-13 03:26:49.955466 | PLAY [all]
2026-04-13 03:26:49.963004 | 
2026-04-13 03:26:49.963095 | TASK [ensure-go : Check installed go version]
2026-04-13 03:26:50.500139 | instance | ok: ERROR (ignored)
2026-04-13 03:26:50.500490 | instance | {
2026-04-13 03:26:50.500530 | instance |   "failed_when_result": false,
2026-04-13 03:26:50.500555 | instance |   "msg": "[Errno 2] No such file or directory: b'go'",
2026-04-13 03:26:50.500577 | instance |   "rc": 2
2026-04-13 03:26:50.500596 | instance | }
2026-04-13 03:26:50.505402 | 
2026-04-13 03:26:50.505471 | TASK [ensure-go : Skip if correct version of go is installed]
2026-04-13 03:26:50.559572 | instance | ok
2026-04-13 03:26:50.569310 | instance | included: /var/lib/zuul/builds/3fc4e5b37b9442bc9eb66252cba4f16f/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml
2026-04-13 03:26:50.574113 | 
2026-04-13 03:26:50.574179 | TASK [ensure-go : Create temp directory]
2026-04-13 03:26:50.883248 | instance | changed
2026-04-13 03:26:50.888821 | 
2026-04-13 03:26:50.888888 | TASK [ensure-go : Get archive checksum]
2026-04-13 03:26:51.511807 | instance | ok: OK (64 bytes)
2026-04-13 03:26:51.517959 | 
2026-04-13 03:26:51.518026 | TASK [ensure-go : Download go archive]
2026-04-13 03:26:52.962244 | instance | changed: OK (78559214 bytes)
2026-04-13 03:26:52.968654 | 
2026-04-13 03:26:52.968720 | TASK [ensure-go : Install go]
2026-04-13 03:26:58.841803 | instance | changed
2026-04-13 03:26:58.853043 | 
2026-04-13 03:26:58.853167 | PLAY RECAP
2026-04-13 03:26:58.853231 | instance | ok: 7 changed: 4 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:26:58.853263 | 
2026-04-13 03:26:58.994363 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-13 03:26:58.999210 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-13 03:26:59.629524 | 
2026-04-13 03:26:59.629674 | PLAY [all]
2026-04-13 03:26:59.641919 | 
2026-04-13 03:26:59.642028 | TASK [Copy inventory file for Zuul]
2026-04-13 03:27:00.472438 | instance | changed
2026-04-13 03:27:00.478020 | 
2026-04-13 03:27:00.478133 | TASK [Switch "ansible_host" to private IP]
2026-04-13 03:27:00.747467 | instance | changed: 1 replacements made
2026-04-13 03:27:00.753920 | 
2026-04-13 03:27:00.754009 | TASK [Run Molecule scenario]
2026-04-13 03:27:01.191310 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-13 03:27:01.191550 | instance | Creating virtual environment at: .venv
2026-04-13 03:27:01.213543 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-13 03:27:01.239674 | instance | Downloading pygments (1.2MiB)
2026-04-13 03:27:01.241293 | instance | Downloading kubernetes (1.9MiB)
2026-04-13 03:27:01.241690 | instance | Downloading openstacksdk (1.7MiB)
2026-04-13 03:27:01.241887 | instance | Downloading cryptography (4.2MiB)
2026-04-13 03:27:01.242305 | instance | Downloading netaddr (2.2MiB)
2026-04-13 03:27:01.243074 | instance | Downloading pydantic-core (2.0MiB)
2026-04-13 03:27:01.243484 | instance | Downloading setuptools (1.1MiB)
2026-04-13 03:27:01.243702 | instance | Downloading rjsonnet (1.2MiB)
2026-04-13 03:27:01.251002 | instance | Downloading ansible-core (2.1MiB)
2026-04-13 03:27:01.586465 | instance |    Building pyperclip==1.9.0
2026-04-13 03:27:01.591676 | instance |  Downloading rjsonnet
2026-04-13 03:27:01.653381 | instance |  Downloading pydantic-core
2026-04-13 03:27:01.704039 | instance |  Downloading netaddr
2026-04-13 03:27:01.726531 | instance |  Downloading cryptography
2026-04-13 03:27:01.749709 | instance |  Downloading pygments
2026-04-13 03:27:01.789427 | instance |  Downloading setuptools
2026-04-13 03:27:01.863130 | instance |  Downloading kubernetes
2026-04-13 03:27:01.878104 | instance |  Downloading ansible-core
2026-04-13 03:27:01.956599 | instance |  Downloading openstacksdk
2026-04-13 03:27:02.360926 | instance |       Built pyperclip==1.9.0
2026-04-13 03:27:02.527251 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-13 03:27:02.566633 | instance | Installed 83 packages in 37ms
2026-04-13 03:27:03.214264 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-13 03:27:03.819203 | instance | INFO     [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-13 03:27:03.819285 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-04-13 03:27:40.768787 | instance | INFO     [csi > dependency] Executing
2026-04-13 03:27:40.769150 | instance | WARNING  [csi > dependency] Missing roles requirements file: requirements.yml
2026-04-13 03:27:40.769542 | instance | WARNING  [csi > dependency] Missing collections requirements file: collections.yml
2026-04-13 03:27:40.769644 | instance | WARNING  [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-04-13 03:27:40.778410 | instance | INFO     [csi > cleanup] Executing
2026-04-13 03:27:40.778787 | instance | WARNING  [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-13 03:27:40.787095 | instance | INFO     [csi > destroy] Executing
2026-04-13 03:27:40.787188 | instance | WARNING  [csi > destroy] Skipping, '--destroy=never' requested.
2026-04-13 03:27:40.787266 | instance | INFO     [csi > destroy] Executed: Successful
2026-04-13 03:27:40.795606 | instance | INFO     [csi > syntax] Executing
2026-04-13 03:27:41.659239 | instance |
2026-04-13 03:27:41.659494 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-13 03:27:41.703842 | instance | INFO     [csi > syntax] Executed: Successful
2026-04-13 03:27:41.715940 | instance | INFO     [csi > create] Executing
2026-04-13 03:27:41.718051 | instance | WARNING  [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-13 03:27:41.726539 | instance | INFO     [csi > prepare] Executing
2026-04-13 03:27:42.509626 | instance |
2026-04-13 03:27:42.509909 | instance | PLAY [Prepare] *****************************************************************
2026-04-13 03:27:42.510172 | instance |
2026-04-13 03:27:42.510489 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:27:42.510861 | instance | Monday 13 April 2026  03:27:42 +0000 (0:00:00.025)       0:00:00.025 **********
2026-04-13 03:27:43.714132 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-13 03:27:43.714522 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-13 03:27:43.714811 | instance | interpreter could change the meaning of that path. See
2026-04-13 03:27:43.715205 | instance | https://docs.ansible.com/ansible-
2026-04-13 03:27:43.715557 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-13 03:27:43.723021 | instance | ok: [instance]
2026-04-13 03:27:43.723309 | instance |
2026-04-13 03:27:43.723625 | instance | TASK [Configure short hostname] ************************************************
2026-04-13 03:27:43.723958 | instance | Monday 13 April 2026  03:27:43 +0000 (0:00:01.213)       0:00:01.239 **********
2026-04-13 03:27:44.421755 | instance | changed: [instance]
2026-04-13 03:27:44.421832 | instance |
2026-04-13 03:27:44.421844 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-13 03:27:44.421854 | instance | Monday 13 April 2026  03:27:44 +0000 (0:00:00.698)       0:00:01.937 **********
2026-04-13 03:27:44.691339 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-13 03:27:44.691504 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-04-13 03:27:44.691693 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-13 03:27:44.699759 | instance | changed: [instance]
2026-04-13 03:27:44.700004 | instance |
2026-04-13 03:27:44.700283 | instance | TASK [Purge "snapd" package] ***************************************************
2026-04-13 03:27:44.700563 | instance | Monday 13 April 2026  03:27:44 +0000 (0:00:00.278)       0:00:02.216 **********
2026-04-13 03:27:45.715283 | instance | ok: [instance]
2026-04-13 03:27:45.715565 | instance |
2026-04-13 03:27:45.716007 | instance | PLAY [Create devices for Ceph] *************************************************
2026-04-13 03:27:45.716428 | instance |
2026-04-13 03:27:45.716738 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:27:45.717120 | instance | Monday 13 April 2026  03:27:45 +0000 (0:00:01.015)       0:00:03.231 **********
2026-04-13 03:27:46.417126 | instance | ok: [instance]
2026-04-13 03:27:46.417437 | instance |
2026-04-13 03:27:46.417910 | instance | TASK [Install depedencies] *****************************************************
2026-04-13 03:27:46.418387 | instance | Monday 13 April 2026  03:27:46 +0000 (0:00:00.701)       0:00:03.932 **********
2026-04-13 03:28:07.474647 | instance | changed: [instance]
2026-04-13 03:28:07.474923 | instance |
2026-04-13 03:28:07.475270 | instance | TASK [Start up service] ********************************************************
2026-04-13 03:28:07.475661 | instance | Monday 13 April 2026  03:28:07 +0000 (0:00:21.057)       0:00:24.990 **********
2026-04-13 03:28:08.046261 | instance | ok: [instance]
2026-04-13 03:28:08.046404 | instance |
2026-04-13 03:28:08.046583 | instance | TASK [Generate lvm.conf] *******************************************************
2026-04-13 03:28:08.046756 | instance | Monday 13 April 2026  03:28:08 +0000 (0:00:00.572)       0:00:25.562 **********
2026-04-13 03:28:08.358324 | instance | ok: [instance]
2026-04-13 03:28:08.358657 | instance |
2026-04-13 03:28:08.358951 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-13 03:28:08.359293 | instance | Monday 13 April 2026  03:28:08 +0000 (0:00:00.311)       0:00:25.874 **********
2026-04-13 03:28:09.014569 | instance | changed: [instance]
2026-04-13 03:28:09.014733 | instance |
2026-04-13 03:28:09.014937 | instance | TASK [Get list of all loopback devices] ****************************************
2026-04-13 03:28:09.015123 | instance | Monday 13 April 2026  03:28:09 +0000 (0:00:00.656)       0:00:26.530 **********
2026-04-13 03:28:09.221732 | instance | ok: [instance]
2026-04-13 03:28:09.221995 | instance |
2026-04-13 03:28:09.222424 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-04-13 03:28:09.222887 | instance | Monday 13 April 2026  03:28:09 +0000 (0:00:00.206)       0:00:26.737 **********
2026-04-13 03:28:09.238244 | instance | skipping: [instance]
2026-04-13 03:28:09.238666 | instance |
2026-04-13 03:28:09.239040 | instance | TASK [Create devices for Ceph] *************************************************
2026-04-13 03:28:09.239394 | instance | Monday 13 April 2026  03:28:09 +0000 (0:00:00.017)       0:00:26.754 **********
2026-04-13 03:28:09.816077 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:09.816354 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:09.816641 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:09.816912 | instance |
2026-04-13 03:28:09.817207 | instance | TASK [Set permissions on loopback devices] *************************************
2026-04-13 03:28:09.817500 | instance | Monday 13 April 2026  03:28:09 +0000 (0:00:00.577)       0:00:27.332 **********
2026-04-13 03:28:10.428316 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:10.428702 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:10.429147 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:10.429564 | instance |
2026-04-13 03:28:10.430012 | instance | TASK [Start loop devices] ******************************************************
2026-04-13 03:28:10.430520 | instance | Monday 13 April 2026  03:28:10 +0000 (0:00:00.611)       0:00:27.944 **********
2026-04-13 03:28:11.121830 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:11.121942 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:11.122229 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:11.122351 | instance |
2026-04-13 03:28:11.122674 | instance | TASK [Create a volume group for each loop device] ******************************
2026-04-13 03:28:11.122847 | instance | Monday 13 April 2026  03:28:11 +0000 (0:00:00.692)       0:00:28.637 **********
2026-04-13 03:28:14.204993 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:14.205325 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:14.205650 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:14.205954 | instance |
2026-04-13 03:28:14.206353 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-04-13 03:28:14.206983 | instance | Monday 13 April 2026  03:28:14 +0000 (0:00:03.082)       0:00:31.719 **********
2026-04-13 03:28:16.157621 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-04-13 03:28:16.157891 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-04-13 03:28:16.158284 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-04-13 03:28:16.158539 | instance |
2026-04-13 03:28:16.158875 | instance | PLAY RECAP *********************************************************************
2026-04-13 03:28:16.159194 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-13 03:28:16.159437 | instance |
2026-04-13 03:28:16.159706 | instance | Monday 13 April 2026  03:28:16 +0000 (0:00:01.954)       0:00:33.674 **********
2026-04-13 03:28:16.159965 | instance | ===============================================================================
2026-04-13 03:28:16.160259 | instance | Install depedencies ---------------------------------------------------- 21.06s
2026-04-13 03:28:16.160504 | instance | Create a volume group for each loop device ------------------------------ 3.08s
2026-04-13 03:28:16.160770 | instance | Create a logical volume for each loop device ---------------------------- 1.95s
2026-04-13 03:28:16.161033 | instance | Gathering Facts --------------------------------------------------------- 1.21s
2026-04-13 03:28:16.161336 | instance | Purge "snapd" package --------------------------------------------------- 1.02s
2026-04-13 03:28:16.161624 | instance | Gathering Facts --------------------------------------------------------- 0.70s
2026-04-13 03:28:16.161898 | instance | Configure short hostname ------------------------------------------------ 0.70s
2026-04-13 03:28:16.162219 | instance | Start loop devices ------------------------------------------------------ 0.69s
2026-04-13 03:28:16.162490 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.66s
2026-04-13 03:28:16.162761 | instance | Set permissions on loopback devices ------------------------------------- 0.61s
2026-04-13 03:28:16.163036 | instance | Create devices for Ceph ------------------------------------------------- 0.58s
2026-04-13 03:28:16.163311 | instance | Start up service -------------------------------------------------------- 0.57s
2026-04-13 03:28:16.163586 | instance | Generate lvm.conf ------------------------------------------------------- 0.31s
2026-04-13 03:28:16.163859 | instance | Ensure hostname inside hosts file --------------------------------------- 0.28s
2026-04-13 03:28:16.164132 | instance | Get list of all loopback devices ---------------------------------------- 0.21s
2026-04-13 03:28:16.164418 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-04-13 03:28:16.226387 | instance | INFO     [csi > prepare] Executed: Successful
2026-04-13 03:28:16.238520 | instance | INFO     [csi > converge] Executing
2026-04-13 03:28:17.016770 | instance |
2026-04-13 03:28:17.016934 | instance | PLAY [Debug CSI driver value] **************************************************
2026-04-13 03:28:17.017224 | instance |
2026-04-13 03:28:17.017501 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:28:17.017816 | instance | Monday 13 April 2026  03:28:17 +0000 (0:00:00.008)       0:00:00.008 **********
2026-04-13 03:28:17.957742 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-13 03:28:17.958026 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-13 03:28:17.958360 | instance | interpreter could change the meaning of that path. See
2026-04-13 03:28:17.958703 | instance | https://docs.ansible.com/ansible-
2026-04-13 03:28:17.958975 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-13 03:28:17.968311 | instance | ok: [instance]
2026-04-13 03:28:17.968557 | instance |
2026-04-13 03:28:17.968823 | instance | TASK [Display CSI driver value and environment variable] ***********************
2026-04-13 03:28:17.969098 | instance | Monday 13 April 2026  03:28:17 +0000 (0:00:00.951)       0:00:00.960 **********
2026-04-13 03:28:18.006482 | instance | ok: [instance] => {
2026-04-13 03:28:18.006821 | instance |     "msg": "csi_driver=rbd, MOLECULE_CSI_DRIVER="
2026-04-13 03:28:18.007113 | instance | }
2026-04-13 03:28:18.007387 | instance |
2026-04-13 03:28:18.007689 | instance | PLAY [localhost] ***************************************************************
2026-04-13 03:28:18.007939 | instance |
2026-04-13 03:28:18.008264 | instance | TASK [Build atmosphere binary] *************************************************
2026-04-13 03:28:18.008568 | instance | Monday 13 April 2026  03:28:18 +0000 (0:00:00.037)       0:00:00.998 **********
2026-04-13 03:28:24.560416 | instance | changed: [localhost]
2026-04-13 03:28:24.560620 | instance |
2026-04-13 03:28:24.560908 | instance | TASK [Deploy with parallel orchestrator (with ceph)] ***************************
2026-04-13 03:28:24.561196 | instance | Monday 13 April 2026  03:28:24 +0000 (0:00:06.553)       0:00:07.552 **********
2026-04-13 03:28:25.199251 | instance | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["/home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/../../bin/atmosphere", "deploy", "--inventory", "/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml", "--playbook-dir", "/home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/../../playbooks", "--tags", "ceph,kubernetes,csi"], "delta": "0:00:00.469791", "end": "2026-04-13 03:28:25.174111", "msg": "non-zero return code", "rc": 1, "start": "2026-04-13 03:28:24.704320", "stderr": "Error: component ceph failed: ansible-playbook failed for ceph: exit status 1\nUsage:\n  atmosphere deploy [flags]\n\nFlags:\n      --concurrency int       Max concurrent deployments per wave (0 = unlimited)\n  -h, --help                  help for deploy\n  -i, --inventory string      Path to Ansible inventory file (required)\n      --playbook-dir string   Directory containing playbook files (default: playbooks)\n  -t, --tags string           Comma-separated list of component tags to deploy\n\ncomponent ceph failed: ansible-playbook failed for ceph: exit status 1", "stderr_lines": ["Error: component ceph failed: ansible-playbook failed for ceph: exit status 1", "Usage:", "  atmosphere deploy [flags]", "", "Flags:", "      --concurrency int       Max concurrent deployments per wave (0 = unlimited)", "  -h, --help                  help for deploy", "  -i, --inventory string      Path to Ansible inventory file (required)", "      --playbook-dir string   Directory containing playbook files (default: playbooks)", "  -t, --tags string           Comma-separated list of component tags to deploy", "", "component ceph failed: ansible-playbook failed for ceph: exit status 1"], "stdout": "==> Multi-tag mode: ceph, kubernetes, csi\n==> Starting parallel deployment (subgraph)\n==> [ceph] Starting deployment\n==> [kubernetes] Starting deployment\n[ceph] ERROR! the role 'defaults' was not found in /home/zuul/src/github.com/vexxhost/atmosphere/playbooks/roles:/home/zuul/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/home/zuul/src/github.com/vexxhost/atmosphere/playbooks\n[ceph] \n[ceph] The error appears to be in '/home/zuul/src/github.com/vexxhost/atmosphere/playbooks/ceph.yml': line 27, column 7, but may\n[ceph] be elsewhere in the file depending on the exact syntax problem.\n[ceph] \n[ceph] The offending line appears to be:\n[ceph] \n[ceph]   roles:\n[ceph]     - role: defaults\n[ceph]       ^ here", "stdout_lines": ["==> Multi-tag mode: ceph, kubernetes, csi", "==> Starting parallel deployment (subgraph)", "==> [ceph] Starting deployment", "==> [kubernetes] Starting deployment", "[ceph] ERROR! the role 'defaults' was not found in /home/zuul/src/github.com/vexxhost/atmosphere/playbooks/roles:/home/zuul/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/home/zuul/src/github.com/vexxhost/atmosphere/playbooks", "[ceph] ", "[ceph] The error appears to be in '/home/zuul/src/github.com/vexxhost/atmosphere/playbooks/ceph.yml': line 27, column 7, but may", "[ceph] be elsewhere in the file depending on the exact syntax problem.", "[ceph] ", "[ceph] The offending line appears to be:", "[ceph] ", "[ceph]   roles:", "[ceph]     - role: defaults", "[ceph]       ^ here"]}
2026-04-13 03:28:25.200430 | instance |
2026-04-13 03:28:25.200917 | instance | PLAY RECAP *********************************************************************
2026-04-13 03:28:25.201230 | instance | instance                   : ok=2    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-04-13 03:28:25.201594 | instance | localhost                  : ok=1    changed=1    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0
2026-04-13 03:28:25.201913 | instance |
2026-04-13 03:28:25.202272 | instance | Monday 13 April 2026  03:28:25 +0000 (0:00:00.640)       0:00:08.193 **********
2026-04-13 03:28:25.202595 | instance | ===============================================================================
2026-04-13 03:28:25.202969 | instance | Build atmosphere binary ------------------------------------------------- 6.55s
2026-04-13 03:28:25.203286 | instance | Gathering Facts --------------------------------------------------------- 0.95s
2026-04-13 03:28:25.203604 | instance | Deploy with parallel orchestrator (with ceph) --------------------------- 0.64s
2026-04-13 03:28:25.203921 | instance | Display CSI driver value and environment variable ----------------------- 0.04s
2026-04-13 03:28:25.267010 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-13 03:28:25.267232 | instance | ERROR    [csi > converge] Executed: Failed
2026-04-13 03:28:25.267420 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-13 03:28:25.429382 | instance | ERROR
2026-04-13 03:28:25.429603 | instance | {
2026-04-13 03:28:25.429666 | instance |   "delta": "0:01:24.214716",
2026-04-13 03:28:25.429720 | instance |   "end": "2026-04-13 03:28:25.348408",
2026-04-13 03:28:25.429755 | instance |   "msg": "non-zero return code",
2026-04-13 03:28:25.429783 | instance |   "rc": 2,
2026-04-13 03:28:25.429816 | instance |   "start": "2026-04-13 03:27:01.133692"
2026-04-13 03:28:25.429841 | instance | }
failure
2026-04-13 03:28:25.433684 | 
2026-04-13 03:28:25.433744 | PLAY RECAP
2026-04-13 03:28:25.433802 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:28:25.433833 | 
2026-04-13 03:28:25.576193 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-13 03:28:25.580515 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-13 03:28:26.145736 | 
2026-04-13 03:28:26.145849 | PLAY [all]
2026-04-13 03:28:26.159384 | 
2026-04-13 03:28:26.159463 | TASK [gather-host-logs : creating directory for system status]
2026-04-13 03:28:26.506130 | instance | changed
2026-04-13 03:28:26.511282 | 
2026-04-13 03:28:26.511357 | TASK [gather-host-logs : Get logs for each host]
2026-04-13 03:28:26.850888 | instance | + systemd-cgls --full --all --no-pager
2026-04-13 03:28:26.864368 | instance | + ip addr
2026-04-13 03:28:26.867137 | instance | + ip route
2026-04-13 03:28:26.868558 | instance | + lsblk
2026-04-13 03:28:26.871048 | instance | + mount
2026-04-13 03:28:26.872295 | instance | + docker images
2026-04-13 03:28:26.872621 | instance | /bin/bash: line 7: docker: command not found
2026-04-13 03:28:26.872789 | instance | + brctl show
2026-04-13 03:28:26.873174 | instance | /bin/bash: line 8: brctl: command not found
2026-04-13 03:28:26.873405 | instance | + ps aux --sort=-%mem
2026-04-13 03:28:26.884825 | instance | + dpkg -l
2026-04-13 03:28:26.893079 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-13 03:28:26.893420 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-13 03:28:26.893446 | instance | /bin/bash: line 11: docker: command not found
2026-04-13 03:28:26.893768 | instance | + '[' '!' -z '' ']'
2026-04-13 03:28:27.040398 | instance | ok: Runtime: 0:00:00.049784
2026-04-13 03:28:27.047930 | 
2026-04-13 03:28:27.048019 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-13 03:28:27.691120 | instance | changed:
2026-04-13 03:28:27.691302 | instance | created directory /var/lib/zuul/builds/3fc4e5b37b9442bc9eb66252cba4f16f/work/logs/instance
2026-04-13 03:28:27.691344 | instance | cd+++++++++ system/
2026-04-13 03:28:27.691387 | instance | >f+++++++++ system/brctl-show.txt
2026-04-13 03:28:27.691420 | instance | >f+++++++++ system/docker-images.txt
2026-04-13 03:28:27.691449 | instance | >f+++++++++ system/ip-addr.txt
2026-04-13 03:28:27.691483 | instance | >f+++++++++ system/ip-route.txt
2026-04-13 03:28:27.691514 | instance | >f+++++++++ system/lsblk.txt
2026-04-13 03:28:27.691544 | instance | >f+++++++++ system/mount.txt
2026-04-13 03:28:27.691577 | instance | >f+++++++++ system/packages.txt
2026-04-13 03:28:27.691607 | instance | >f+++++++++ system/ps.txt
2026-04-13 03:28:27.691635 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-13 03:28:27.702551 | 
2026-04-13 03:28:27.702628 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-13 03:28:27.910629 | instance | changed: "values"
2026-04-13 03:28:28.088904 | instance | changed: "releases"
2026-04-13 03:28:28.105008 | 
2026-04-13 03:28:28.105153 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-13 03:28:28.302938 | instance | /bin/bash: line 3: kubectl: command not found
2026-04-13 03:28:28.642899 | instance | ok: Runtime: 0:00:00.005360
2026-04-13 03:28:28.650314 | 
2026-04-13 03:28:28.650380 | TASK [helm-release-status : Downloads logs to executor]
2026-04-13 03:28:29.137463 | instance | changed:
2026-04-13 03:28:29.137677 | instance | cd+++++++++ helm/
2026-04-13 03:28:29.137722 | instance | cd+++++++++ helm/releases/
2026-04-13 03:28:29.137753 | instance | cd+++++++++ helm/values/
2026-04-13 03:28:29.149549 | 
2026-04-13 03:28:29.149617 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-13 03:28:29.353107 | instance | changed
2026-04-13 03:28:29.359827 | 
2026-04-13 03:28:29.359909 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-13 03:28:29.572741 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:28:29.573274 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:28:29.578637 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:28:29.579577 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:28:29.579606 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:28:29.580421 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:28:29.582412 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:28:29.583205 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:28:29.585357 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:28:29.586147 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:28:29.586792 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:28:29.586974 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:28:29.890241 | instance | ok: Runtime: 0:00:00.021553
2026-04-13 03:28:29.897773 | 
2026-04-13 03:28:29.897941 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-13 03:28:30.094823 | instance | changed
2026-04-13 03:28:30.101803 | 
2026-04-13 03:28:30.101903 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-13 03:28:30.341115 | instance | environment: line 5: kubectl: command not found
2026-04-13 03:28:30.342080 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:28:30.342531 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:28:30.342569 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:28:30.664698 | instance | ok: Runtime: 0:00:00.008825
2026-04-13 03:28:30.672116 | 
2026-04-13 03:28:30.672206 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-13 03:28:31.152662 | instance | changed:
2026-04-13 03:28:31.153036 | instance | cd+++++++++ objects/
2026-04-13 03:28:31.153091 | instance | cd+++++++++ objects/cluster/
2026-04-13 03:28:31.153122 | instance | cd+++++++++ objects/namespaced/
2026-04-13 03:28:31.165562 | 
2026-04-13 03:28:31.165628 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-13 03:28:31.373874 | instance | changed
2026-04-13 03:28:31.384800 | 
2026-04-13 03:28:31.384872 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-13 03:28:31.584263 | instance | changed
2026-04-13 03:28:31.591736 | 
2026-04-13 03:28:31.591868 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-13 03:28:31.835546 | instance | environment: line 3: kubectl: command not found
2026-04-13 03:28:32.127117 | instance | ok: Runtime: 0:00:00.008632
2026-04-13 03:28:32.134620 | 
2026-04-13 03:28:32.134762 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-13 03:28:32.622187 | instance | changed:
2026-04-13 03:28:32.622379 | instance | cd+++++++++ pod-logs/
2026-04-13 03:28:32.622409 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-13 03:28:32.632709 | 
2026-04-13 03:28:32.632777 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-13 03:28:32.828404 | instance | changed
2026-04-13 03:28:32.834883 | 
2026-04-13 03:28:32.834957 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-13 03:28:33.044148 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-13 03:28:33.373174 | instance | ok: Runtime: 0:00:00.037902
2026-04-13 03:28:33.380024 | 
2026-04-13 03:28:33.380101 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-13 03:28:33.608997 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-13 03:28:33.639198 | instance | ceph-mgr endpoints:
2026-04-13 03:28:33.917844 | instance | ok: Runtime: 0:00:00.036650
2026-04-13 03:28:33.924609 | 
2026-04-13 03:28:33.924676 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-13 03:28:34.136941 | instance | /bin/bash: line 4: kubectl: command not found
2026-04-13 03:28:34.461648 | instance | ok: Runtime: 0:00:00.036583
2026-04-13 03:28:34.468666 | 
2026-04-13 03:28:34.468754 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-13 03:28:34.976283 | instance | changed: cd+++++++++ prometheus/
2026-04-13 03:28:34.989172 | 
2026-04-13 03:28:34.989261 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-13 03:28:35.204284 | instance | changed
2026-04-13 03:28:35.209709 | 
2026-04-13 03:28:35.209772 | TASK [gather-selenium-data : Get selenium data]
2026-04-13 03:28:35.411188 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-13 03:28:35.413093 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-13 03:28:35.746758 | instance | ERROR
2026-04-13 03:28:35.747030 | instance | {
2026-04-13 03:28:35.747075 | instance |   "delta": "0:00:00.007018",
2026-04-13 03:28:35.747107 | instance |   "end": "2026-04-13 03:28:35.413518",
2026-04-13 03:28:35.747136 | instance |   "msg": "non-zero return code",
2026-04-13 03:28:35.747163 | instance |   "rc": 1,
2026-04-13 03:28:35.747190 | instance |   "start": "2026-04-13 03:28:35.406500"
2026-04-13 03:28:35.747216 | instance | }
2026-04-13 03:28:35.747250 | instance | ERROR: Ignoring Errors
2026-04-13 03:28:35.754297 | 
2026-04-13 03:28:35.754383 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-13 03:28:36.231857 | instance | changed: cd+++++++++ selenium/
2026-04-13 03:28:36.237993 | 
2026-04-13 03:28:36.238070 | PLAY RECAP
2026-04-13 03:28:36.238123 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-13 03:28:36.238174 | 
2026-04-13 03:28:36.375693 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-13 03:28:36.377850 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-13 03:28:37.002596 | 
2026-04-13 03:28:37.002763 | PLAY [all]
2026-04-13 03:28:37.015210 | 
2026-04-13 03:28:37.015289 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-13 03:28:37.060486 | instance | skipping: Conditional result was False
2026-04-13 03:28:37.071855 | 
2026-04-13 03:28:37.071977 | TASK [fetch-output : Set log path for single node]
2026-04-13 03:28:37.131006 | instance | ok
2026-04-13 03:28:37.136934 | 
2026-04-13 03:28:37.137028 | LOOP [fetch-output : Ensure local output dirs]
2026-04-13 03:28:37.553779 | instance -> localhost | ok: "/var/lib/zuul/builds/3fc4e5b37b9442bc9eb66252cba4f16f/work/logs"
2026-04-13 03:28:37.788431 | instance -> localhost | changed: "/var/lib/zuul/builds/3fc4e5b37b9442bc9eb66252cba4f16f/work/artifacts"
2026-04-13 03:28:38.028833 | instance -> localhost | changed: "/var/lib/zuul/builds/3fc4e5b37b9442bc9eb66252cba4f16f/work/docs"
2026-04-13 03:28:38.048553 | 
2026-04-13 03:28:38.048713 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-13 03:28:38.736137 | instance | changed: .d..t...... ./
2026-04-13 03:28:38.736598 | instance | changed: All items complete
2026-04-13 03:28:38.736651 | 
2026-04-13 03:28:39.168841 | instance | changed: .d..t...... ./
2026-04-13 03:28:39.644278 | instance | changed: .d..t...... ./
2026-04-13 03:28:39.662029 | 
2026-04-13 03:28:39.662162 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-13 03:28:40.091901 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.006614
2026-04-13 03:28:40.307793 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.006543
2026-04-13 03:28:40.330692 | 
2026-04-13 03:28:40.330792 | PLAY [all]
2026-04-13 03:28:40.336585 | 
2026-04-13 03:28:40.336654 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-13 03:28:40.775136 | instance | changed
2026-04-13 03:28:40.780530 | 
2026-04-13 03:28:40.780578 | PLAY RECAP
2026-04-13 03:28:40.780656 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-13 03:28:40.780681 | 
2026-04-13 03:28:40.914490 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-13 03:28:40.918625 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-13 03:28:41.542948 | 
2026-04-13 03:28:41.543129 | PLAY [localhost]
2026-04-13 03:28:41.560098 | 
2026-04-13 03:28:41.560286 | TASK [Generate Zuul manifest]
2026-04-13 03:28:41.589799 | localhost | ok
2026-04-13 03:28:41.615128 | 
2026-04-13 03:28:41.615380 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-13 03:28:41.944459 | localhost | changed
2026-04-13 03:28:41.956634 | 
2026-04-13 03:28:41.956724 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-13 03:28:41.990258 | localhost | ok
2026-04-13 03:28:41.997654 | 
2026-04-13 03:28:41.997735 | TASK [Upload logs]
2026-04-13 03:28:42.023093 | localhost | ok
2026-04-13 03:28:42.083091 | 
2026-04-13 03:28:42.083249 | TASK [Set zuul-log-path fact]
2026-04-13 03:28:42.103658 | localhost | ok
2026-04-13 03:28:42.118357 | 
2026-04-13 03:28:42.118442 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-13 03:28:42.153185 | localhost | ok
2026-04-13 03:28:42.162920 | 
2026-04-13 03:28:42.162993 | TASK [upload-logs : Create log directories]
2026-04-13 03:28:42.624511 | localhost | changed
2026-04-13 03:28:42.630621 | 
2026-04-13 03:28:42.630732 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-13 03:28:43.017607 | localhost -> localhost | ok: Runtime: 0:00:00.005625
2026-04-13 03:28:43.024698 | 
2026-04-13 03:28:43.024779 | TASK [upload-logs : Upload logs to log server]
2026-04-13 03:28:43.518069 | localhost | Output suppressed because no_log was given
2026-04-13 03:28:43.522307 | 
2026-04-13 03:28:43.522400 | LOOP [upload-logs : Compress console log and json output]
2026-04-13 03:28:43.575376 | localhost | skipping: Conditional result was False
2026-04-13 03:28:43.584878 | localhost | skipping: Conditional result was False
2026-04-13 03:28:43.598692 | 
2026-04-13 03:28:43.598918 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-13 03:28:43.643113 | localhost | skipping: Conditional result was False
2026-04-13 03:28:43.643509 | 
2026-04-13 03:28:43.647226 | localhost | skipping: Conditional result was False
2026-04-13 03:28:43.665851 | 
2026-04-13 03:28:43.666057 | LOOP [upload-logs : Upload console log and json output]