2026-04-13 03:19:13.338120 | Job console starting
2026-04-13 03:19:13.350154 | Updating git repos
2026-04-13 03:19:13.398495 | Cloning repos into workspace
2026-04-13 03:19:13.464243 | Restoring repo states
2026-04-13 03:19:13.485498 | Merging changes
2026-04-13 03:19:14.319958 | Checking out repos
2026-04-13 03:19:14.462871 | Preparing playbooks
2026-04-13 03:19:17.950410 | Running Ansible setup
2026-04-13 03:19:21.641202 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-13 03:19:22.225419 | 
2026-04-13 03:19:22.225547 | PLAY [localhost]
2026-04-13 03:19:22.233742 | 
2026-04-13 03:19:22.233813 | TASK [Gathering Facts]
2026-04-13 03:19:23.197683 | localhost | ok
2026-04-13 03:19:23.207557 | 
2026-04-13 03:19:23.207642 | TASK [Setup log path fact]
2026-04-13 03:19:23.241165 | localhost | ok
2026-04-13 03:19:23.252540 | 
2026-04-13 03:19:23.252627 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-13 03:19:23.282273 | localhost | ok
2026-04-13 03:19:23.293589 | 
2026-04-13 03:19:23.293656 | TASK [emit-job-header : Print job information]
2026-04-13 03:19:23.334234 | # Job Information
2026-04-13 03:19:23.334485 | Ansible Version: 2.16.16
2026-04-13 03:19:23.334574 | Job: atmosphere-molecule-csi-local-path-provisioner
2026-04-13 03:19:23.334643 | Pipeline: check
2026-04-13 03:19:23.334695 | Executor: 0a8996d2b663
2026-04-13 03:19:23.334737 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3818
2026-04-13 03:19:23.334849 | Event ID: 72d011e0-36e7-11f1-9d04-92185c998148
2026-04-13 03:19:23.338688 | 
2026-04-13 03:19:23.338798 | LOOP [emit-job-header : Print node information]
2026-04-13 03:19:23.436004 | localhost | ok:
2026-04-13 03:19:23.436773 | localhost | # Node Information
2026-04-13 03:19:23.436876 | localhost | Inventory Hostname: instance
2026-04-13 03:19:23.436936 | localhost | Hostname: np0000165442
2026-04-13 03:19:23.437017 | localhost | Username: zuul
2026-04-13 03:19:23.437070 | localhost | Distro: Ubuntu 22.04
2026-04-13 03:19:23.437114 | localhost | Provider: yul1
2026-04-13 03:19:23.437155 | localhost | Region: ca-ymq-1
2026-04-13 03:19:23.437196 | localhost | Label: ubuntu-jammy
2026-04-13 03:19:23.437236 | localhost | Product Name: OpenStack Nova
2026-04-13 03:19:23.437276 | localhost | Interface IP: 162.253.55.110
2026-04-13 03:19:23.456311 | 
2026-04-13 03:19:23.456454 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-13 03:19:23.950713 | localhost -> localhost | changed
2026-04-13 03:19:23.960274 | 
2026-04-13 03:19:23.960521 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-13 03:19:24.864165 | localhost -> localhost | changed
2026-04-13 03:19:24.874836 | 
2026-04-13 03:19:24.874898 | PLAY [all]
2026-04-13 03:19:24.883435 | 
2026-04-13 03:19:24.883501 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-13 03:19:25.141183 | instance -> localhost | ok
2026-04-13 03:19:25.151639 | 
2026-04-13 03:19:25.151806 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-13 03:19:25.189193 | instance | ok
2026-04-13 03:19:25.209276 | instance | included: /var/lib/zuul/builds/5fb21e6bafb84596a5b888197bed555c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-13 03:19:25.216827 | 
2026-04-13 03:19:25.216988 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-13 03:19:26.261871 | instance -> localhost | Generating public/private rsa key pair.
2026-04-13 03:19:26.262054 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/5fb21e6bafb84596a5b888197bed555c/work/5fb21e6bafb84596a5b888197bed555c_id_rsa
2026-04-13 03:19:26.262083 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/5fb21e6bafb84596a5b888197bed555c/work/5fb21e6bafb84596a5b888197bed555c_id_rsa.pub
2026-04-13 03:19:26.262105 | instance -> localhost | The key fingerprint is:
2026-04-13 03:19:26.262126 | instance -> localhost | SHA256:ZdJsCkOQscnpJ8KxFOuCYkyfaKq08xb3DU9KmALYpNQ zuul-build-sshkey
2026-04-13 03:19:26.262159 | instance -> localhost | The key's randomart image is:
2026-04-13 03:19:26.262179 | instance -> localhost | +---[RSA 3072]----+
2026-04-13 03:19:26.262202 | instance -> localhost | |  o o+.          |
2026-04-13 03:19:26.262224 | instance -> localhost | | ..E.=   o       |
2026-04-13 03:19:26.262245 | instance -> localhost | |o=+ = o . *      |
2026-04-13 03:19:26.262266 | instance -> localhost | |*=++.  o *       |
2026-04-13 03:19:26.262285 | instance -> localhost | |+=*oo + S        |
2026-04-13 03:19:26.262304 | instance -> localhost | |=. + * o .       |
2026-04-13 03:19:26.262324 | instance -> localhost | |..  + o *        |
2026-04-13 03:19:26.262343 | instance -> localhost | |o...   o o       |
2026-04-13 03:19:26.262365 | instance -> localhost | |..+.             |
2026-04-13 03:19:26.262385 | instance -> localhost | +----[SHA256]-----+
2026-04-13 03:19:26.262432 | instance -> localhost | ok: Runtime: 0:00:00.629182
2026-04-13 03:19:26.268028 | 
2026-04-13 03:19:26.268117 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-13 03:19:26.305857 | instance | ok
2026-04-13 03:19:26.316568 | instance | included: /var/lib/zuul/builds/5fb21e6bafb84596a5b888197bed555c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-13 03:19:26.324038 | 
2026-04-13 03:19:26.325801 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-13 03:19:26.352401 | instance | skipping: Conditional result was False
2026-04-13 03:19:26.363637 | 
2026-04-13 03:19:26.363767 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-13 03:19:26.818439 | instance | changed
2026-04-13 03:19:26.824587 | 
2026-04-13 03:19:26.824665 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-13 03:19:27.007986 | instance | ok
2026-04-13 03:19:27.013242 | 
2026-04-13 03:19:27.013314 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-13 03:19:27.479417 | instance | changed
2026-04-13 03:19:27.484578 | 
2026-04-13 03:19:27.484649 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-13 03:19:27.957359 | instance | changed
2026-04-13 03:19:27.965379 | 
2026-04-13 03:19:27.965480 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-13 03:19:27.990673 | instance | skipping: Conditional result was False
2026-04-13 03:19:27.999503 | 
2026-04-13 03:19:27.999631 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-13 03:19:28.490852 | instance -> localhost | changed
2026-04-13 03:19:28.504949 | 
2026-04-13 03:19:28.505290 | TASK [add-build-sshkey : Add back temp key]
2026-04-13 03:19:28.825836 | instance -> localhost | Identity added: /var/lib/zuul/builds/5fb21e6bafb84596a5b888197bed555c/work/5fb21e6bafb84596a5b888197bed555c_id_rsa (zuul-build-sshkey)
2026-04-13 03:19:28.826242 | instance -> localhost | ok: Runtime: 0:00:00.014636
2026-04-13 03:19:28.844315 | 
2026-04-13 03:19:28.844496 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-13 03:19:29.139369 | instance | ok
2026-04-13 03:19:29.145629 | 
2026-04-13 03:19:29.145697 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-13 03:19:29.170948 | instance | skipping: Conditional result was False
2026-04-13 03:19:29.187634 | 
2026-04-13 03:19:29.187795 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-13 03:19:29.554734 | instance | ok
2026-04-13 03:19:29.565133 | 
2026-04-13 03:19:29.565208 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-13 03:19:31.266234 | instance | Output suppressed because no_log was given
2026-04-13 03:19:31.275629 | 
2026-04-13 03:19:31.275700 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-13 03:19:31.460002 | instance | ok: "logs"
2026-04-13 03:19:31.460405 | instance | ok: All items complete
2026-04-13 03:19:31.460442 | 
2026-04-13 03:19:31.610032 | instance | ok: "artifacts"
2026-04-13 03:19:31.764901 | instance | ok: "docs"
2026-04-13 03:19:31.782606 | 
2026-04-13 03:19:31.782795 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-13 03:19:31.976790 | instance | changed: "logs"
2026-04-13 03:19:32.127536 | instance | changed: "artifacts"
2026-04-13 03:19:32.284590 | instance | changed: "docs"
2026-04-13 03:19:32.302387 | 
2026-04-13 03:19:32.302546 | PLAY RECAP
2026-04-13 03:19:32.302614 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-13 03:19:32.302655 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:19:32.302687 | 
2026-04-13 03:19:32.423327 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-13 03:19:32.427091 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-13 03:19:33.071484 | 
2026-04-13 03:19:33.071639 | PLAY [all]
2026-04-13 03:19:33.083325 | 
2026-04-13 03:19:33.083406 | TASK [setup-uv : Extract archive]
2026-04-13 03:19:35.350902 | instance | changed
2026-04-13 03:19:35.356537 | 
2026-04-13 03:19:35.356613 | TASK [setup-uv : Print version]
2026-04-13 03:19:34.904035 | instance | uv 0.8.13
2026-04-13 03:19:35.891864 | instance | ok: Runtime: 0:00:00.013527
2026-04-13 03:19:35.899458 | 
2026-04-13 03:19:35.899539 | PLAY RECAP
2026-04-13 03:19:35.899585 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:19:35.899609 | 
2026-04-13 03:19:36.014739 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-13 03:19:36.016803 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-13 03:19:36.568403 | 
2026-04-13 03:19:36.568518 | PLAY [all]
2026-04-13 03:19:36.579596 | 
2026-04-13 03:19:36.579669 | TASK [Install "jq" for log collection]
2026-04-13 03:19:46.113500 | instance | changed
2026-04-13 03:19:46.117817 | 
2026-04-13 03:19:46.117905 | PLAY [all]
2026-04-13 03:19:46.125702 | 
2026-04-13 03:19:46.125807 | TASK [ensure-go : Check installed go version]
2026-04-13 03:19:46.665347 | instance | ok: ERROR (ignored)
2026-04-13 03:19:46.665593 | instance | {
2026-04-13 03:19:46.665625 | instance |   "failed_when_result": false,
2026-04-13 03:19:46.665648 | instance |   "msg": "[Errno 2] No such file or directory: b'go'",
2026-04-13 03:19:46.665668 | instance |   "rc": 2
2026-04-13 03:19:46.665687 | instance | }
2026-04-13 03:19:46.670529 | 
2026-04-13 03:19:46.670598 | TASK [ensure-go : Skip if correct version of go is installed]
2026-04-13 03:19:46.724488 | instance | ok
2026-04-13 03:19:46.735842 | instance | included: /var/lib/zuul/builds/5fb21e6bafb84596a5b888197bed555c/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml
2026-04-13 03:19:46.741035 | 
2026-04-13 03:19:46.741129 | TASK [ensure-go : Create temp directory]
2026-04-13 03:19:47.035708 | instance | changed
2026-04-13 03:19:47.042311 | 
2026-04-13 03:19:47.042388 | TASK [ensure-go : Get archive checksum]
2026-04-13 03:19:47.649917 | instance | ok: OK (64 bytes)
2026-04-13 03:19:47.655210 | 
2026-04-13 03:19:47.655279 | TASK [ensure-go : Download go archive]
2026-04-13 03:19:49.117628 | instance | changed: OK (78559214 bytes)
2026-04-13 03:19:49.124748 | 
2026-04-13 03:19:49.124839 | TASK [ensure-go : Install go]
2026-04-13 03:19:54.867517 | instance | changed
2026-04-13 03:19:54.875824 | 
2026-04-13 03:19:54.875900 | PLAY RECAP
2026-04-13 03:19:54.875961 | instance | ok: 7 changed: 4 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:19:54.875994 | 
2026-04-13 03:19:55.028003 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-13 03:19:55.032114 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-13 03:19:55.666262 | 
2026-04-13 03:19:55.666424 | PLAY [all]
2026-04-13 03:19:55.678164 | 
2026-04-13 03:19:55.678282 | TASK [Copy inventory file for Zuul]
2026-04-13 03:19:56.537901 | instance | changed
2026-04-13 03:19:56.543885 | 
2026-04-13 03:19:56.543991 | TASK [Switch "ansible_host" to private IP]
2026-04-13 03:19:56.834215 | instance | changed: 1 replacements made
2026-04-13 03:19:56.839944 | 
2026-04-13 03:19:56.840025 | TASK [Run Molecule scenario]
2026-04-13 03:19:57.222983 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-13 03:19:57.223175 | instance | Creating virtual environment at: .venv
2026-04-13 03:19:57.250381 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-13 03:19:57.297832 | instance | Downloading setuptools (1.1MiB)
2026-04-13 03:19:57.298190 | instance | Downloading pydantic-core (2.0MiB)
2026-04-13 03:19:57.300696 | instance | Downloading pygments (1.2MiB)
2026-04-13 03:19:57.303096 | instance | Downloading netaddr (2.2MiB)
2026-04-13 03:19:57.303399 | instance | Downloading kubernetes (1.9MiB)
2026-04-13 03:19:57.303664 | instance | Downloading cryptography (4.2MiB)
2026-04-13 03:19:57.303958 | instance | Downloading ansible-core (2.1MiB)
2026-04-13 03:19:57.304744 | instance | Downloading openstacksdk (1.7MiB)
2026-04-13 03:19:57.312610 | instance | Downloading rjsonnet (1.2MiB)
2026-04-13 03:19:57.612810 | instance |    Building pyperclip==1.9.0
2026-04-13 03:19:57.646495 | instance |  Downloading rjsonnet
2026-04-13 03:19:57.728562 | instance |  Downloading pydantic-core
2026-04-13 03:19:57.771233 | instance |  Downloading pygments
2026-04-13 03:19:57.773249 | instance |  Downloading netaddr
2026-04-13 03:19:57.795712 | instance |  Downloading cryptography
2026-04-13 03:19:57.815572 | instance |  Downloading setuptools
2026-04-13 03:19:57.865669 | instance |  Downloading kubernetes
2026-04-13 03:19:57.889135 | instance |  Downloading ansible-core
2026-04-13 03:19:57.914427 | instance |  Downloading openstacksdk
2026-04-13 03:19:58.313693 | instance |       Built pyperclip==1.9.0
2026-04-13 03:19:58.521779 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-13 03:19:58.562466 | instance | Installed 83 packages in 38ms
2026-04-13 03:19:59.223250 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-13 03:19:59.797510 | instance | INFO     [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-13 03:19:59.797592 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-04-13 03:20:39.191485 | instance | INFO     [csi > dependency] Executing
2026-04-13 03:20:39.191679 | instance | WARNING  [csi > dependency] Missing roles requirements file: requirements.yml
2026-04-13 03:20:39.191869 | instance | WARNING  [csi > dependency] Missing collections requirements file: collections.yml
2026-04-13 03:20:39.191928 | instance | WARNING  [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-04-13 03:20:39.199623 | instance | INFO     [csi > cleanup] Executing
2026-04-13 03:20:39.199934 | instance | WARNING  [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-13 03:20:39.207375 | instance | INFO     [csi > destroy] Executing
2026-04-13 03:20:39.207414 | instance | WARNING  [csi > destroy] Skipping, '--destroy=never' requested.
2026-04-13 03:20:39.207471 | instance | INFO     [csi > destroy] Executed: Successful
2026-04-13 03:20:39.215284 | instance | INFO     [csi > syntax] Executing
2026-04-13 03:20:39.984280 | instance |
2026-04-13 03:20:39.984353 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-13 03:20:40.021512 | instance | INFO     [csi > syntax] Executed: Successful
2026-04-13 03:20:40.034238 | instance | INFO     [csi > create] Executing
2026-04-13 03:20:40.036742 | instance | WARNING  [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-13 03:20:40.044679 | instance | INFO     [csi > prepare] Executing
2026-04-13 03:20:40.814462 | instance |
2026-04-13 03:20:40.814676 | instance | PLAY [Prepare] *****************************************************************
2026-04-13 03:20:40.814930 | instance |
2026-04-13 03:20:40.815199 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:20:40.815468 | instance | Monday 13 April 2026  03:20:40 +0000 (0:00:00.026)       0:00:00.026 **********
2026-04-13 03:20:41.979417 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-13 03:20:41.979659 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-13 03:20:41.980063 | instance | interpreter could change the meaning of that path. See
2026-04-13 03:20:41.980345 | instance | https://docs.ansible.com/ansible-
2026-04-13 03:20:41.980623 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-13 03:20:41.987780 | instance | ok: [instance]
2026-04-13 03:20:41.988056 | instance |
2026-04-13 03:20:41.988338 | instance | TASK [Configure short hostname] ************************************************
2026-04-13 03:20:41.988569 | instance | Monday 13 April 2026  03:20:41 +0000 (0:00:01.173)       0:00:01.200 **********
2026-04-13 03:20:42.661623 | instance | changed: [instance]
2026-04-13 03:20:42.661904 | instance |
2026-04-13 03:20:42.662194 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-13 03:20:42.662509 | instance | Monday 13 April 2026  03:20:42 +0000 (0:00:00.673)       0:00:01.874 **********
2026-04-13 03:20:42.951150 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-13 03:20:42.951440 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-04-13 03:20:42.951708 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-13 03:20:42.961205 | instance | changed: [instance]
2026-04-13 03:20:42.961477 | instance |
2026-04-13 03:20:42.961754 | instance | TASK [Purge "snapd" package] ***************************************************
2026-04-13 03:20:42.962020 | instance | Monday 13 April 2026  03:20:42 +0000 (0:00:00.299)       0:00:02.173 **********
2026-04-13 03:20:43.761504 | instance | ok: [instance]
2026-04-13 03:20:43.761581 | instance |
2026-04-13 03:20:43.761595 | instance | PLAY [Create devices for Ceph] *************************************************
2026-04-13 03:20:43.761721 | instance |
2026-04-13 03:20:43.761840 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:20:43.761964 | instance | Monday 13 April 2026  03:20:43 +0000 (0:00:00.800)       0:00:02.973 **********
2026-04-13 03:20:44.451404 | instance | ok: [instance]
2026-04-13 03:20:44.451558 | instance |
2026-04-13 03:20:44.451737 | instance | TASK [Install depedencies] *****************************************************
2026-04-13 03:20:44.451913 | instance | Monday 13 April 2026  03:20:44 +0000 (0:00:00.690)       0:00:03.664 **********
2026-04-13 03:21:05.968453 | instance | changed: [instance]
2026-04-13 03:21:05.968712 | instance |
2026-04-13 03:21:05.968962 | instance | TASK [Start up service] ********************************************************
2026-04-13 03:21:05.969254 | instance | Monday 13 April 2026  03:21:05 +0000 (0:00:21.516)       0:00:25.180 **********
2026-04-13 03:21:06.509751 | instance | ok: [instance]
2026-04-13 03:21:06.510466 | instance |
2026-04-13 03:21:06.510479 | instance | TASK [Generate lvm.conf] *******************************************************
2026-04-13 03:21:06.510490 | instance | Monday 13 April 2026  03:21:06 +0000 (0:00:00.541)       0:00:25.722 **********
2026-04-13 03:21:06.803366 | instance | ok: [instance]
2026-04-13 03:21:06.803630 | instance |
2026-04-13 03:21:06.803952 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-13 03:21:06.804228 | instance | Monday 13 April 2026  03:21:06 +0000 (0:00:00.292)       0:00:26.015 **********
2026-04-13 03:21:07.436586 | instance | changed: [instance]
2026-04-13 03:21:07.436828 | instance |
2026-04-13 03:21:07.437107 | instance | TASK [Get list of all loopback devices] ****************************************
2026-04-13 03:21:07.437383 | instance | Monday 13 April 2026  03:21:07 +0000 (0:00:00.634)       0:00:26.649 **********
2026-04-13 03:21:07.616443 | instance | ok: [instance]
2026-04-13 03:21:07.616693 | instance |
2026-04-13 03:21:07.617049 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-04-13 03:21:07.617354 | instance | Monday 13 April 2026  03:21:07 +0000 (0:00:00.179)       0:00:26.828 **********
2026-04-13 03:21:07.641044 | instance | skipping: [instance]
2026-04-13 03:21:07.641461 | instance |
2026-04-13 03:21:07.641798 | instance | TASK [Create devices for Ceph] *************************************************
2026-04-13 03:21:07.642084 | instance | Monday 13 April 2026  03:21:07 +0000 (0:00:00.024)       0:00:26.852 **********
2026-04-13 03:21:08.173310 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:21:08.173599 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:21:08.173887 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:21:08.174156 | instance |
2026-04-13 03:21:08.174543 | instance | TASK [Set permissions on loopback devices] *************************************
2026-04-13 03:21:08.174865 | instance | Monday 13 April 2026  03:21:08 +0000 (0:00:00.532)       0:00:27.385 **********
2026-04-13 03:21:08.751197 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:21:08.751462 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:21:08.751742 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:21:08.752008 | instance |
2026-04-13 03:21:08.752294 | instance | TASK [Start loop devices] ******************************************************
2026-04-13 03:21:08.752576 | instance | Monday 13 April 2026  03:21:08 +0000 (0:00:00.578)       0:00:27.963 **********
2026-04-13 03:21:09.391164 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:21:09.391414 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:21:09.391682 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:21:09.391932 | instance |
2026-04-13 03:21:09.392199 | instance | TASK [Create a volume group for each loop device] ******************************
2026-04-13 03:21:09.392463 | instance | Monday 13 April 2026  03:21:09 +0000 (0:00:00.640)       0:00:28.603 **********
2026-04-13 03:21:12.529441 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:21:12.529732 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:21:12.530011 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:21:12.530280 | instance |
2026-04-13 03:21:12.530635 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-04-13 03:21:12.530944 | instance | Monday 13 April 2026  03:21:12 +0000 (0:00:03.137)       0:00:31.741 **********
2026-04-13 03:21:14.446783 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-04-13 03:21:14.446850 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-04-13 03:21:14.447041 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-04-13 03:21:14.447085 | instance |
2026-04-13 03:21:14.447223 | instance | PLAY RECAP *********************************************************************
2026-04-13 03:21:14.447371 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-13 03:21:14.447478 | instance |
2026-04-13 03:21:14.447592 | instance | Monday 13 April 2026  03:21:14 +0000 (0:00:01.918)       0:00:33.659 **********
2026-04-13 03:21:14.447769 | instance | ===============================================================================
2026-04-13 03:21:14.447869 | instance | Install depedencies ---------------------------------------------------- 21.52s
2026-04-13 03:21:14.447988 | instance | Create a volume group for each loop device ------------------------------ 3.14s
2026-04-13 03:21:14.448107 | instance | Create a logical volume for each loop device ---------------------------- 1.92s
2026-04-13 03:21:14.448219 | instance | Gathering Facts --------------------------------------------------------- 1.17s
2026-04-13 03:21:14.448342 | instance | Purge "snapd" package --------------------------------------------------- 0.80s
2026-04-13 03:21:14.448460 | instance | Gathering Facts --------------------------------------------------------- 0.69s
2026-04-13 03:21:14.448578 | instance | Configure short hostname ------------------------------------------------ 0.67s
2026-04-13 03:21:14.448688 | instance | Start loop devices ------------------------------------------------------ 0.64s
2026-04-13 03:21:14.448804 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.63s
2026-04-13 03:21:14.448920 | instance | Set permissions on loopback devices ------------------------------------- 0.58s
2026-04-13 03:21:14.449037 | instance | Start up service -------------------------------------------------------- 0.54s
2026-04-13 03:21:14.449153 | instance | Create devices for Ceph ------------------------------------------------- 0.53s
2026-04-13 03:21:14.449270 | instance | Ensure hostname inside hosts file --------------------------------------- 0.30s
2026-04-13 03:21:14.449383 | instance | Generate lvm.conf ------------------------------------------------------- 0.29s
2026-04-13 03:21:14.449500 | instance | Get list of all loopback devices ---------------------------------------- 0.18s
2026-04-13 03:21:14.449618 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-04-13 03:21:14.508739 | instance | INFO     [csi > prepare] Executed: Successful
2026-04-13 03:21:14.521003 | instance | INFO     [csi > converge] Executing
2026-04-13 03:21:15.248233 | instance |
2026-04-13 03:21:15.248525 | instance | PLAY [Debug CSI driver value] **************************************************
2026-04-13 03:21:15.248789 | instance |
2026-04-13 03:21:15.249064 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:21:15.249385 | instance | Monday 13 April 2026  03:21:15 +0000 (0:00:00.007)       0:00:00.007 **********
2026-04-13 03:21:16.144899 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-13 03:21:16.145180 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-13 03:21:16.145480 | instance | interpreter could change the meaning of that path. See
2026-04-13 03:21:16.145776 | instance | https://docs.ansible.com/ansible-
2026-04-13 03:21:16.146073 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-13 03:21:16.155349 | instance | ok: [instance]
2026-04-13 03:21:16.155481 | instance |
2026-04-13 03:21:16.155637 | instance | TASK [Display CSI driver value and environment variable] ***********************
2026-04-13 03:21:16.155804 | instance | Monday 13 April 2026  03:21:16 +0000 (0:00:00.907)       0:00:00.915 **********
2026-04-13 03:21:16.186103 | instance | ok: [instance] => {
2026-04-13 03:21:16.186397 | instance |     "msg": "csi_driver=local-path-provisioner, MOLECULE_CSI_DRIVER="
2026-04-13 03:21:16.186663 | instance | }
2026-04-13 03:21:16.186962 | instance |
2026-04-13 03:21:16.187243 | instance | PLAY [localhost] ***************************************************************
2026-04-13 03:21:16.187477 | instance |
2026-04-13 03:21:16.187790 | instance | TASK [Build atmosphere binary] *************************************************
2026-04-13 03:21:16.188067 | instance | Monday 13 April 2026  03:21:16 +0000 (0:00:00.030)       0:00:00.945 **********
2026-04-13 03:21:22.423977 | instance | changed: [localhost]
2026-04-13 03:21:22.424182 | instance |
2026-04-13 03:21:22.424457 | instance | TASK [Deploy with parallel orchestrator (with ceph)] ***************************
2026-04-13 03:21:22.424739 | instance | Monday 13 April 2026  03:21:22 +0000 (0:00:06.237)       0:00:07.182 **********
2026-04-13 03:21:22.445471 | instance | skipping: [localhost]
2026-04-13 03:21:22.445719 | instance |
2026-04-13 03:21:22.445990 | instance | TASK [Deploy with parallel orchestrator (without ceph)] ************************
2026-04-13 03:21:22.446261 | instance | Monday 13 April 2026  03:21:22 +0000 (0:00:00.022)       0:00:07.205 **********
2026-04-13 03:21:23.082189 | instance | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["/home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/../../bin/atmosphere", "deploy", "--inventory", "/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml", "--playbook-dir", "/home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/../../playbooks", "--tags", "kubernetes,csi"], "delta": "0:00:00.462859", "end": "2026-04-13 03:21:23.061004", "msg": "non-zero return code", "rc": 1, "start": "2026-04-13 03:21:22.598145", "stderr": "Error: component kubernetes failed: ansible-playbook failed for kubernetes: exit status 1\nUsage:\n  atmosphere deploy [flags]\n\nFlags:\n      --concurrency int       Max concurrent deployments per wave (0 = unlimited)\n  -h, --help                  help for deploy\n  -i, --inventory string      Path to Ansible inventory file (required)\n      --playbook-dir string   Directory containing playbook files (default: playbooks)\n  -t, --tags string           Comma-separated list of component tags to deploy\n\ncomponent kubernetes failed: ansible-playbook failed for kubernetes: exit status 1", "stderr_lines": ["Error: component kubernetes failed: ansible-playbook failed for kubernetes: exit status 1", "Usage:", "  atmosphere deploy [flags]", "", "Flags:", "      --concurrency int       Max concurrent deployments per wave (0 = unlimited)", "  -h, --help                  help for deploy", "  -i, --inventory string      Path to Ansible inventory file (required)", "      --playbook-dir string   Directory containing playbook files (default: playbooks)", "  -t, --tags string           Comma-separated list of component tags to deploy", "", "component kubernetes failed: ansible-playbook failed for kubernetes: exit status 1"], "stdout": "==> Multi-tag mode: kubernetes, csi\n==> Starting parallel deployment (subgraph)\n==> [kubernetes] Starting deployment\n[kubernetes] ERROR! the role 'defaults' was not found in /home/zuul/src/github.com/vexxhost/atmosphere/playbooks/roles:/home/zuul/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/home/zuul/src/github.com/vexxhost/atmosphere/playbooks\n[kubernetes] \n[kubernetes] The error appears to be in '/home/zuul/src/github.com/vexxhost/atmosphere/playbooks/kubernetes.yml': line 18, column 7, but may\n[kubernetes] be elsewhere in the file depending on the exact syntax problem.\n[kubernetes] \n[kubernetes] The offending line appears to be:\n[kubernetes] \n[kubernetes]   roles:\n[kubernetes]     - role: defaults\n[kubernetes]       ^ here", "stdout_lines": ["==> Multi-tag mode: kubernetes, csi", "==> Starting parallel deployment (subgraph)", "==> [kubernetes] Starting deployment", "[kubernetes] ERROR! the role 'defaults' was not found in /home/zuul/src/github.com/vexxhost/atmosphere/playbooks/roles:/home/zuul/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/home/zuul/src/github.com/vexxhost/atmosphere/playbooks", "[kubernetes] ", "[kubernetes] The error appears to be in '/home/zuul/src/github.com/vexxhost/atmosphere/playbooks/kubernetes.yml': line 18, column 7, but may", "[kubernetes] be elsewhere in the file depending on the exact syntax problem.", "[kubernetes] ", "[kubernetes] The offending line appears to be:", "[kubernetes] ", "[kubernetes]   roles:", "[kubernetes]     - role: defaults", "[kubernetes]       ^ here"]}
2026-04-13 03:21:23.083046 | instance |
2026-04-13 03:21:23.083309 | instance | PLAY RECAP *********************************************************************
2026-04-13 03:21:23.083794 | instance | instance                   : ok=2    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-04-13 03:21:23.084154 | instance | localhost                  : ok=1    changed=1    unreachable=0    failed=1    skipped=1    rescued=0    ignored=0
2026-04-13 03:21:23.084409 | instance |
2026-04-13 03:21:23.084678 | instance | Monday 13 April 2026  03:21:23 +0000 (0:00:00.638)       0:00:07.843 **********
2026-04-13 03:21:23.084988 | instance | ===============================================================================
2026-04-13 03:21:23.085292 | instance | Build atmosphere binary ------------------------------------------------- 6.24s
2026-04-13 03:21:23.085556 | instance | Gathering Facts --------------------------------------------------------- 0.91s
2026-04-13 03:21:23.085824 | instance | Deploy with parallel orchestrator (without ceph) ------------------------ 0.64s
2026-04-13 03:21:23.086088 | instance | Display CSI driver value and environment variable ----------------------- 0.03s
2026-04-13 03:21:23.086401 | instance | Deploy with parallel orchestrator (with ceph) --------------------------- 0.02s
2026-04-13 03:21:23.144788 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-13 03:21:23.144872 | instance | ERROR    [csi > converge] Executed: Failed
2026-04-13 03:21:23.145011 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-13 03:21:23.491579 | instance | ERROR
2026-04-13 03:21:23.492079 | instance | {
2026-04-13 03:21:23.492122 | instance |   "delta": "0:01:26.061779",
2026-04-13 03:21:23.492150 | instance |   "end": "2026-04-13 03:21:23.224266",
2026-04-13 03:21:23.492176 | instance |   "msg": "non-zero return code",
2026-04-13 03:21:23.492200 | instance |   "rc": 2,
2026-04-13 03:21:23.492228 | instance |   "start": "2026-04-13 03:19:57.162487"
2026-04-13 03:21:23.492252 | instance | }
failure
2026-04-13 03:21:23.496588 | 
2026-04-13 03:21:23.496654 | PLAY RECAP
2026-04-13 03:21:23.496710 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:21:23.496737 | 
2026-04-13 03:21:23.684822 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-13 03:21:23.688971 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-13 03:21:24.378039 | 
2026-04-13 03:21:24.378196 | PLAY [all]
2026-04-13 03:21:24.393744 | 
2026-04-13 03:21:24.393840 | TASK [gather-host-logs : creating directory for system status]
2026-04-13 03:21:24.763859 | instance | changed
2026-04-13 03:21:24.770769 | 
2026-04-13 03:21:24.770856 | TASK [gather-host-logs : Get logs for each host]
2026-04-13 03:21:25.149505 | instance | + systemd-cgls --full --all --no-pager
2026-04-13 03:21:25.162176 | instance | + ip addr
2026-04-13 03:21:25.164704 | instance | + ip route
2026-04-13 03:21:25.166374 | instance | + lsblk
2026-04-13 03:21:25.168910 | instance | + mount
2026-04-13 03:21:25.170244 | instance | + docker images
2026-04-13 03:21:25.170648 | instance | /bin/bash: line 7: docker: command not found
2026-04-13 03:21:25.170868 | instance | + brctl show
2026-04-13 03:21:25.171223 | instance | /bin/bash: line 8: brctl: command not found
2026-04-13 03:21:25.171417 | instance | + ps aux --sort=-%mem
2026-04-13 03:21:25.183116 | instance | + dpkg -l
2026-04-13 03:21:25.189658 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-13 03:21:25.190013 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-13 03:21:25.190042 | instance | /bin/bash: line 11: docker: command not found
2026-04-13 03:21:25.190360 | instance | + '[' '!' -z '' ']'
2026-04-13 03:21:25.311341 | instance | ok: Runtime: 0:00:00.046754
2026-04-13 03:21:25.320109 | 
2026-04-13 03:21:25.320207 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-13 03:21:25.959671 | instance | changed:
2026-04-13 03:21:25.959884 | instance | created directory /var/lib/zuul/builds/5fb21e6bafb84596a5b888197bed555c/work/logs/instance
2026-04-13 03:21:25.959913 | instance | cd+++++++++ system/
2026-04-13 03:21:25.959934 | instance | >f+++++++++ system/brctl-show.txt
2026-04-13 03:21:25.959954 | instance | >f+++++++++ system/docker-images.txt
2026-04-13 03:21:25.959974 | instance | >f+++++++++ system/ip-addr.txt
2026-04-13 03:21:25.959997 | instance | >f+++++++++ system/ip-route.txt
2026-04-13 03:21:25.960017 | instance | >f+++++++++ system/lsblk.txt
2026-04-13 03:21:25.960037 | instance | >f+++++++++ system/mount.txt
2026-04-13 03:21:25.960058 | instance | >f+++++++++ system/packages.txt
2026-04-13 03:21:25.960077 | instance | >f+++++++++ system/ps.txt
2026-04-13 03:21:25.960096 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-13 03:21:25.970109 | 
2026-04-13 03:21:25.970180 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-13 03:21:26.171913 | instance | changed: "values"
2026-04-13 03:21:26.337035 | instance | changed: "releases"
2026-04-13 03:21:26.357474 | 
2026-04-13 03:21:26.357675 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-13 03:21:26.579893 | instance | /bin/bash: line 3: kubectl: command not found
2026-04-13 03:21:26.893907 | instance | ok: Runtime: 0:00:00.007621
2026-04-13 03:21:26.901698 | 
2026-04-13 03:21:26.901803 | TASK [helm-release-status : Downloads logs to executor]
2026-04-13 03:21:27.424427 | instance | changed:
2026-04-13 03:21:27.424665 | instance | cd+++++++++ helm/
2026-04-13 03:21:27.424703 | instance | cd+++++++++ helm/releases/
2026-04-13 03:21:27.424733 | instance | cd+++++++++ helm/values/
2026-04-13 03:21:27.435257 | 
2026-04-13 03:21:27.435338 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-13 03:21:27.644423 | instance | changed
2026-04-13 03:21:27.653418 | 
2026-04-13 03:21:27.653536 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-13 03:21:27.872287 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:21:27.872420 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:21:27.878263 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:21:27.879957 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:21:27.880164 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:21:27.882278 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:21:27.884367 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:21:27.885542 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:21:27.885779 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:21:27.887384 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:21:27.888585 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:21:27.890086 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:21:28.187294 | instance | ok: Runtime: 0:00:00.028053
2026-04-13 03:21:28.194387 | 
2026-04-13 03:21:28.194815 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-13 03:21:28.391297 | instance | changed
2026-04-13 03:21:28.398962 | 
2026-04-13 03:21:28.399101 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-13 03:21:28.650634 | instance | environment: line 5: kubectl: command not found
2026-04-13 03:21:28.651213 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:21:28.651280 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:21:28.651713 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:21:28.982237 | instance | ok: Runtime: 0:00:00.008793
2026-04-13 03:21:28.990579 | 
2026-04-13 03:21:28.990692 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-13 03:21:29.522952 | instance | changed:
2026-04-13 03:21:29.523213 | instance | cd+++++++++ objects/
2026-04-13 03:21:29.523264 | instance | cd+++++++++ objects/cluster/
2026-04-13 03:21:29.523305 | instance | cd+++++++++ objects/namespaced/
2026-04-13 03:21:29.534142 | 
2026-04-13 03:21:29.534274 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-13 03:21:29.739785 | instance | changed
2026-04-13 03:21:29.747388 | 
2026-04-13 03:21:29.747487 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-13 03:21:29.966723 | instance | changed
2026-04-13 03:21:29.971625 | 
2026-04-13 03:21:29.971694 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-13 03:21:30.195971 | instance | environment: line 3: kubectl: command not found
2026-04-13 03:21:30.511079 | instance | ok: Runtime: 0:00:00.008761
2026-04-13 03:21:30.525850 | 
2026-04-13 03:21:30.526022 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-13 03:21:31.004521 | instance | changed:
2026-04-13 03:21:31.004711 | instance | cd+++++++++ pod-logs/
2026-04-13 03:21:31.004748 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-13 03:21:31.017342 | 
2026-04-13 03:21:31.017411 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-13 03:21:31.212913 | instance | changed
2026-04-13 03:21:31.221322 | 
2026-04-13 03:21:31.221392 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-13 03:21:31.413697 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-13 03:21:31.752361 | instance | ok: Runtime: 0:00:00.036299
2026-04-13 03:21:31.759826 | 
2026-04-13 03:21:31.759902 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-13 03:21:31.975609 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-13 03:21:32.002626 | instance | ceph-mgr endpoints:
2026-04-13 03:21:32.300639 | instance | ok: Runtime: 0:00:00.033390
2026-04-13 03:21:32.306680 | 
2026-04-13 03:21:32.306746 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-13 03:21:32.510944 | instance | /bin/bash: line 4: kubectl: command not found
2026-04-13 03:21:32.841671 | instance | ok: Runtime: 0:00:00.034640
2026-04-13 03:21:32.847251 | 
2026-04-13 03:21:32.847329 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-13 03:21:33.346760 | instance | changed: cd+++++++++ prometheus/
2026-04-13 03:21:33.355803 | 
2026-04-13 03:21:33.355919 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-13 03:21:33.564470 | instance | changed
2026-04-13 03:21:33.570284 | 
2026-04-13 03:21:33.570358 | TASK [gather-selenium-data : Get selenium data]
2026-04-13 03:21:33.776457 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-13 03:21:33.777928 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-13 03:21:34.110914 | instance | ERROR
2026-04-13 03:21:34.111246 | instance | {
2026-04-13 03:21:34.111313 | instance |   "delta": "0:00:00.007027",
2026-04-13 03:21:34.111337 | instance |   "end": "2026-04-13 03:21:33.778372",
2026-04-13 03:21:34.111360 | instance |   "msg": "non-zero return code",
2026-04-13 03:21:34.111382 | instance |   "rc": 1,
2026-04-13 03:21:34.111403 | instance |   "start": "2026-04-13 03:21:33.771345"
2026-04-13 03:21:34.111424 | instance | }
2026-04-13 03:21:34.111454 | instance | ERROR: Ignoring Errors
2026-04-13 03:21:34.117404 | 
2026-04-13 03:21:34.117477 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-13 03:21:34.600852 | instance | changed: cd+++++++++ selenium/
2026-04-13 03:21:34.609262 | 
2026-04-13 03:21:34.609343 | PLAY RECAP
2026-04-13 03:21:34.609494 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-13 03:21:34.609529 | 
2026-04-13 03:21:34.791221 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-13 03:21:34.794006 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-13 03:21:35.399643 | 
2026-04-13 03:21:35.399764 | PLAY [all]
2026-04-13 03:21:35.411177 | 
2026-04-13 03:21:35.411252 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-13 03:21:35.446654 | instance | skipping: Conditional result was False
2026-04-13 03:21:35.457655 | 
2026-04-13 03:21:35.457823 | TASK [fetch-output : Set log path for single node]
2026-04-13 03:21:35.501065 | instance | ok
2026-04-13 03:21:35.507590 | 
2026-04-13 03:21:35.507687 | LOOP [fetch-output : Ensure local output dirs]
2026-04-13 03:21:35.893578 | instance -> localhost | ok: "/var/lib/zuul/builds/5fb21e6bafb84596a5b888197bed555c/work/logs"
2026-04-13 03:21:36.096163 | instance -> localhost | changed: "/var/lib/zuul/builds/5fb21e6bafb84596a5b888197bed555c/work/artifacts"
2026-04-13 03:21:36.329273 | instance -> localhost | changed: "/var/lib/zuul/builds/5fb21e6bafb84596a5b888197bed555c/work/docs"
2026-04-13 03:21:36.350412 | 
2026-04-13 03:21:36.350609 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-13 03:21:37.013322 | instance | changed: .d..t...... ./
2026-04-13 03:21:37.013630 | instance | changed: All items complete
2026-04-13 03:21:37.013675 | 
2026-04-13 03:21:37.482522 | instance | changed: .d..t...... ./
2026-04-13 03:21:37.907269 | instance | changed: .d..t...... ./
2026-04-13 03:21:37.930905 | 
2026-04-13 03:21:37.931033 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-13 03:21:38.376324 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.008078
2026-04-13 03:21:38.590833 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007157
2026-04-13 03:21:38.612374 | 
2026-04-13 03:21:38.612522 | PLAY [all]
2026-04-13 03:21:38.621139 | 
2026-04-13 03:21:38.621218 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-13 03:21:39.018659 | instance | changed
2026-04-13 03:21:39.026630 | 
2026-04-13 03:21:39.026699 | PLAY RECAP
2026-04-13 03:21:39.026760 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-13 03:21:39.026789 | 
2026-04-13 03:21:39.141635 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-13 03:21:39.145574 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-13 03:21:39.710250 | 
2026-04-13 03:21:39.710420 | PLAY [localhost]
2026-04-13 03:21:39.724147 | 
2026-04-13 03:21:39.724291 | TASK [Generate Zuul manifest]
2026-04-13 03:21:39.745326 | localhost | ok
2026-04-13 03:21:39.765604 | 
2026-04-13 03:21:39.765795 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-13 03:21:40.103095 | localhost | changed
2026-04-13 03:21:40.119017 | 
2026-04-13 03:21:40.119155 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-13 03:21:40.150555 | localhost | ok
2026-04-13 03:21:40.160040 | 
2026-04-13 03:21:40.160153 | TASK [Upload logs]
2026-04-13 03:21:40.194583 | localhost | ok
2026-04-13 03:21:40.255979 | 
2026-04-13 03:21:40.256113 | TASK [Set zuul-log-path fact]
2026-04-13 03:21:40.276212 | localhost | ok
2026-04-13 03:21:40.290747 | 
2026-04-13 03:21:40.290876 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-13 03:21:40.323800 | localhost | ok
2026-04-13 03:21:40.334585 | 
2026-04-13 03:21:40.334759 | TASK [upload-logs : Create log directories]
2026-04-13 03:21:40.782873 | localhost | changed
2026-04-13 03:21:40.794171 | 
2026-04-13 03:21:40.794259 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-13 03:21:41.223554 | localhost -> localhost | ok: Runtime: 0:00:00.005260
2026-04-13 03:21:41.230670 | 
2026-04-13 03:21:41.230763 | TASK [upload-logs : Upload logs to log server]
2026-04-13 03:21:41.683691 | localhost | Output suppressed because no_log was given
2026-04-13 03:21:41.688849 | 
2026-04-13 03:21:41.688912 | LOOP [upload-logs : Compress console log and json output]
2026-04-13 03:21:41.738316 | localhost | skipping: Conditional result was False
2026-04-13 03:21:41.746511 | localhost | skipping: Conditional result was False
2026-04-13 03:21:41.767026 | 
2026-04-13 03:21:41.767175 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-13 03:21:41.807208 | localhost | skipping: Conditional result was False
2026-04-13 03:21:41.807484 | 
2026-04-13 03:21:41.811530 | localhost | skipping: Conditional result was False
2026-04-13 03:21:41.820405 | 
2026-04-13 03:21:41.820524 | LOOP [upload-logs : Upload console log and json output]