2026-04-13 20:56:54.090058 | Job console starting 2026-04-13 20:56:54.128613 | Updating git repos 2026-04-13 20:56:54.327926 | Cloning repos into workspace 2026-04-13 20:56:54.989410 | Restoring repo states 2026-04-13 20:56:55.021681 | Merging changes 2026-04-13 20:57:01.389364 | Checking out repos 2026-04-13 20:57:01.740103 | Preparing playbooks 2026-04-13 20:57:15.790974 | Running Ansible setup 2026-04-13 20:57:20.462343 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-13 20:57:21.197440 | 2026-04-13 20:57:21.197590 | PLAY [localhost] 2026-04-13 20:57:21.206429 | 2026-04-13 20:57:21.206543 | TASK [Gathering Facts] 2026-04-13 20:57:22.269773 | localhost | ok 2026-04-13 20:57:22.285043 | 2026-04-13 20:57:22.285578 | TASK [Setup log path fact] 2026-04-13 20:57:22.310001 | localhost | ok 2026-04-13 20:57:22.326035 | 2026-04-13 20:57:22.326330 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-13 20:57:22.359622 | localhost | ok 2026-04-13 20:57:22.372120 | 2026-04-13 20:57:22.372231 | TASK [emit-job-header : Print job information] 2026-04-13 20:57:22.407246 | # Job Information 2026-04-13 20:57:22.407571 | Ansible Version: 2.16.16 2026-04-13 20:57:22.407616 | Job: atmosphere-molecule-csi-local-path-provisioner 2026-04-13 20:57:22.407642 | Pipeline: check 2026-04-13 20:57:22.407663 | Executor: 0a8996d2b663 2026-04-13 20:57:22.407684 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3818 2026-04-13 20:57:22.407706 | Event ID: 339c6a70-377b-11f1-98fb-da2a05131e59 2026-04-13 20:57:22.411381 | 2026-04-13 20:57:22.411720 | LOOP [emit-job-header : Print node information] 2026-04-13 20:57:22.511160 | localhost | ok: 2026-04-13 20:57:22.511447 | localhost | # Node Information 2026-04-13 20:57:22.511485 | localhost | Inventory Hostname: instance 2026-04-13 20:57:22.511510 | localhost | Hostname: np0000165808 2026-04-13 20:57:22.511532 | localhost | Username: zuul 2026-04-13 20:57:22.511565 | localhost | Distro: Ubuntu 22.04 2026-04-13 20:57:22.511592 | localhost | Provider: yul1 2026-04-13 20:57:22.511614 | localhost | Region: ca-ymq-1 2026-04-13 20:57:22.511634 | localhost | Label: ubuntu-jammy 2026-04-13 20:57:22.511654 | localhost | Product Name: OpenStack Nova 2026-04-13 20:57:22.511678 | localhost | Interface IP: 199.19.213.111 2026-04-13 20:57:22.521107 | 2026-04-13 20:57:22.521277 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-13 20:57:23.183197 | localhost -> localhost | changed 2026-04-13 20:57:23.192653 | 2026-04-13 20:57:23.192812 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-13 20:57:24.473506 | localhost -> localhost | changed 2026-04-13 20:57:24.484669 | 2026-04-13 20:57:24.484789 | PLAY [all] 2026-04-13 20:57:24.495434 | 2026-04-13 20:57:24.495536 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-13 20:57:25.106743 | instance -> localhost | ok 2026-04-13 20:57:25.119411 | 2026-04-13 20:57:25.119561 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-13 20:57:25.148131 | instance | ok 2026-04-13 20:57:25.164758 | instance | included: /var/lib/zuul/builds/08bbf52b4f0b4fdaa6c5a3b6c883e58f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-13 20:57:25.170790 | 2026-04-13 20:57:25.170854 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-13 20:57:26.351732 | instance -> localhost | Generating public/private rsa key pair. 2026-04-13 20:57:26.351888 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/08bbf52b4f0b4fdaa6c5a3b6c883e58f/work/08bbf52b4f0b4fdaa6c5a3b6c883e58f_id_rsa 2026-04-13 20:57:26.351920 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/08bbf52b4f0b4fdaa6c5a3b6c883e58f/work/08bbf52b4f0b4fdaa6c5a3b6c883e58f_id_rsa.pub 2026-04-13 20:57:26.351943 | instance -> localhost | The key fingerprint is: 2026-04-13 20:57:26.351966 | instance -> localhost | SHA256:hhowko6u8jL5Fi3ymIDGuMMrptn4fMTgTZPEmTF9q64 zuul-build-sshkey 2026-04-13 20:57:26.352000 | instance -> localhost | The key's randomart image is: 2026-04-13 20:57:26.352023 | instance -> localhost | +---[RSA 3072]----+ 2026-04-13 20:57:26.352052 | instance -> localhost | | .o= | 2026-04-13 20:57:26.352075 | instance -> localhost | | . =.. . | 2026-04-13 20:57:26.352097 | instance -> localhost | |o o. . . . | 2026-04-13 20:57:26.352119 | instance -> localhost | |o..o+ .. | 2026-04-13 20:57:26.352145 | instance -> localhost | |=o *....S | 2026-04-13 20:57:26.352169 | instance -> localhost | |*o+ =o.. | 2026-04-13 20:57:26.352191 | instance -> localhost | |+O +.. | 2026-04-13 20:57:26.352212 | instance -> localhost | |%Bo . . | 2026-04-13 20:57:26.352237 | instance -> localhost | |XXB.E. | 2026-04-13 20:57:26.352259 | instance -> localhost | +----[SHA256]-----+ 2026-04-13 20:57:26.352307 | instance -> localhost | ok: Runtime: 0:00:00.717564 2026-04-13 20:57:26.361327 | 2026-04-13 20:57:26.361427 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-13 20:57:26.393200 | instance | ok 2026-04-13 20:57:26.405442 | instance | included: /var/lib/zuul/builds/08bbf52b4f0b4fdaa6c5a3b6c883e58f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-13 20:57:26.413279 | 2026-04-13 20:57:26.413358 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-13 20:57:26.437410 | instance | skipping: Conditional result was False 2026-04-13 20:57:26.447781 | 2026-04-13 20:57:26.447923 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-13 20:57:26.885987 | instance | changed 2026-04-13 20:57:26.896763 | 2026-04-13 20:57:26.896949 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-13 20:57:27.080949 | instance | ok 2026-04-13 20:57:27.086149 | 2026-04-13 20:57:27.086212 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-13 20:57:27.544210 | instance | changed 2026-04-13 20:57:27.552790 | 2026-04-13 20:57:27.552943 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-13 20:57:28.018569 | instance | changed 2026-04-13 20:57:28.026404 | 2026-04-13 20:57:28.026558 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-13 20:57:28.050848 | instance | skipping: Conditional result was False 2026-04-13 20:57:28.060094 | 2026-04-13 20:57:28.060262 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-13 20:57:28.450506 | instance -> localhost | changed 2026-04-13 20:57:28.465542 | 2026-04-13 20:57:28.465694 | TASK [add-build-sshkey : Add back temp key] 2026-04-13 20:57:28.792114 | instance -> localhost | Identity added: /var/lib/zuul/builds/08bbf52b4f0b4fdaa6c5a3b6c883e58f/work/08bbf52b4f0b4fdaa6c5a3b6c883e58f_id_rsa (zuul-build-sshkey) 2026-04-13 20:57:28.792374 | instance -> localhost | ok: Runtime: 0:00:00.015755 2026-04-13 20:57:28.801244 | 2026-04-13 20:57:28.801362 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-13 20:57:29.170113 | instance | ok 2026-04-13 20:57:29.205075 | 2026-04-13 20:57:29.205211 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-13 20:57:29.230186 | instance | skipping: Conditional result was False 2026-04-13 20:57:29.245967 | 2026-04-13 20:57:29.246104 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-13 20:57:29.593076 | instance | ok 2026-04-13 20:57:29.602702 | 2026-04-13 20:57:29.602803 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-13 20:57:31.652920 | instance | Output suppressed because no_log was given 2026-04-13 20:57:31.673296 | 2026-04-13 20:57:31.673408 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-13 20:57:31.855182 | instance | ok: "logs" 2026-04-13 20:57:31.855450 | instance | ok: All items complete 2026-04-13 20:57:31.855490 | 2026-04-13 20:57:32.036357 | instance | ok: "artifacts" 2026-04-13 20:57:32.165489 | instance | ok: "docs" 2026-04-13 20:57:32.191050 | 2026-04-13 20:57:32.191180 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-13 20:57:32.387309 | instance | changed: "logs" 2026-04-13 20:57:32.535176 | instance | changed: "artifacts" 2026-04-13 20:57:32.692046 | instance | changed: "docs" 2026-04-13 20:57:32.721226 | 2026-04-13 20:57:32.721399 | PLAY RECAP 2026-04-13 20:57:32.721527 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-13 20:57:32.721576 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-13 20:57:32.721610 | 2026-04-13 20:57:32.876667 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-13 20:57:32.879306 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-13 20:57:33.578466 | 2026-04-13 20:57:33.578656 | PLAY [all] 2026-04-13 20:57:33.598312 | 2026-04-13 20:57:33.598566 | TASK [setup-uv : Extract archive] 2026-04-13 20:57:35.902826 | instance | changed 2026-04-13 20:57:35.914292 | 2026-04-13 20:57:35.914426 | TASK [setup-uv : Print version] 2026-04-13 20:57:36.318120 | instance | uv 0.8.13 2026-04-13 20:57:36.483706 | instance | ok: Runtime: 0:00:00.013435 2026-04-13 20:57:36.492811 | 2026-04-13 20:57:36.492922 | PLAY RECAP 2026-04-13 20:57:36.493011 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-13 20:57:36.493055 | 2026-04-13 20:57:36.665324 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-13 20:57:36.669010 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-13 20:57:37.407632 | 2026-04-13 20:57:37.407799 | PLAY [all] 2026-04-13 20:57:37.421968 | 2026-04-13 20:57:37.422125 | TASK [Install "jq" for log collection] 2026-04-13 20:57:47.267577 | instance | changed 2026-04-13 20:57:47.282759 | 2026-04-13 20:57:47.282924 | TASK [Install pip3 for Python package management] 2026-04-13 20:57:51.672849 | instance | changed 2026-04-13 20:57:51.679458 | 2026-04-13 20:57:51.679565 | TASK [Install Python "kubernetes" library for kubernetes.core modules] 2026-04-13 20:57:54.980433 | instance | changed 2026-04-13 20:57:55.268435 | 2026-04-13 20:57:55.268597 | PLAY [all] 2026-04-13 20:57:55.282045 | 2026-04-13 20:57:55.282214 | TASK [ensure-go : Check installed go version] 2026-04-13 20:57:55.815606 | instance | ok: ERROR (ignored) 2026-04-13 20:57:55.815907 | instance | { 2026-04-13 20:57:55.815961 | instance | "failed_when_result": false, 2026-04-13 20:57:55.815998 | instance | "msg": "[Errno 2] No such file or directory: b'go'", 2026-04-13 20:57:55.816035 | instance | "rc": 2 2026-04-13 20:57:55.816072 | instance | } 2026-04-13 20:57:55.825733 | 2026-04-13 20:57:55.825910 | TASK [ensure-go : Skip if correct version of go is installed] 2026-04-13 20:57:55.877206 | instance | ok 2026-04-13 20:57:55.920983 | instance | included: /var/lib/zuul/builds/08bbf52b4f0b4fdaa6c5a3b6c883e58f/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml 2026-04-13 20:57:55.928351 | 2026-04-13 20:57:55.928452 | TASK [ensure-go : Create temp directory] 2026-04-13 20:57:56.267643 | instance | changed 2026-04-13 20:57:56.273420 | 2026-04-13 20:57:56.273490 | TASK [ensure-go : Get archive checksum] 2026-04-13 20:57:56.920404 | instance | ok: OK (64 bytes) 2026-04-13 20:57:57.168849 | 2026-04-13 20:57:57.169004 | TASK [ensure-go : Download go archive] 2026-04-13 20:57:58.645293 | instance | changed: OK (78559214 bytes) 2026-04-13 20:57:58.653258 | 2026-04-13 20:57:58.653390 | TASK [ensure-go : Install go] 2026-04-13 20:58:04.579088 | instance | changed 2026-04-13 20:58:05.126190 | 2026-04-13 20:58:05.126301 | PLAY [all] 2026-04-13 20:58:05.133605 | 2026-04-13 20:58:05.133724 | TASK [Copy inventory file for Zuul] 2026-04-13 20:58:05.882606 | instance | changed 2026-04-13 20:58:05.888419 | 2026-04-13 20:58:05.888545 | TASK [Switch "ansible_host" to private IP] 2026-04-13 20:58:06.244277 | instance | changed: 1 replacements made 2026-04-13 20:58:06.254058 | 2026-04-13 20:58:06.254215 | TASK [Run molecule prepare] 2026-04-13 20:58:06.512905 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3 2026-04-13 20:58:06.513151 | instance | Creating virtual environment at: .venv 2026-04-13 20:58:06.534886 | instance | Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-13 20:58:06.562793 | instance | Downloading ansible-core (2.1MiB) 2026-04-13 20:58:06.564461 | instance | Downloading kubernetes (1.9MiB) 2026-04-13 20:58:06.564929 | instance | Downloading setuptools (1.1MiB) 2026-04-13 20:58:06.565138 | instance | Downloading netaddr (2.2MiB) 2026-04-13 20:58:06.565415 | instance | Downloading rjsonnet (1.2MiB) 2026-04-13 20:58:06.565641 | instance | Downloading cryptography (4.2MiB) 2026-04-13 20:58:06.565898 | instance | Downloading pydantic-core (2.0MiB) 2026-04-13 20:58:06.566417 | instance | Downloading pygments (1.2MiB) 2026-04-13 20:58:06.566652 | instance | Downloading openstacksdk (1.7MiB) 2026-04-13 20:58:06.853450 | instance | Building pyperclip==1.9.0 2026-04-13 20:58:06.885676 | instance | Downloading rjsonnet 2026-04-13 20:58:06.964022 | instance | Downloading pygments 2026-04-13 20:58:06.997157 | instance | Downloading setuptools 2026-04-13 20:58:07.812376 | instance | Downloading pydantic-core 2026-04-13 20:58:07.870086 | instance | Downloading netaddr 2026-04-13 20:58:07.881947 | instance | Downloading cryptography 2026-04-13 20:58:07.911828 | instance | Downloading openstacksdk 2026-04-13 20:58:07.920510 | instance | Downloading kubernetes 2026-04-13 20:58:07.953355 | instance | Downloading ansible-core 2026-04-13 20:58:08.436293 | instance | Built pyperclip==1.9.0 2026-04-13 20:58:08.592857 | instance | Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-13 20:58:08.632368 | instance | Installed 83 packages in 36ms 2026-04-13 20:58:09.303194 | instance | WARNING Molecule scenarios should migrate to 'extensions/molecule' 2026-04-13 20:58:09.907243 | instance | INFO [csi > discovery] scenario test matrix: prepare 2026-04-13 20:58:09.907393 | instance | INFO [csi > prerun] Performing prerun with role_name_check=0... 2026-04-13 20:58:46.558866 | instance | INFO [csi > prepare] Executing 2026-04-13 20:58:47.523370 | instance | 2026-04-13 20:58:47.524091 | instance | PLAY [Prepare] ***************************************************************** 2026-04-13 20:58:47.524426 | instance | 2026-04-13 20:58:47.524760 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-13 20:58:47.525095 | instance | Monday 13 April 2026 20:58:47 +0000 (0:00:00.029) 0:00:00.029 ********** 2026-04-13 20:58:48.679954 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-04-13 20:58:48.680029 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-13 20:58:48.680042 | instance | interpreter could change the meaning of that path. See 2026-04-13 20:58:48.680053 | instance | https://docs.ansible.com/ansible- 2026-04-13 20:58:48.680062 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-04-13 20:58:48.688382 | instance | ok: [instance] 2026-04-13 20:58:48.688412 | instance | 2026-04-13 20:58:48.688423 | instance | TASK [Configure short hostname] ************************************************ 2026-04-13 20:58:48.688432 | instance | Monday 13 April 2026 20:58:48 +0000 (0:00:01.165) 0:00:01.195 ********** 2026-04-13 20:58:49.445884 | instance | changed: [instance] 2026-04-13 20:58:49.445981 | instance | 2026-04-13 20:58:49.445992 | instance | TASK [Ensure hostname inside hosts file] *************************************** 2026-04-13 20:58:49.446002 | instance | Monday 13 April 2026 20:58:49 +0000 (0:00:00.755) 0:00:01.950 ********** 2026-04-13 20:58:49.719650 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-04-13 20:58:49.719727 | instance | with a mode of 0700, this may cause issues when running as another user. To 2026-04-13 20:58:49.719738 | instance | avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-13 20:58:49.731559 | instance | changed: [instance] 2026-04-13 20:58:49.731577 | instance | 2026-04-13 20:58:49.731583 | instance | TASK [Purge "snapd" package] *************************************************** 2026-04-13 20:58:49.731588 | instance | Monday 13 April 2026 20:58:49 +0000 (0:00:00.288) 0:00:02.239 ********** 2026-04-13 20:58:50.650382 | instance | ok: [instance] 2026-04-13 20:58:50.650437 | instance | 2026-04-13 20:58:50.650443 | instance | PLAY [Create devices for Ceph] ************************************************* 2026-04-13 20:58:50.650462 | instance | 2026-04-13 20:58:50.650466 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-13 20:58:50.650471 | instance | Monday 13 April 2026 20:58:50 +0000 (0:00:00.917) 0:00:03.156 ********** 2026-04-13 20:58:51.340515 | instance | ok: [instance] 2026-04-13 20:58:51.340726 | instance | 2026-04-13 20:58:51.340739 | instance | TASK [Install depedencies] ***************************************************** 2026-04-13 20:58:51.340750 | instance | Monday 13 April 2026 20:58:51 +0000 (0:00:00.690) 0:00:03.846 ********** 2026-04-13 20:59:11.231323 | instance | changed: [instance] 2026-04-13 20:59:11.231377 | instance | 2026-04-13 20:59:11.231390 | instance | TASK [Start up service] ******************************************************** 2026-04-13 20:59:11.231676 | instance | Monday 13 April 2026 20:59:11 +0000 (0:00:19.890) 0:00:23.737 ********** 2026-04-13 20:59:11.747380 | instance | ok: [instance] 2026-04-13 20:59:11.747673 | instance | 2026-04-13 20:59:11.747970 | instance | TASK [Generate lvm.conf] ******************************************************* 2026-04-13 20:59:11.748237 | instance | Monday 13 April 2026 20:59:11 +0000 (0:00:00.517) 0:00:24.254 ********** 2026-04-13 20:59:12.051991 | instance | ok: [instance] 2026-04-13 20:59:12.052275 | instance | 2026-04-13 20:59:12.052570 | instance | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-04-13 20:59:12.052852 | instance | Monday 13 April 2026 20:59:12 +0000 (0:00:00.304) 0:00:24.559 ********** 2026-04-13 20:59:12.704441 | instance | changed: [instance] 2026-04-13 20:59:12.704712 | instance | 2026-04-13 20:59:12.705081 | instance | TASK [Get list of all loopback devices] **************************************** 2026-04-13 20:59:12.705400 | instance | Monday 13 April 2026 20:59:12 +0000 (0:00:00.652) 0:00:25.211 ********** 2026-04-13 20:59:12.887371 | instance | ok: [instance] 2026-04-13 20:59:12.887521 | instance | 2026-04-13 20:59:12.887696 | instance | TASK [Fail if there is any existing loopback devices] ************************** 2026-04-13 20:59:12.887863 | instance | Monday 13 April 2026 20:59:12 +0000 (0:00:00.183) 0:00:25.394 ********** 2026-04-13 20:59:12.913730 | instance | skipping: [instance] 2026-04-13 20:59:12.913847 | instance | 2026-04-13 20:59:12.914001 | instance | TASK [Create devices for Ceph] ************************************************* 2026-04-13 20:59:12.914165 | instance | Monday 13 April 2026 20:59:12 +0000 (0:00:00.025) 0:00:25.420 ********** 2026-04-13 20:59:13.450837 | instance | changed: [instance] => (item=osd0) 2026-04-13 20:59:13.450981 | instance | changed: [instance] => (item=osd1) 2026-04-13 20:59:13.451165 | instance | changed: [instance] => (item=osd2) 2026-04-13 20:59:13.451330 | instance | 2026-04-13 20:59:13.451509 | instance | TASK [Set permissions on loopback devices] ************************************* 2026-04-13 20:59:13.451695 | instance | Monday 13 April 2026 20:59:13 +0000 (0:00:00.537) 0:00:25.958 ********** 2026-04-13 20:59:14.076486 | instance | changed: [instance] => (item=osd0) 2026-04-13 20:59:14.076580 | instance | changed: [instance] => (item=osd1) 2026-04-13 20:59:14.076763 | instance | changed: [instance] => (item=osd2) 2026-04-13 20:59:14.076915 | instance | 2026-04-13 20:59:14.077085 | instance | TASK [Start loop devices] ****************************************************** 2026-04-13 20:59:14.077296 | instance | Monday 13 April 2026 20:59:14 +0000 (0:00:00.625) 0:00:26.583 ********** 2026-04-13 20:59:14.788958 | instance | changed: [instance] => (item=osd0) 2026-04-13 20:59:14.789249 | instance | changed: [instance] => (item=osd1) 2026-04-13 20:59:14.789524 | instance | changed: [instance] => (item=osd2) 2026-04-13 20:59:14.789777 | instance | 2026-04-13 20:59:14.790037 | instance | TASK [Create a volume group for each loop device] ****************************** 2026-04-13 20:59:14.790333 | instance | Monday 13 April 2026 20:59:14 +0000 (0:00:00.712) 0:00:27.296 ********** 2026-04-13 20:59:18.019798 | instance | changed: [instance] => (item=osd0) 2026-04-13 20:59:18.019949 | instance | changed: [instance] => (item=osd1) 2026-04-13 20:59:18.020121 | instance | changed: [instance] => (item=osd2) 2026-04-13 20:59:18.020284 | instance | 2026-04-13 20:59:18.020608 | instance | TASK [Create a logical volume for each loop device] **************************** 2026-04-13 20:59:18.020788 | instance | Monday 13 April 2026 20:59:18 +0000 (0:00:03.228) 0:00:30.525 ********** 2026-04-13 20:59:19.851433 | instance | changed: [instance] => (item=ceph-instance-osd0) 2026-04-13 20:59:19.851507 | instance | changed: [instance] => (item=ceph-instance-osd1) 2026-04-13 20:59:19.851514 | instance | changed: [instance] => (item=ceph-instance-osd2) 2026-04-13 20:59:19.853338 | instance | 2026-04-13 20:59:19.853409 | instance | PLAY RECAP ********************************************************************* 2026-04-13 20:59:19.853422 | instance | instance : ok=15 changed=9 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-13 20:59:19.853433 | instance | 2026-04-13 20:59:19.853443 | instance | Monday 13 April 2026 20:59:19 +0000 (0:00:01.833) 0:00:32.358 ********** 2026-04-13 20:59:19.855732 | instance | =============================================================================== 2026-04-13 20:59:19.855782 | instance | Install depedencies ---------------------------------------------------- 19.89s 2026-04-13 20:59:19.855788 | instance | Create a volume group for each loop device ------------------------------ 3.23s 2026-04-13 20:59:19.855793 | instance | Create a logical volume for each loop device ---------------------------- 1.83s 2026-04-13 20:59:19.855797 | instance | Gathering Facts --------------------------------------------------------- 1.17s 2026-04-13 20:59:19.855802 | instance | Purge "snapd" package --------------------------------------------------- 0.92s 2026-04-13 20:59:19.855806 | instance | Configure short hostname ------------------------------------------------ 0.76s 2026-04-13 20:59:19.855810 | instance | Start loop devices ------------------------------------------------------ 0.71s 2026-04-13 20:59:19.855814 | instance | Gathering Facts --------------------------------------------------------- 0.69s 2026-04-13 20:59:19.855818 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.65s 2026-04-13 20:59:19.855823 | instance | Set permissions on loopback devices ------------------------------------- 0.63s 2026-04-13 20:59:19.855826 | instance | Create devices for Ceph ------------------------------------------------- 0.54s 2026-04-13 20:59:19.855830 | instance | Start up service -------------------------------------------------------- 0.52s 2026-04-13 20:59:19.855834 | instance | Generate lvm.conf ------------------------------------------------------- 0.30s 2026-04-13 20:59:19.855838 | instance | Ensure hostname inside hosts file --------------------------------------- 0.29s 2026-04-13 20:59:19.855842 | instance | Get list of all loopback devices ---------------------------------------- 0.18s 2026-04-13 20:59:19.855846 | instance | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-04-13 20:59:19.916954 | instance | INFO [csi > prepare] Executed: Successful 2026-04-13 20:59:19.918142 | instance | INFO Molecule executed 1 scenario (1 successful) 2026-04-13 20:59:20.403358 | instance | ok: Runtime: 0:01:13.535905 2026-04-13 20:59:20.406593 | 2026-04-13 20:59:20.406662 | PLAY RECAP 2026-04-13 20:59:20.406729 | instance | ok: 12 changed: 9 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-13 20:59:20.406787 | 2026-04-13 20:59:20.519427 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-13 20:59:20.523180 | RUN START: [untrusted : github.com/vexxhost/atmosphere/molecule/csi/converge.yml@main] 2026-04-13 20:59:21.161792 | 2026-04-13 20:59:21.161979 | PLAY [all] 2026-04-13 20:59:21.178438 | 2026-04-13 20:59:21.178629 | TASK [Build atmosphere binary] 2026-04-13 20:59:21.659494 | instance -> localhost | ERROR 2026-04-13 20:59:21.659789 | instance -> localhost | { 2026-04-13 20:59:21.659859 | instance -> localhost | "msg": "[Errno 2] No such file or directory: b'go'", 2026-04-13 20:59:21.659918 | instance -> localhost | "rc": 2 2026-04-13 20:59:21.659998 | instance -> localhost | } failure 2026-04-13 20:59:21.661985 | 2026-04-13 20:59:21.662072 | PLAY RECAP 2026-04-13 20:59:21.662171 | instance | ok: 0 changed: 0 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-04-13 20:59:21.662257 | 2026-04-13 20:59:21.778093 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/molecule/csi/converge.yml@main] 2026-04-13 20:59:21.780197 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-13 20:59:22.633056 | 2026-04-13 20:59:22.633285 | PLAY [all] 2026-04-13 20:59:22.653502 | 2026-04-13 20:59:22.653748 | TASK [gather-host-logs : creating directory for system status] 2026-04-13 20:59:23.017407 | instance | changed 2026-04-13 20:59:23.029143 | 2026-04-13 20:59:23.029376 | TASK [gather-host-logs : Get logs for each host] 2026-04-13 20:59:23.447476 | instance | + systemd-cgls --full --all --no-pager 2026-04-13 20:59:23.459006 | instance | + ip addr 2026-04-13 20:59:23.461826 | instance | + ip route 2026-04-13 20:59:23.463265 | instance | + lsblk 2026-04-13 20:59:23.468548 | instance | + mount 2026-04-13 20:59:23.471336 | instance | + docker images 2026-04-13 20:59:23.471902 | instance | /bin/bash: line 7: docker: command not found 2026-04-13 20:59:23.472164 | instance | + brctl show 2026-04-13 20:59:23.472581 | instance | /bin/bash: line 8: brctl: command not found 2026-04-13 20:59:23.472770 | instance | + ps aux --sort=-%mem 2026-04-13 20:59:23.485406 | instance | + dpkg -l 2026-04-13 20:59:23.491310 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul)) 2026-04-13 20:59:23.491681 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul 2026-04-13 20:59:23.491699 | instance | /bin/bash: line 11: docker: command not found 2026-04-13 20:59:23.491979 | instance | + '[' '!' -z '' ']' 2026-04-13 20:59:23.572865 | instance | ok: Runtime: 0:00:00.049841 2026-04-13 20:59:23.583064 | 2026-04-13 20:59:23.583295 | TASK [gather-host-logs : Downloads logs to executor] 2026-04-13 20:59:24.250607 | instance | changed: 2026-04-13 20:59:24.250778 | instance | created directory /var/lib/zuul/builds/08bbf52b4f0b4fdaa6c5a3b6c883e58f/work/logs/instance 2026-04-13 20:59:24.250815 | instance | cd+++++++++ system/ 2026-04-13 20:59:24.250838 | instance | >f+++++++++ system/brctl-show.txt 2026-04-13 20:59:24.250858 | instance | >f+++++++++ system/docker-images.txt 2026-04-13 20:59:24.250879 | instance | >f+++++++++ system/ip-addr.txt 2026-04-13 20:59:24.250902 | instance | >f+++++++++ system/ip-route.txt 2026-04-13 20:59:24.250922 | instance | >f+++++++++ system/lsblk.txt 2026-04-13 20:59:24.250942 | instance | >f+++++++++ system/mount.txt 2026-04-13 20:59:24.250973 | instance | >f+++++++++ system/packages.txt 2026-04-13 20:59:24.250993 | instance | >f+++++++++ system/ps.txt 2026-04-13 20:59:24.251012 | instance | >f+++++++++ system/systemd-cgls.txt 2026-04-13 20:59:24.260337 | 2026-04-13 20:59:24.260412 | LOOP [helm-release-status : creating directory for helm release status] 2026-04-13 20:59:24.466207 | instance | changed: "values" 2026-04-13 20:59:24.627656 | instance | changed: "releases" 2026-04-13 20:59:24.645509 | 2026-04-13 20:59:24.645704 | TASK [helm-release-status : Gather get release status for helm charts] 2026-04-13 20:59:24.857550 | instance | /bin/bash: line 3: kubectl: command not found 2026-04-13 20:59:25.193785 | instance | ok: Runtime: 0:00:00.006064 2026-04-13 20:59:25.201958 | 2026-04-13 20:59:25.202119 | TASK [helm-release-status : Downloads logs to executor] 2026-04-13 20:59:25.704796 | instance | changed: 2026-04-13 20:59:25.705012 | instance | cd+++++++++ helm/ 2026-04-13 20:59:25.705053 | instance | cd+++++++++ helm/releases/ 2026-04-13 20:59:25.705083 | instance | cd+++++++++ helm/values/ 2026-04-13 20:59:25.717952 | 2026-04-13 20:59:25.718066 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects] 2026-04-13 20:59:25.915434 | instance | changed 2026-04-13 20:59:25.926698 | 2026-04-13 20:59:25.926889 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects] 2026-04-13 20:59:26.132986 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 20:59:26.133095 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 20:59:26.138628 | instance | environment: line 1: kubectl: command not found 2026-04-13 20:59:26.140021 | instance | xargs: environment: line 1: kubectl: command not found 2026-04-13 20:59:26.140040 | instance | warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:59:26.140965 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:59:26.143853 | instance | environment: line 1: kubectl: command not found 2026-04-13 20:59:26.143976 | instance | environment: line 1: kubectl: command not found 2026-04-13 20:59:26.144819 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:59:26.144871 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:59:26.148183 | instance | environment: line 1: kubectl: command not found 2026-04-13 20:59:26.149077 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:59:26.476615 | instance | ok: Runtime: 0:00:00.024642 2026-04-13 20:59:26.490630 | 2026-04-13 20:59:26.490875 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects] 2026-04-13 20:59:26.686482 | instance | changed 2026-04-13 20:59:26.694668 | 2026-04-13 20:59:26.694861 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects] 2026-04-13 20:59:26.997087 | instance | environment: line 5: kubectl: command not found 2026-04-13 20:59:26.997888 | instance | xargs: xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args valuewarning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 20:59:26.997917 | instance | 2026-04-13 20:59:26.998518 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 20:59:27.314533 | instance | ok: Runtime: 0:00:00.009746 2026-04-13 20:59:27.322811 | 2026-04-13 20:59:27.323113 | TASK [describe-kubernetes-objects : Downloads logs to executor] 2026-04-13 20:59:27.837971 | instance | changed: 2026-04-13 20:59:27.838239 | instance | cd+++++++++ objects/ 2026-04-13 20:59:27.838280 | instance | cd+++++++++ objects/cluster/ 2026-04-13 20:59:27.838312 | instance | cd+++++++++ objects/namespaced/ 2026-04-13 20:59:27.850070 | 2026-04-13 20:59:27.850247 | TASK [gather-pod-logs : creating directory for pod logs] 2026-04-13 20:59:28.042222 | instance | changed 2026-04-13 20:59:28.050755 | 2026-04-13 20:59:28.050926 | TASK [gather-pod-logs : creating directory for failed pod logs] 2026-04-13 20:59:28.260053 | instance | changed 2026-04-13 20:59:28.269799 | 2026-04-13 20:59:28.270043 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)] 2026-04-13 20:59:28.493519 | instance | environment: line 3: kubectl: command not found 2026-04-13 20:59:28.821575 | instance | ok: Runtime: 0:00:00.008285 2026-04-13 20:59:28.826491 | 2026-04-13 20:59:28.826567 | TASK [gather-pod-logs : Downloads pod logs to executor] 2026-04-13 20:59:29.335451 | instance | changed: 2026-04-13 20:59:29.335640 | instance | cd+++++++++ pod-logs/ 2026-04-13 20:59:29.335679 | instance | cd+++++++++ pod-logs/failed-pods/ 2026-04-13 20:59:29.346225 | 2026-04-13 20:59:29.346305 | TASK [gather-prom-metrics : creating directory for helm release descriptions] 2026-04-13 20:59:29.541893 | instance | changed 2026-04-13 20:59:29.550373 | 2026-04-13 20:59:29.550504 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces] 2026-04-13 20:59:29.754648 | instance | /bin/bash: line 2: kubectl: command not found 2026-04-13 20:59:30.090083 | instance | ok: Runtime: 0:00:00.034571 2026-04-13 20:59:30.099451 | 2026-04-13 20:59:30.099576 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr] 2026-04-13 20:59:30.299390 | instance | /bin/bash: line 2: kubectl: command not found 2026-04-13 20:59:30.326525 | instance | ceph-mgr endpoints: 2026-04-13 20:59:30.635429 | instance | ok: Runtime: 0:00:00.033272 2026-04-13 20:59:30.641193 | 2026-04-13 20:59:30.641312 | TASK [gather-prom-metrics : Get metrics from fluentd pods] 2026-04-13 20:59:30.842204 | instance | /bin/bash: line 4: kubectl: command not found 2026-04-13 20:59:31.176426 | instance | ok: Runtime: 0:00:00.033045 2026-04-13 20:59:31.189591 | 2026-04-13 20:59:31.189697 | TASK [gather-prom-metrics : Downloads logs to executor] 2026-04-13 20:59:31.690641 | instance | changed: cd+++++++++ prometheus/ 2026-04-13 20:59:31.703770 | 2026-04-13 20:59:31.703890 | TASK [gather-selenium-data : creating directory for helm release descriptions] 2026-04-13 20:59:31.897636 | instance | changed 2026-04-13 20:59:31.904227 | 2026-04-13 20:59:31.904318 | TASK [gather-selenium-data : Get selenium data] 2026-04-13 20:59:32.120326 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/. 2026-04-13 20:59:32.121860 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory 2026-04-13 20:59:32.436606 | instance | ERROR 2026-04-13 20:59:32.436902 | instance | { 2026-04-13 20:59:32.437014 | instance | "delta": "0:00:00.006206", 2026-04-13 20:59:32.437066 | instance | "end": "2026-04-13 20:59:32.122259", 2026-04-13 20:59:32.437110 | instance | "msg": "non-zero return code", 2026-04-13 20:59:32.437152 | instance | "rc": 1, 2026-04-13 20:59:32.437190 | instance | "start": "2026-04-13 20:59:32.116053" 2026-04-13 20:59:32.437230 | instance | } 2026-04-13 20:59:32.437394 | instance | ERROR: Ignoring Errors 2026-04-13 20:59:32.445591 | 2026-04-13 20:59:32.445716 | TASK [gather-selenium-data : Downloads logs to executor] 2026-04-13 20:59:32.955548 | instance | changed: cd+++++++++ selenium/ 2026-04-13 20:59:32.963529 | 2026-04-13 20:59:32.963598 | PLAY RECAP 2026-04-13 20:59:32.963643 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1 2026-04-13 20:59:32.963666 | 2026-04-13 20:59:33.081728 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-13 20:59:33.086998 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-13 20:59:33.697932 | 2026-04-13 20:59:33.698414 | PLAY [all] 2026-04-13 20:59:33.710532 | 2026-04-13 20:59:33.710613 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-13 20:59:33.755021 | instance | skipping: Conditional result was False 2026-04-13 20:59:33.763906 | 2026-04-13 20:59:33.764025 | TASK [fetch-output : Set log path for single node] 2026-04-13 20:59:33.797149 | instance | ok 2026-04-13 20:59:33.803972 | 2026-04-13 20:59:33.804088 | LOOP [fetch-output : Ensure local output dirs] 2026-04-13 20:59:34.293168 | instance -> localhost | ok: "/var/lib/zuul/builds/08bbf52b4f0b4fdaa6c5a3b6c883e58f/work/logs" 2026-04-13 20:59:34.534239 | instance -> localhost | changed: "/var/lib/zuul/builds/08bbf52b4f0b4fdaa6c5a3b6c883e58f/work/artifacts" 2026-04-13 20:59:34.748800 | instance -> localhost | changed: "/var/lib/zuul/builds/08bbf52b4f0b4fdaa6c5a3b6c883e58f/work/docs" 2026-04-13 20:59:34.767114 | 2026-04-13 20:59:34.767265 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-13 20:59:35.408469 | instance | changed: .d..t...... ./ 2026-04-13 20:59:35.408807 | instance | changed: All items complete 2026-04-13 20:59:35.408850 | 2026-04-13 20:59:35.874907 | instance | changed: .d..t...... ./ 2026-04-13 20:59:36.348689 | instance | changed: .d..t...... ./ 2026-04-13 20:59:36.373893 | 2026-04-13 20:59:36.374024 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-13 20:59:36.789297 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.008848 2026-04-13 20:59:37.035856 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007915 2026-04-13 20:59:37.058023 | 2026-04-13 20:59:37.058135 | PLAY [all] 2026-04-13 20:59:37.063990 | 2026-04-13 20:59:37.064055 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-13 20:59:37.458096 | instance | changed 2026-04-13 20:59:37.466120 | 2026-04-13 20:59:37.466218 | PLAY RECAP 2026-04-13 20:59:37.466265 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-13 20:59:37.466288 | 2026-04-13 20:59:37.579354 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-13 20:59:37.582505 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-13 20:59:38.188810 | 2026-04-13 20:59:38.188981 | PLAY [localhost] 2026-04-13 20:59:38.201452 | 2026-04-13 20:59:38.201576 | TASK [Generate Zuul manifest] 2026-04-13 20:59:38.225976 | localhost | ok 2026-04-13 20:59:38.243762 | 2026-04-13 20:59:38.243901 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-13 20:59:38.609062 | localhost | changed 2026-04-13 20:59:38.623836 | 2026-04-13 20:59:38.624040 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-13 20:59:38.656055 | localhost | ok 2026-04-13 20:59:38.665681 | 2026-04-13 20:59:38.665820 | TASK [Upload logs] 2026-04-13 20:59:38.698668 | localhost | ok 2026-04-13 20:59:38.760635 | 2026-04-13 20:59:38.760754 | TASK [Set zuul-log-path fact] 2026-04-13 20:59:38.782206 | localhost | ok 2026-04-13 20:59:38.794867 | 2026-04-13 20:59:38.794980 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-13 20:59:38.826179 | localhost | ok 2026-04-13 20:59:38.837359 | 2026-04-13 20:59:38.837526 | TASK [upload-logs : Create log directories] 2026-04-13 20:59:39.264306 | localhost | changed 2026-04-13 20:59:39.270800 | 2026-04-13 20:59:39.270928 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-13 20:59:39.756290 | localhost -> localhost | ok: Runtime: 0:00:00.005970 2026-04-13 20:59:39.765897 | 2026-04-13 20:59:39.766067 | TASK [upload-logs : Upload logs to log server] 2026-04-13 20:59:40.243875 | localhost | Output suppressed because no_log was given 2026-04-13 20:59:40.247552 | 2026-04-13 20:59:40.247625 | LOOP [upload-logs : Compress console log and json output] 2026-04-13 20:59:40.297168 | localhost | skipping: Conditional result was False 2026-04-13 20:59:40.307510 | localhost | skipping: Conditional result was False 2026-04-13 20:59:40.321538 | 2026-04-13 20:59:40.321696 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-13 20:59:40.365360 | localhost | skipping: Conditional result was False 2026-04-13 20:59:40.365808 | 2026-04-13 20:59:40.370629 | localhost | skipping: Conditional result was False 2026-04-13 20:59:40.382844 | 2026-04-13 20:59:40.383414 | LOOP [upload-logs : Upload console log and json output]