2026-04-23 09:39:30.745094 | Job console starting
2026-04-23 09:39:30.761546 | Updating git repos
2026-04-23 09:39:30.919475 | Cloning repos into workspace
2026-04-23 09:39:32.301895 | Restoring repo states
2026-04-23 09:39:32.376695 | Merging changes
2026-04-23 09:39:39.576585 | Checking out repos
2026-04-23 09:39:40.110307 | Preparing playbooks
2026-04-23 09:40:58.874427 | Running Ansible setup
2026-04-23 09:41:04.993853 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-23 09:41:05.704200 | 
2026-04-23 09:41:05.704388 | PLAY [localhost]
2026-04-23 09:41:05.713832 | 
2026-04-23 09:41:05.713905 | TASK [Gathering Facts]
2026-04-23 09:41:06.870540 | localhost | ok
2026-04-23 09:41:06.886386 | 
2026-04-23 09:41:06.886496 | TASK [Setup log path fact]
2026-04-23 09:41:06.903469 | localhost | ok
2026-04-23 09:41:06.916682 | 
2026-04-23 09:41:06.916795 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-23 09:41:06.948462 | localhost | ok
2026-04-23 09:41:06.955816 | 
2026-04-23 09:41:06.955916 | TASK [emit-job-header : Print job information]
2026-04-23 09:41:07.009258 | # Job Information
2026-04-23 09:41:07.009453 | Ansible Version: 2.16.16
2026-04-23 09:41:07.009488 | Job: atmosphere-molecule-csi-rbd
2026-04-23 09:41:07.009511 | Pipeline: check
2026-04-23 09:41:07.009533 | Executor: 0a8996d2b663
2026-04-23 09:41:07.009555 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3872
2026-04-23 09:41:07.009578 | Event ID: 26892650-3ef8-11f1-8738-3c10401fa363
2026-04-23 09:41:07.013004 | 
2026-04-23 09:41:07.013073 | LOOP [emit-job-header : Print node information]
2026-04-23 09:41:07.835760 | localhost | ok:
2026-04-23 09:41:08.290447 | localhost | # Node Information
2026-04-23 09:41:08.290750 | localhost | Inventory Hostname: instance
2026-04-23 09:41:08.290857 | localhost | Hostname: np0000169732
2026-04-23 09:41:08.290976 | localhost | Username: zuul
2026-04-23 09:41:08.291080 | localhost | Distro: Ubuntu 22.04
2026-04-23 09:41:08.291137 | localhost | Provider: yul1
2026-04-23 09:41:08.291181 | localhost | Region: ca-ymq-1
2026-04-23 09:41:08.291223 | localhost | Label: ubuntu-jammy
2026-04-23 09:41:08.291264 | localhost | Product Name: OpenStack Nova
2026-04-23 09:41:08.291306 | localhost | Interface IP: 199.19.213.138
2026-04-23 09:41:08.311009 | 
2026-04-23 09:41:08.311149 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-23 09:41:08.866588 | localhost -> localhost | changed
2026-04-23 09:41:08.873319 | 
2026-04-23 09:41:08.873446 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-23 09:41:10.245840 | localhost -> localhost | changed
2026-04-23 09:41:10.262983 | 
2026-04-23 09:41:10.263273 | PLAY [all]
2026-04-23 09:41:10.278553 | 
2026-04-23 09:41:10.278699 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-23 09:41:10.589313 | instance -> localhost | ok
2026-04-23 09:41:10.595647 | 
2026-04-23 09:41:10.595723 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-23 09:41:10.626511 | instance | ok
2026-04-23 09:41:10.647337 | instance | included: /var/lib/zuul/builds/bf815acf62154af79a1bb5904a8845db/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-23 09:41:10.653663 | 
2026-04-23 09:41:10.653755 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-23 09:41:11.623422 | instance -> localhost | Generating public/private rsa key pair.
2026-04-23 09:41:11.623968 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/bf815acf62154af79a1bb5904a8845db/work/bf815acf62154af79a1bb5904a8845db_id_rsa
2026-04-23 09:41:11.624004 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/bf815acf62154af79a1bb5904a8845db/work/bf815acf62154af79a1bb5904a8845db_id_rsa.pub
2026-04-23 09:41:11.624028 | instance -> localhost | The key fingerprint is:
2026-04-23 09:41:11.624049 | instance -> localhost | SHA256:I6miW35XwBqwdk2bnx87i2HrtqbfupFQfNbCtUMeql4 zuul-build-sshkey
2026-04-23 09:41:11.624089 | instance -> localhost | The key's randomart image is:
2026-04-23 09:41:11.624110 | instance -> localhost | +---[RSA 3072]----+
2026-04-23 09:41:11.624139 | instance -> localhost | |            +    |
2026-04-23 09:41:11.624161 | instance -> localhost | |  .   .. . * o   |
2026-04-23 09:41:11.624181 | instance -> localhost | |   o + oo * =    |
2026-04-23 09:41:11.624201 | instance -> localhost | |  o o *o + . .   |
2026-04-23 09:41:11.624221 | instance -> localhost | | . . o+oS.E      |
2026-04-23 09:41:11.624241 | instance -> localhost | |    .. +++.      |
2026-04-23 09:41:11.624260 | instance -> localhost | |  o .  .*. o     |
2026-04-23 09:41:11.624280 | instance -> localhost | | + .. ..o*+      |
2026-04-23 09:41:11.624302 | instance -> localhost | |o... ..*O+oo     |
2026-04-23 09:41:11.624322 | instance -> localhost | +----[SHA256]-----+
2026-04-23 09:41:11.624375 | instance -> localhost | ok: Runtime: 0:00:00.518234
2026-04-23 09:41:11.629501 | 
2026-04-23 09:41:11.629564 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-23 09:41:11.679340 | instance | ok
2026-04-23 09:41:11.688536 | instance | included: /var/lib/zuul/builds/bf815acf62154af79a1bb5904a8845db/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-23 09:41:11.697015 | 
2026-04-23 09:41:11.697085 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-23 09:41:11.722870 | instance | skipping: Conditional result was False
2026-04-23 09:41:11.749573 | 
2026-04-23 09:41:11.749726 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-23 09:41:12.402855 | instance | changed
2026-04-23 09:41:12.410679 | 
2026-04-23 09:41:12.410761 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-23 09:41:12.658715 | instance | ok
2026-04-23 09:41:12.667229 | 
2026-04-23 09:41:12.667356 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-23 09:41:13.225033 | instance | changed
2026-04-23 09:41:13.230050 | 
2026-04-23 09:41:13.230121 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-23 09:41:13.739553 | instance | changed
2026-04-23 09:41:13.745096 | 
2026-04-23 09:41:13.745206 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-23 09:41:13.778891 | instance | skipping: Conditional result was False
2026-04-23 09:41:13.789679 | 
2026-04-23 09:41:13.789854 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-23 09:41:14.263547 | instance -> localhost | changed
2026-04-23 09:41:14.279179 | 
2026-04-23 09:41:14.279367 | TASK [add-build-sshkey : Add back temp key]
2026-04-23 09:41:14.606201 | instance -> localhost | Identity added: /var/lib/zuul/builds/bf815acf62154af79a1bb5904a8845db/work/bf815acf62154af79a1bb5904a8845db_id_rsa (zuul-build-sshkey)
2026-04-23 09:41:14.606466 | instance -> localhost | ok: Runtime: 0:00:00.013699
2026-04-23 09:41:14.615951 | 
2026-04-23 09:41:14.616119 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-23 09:41:14.954324 | instance | ok
2026-04-23 09:41:14.962433 | 
2026-04-23 09:41:14.962599 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-23 09:41:14.989524 | instance | skipping: Conditional result was False
2026-04-23 09:41:15.005434 | 
2026-04-23 09:41:15.005637 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-23 09:41:15.380337 | instance | ok
2026-04-23 09:41:15.390302 | 
2026-04-23 09:41:15.390433 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-23 09:41:17.958554 | instance | Output suppressed because no_log was given
2026-04-23 09:41:19.777491 | 
2026-04-23 09:41:19.777648 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-23 09:41:19.973575 | instance | ok: "logs"
2026-04-23 09:41:19.973853 | instance | ok: All items complete
2026-04-23 09:41:19.973882 | 
2026-04-23 09:41:20.149049 | instance | ok: "artifacts"
2026-04-23 09:41:20.311028 | instance | ok: "docs"
2026-04-23 09:41:20.322079 | 
2026-04-23 09:41:20.322259 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-23 09:41:20.508407 | instance | changed: "logs"
2026-04-23 09:41:20.675729 | instance | changed: "artifacts"
2026-04-23 09:41:20.840559 | instance | changed: "docs"
2026-04-23 09:41:20.856505 | 
2026-04-23 09:41:20.856644 | PLAY RECAP
2026-04-23 09:41:20.856697 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-23 09:41:20.856727 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-23 09:41:20.856747 | 
2026-04-23 09:41:20.996393 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-23 09:41:20.998531 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-23 09:41:21.765102 | 
2026-04-23 09:41:21.765270 | PLAY [all]
2026-04-23 09:41:21.778484 | 
2026-04-23 09:41:21.778623 | TASK [setup-uv : Extract archive]
2026-04-23 09:41:24.568855 | instance | changed
2026-04-23 09:41:24.575538 | 
2026-04-23 09:41:24.575645 | TASK [setup-uv : Print version]
2026-04-23 09:41:24.984464 | instance | uv 0.8.13
2026-04-23 09:41:27.400525 | instance | ok: Runtime: 0:00:00.013003
2026-04-23 09:41:27.410337 | 
2026-04-23 09:41:27.410460 | PLAY RECAP
2026-04-23 09:41:27.410512 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-23 09:41:27.410539 | 
2026-04-23 09:41:27.559831 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-23 09:41:27.562232 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-23 09:41:28.212344 | 
2026-04-23 09:41:28.212924 | PLAY [all]
2026-04-23 09:41:28.227313 | 
2026-04-23 09:41:28.227450 | TASK [Install "jq" for log collection]
2026-04-23 09:41:53.636657 | instance | changed
2026-04-23 09:41:53.643437 | 
2026-04-23 09:41:53.643520 | TASK [Install pip3 for Python package management]
2026-04-23 09:42:10.849218 | instance | changed
2026-04-23 09:42:10.858429 | 
2026-04-23 09:42:10.858559 | TASK [Install Python "kubernetes" library for kubernetes.core modules]
2026-04-23 09:42:19.601807 | instance | changed
2026-04-23 09:42:19.606316 | 
2026-04-23 09:42:19.606374 | PLAY [all]
2026-04-23 09:42:19.614941 | 
2026-04-23 09:42:19.615028 | TASK [ensure-go : Check installed go version]
2026-04-23 09:42:20.154572 | instance | ok: ERROR (ignored)
2026-04-23 09:42:20.155025 | instance | {
2026-04-23 09:42:20.155085 | instance |   "failed_when_result": false,
2026-04-23 09:42:20.155120 | instance |   "msg": "[Errno 2] No such file or directory: b'go'",
2026-04-23 09:42:20.155153 | instance |   "rc": 2
2026-04-23 09:42:20.155188 | instance | }
2026-04-23 09:42:20.163097 | 
2026-04-23 09:42:20.163226 | TASK [ensure-go : Skip if correct version of go is installed]
2026-04-23 09:42:20.216743 | instance | ok
2026-04-23 09:42:20.227991 | instance | included: /var/lib/zuul/builds/bf815acf62154af79a1bb5904a8845db/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml
2026-04-23 09:42:20.232946 | 
2026-04-23 09:42:20.233042 | TASK [ensure-go : Create temp directory]
2026-04-23 09:42:20.559868 | instance | changed
2026-04-23 09:42:20.567387 | 
2026-04-23 09:42:20.567502 | TASK [ensure-go : Get archive checksum]
2026-04-23 09:42:21.249836 | instance | ok: OK (64 bytes)
2026-04-23 09:42:22.332908 | 
2026-04-23 09:42:22.333163 | TASK [ensure-go : Download go archive]
2026-04-23 09:42:24.115504 | instance | changed: OK (78559214 bytes)
2026-04-23 09:42:24.121317 | 
2026-04-23 09:42:24.121388 | TASK [ensure-go : Install go]
2026-04-23 09:42:30.273918 | instance | changed
2026-04-23 09:42:30.280698 | 
2026-04-23 09:42:30.280756 | PLAY [all]
2026-04-23 09:42:30.286906 | 
2026-04-23 09:42:30.286966 | TASK [Copy inventory file for Zuul]
2026-04-23 09:42:31.086712 | instance | changed
2026-04-23 09:42:31.160479 | 
2026-04-23 09:42:31.160609 | TASK [Switch "ansible_host" to private IP]
2026-04-23 09:42:31.633780 | instance | changed: 1 replacements made
2026-04-23 09:42:31.640456 | 
2026-04-23 09:42:31.640580 | TASK [Drop "idempotence" from AIO test sequence in check pipeline]
2026-04-23 09:42:31.687457 | instance | skipping: Conditional result was False
2026-04-23 09:42:31.697658 | 
2026-04-23 09:42:31.697746 | TASK [Run molecule prepare]
2026-04-23 09:42:31.977251 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-23 09:42:31.977330 | instance | Creating virtual environment at: .venv
2026-04-23 09:42:32.002147 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-23 09:42:32.026867 | instance | Downloading setuptools (1.1MiB)
2026-04-23 09:42:32.027012 | instance | Downloading ansible-core (2.1MiB)
2026-04-23 09:42:32.027326 | instance | Downloading cryptography (4.2MiB)
2026-04-23 09:42:32.027526 | instance | Downloading kubernetes (1.9MiB)
2026-04-23 09:42:32.027795 | instance | Downloading rjsonnet (1.2MiB)
2026-04-23 09:42:32.028020 | instance | Downloading openstacksdk (1.7MiB)
2026-04-23 09:42:32.028257 | instance | Downloading pydantic-core (2.0MiB)
2026-04-23 09:42:32.028792 | instance | Downloading netaddr (2.2MiB)
2026-04-23 09:42:32.029378 | instance | Downloading pygments (1.2MiB)
2026-04-23 09:42:32.401003 | instance |    Building pyperclip==1.9.0
2026-04-23 09:42:32.404130 | instance |  Downloading rjsonnet
2026-04-23 09:42:32.502320 | instance |  Downloading pydantic-core
2026-04-23 09:42:32.557246 | instance |  Downloading netaddr
2026-04-23 09:42:32.567532 | instance |  Downloading pygments
2026-04-23 09:42:32.581538 | instance |  Downloading cryptography
2026-04-23 09:42:32.629453 | instance |  Downloading setuptools
2026-04-23 09:42:32.685998 | instance |  Downloading kubernetes
2026-04-23 09:42:32.718635 | instance |  Downloading ansible-core
2026-04-23 09:42:32.757944 | instance |  Downloading openstacksdk
2026-04-23 09:42:33.149643 | instance |       Built pyperclip==1.9.0
2026-04-23 09:42:33.569080 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-23 09:42:33.747646 | instance | Installed 83 packages in 175ms
2026-04-23 09:42:34.402635 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-23 09:42:35.451424 | instance | INFO     [csi > discovery] scenario test matrix: prepare
2026-04-23 09:42:35.451607 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-04-23 09:43:18.824380 | instance | INFO     [csi > prepare] Executing
2026-04-23 09:43:20.021979 | instance |
2026-04-23 09:43:20.022630 | instance | PLAY [Prepare] *****************************************************************
2026-04-23 09:43:20.022992 | instance |
2026-04-23 09:43:20.023334 | instance | TASK [Gathering Facts] *********************************************************
2026-04-23 09:43:20.023674 | instance | Thursday 23 April 2026  09:43:20 +0000 (0:00:00.032)       0:00:00.032 ********
2026-04-23 09:43:21.231149 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-23 09:43:21.231646 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-23 09:43:21.232010 | instance | interpreter could change the meaning of that path. See
2026-04-23 09:43:21.232397 | instance | https://docs.ansible.com/ansible-
2026-04-23 09:43:21.232752 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-23 09:43:21.241587 | instance | ok: [instance]
2026-04-23 09:43:21.242009 | instance |
2026-04-23 09:43:21.242400 | instance | TASK [Configure short hostname] ************************************************
2026-04-23 09:43:21.242749 | instance | Thursday 23 April 2026  09:43:21 +0000 (0:00:01.221)       0:00:01.253 ********
2026-04-23 09:43:21.986036 | instance | changed: [instance]
2026-04-23 09:43:21.986096 | instance |
2026-04-23 09:43:21.986103 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-23 09:43:21.986110 | instance | Thursday 23 April 2026  09:43:21 +0000 (0:00:00.743)       0:00:01.996 ********
2026-04-23 09:43:22.272934 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-23 09:43:22.273005 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-04-23 09:43:22.273017 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-23 09:43:22.283648 | instance | changed: [instance]
2026-04-23 09:43:22.283690 | instance |
2026-04-23 09:43:22.283702 | instance | TASK [Purge "snapd" package] ***************************************************
2026-04-23 09:43:22.283712 | instance | Thursday 23 April 2026  09:43:22 +0000 (0:00:00.297)       0:00:02.294 ********
2026-04-23 09:43:23.285983 | instance | ok: [instance]
2026-04-23 09:43:23.286049 | instance |
2026-04-23 09:43:23.286055 | instance | PLAY [Create devices for Ceph] *************************************************
2026-04-23 09:43:23.286165 | instance |
2026-04-23 09:43:23.286477 | instance | TASK [Gathering Facts] *********************************************************
2026-04-23 09:43:23.286789 | instance | Thursday 23 April 2026  09:43:23 +0000 (0:00:01.001)       0:00:03.296 ********
2026-04-23 09:43:24.018311 | instance | ok: [instance]
2026-04-23 09:43:24.018432 | instance |
2026-04-23 09:43:24.018445 | instance | TASK [Install depedencies] *****************************************************
2026-04-23 09:43:24.018460 | instance | Thursday 23 April 2026  09:43:24 +0000 (0:00:00.732)       0:00:04.029 ********
2026-04-23 09:44:07.438565 | instance | changed: [instance]
2026-04-23 09:44:07.438822 | instance |
2026-04-23 09:44:07.438835 | instance | TASK [Start up service] ********************************************************
2026-04-23 09:44:07.438844 | instance | Thursday 23 April 2026  09:44:07 +0000 (0:00:43.419)       0:00:47.448 ********
2026-04-23 09:44:08.013801 | instance | ok: [instance]
2026-04-23 09:44:08.014081 | instance |
2026-04-23 09:44:08.014454 | instance | TASK [Generate lvm.conf] *******************************************************
2026-04-23 09:44:08.014811 | instance | Thursday 23 April 2026  09:44:08 +0000 (0:00:00.576)       0:00:48.025 ********
2026-04-23 09:44:08.323285 | instance | ok: [instance]
2026-04-23 09:44:08.323385 | instance |
2026-04-23 09:44:08.323464 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-23 09:44:08.323591 | instance | Thursday 23 April 2026  09:44:08 +0000 (0:00:00.310)       0:00:48.335 ********
2026-04-23 09:44:09.034849 | instance | changed: [instance]
2026-04-23 09:44:09.035125 | instance |
2026-04-23 09:44:09.035426 | instance | TASK [Get list of all loopback devices] ****************************************
2026-04-23 09:44:09.035768 | instance | Thursday 23 April 2026  09:44:09 +0000 (0:00:00.711)       0:00:49.046 ********
2026-04-23 09:44:09.247540 | instance | ok: [instance]
2026-04-23 09:44:09.247645 | instance |
2026-04-23 09:44:09.247844 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-04-23 09:44:09.247993 | instance | Thursday 23 April 2026  09:44:09 +0000 (0:00:00.213)       0:00:49.259 ********
2026-04-23 09:44:09.271895 | instance | skipping: [instance]
2026-04-23 09:44:09.272312 | instance |
2026-04-23 09:44:09.272636 | instance | TASK [Create devices for Ceph] *************************************************
2026-04-23 09:44:09.272938 | instance | Thursday 23 April 2026  09:44:09 +0000 (0:00:00.023)       0:00:49.283 ********
2026-04-23 09:44:09.886247 | instance | changed: [instance] => (item=osd0)
2026-04-23 09:44:09.886353 | instance | changed: [instance] => (item=osd1)
2026-04-23 09:44:09.886516 | instance | changed: [instance] => (item=osd2)
2026-04-23 09:44:09.886660 | instance |
2026-04-23 09:44:09.886815 | instance | TASK [Set permissions on loopback devices] *************************************
2026-04-23 09:44:09.886978 | instance | Thursday 23 April 2026  09:44:09 +0000 (0:00:00.614)       0:00:49.897 ********
2026-04-23 09:44:10.580393 | instance | changed: [instance] => (item=osd0)
2026-04-23 09:44:10.580639 | instance | changed: [instance] => (item=osd1)
2026-04-23 09:44:10.580832 | instance | changed: [instance] => (item=osd2)
2026-04-23 09:44:10.581047 | instance |
2026-04-23 09:44:10.581236 | instance | TASK [Start loop devices] ******************************************************
2026-04-23 09:44:10.581420 | instance | Thursday 23 April 2026  09:44:10 +0000 (0:00:00.693)       0:00:50.591 ********
2026-04-23 09:44:11.300368 | instance | changed: [instance] => (item=osd0)
2026-04-23 09:44:11.300625 | instance | changed: [instance] => (item=osd1)
2026-04-23 09:44:11.301030 | instance | changed: [instance] => (item=osd2)
2026-04-23 09:44:11.301294 | instance |
2026-04-23 09:44:11.301574 | instance | TASK [Create a volume group for each loop device] ******************************
2026-04-23 09:44:11.301854 | instance | Thursday 23 April 2026  09:44:11 +0000 (0:00:00.719)       0:00:51.311 ********
2026-04-23 09:44:14.588004 | instance | changed: [instance] => (item=osd0)
2026-04-23 09:44:14.588737 | instance | changed: [instance] => (item=osd1)
2026-04-23 09:44:14.588751 | instance | changed: [instance] => (item=osd2)
2026-04-23 09:44:14.588761 | instance |
2026-04-23 09:44:14.589033 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-04-23 09:44:14.589290 | instance | Thursday 23 April 2026  09:44:14 +0000 (0:00:03.287)       0:00:54.598 ********
2026-04-23 09:44:16.738699 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-04-23 09:44:16.738824 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-04-23 09:44:16.738837 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-04-23 09:44:16.738963 | instance |
2026-04-23 09:44:16.739248 | instance | PLAY RECAP *********************************************************************
2026-04-23 09:44:16.739562 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-23 09:44:16.739817 | instance |
2026-04-23 09:44:16.740122 | instance | Thursday 23 April 2026  09:44:16 +0000 (0:00:02.150)       0:00:56.749 ********
2026-04-23 09:44:16.740485 | instance | ===============================================================================
2026-04-23 09:44:16.740765 | instance | Install depedencies ---------------------------------------------------- 43.42s
2026-04-23 09:44:16.741066 | instance | Create a volume group for each loop device ------------------------------ 3.29s
2026-04-23 09:44:16.741354 | instance | Create a logical volume for each loop device ---------------------------- 2.15s
2026-04-23 09:44:16.741655 | instance | Gathering Facts --------------------------------------------------------- 1.22s
2026-04-23 09:44:16.741966 | instance | Purge "snapd" package --------------------------------------------------- 1.00s
2026-04-23 09:44:16.742251 | instance | Configure short hostname ------------------------------------------------ 0.74s
2026-04-23 09:44:16.742545 | instance | Gathering Facts --------------------------------------------------------- 0.73s
2026-04-23 09:44:16.742803 | instance | Start loop devices ------------------------------------------------------ 0.72s
2026-04-23 09:44:16.743098 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.71s
2026-04-23 09:44:16.743381 | instance | Set permissions on loopback devices ------------------------------------- 0.69s
2026-04-23 09:44:16.743690 | instance | Create devices for Ceph ------------------------------------------------- 0.61s
2026-04-23 09:44:16.743954 | instance | Start up service -------------------------------------------------------- 0.58s
2026-04-23 09:44:16.744274 | instance | Generate lvm.conf ------------------------------------------------------- 0.31s
2026-04-23 09:44:16.744607 | instance | Ensure hostname inside hosts file --------------------------------------- 0.30s
2026-04-23 09:44:16.744855 | instance | Get list of all loopback devices ---------------------------------------- 0.21s
2026-04-23 09:44:16.745115 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-04-23 09:44:16.831739 | instance | INFO     [csi > prepare] Executed: Successful
2026-04-23 09:44:16.832118 | instance | INFO     Molecule executed 1 scenario (1 successful)
2026-04-23 09:44:16.966693 | instance | ok: Runtime: 0:01:45.013177
2026-04-23 09:44:16.970098 | 
2026-04-23 09:44:16.970160 | PLAY RECAP
2026-04-23 09:44:16.970219 | instance | ok: 12 changed: 9 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-23 09:44:16.970250 | 
2026-04-23 09:44:17.136135 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-23 09:44:17.139784 | RUN START: [untrusted : github.com/vexxhost/atmosphere/molecule/csi/converge.yml@main]
2026-04-23 09:44:17.813822 | 
2026-04-23 09:44:17.814069 | PLAY [all]
2026-04-23 09:44:17.827144 | 
2026-04-23 09:44:17.827300 | TASK [Build atmosphere binary]
2026-04-23 09:44:18.259044 | instance | go: downloading github.com/spf13/cobra v1.9.1
2026-04-23 09:44:18.271913 | instance | go: downloading golang.org/x/sync v0.18.0
2026-04-23 09:44:18.464114 | instance | go: downloading github.com/spf13/pflag v1.0.7
2026-04-23 09:44:25.424798 | instance | ok: Runtime: 0:00:07.120232
2026-04-23 09:44:25.434674 | 
2026-04-23 09:44:25.434772 | TASK [Deploy with parallel orchestrator]
2026-04-23 09:44:25.688736 | instance | ==> Multi-tag mode: ceph, kubernetes, csi
2026-04-23 09:44:25.688953 | instance | ==> Running preflight checks
2026-04-23 09:44:26.237074 | instance | [preflight]
2026-04-23 09:44:26.237115 | instance | [preflight] PLAY [Preflight checks] ********************************************************
2026-04-23 09:44:26.237124 | instance | [preflight]
2026-04-23 09:44:26.237129 | instance | [preflight] TASK [Fail if atmosphere_ceph_enabled is set] **********************************
2026-04-23 09:44:26.261560 | instance | [preflight] skipping: [instance]
2026-04-23 09:44:26.261594 | instance | [preflight]
2026-04-23 09:44:26.261605 | instance | [preflight] PLAY RECAP *********************************************************************
2026-04-23 09:44:26.261622 | instance | [preflight] instance                   : ok=0    changed=0    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-23 09:44:26.261632 | instance | [preflight]
2026-04-23 09:44:26.324010 | instance | ==> Preflight checks passed
2026-04-23 09:44:26.324164 | instance | ==> Starting parallel deployment (subgraph)
2026-04-23 09:44:26.324236 | instance | ==> [kubernetes] Starting deployment
2026-04-23 09:44:26.324368 | instance | ==> [ceph] Starting deployment
2026-04-23 09:44:27.139926 | instance | [ceph]
2026-04-23 09:44:27.139965 | instance | [ceph] PLAY [all] *********************************************************************
2026-04-23 09:44:27.139973 | instance | [ceph]
2026-04-23 09:44:27.139979 | instance | [ceph] TASK [Gathering Facts] *********************************************************
2026-04-23 09:44:27.194415 | instance | [kubernetes]
2026-04-23 09:44:27.194462 | instance | [kubernetes] PLAY [all] *********************************************************************
2026-04-23 09:44:27.194473 | instance | [kubernetes]
2026-04-23 09:44:27.194491 | instance | [kubernetes] TASK [Gathering Facts] *********************************************************
2026-04-23 09:44:28.605178 | instance | [ceph] [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-23 09:44:28.605235 | instance | [ceph] interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-23 09:44:28.605248 | instance | [ceph] interpreter could change the meaning of that path. See
2026-04-23 09:44:28.605258 | instance | [ceph] https://docs.ansible.com/ansible-
2026-04-23 09:44:28.605268 | instance | [ceph] core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-23 09:44:28.614147 | instance | [kubernetes] [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-23 09:44:28.614179 | instance | [kubernetes] interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-23 09:44:28.614190 | instance | [kubernetes] interpreter could change the meaning of that path. See
2026-04-23 09:44:28.614200 | instance | [kubernetes] https://docs.ansible.com/ansible-
2026-04-23 09:44:28.614210 | instance | [kubernetes] core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-23 09:44:28.614626 | instance | [ceph] ok: [instance]
2026-04-23 09:44:28.614647 | instance | [ceph]
2026-04-23 09:44:28.614657 | instance | [ceph] TASK [Fail if atmosphere_ceph_enabled is set] **********************************
2026-04-23 09:44:28.629339 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:28.629373 | instance | [kubernetes]
2026-04-23 09:44:28.629384 | instance | [kubernetes] TASK [vexxhost.atmosphere.sysctl : Configure sysctl values] ********************
2026-04-23 09:44:28.653490 | instance | [ceph] skipping: [instance]
2026-04-23 09:44:28.653524 | instance | [ceph]
2026-04-23 09:44:28.653540 | instance | [ceph] TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-04-23 09:44:28.845231 | instance | [ceph] ok: [instance]
2026-04-23 09:44:28.845286 | instance | [ceph]
2026-04-23 09:44:28.845298 | instance | [ceph] PLAY [Deploy Ceph monitors & managers] *****************************************
2026-04-23 09:44:28.845308 | instance | [ceph]
2026-04-23 09:44:28.845317 | instance | [ceph] TASK [Gathering Facts] *********************************************************
2026-04-23 09:44:29.897763 | instance | [ceph] ok: [instance]
2026-04-23 09:44:29.897840 | instance | [ceph]
2026-04-23 09:44:29.897850 | instance | [ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-23 09:44:30.420080 | instance | [ceph] ok: [instance]
2026-04-23 09:44:30.420155 | instance | [ceph]
2026-04-23 09:44:30.420191 | instance | [ceph] TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-23 09:44:30.464667 | instance | [ceph] skipping: [instance]
2026-04-23 09:44:30.464737 | instance | [ceph]
2026-04-23 09:44:30.464749 | instance | [ceph] TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-23 09:44:30.954478 | instance | [ceph] changed: [instance]
2026-04-23 09:44:30.954517 | instance | [ceph]
2026-04-23 09:44:30.954527 | instance | [ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-23 09:44:31.020382 | instance | [ceph] ok: [instance] => {
2026-04-23 09:44:31.020431 | instance | [ceph]     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-23 09:44:31.020438 | instance | [ceph] }
2026-04-23 09:44:31.020444 | instance | [ceph]
2026-04-23 09:44:31.020451 | instance | [ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-23 09:44:31.741210 | instance | [ceph] changed: [instance]
2026-04-23 09:44:31.741271 | instance | [ceph]
2026-04-23 09:44:31.741283 | instance | [ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-23 09:44:31.793887 | instance | [ceph] skipping: [instance]
2026-04-23 09:44:31.980876 | instance | [ceph]
2026-04-23 09:44:31.980931 | instance | [ceph] TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-23 09:44:31.980959 | instance | [ceph] skipping: [instance]
2026-04-23 09:44:31.984051 | instance | [ceph]
2026-04-23 09:44:31.984099 | instance | [ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-23 09:44:32.270738 | instance | [ceph] ok: [instance]
2026-04-23 09:44:32.271070 | instance | [ceph]
2026-04-23 09:44:32.271086 | instance | [ceph] TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-23 09:44:33.590524 | instance | [ceph] ok: [instance]
2026-04-23 09:44:33.590632 | instance | [ceph]
2026-04-23 09:44:33.590647 | instance | [ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-23 09:44:33.662978 | instance | [ceph] ok: [instance] => {
2026-04-23 09:44:33.663046 | instance | [ceph]     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-04-23 09:44:33.663053 | instance | [ceph] }
2026-04-23 09:44:33.663058 | instance | [ceph]
2026-04-23 09:44:33.663064 | instance | [ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-23 09:44:34.508590 | instance | [ceph] changed: [instance]
2026-04-23 09:44:34.508634 | instance | [ceph]
2026-04-23 09:44:34.508643 | instance | [ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-23 09:44:37.828162 | instance | [ceph] changed: [instance]
2026-04-23 09:44:37.828238 | instance | [ceph]
2026-04-23 09:44:37.828250 | instance | [ceph] TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-23 09:44:37.864226 | instance | [ceph] skipping: [instance]
2026-04-23 09:44:37.864312 | instance | [ceph]
2026-04-23 09:44:37.864328 | instance | [ceph] TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-23 09:44:37.895794 | instance | [ceph] skipping: [instance]
2026-04-23 09:44:37.895845 | instance | [ceph]
2026-04-23 09:44:37.895853 | instance | [ceph] TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-23 09:44:37.935862 | instance | [ceph] skipping: [instance]
2026-04-23 09:44:37.935923 | instance | [ceph]
2026-04-23 09:44:37.935935 | instance | [ceph] TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-23 09:44:38.452119 | instance | [kubernetes] changed: [instance] => (item={'name': 'fs.aio-max-nr', 'value': 1048576})
2026-04-23 09:44:38.452203 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_timestamps', 'value': 0})
2026-04-23 09:44:38.452215 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_sack', 'value': 1})
2026-04-23 09:44:38.452224 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.core.netdev_budget', 'value': 1000})
2026-04-23 09:44:38.452234 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.core.netdev_max_backlog', 'value': 250000})
2026-04-23 09:44:38.452243 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.core.rmem_max', 'value': 4194304})
2026-04-23 09:44:38.452269 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.core.wmem_max', 'value': 4194304})
2026-04-23 09:44:38.452278 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.core.rmem_default', 'value': 4194304})
2026-04-23 09:44:38.452311 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.core.wmem_default', 'value': 4194304})
2026-04-23 09:44:38.452322 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.core.optmem_max', 'value': 4194304})
2026-04-23 09:44:38.452331 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_rmem', 'value': '4096 87380 4194304'})
2026-04-23 09:44:38.452340 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_wmem', 'value': '4096 65536 4194304'})
2026-04-23 09:44:38.452349 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_low_latency', 'value': 1})
2026-04-23 09:44:38.452357 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_adv_win_scale', 'value': 1})
2026-04-23 09:44:38.452366 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh1', 'value': 128})
2026-04-23 09:44:38.452375 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh2', 'value': 28872})
2026-04-23 09:44:38.452384 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh3', 'value': 32768})
2026-04-23 09:44:38.452392 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh1', 'value': 128})
2026-04-23 09:44:38.452401 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh2', 'value': 28872})
2026-04-23 09:44:38.452410 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh3', 'value': 32768})
2026-04-23 09:44:38.452418 | instance | [kubernetes]
2026-04-23 09:44:38.452428 | instance | [kubernetes] TASK [vexxhost.atmosphere.ethtool : Create folder for persistent configuration] ***
2026-04-23 09:44:38.873390 | instance | [kubernetes] changed: [instance]
2026-04-23 09:44:38.873449 | instance | [kubernetes]
2026-04-23 09:44:38.873456 | instance | [kubernetes] TASK [vexxhost.atmosphere.ethtool : Install persistent "ethtool" tuning] *******
2026-04-23 09:44:39.594818 | instance | [kubernetes] changed: [instance]
2026-04-23 09:44:39.594878 | instance | [kubernetes]
2026-04-23 09:44:39.594890 | instance | [kubernetes] TASK [vexxhost.atmosphere.ethtool : Run "ethtool" tuning] **********************
2026-04-23 09:44:40.052634 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:40.052671 | instance | [kubernetes]
2026-04-23 09:44:40.052677 | instance | [kubernetes] TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-04-23 09:44:40.193086 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:40.193127 | instance | [kubernetes]
2026-04-23 09:44:40.193133 | instance | [kubernetes] PLAY [Configure Kubernetes VIP] ************************************************
2026-04-23 09:44:40.193138 | instance | [kubernetes]
2026-04-23 09:44:40.193142 | instance | [kubernetes] TASK [Gathering Facts] *********************************************************
2026-04-23 09:44:41.197456 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:41.197523 | instance | [kubernetes]
2026-04-23 09:44:41.197531 | instance | [kubernetes] TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] ***
2026-04-23 09:44:41.507884 | instance | [kubernetes] changed: [instance]
2026-04-23 09:44:41.508007 | instance | [kubernetes]
2026-04-23 09:44:41.508024 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] ****************
2026-04-23 09:44:42.942773 | instance | [kubernetes] ok: [instance] => (item=/etc/keepalived/keepalived.conf)
2026-04-23 09:44:42.942933 | instance | [kubernetes] ok: [instance] => (item=/etc/keepalived/check_apiserver.sh)
2026-04-23 09:44:42.942940 | instance | [kubernetes] ok: [instance] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-04-23 09:44:42.942944 | instance | [kubernetes] ok: [instance] => (item=/etc/haproxy/haproxy.cfg)
2026-04-23 09:44:42.942949 | instance | [kubernetes] ok: [instance] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-04-23 09:44:42.942953 | instance | [kubernetes]
2026-04-23 09:44:42.942957 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] ****
2026-04-23 09:44:43.851487 | instance | [kubernetes] failed: [instance] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257}
2026-04-23 09:44:43.851579 | instance | [kubernetes] failed: [instance] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257}
2026-04-23 09:44:43.851610 | instance | [kubernetes] failed: [instance] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257}
2026-04-23 09:44:43.851620 | instance | [kubernetes] ...ignoring
2026-04-23 09:44:43.851628 | instance | [kubernetes]
2026-04-23 09:44:43.851637 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] *********
2026-04-23 09:44:44.074366 | instance | [ceph] changed: [instance]
2026-04-23 09:44:44.074431 | instance | [ceph]
2026-04-23 09:44:44.074443 | instance | [ceph] TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-23 09:44:44.127408 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:44.127468 | instance | [kubernetes]
2026-04-23 09:44:44.127485 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] *********
2026-04-23 09:44:44.427832 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:44.427896 | instance | [kubernetes]
2026-04-23 09:44:44.427907 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************
2026-04-23 09:44:44.454863 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:44.454899 | instance | [kubernetes]
2026-04-23 09:44:44.454911 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] ***
2026-04-23 09:44:44.489838 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:44.489871 | instance | [kubernetes]
2026-04-23 09:44:44.489881 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] ***************
2026-04-23 09:44:44.734828 | instance | [ceph] changed: [instance]
2026-04-23 09:44:44.734882 | instance | [ceph]
2026-04-23 09:44:44.734894 | instance | [ceph] TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-23 09:44:45.143667 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:45.143730 | instance | [kubernetes]
2026-04-23 09:44:45.143742 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] *******
2026-04-23 09:44:45.547287 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:45.547335 | instance | [kubernetes]
2026-04-23 09:44:45.547342 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-04-23 09:44:45.547348 | instance | [kubernetes]
2026-04-23 09:44:45.547354 | instance | [kubernetes] PLAY [Install Kubernetes] ******************************************************
2026-04-23 09:44:45.547359 | instance | [kubernetes]
2026-04-23 09:44:45.547364 | instance | [kubernetes] TASK [Gathering Facts] *********************************************************
2026-04-23 09:44:46.244631 | instance | [ceph] changed: [instance] => (item={'path': '/etc/containerd'})
2026-04-23 09:44:46.244688 | instance | [ceph] changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-23 09:44:46.244696 | instance | [ceph] changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-23 09:44:46.244702 | instance | [ceph] changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-23 09:44:46.244709 | instance | [ceph] changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-23 09:44:46.244720 | instance | [ceph]
2026-04-23 09:44:46.244727 | instance | [ceph] TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-23 09:44:46.584872 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:46.584935 | instance | [kubernetes]
2026-04-23 09:44:46.584944 | instance | [kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-23 09:44:46.891213 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:46.891272 | instance | [kubernetes]
2026-04-23 09:44:46.891284 | instance | [kubernetes] TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-23 09:44:46.897759 | instance | [ceph] changed: [instance]
2026-04-23 09:44:46.897787 | instance | [ceph]
2026-04-23 09:44:46.897799 | instance | [ceph] TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-23 09:44:46.897809 | instance | [ceph]
2026-04-23 09:44:46.897818 | instance | [ceph] RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-04-23 09:44:46.925176 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:44:46.925242 | instance | [kubernetes]
2026-04-23 09:44:46.925250 | instance | [kubernetes] TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-23 09:44:47.295905 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:47.295985 | instance | [kubernetes]
2026-04-23 09:44:47.295992 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-23 09:44:47.356116 | instance | [kubernetes] ok: [instance] => {
2026-04-23 09:44:47.356162 | instance | [kubernetes]     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-23 09:44:47.356170 | instance | [kubernetes] }
2026-04-23 09:44:47.356175 | instance | [kubernetes]
2026-04-23 09:44:47.356181 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-23 09:44:47.856555 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:47.856606 | instance | [kubernetes]
2026-04-23 09:44:47.856619 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-23 09:44:47.899501 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:44:47.899547 | instance | [kubernetes]
2026-04-23 09:44:47.899556 | instance | [kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-23 09:44:47.953375 | instance | [ceph] ok: [instance]
2026-04-23 09:44:47.953415 | instance | [ceph]
2026-04-23 09:44:47.953424 | instance | [ceph] RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-04-23 09:44:48.232755 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:48.232810 | instance | [kubernetes]
2026-04-23 09:44:48.232819 | instance | [kubernetes] TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-23 09:44:48.547653 | instance | [ceph] changed: [instance]
2026-04-23 09:44:48.547717 | instance | [ceph]
2026-04-23 09:44:48.547726 | instance | [ceph] TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-23 09:44:49.235356 | instance | [ceph] changed: [instance]
2026-04-23 09:44:49.235412 | instance | [ceph]
2026-04-23 09:44:49.235418 | instance | [ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-23 09:44:49.539078 | instance | [ceph] ok: [instance]
2026-04-23 09:44:49.539143 | instance | [ceph]
2026-04-23 09:44:49.539155 | instance | [ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-23 09:44:49.581063 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:49.581117 | instance | [kubernetes]
2026-04-23 09:44:49.581129 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-23 09:44:49.587307 | instance | [ceph] ok: [instance] => {
2026-04-23 09:44:49.587337 | instance | [ceph]     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-04-23 09:44:49.587343 | instance | [ceph] }
2026-04-23 09:44:49.587347 | instance | [ceph]
2026-04-23 09:44:49.587352 | instance | [ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-23 09:44:49.641303 | instance | [kubernetes] ok: [instance] => {
2026-04-23 09:44:49.641351 | instance | [kubernetes]     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-04-23 09:44:49.641358 | instance | [kubernetes] }
2026-04-23 09:44:49.641365 | instance | [kubernetes]
2026-04-23 09:44:49.641371 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-23 09:44:50.092150 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:50.092193 | instance | [kubernetes]
2026-04-23 09:44:50.092202 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-23 09:44:50.504534 | instance | [ceph] changed: [instance]
2026-04-23 09:44:50.504602 | instance | [ceph]
2026-04-23 09:44:50.504614 | instance | [ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-23 09:44:52.319011 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:52.319089 | instance | [kubernetes]
2026-04-23 09:44:52.319101 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-23 09:44:52.347602 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:44:52.347661 | instance | [kubernetes]
2026-04-23 09:44:52.347672 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-23 09:44:52.373406 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:44:52.373469 | instance | [kubernetes]
2026-04-23 09:44:52.373481 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-23 09:44:52.398604 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:44:52.398679 | instance | [kubernetes]
2026-04-23 09:44:52.398691 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-23 09:44:53.793297 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:53.793399 | instance | [kubernetes]
2026-04-23 09:44:53.793406 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-23 09:44:54.354771 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:54.354817 | instance | [kubernetes]
2026-04-23 09:44:54.354822 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-23 09:44:55.118453 | instance | [ceph] changed: [instance]
2026-04-23 09:44:55.118499 | instance | [ceph]
2026-04-23 09:44:55.118507 | instance | [ceph] TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-04-23 09:44:55.808988 | instance | [kubernetes] ok: [instance] => (item={'path': '/etc/containerd'})
2026-04-23 09:44:55.809038 | instance | [kubernetes] ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-23 09:44:55.809045 | instance | [kubernetes] ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-23 09:44:55.809051 | instance | [kubernetes] ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-23 09:44:55.809056 | instance | [kubernetes] ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-23 09:44:55.809062 | instance | [kubernetes]
2026-04-23 09:44:55.809068 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-23 09:44:56.390099 | instance | [ceph] ok: [instance]
2026-04-23 09:44:56.390161 | instance | [ceph]
2026-04-23 09:44:56.390173 | instance | [ceph] TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-04-23 09:44:56.431492 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:56.431558 | instance | [kubernetes]
2026-04-23 09:44:56.431570 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-23 09:44:56.431580 | instance | [kubernetes]
2026-04-23 09:44:56.431589 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-23 09:44:56.857101 | instance | [ceph] changed: [instance]
2026-04-23 09:44:56.857143 | instance | [ceph]
2026-04-23 09:44:56.857150 | instance | [ceph] TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-04-23 09:44:57.149451 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:57.149509 | instance | [kubernetes]
2026-04-23 09:44:57.149521 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the "kubeadm-config" ConfigMap] ***
2026-04-23 09:44:57.451916 | instance | [ceph] changed: [instance]
2026-04-23 09:44:57.451965 | instance | [ceph]
2026-04-23 09:44:57.451977 | instance | [ceph] TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-04-23 09:44:58.025152 | instance | [kubernetes] An exception occurred during task execution. To see the full traceback, use -vvv. The error was: ansible_collections.kubernetes.core.plugins.module_utils.k8s.exceptions.CoreException: Could not create API client: Invalid kube-config file. No configuration found.
2026-04-23 09:44:58.025207 | instance | [kubernetes] fatal: [instance]: FAILED! => {"changed": false, "msg": "Could not create API client: Invalid kube-config file. No configuration found."}
2026-04-23 09:44:58.025212 | instance | [kubernetes] ...ignoring
2026-04-23 09:44:58.025217 | instance | [kubernetes]
2026-04-23 09:44:58.025222 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Parse the ClusterConfiguration] ***
2026-04-23 09:44:58.053364 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:44:58.053407 | instance | [kubernetes]
2026-04-23 09:44:58.053413 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the current Kubernetes version] ***
2026-04-23 09:44:58.092980 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:44:58.093021 | instance | [kubernetes]
2026-04-23 09:44:58.093026 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Extract major, minor, and patch versions] ***
2026-04-23 09:44:58.130041 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:44:58.130084 | instance | [kubernetes]
2026-04-23 09:44:58.130089 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Fail if we're jumping more than one minor version] ***
2026-04-23 09:44:58.170539 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:44:58.170587 | instance | [kubernetes]
2026-04-23 09:44:58.170595 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Set fact if we need to upgrade] ***
2026-04-23 09:44:58.212480 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:44:58.212522 | instance | [kubernetes]
2026-04-23 09:44:58.212527 | instance | [kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-23 09:44:58.350882 | instance | [ceph] changed: [instance] => (item={'path': '/etc/docker'})
2026-04-23 09:44:58.350919 | instance | [ceph] changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-04-23 09:44:58.350925 | instance | [ceph] changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-04-23 09:44:58.350930 | instance | [ceph]
2026-04-23 09:44:58.350934 | instance | [ceph] TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-04-23 09:44:58.586515 | instance | [kubernetes] ok: [instance]
2026-04-23 09:44:58.586555 | instance | [kubernetes]
2026-04-23 09:44:58.586563 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-23 09:44:58.639199 | instance | [kubernetes] ok: [instance] => {
2026-04-23 09:44:58.639226 | instance | [kubernetes]     "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubeadm"
2026-04-23 09:44:58.639232 | instance | [kubernetes] }
2026-04-23 09:44:58.639236 | instance | [kubernetes]
2026-04-23 09:44:58.639244 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-23 09:44:58.958970 | instance | [ceph] changed: [instance]
2026-04-23 09:44:58.959036 | instance | [ceph]
2026-04-23 09:44:58.959048 | instance | [ceph] TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-04-23 09:44:59.553010 | instance | [ceph] changed: [instance]
2026-04-23 09:44:59.553056 | instance | [ceph]
2026-04-23 09:44:59.553064 | instance | [ceph] TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-04-23 09:44:59.553070 | instance | [ceph]
2026-04-23 09:44:59.553081 | instance | [ceph] RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-04-23 09:44:59.933672 | instance | [kubernetes] changed: [instance]
2026-04-23 09:44:59.933730 | instance | [kubernetes]
2026-04-23 09:44:59.933742 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-23 09:44:59.980816 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:44:59.980859 | instance | [kubernetes]
2026-04-23 09:44:59.980869 | instance | [kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-23 09:45:00.307244 | instance | [ceph] ok: [instance]
2026-04-23 09:45:00.307299 | instance | [ceph]
2026-04-23 09:45:00.307318 | instance | [ceph] RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-04-23 09:45:00.318734 | instance | [kubernetes] ok: [instance]
2026-04-23 09:45:00.318752 | instance | [kubernetes]
2026-04-23 09:45:00.318757 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-23 09:45:00.358410 | instance | [kubernetes] ok: [instance] => {
2026-04-23 09:45:00.358459 | instance | [kubernetes]     "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubectl"
2026-04-23 09:45:00.358472 | instance | [kubernetes] }
2026-04-23 09:45:00.358482 | instance | [kubernetes]
2026-04-23 09:45:00.358491 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-23 09:45:07.796921 | instance | [ceph] changed: [instance]
2026-04-23 09:45:07.796994 | instance | [ceph]
2026-04-23 09:45:07.797005 | instance | [ceph] TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-04-23 09:45:08.488821 | instance | [ceph] changed: [instance]
2026-04-23 09:45:08.488891 | instance | [ceph]
2026-04-23 09:45:08.488902 | instance | [ceph] TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-04-23 09:45:08.540226 | instance | [ceph] ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-04-23 09:45:08.540266 | instance | [ceph]
2026-04-23 09:45:08.540271 | instance | [ceph] TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-04-23 09:45:09.281844 | instance | [kubernetes] changed: [instance]
2026-04-23 09:45:09.281905 | instance | [kubernetes]
2026-04-23 09:45:09.281918 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-23 09:45:09.336694 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:45:09.336753 | instance | [kubernetes]
2026-04-23 09:45:09.336761 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-23 09:45:09.364719 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:45:09.364772 | instance | [kubernetes]
2026-04-23 09:45:09.364779 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-23 09:45:09.390301 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:45:09.390372 | instance | [kubernetes]
2026-04-23 09:45:09.390389 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-23 09:45:09.419385 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:45:09.419440 | instance | [kubernetes]
2026-04-23 09:45:09.419448 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-23 09:45:10.717904 | instance | [kubernetes] ok: [instance]
2026-04-23 09:45:10.717945 | instance | [kubernetes]
2026-04-23 09:45:10.717954 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-23 09:45:11.347287 | instance | [kubernetes] ok: [instance]
2026-04-23 09:45:11.347354 | instance | [kubernetes]
2026-04-23 09:45:11.347362 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-23 09:45:12.927391 | instance | [kubernetes] ok: [instance] => (item={'path': '/etc/containerd'})
2026-04-23 09:45:12.927453 | instance | [kubernetes] ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-23 09:45:12.927466 | instance | [kubernetes] ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-23 09:45:12.927476 | instance | [kubernetes] ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-23 09:45:12.927486 | instance | [kubernetes] ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-23 09:45:12.927495 | instance | [kubernetes]
2026-04-23 09:45:12.927504 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-23 09:45:13.595974 | instance | [kubernetes] ok: [instance]
2026-04-23 09:45:13.596091 | instance | [kubernetes]
2026-04-23 09:45:13.596104 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-23 09:45:13.596112 | instance | [kubernetes]
2026-04-23 09:45:13.596146 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-23 09:45:14.071590 | instance | [kubernetes] ok: [instance]
2026-04-23 09:45:14.071637 | instance | [kubernetes]
2026-04-23 09:45:14.071645 | instance | [kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-23 09:45:14.403078 | instance | [kubernetes] ok: [instance]
2026-04-23 09:45:14.403150 | instance | [kubernetes]
2026-04-23 09:45:14.403166 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-23 09:45:14.460616 | instance | [kubernetes] ok: [instance] => {
2026-04-23 09:45:14.460695 | instance | [kubernetes]     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.35.0/crictl-v1.35.0-linux-amd64.tar.gz"
2026-04-23 09:45:14.460708 | instance | [kubernetes] }
2026-04-23 09:45:14.460718 | instance | [kubernetes]
2026-04-23 09:45:14.460728 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-23 09:45:15.132315 | instance | [kubernetes] changed: [instance]
2026-04-23 09:45:15.132384 | instance | [kubernetes]
2026-04-23 09:45:15.132396 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-23 09:45:17.679231 | instance | [kubernetes] changed: [instance]
2026-04-23 09:45:17.679275 | instance | [kubernetes]
2026-04-23 09:45:17.679283 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-23 09:45:17.725944 | instance | [kubernetes] ok: [instance] => {
2026-04-23 09:45:17.725987 | instance | [kubernetes]     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.35.0/critest-v1.35.0-linux-amd64.tar.gz"
2026-04-23 09:45:17.726023 | instance | [kubernetes] }
2026-04-23 09:45:17.726030 | instance | [kubernetes]
2026-04-23 09:45:17.726037 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-23 09:45:18.588625 | instance | [kubernetes] changed: [instance]
2026-04-23 09:45:18.588684 | instance | [kubernetes]
2026-04-23 09:45:18.588712 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-23 09:45:20.168879 | instance | [kubernetes] changed: [instance]
2026-04-23 09:45:20.168922 | instance | [kubernetes]
2026-04-23 09:45:20.168928 | instance | [kubernetes] TASK [vexxhost.containers.cri_tools : Create crictl config] ********************
2026-04-23 09:45:20.780742 | instance | [kubernetes] changed: [instance]
2026-04-23 09:45:20.780792 | instance | [kubernetes]
2026-04-23 09:45:20.780799 | instance | [kubernetes] TASK [vexxhost.containers.directory : Create directory (/opt/cni/bin)] *********
2026-04-23 09:45:21.108616 | instance | [kubernetes] changed: [instance]
2026-04-23 09:45:21.108667 | instance | [kubernetes]
2026-04-23 09:45:21.108675 | instance | [kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-23 09:45:21.452248 | instance | [kubernetes] ok: [instance]
2026-04-23 09:45:21.452380 | instance | [kubernetes]
2026-04-23 09:45:21.452399 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-23 09:45:21.499007 | instance | [kubernetes] ok: [instance] => {
2026-04-23 09:45:21.499115 | instance | [kubernetes]     "msg": "https://github.com/containernetworking/plugins/releases/download/v1.9.1/cni-plugins-linux-amd64-v1.9.1.tgz"
2026-04-23 09:45:21.499136 | instance | [kubernetes] }
2026-04-23 09:45:21.499146 | instance | [kubernetes]
2026-04-23 09:45:21.499156 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-23 09:45:22.573326 | instance | [kubernetes] changed: [instance]
2026-04-23 09:45:22.573433 | instance | [kubernetes]
2026-04-23 09:45:22.573446 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-23 09:45:25.487538 | instance | [kubernetes] changed: [instance]
2026-04-23 09:45:25.487600 | instance | [kubernetes]
2026-04-23 09:45:25.487608 | instance | [kubernetes] TASK [vexxhost.containers.cni_plugins : Gather variables for each operating system] ***
2026-04-23 09:45:25.535066 | instance | [kubernetes] ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml)
2026-04-23 09:45:25.535146 | instance | [kubernetes]
2026-04-23 09:45:25.535155 | instance | [kubernetes] TASK [vexxhost.containers.cni_plugins : Install additional packages] ***********
2026-04-23 09:45:26.705073 | instance | [kubernetes] ok: [instance]
2026-04-23 09:45:26.705106 | instance | [kubernetes]
2026-04-23 09:45:26.705111 | instance | [kubernetes] TASK [vexxhost.containers.cni_plugins : Ensure IPv6 is enabled] ****************
2026-04-23 09:45:27.024950 | instance | [kubernetes] changed: [instance]
2026-04-23 09:45:27.024988 | instance | [kubernetes]
2026-04-23 09:45:27.024993 | instance | [kubernetes] TASK [vexxhost.containers.cni_plugins : Enable kernel modules on-boot] *********
2026-04-23 09:45:27.615479 | instance | [kubernetes] changed: [instance]
2026-04-23 09:45:27.615527 | instance | [kubernetes]
2026-04-23 09:45:27.615536 | instance | [kubernetes] TASK [vexxhost.containers.cni_plugins : Enable kernel modules in runtime] ******
2026-04-23 09:45:29.151698 | instance | [kubernetes] changed: [instance] => (item=br_netfilter)
2026-04-23 09:45:29.151737 | instance | [kubernetes] ok: [instance] => (item=ip_tables)
2026-04-23 09:45:29.151742 | instance | [kubernetes] changed: [instance] => (item=ip6_tables)
2026-04-23 09:45:29.151746 | instance | [kubernetes] changed: [instance] => (item=nf_conntrack)
2026-04-23 09:45:29.151751 | instance | [kubernetes]
2026-04-23 09:45:29.151759 | instance | [kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-23 09:45:29.488720 | instance | [kubernetes] ok: [instance]
2026-04-23 09:45:29.488789 | instance | [kubernetes]
2026-04-23 09:45:29.488807 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-23 09:45:29.532518 | instance | [kubernetes] ok: [instance] => {
2026-04-23 09:45:29.532579 | instance | [kubernetes]     "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubelet"
2026-04-23 09:45:29.532592 | instance | [kubernetes] }
2026-04-23 09:45:29.532601 | instance | [kubernetes]
2026-04-23 09:45:29.532610 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-23 09:45:31.129115 | instance | [kubernetes] changed: [instance]
2026-04-23 09:45:31.129172 | instance | [kubernetes]
2026-04-23 09:45:31.129179 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-23 09:45:31.171478 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:45:31.171534 | instance | [kubernetes]
2026-04-23 09:45:31.171541 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubelet : Gather variables for each operating system] ***
2026-04-23 09:45:31.219394 | instance | [kubernetes] ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml)
2026-04-23 09:45:31.219438 | instance | [kubernetes]
2026-04-23 09:45:31.219451 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubelet : Install coreutils] *************************
2026-04-23 09:45:31.244439 | instance | [kubernetes] skipping: [instance]
2026-04-23 09:45:31.244475 | instance | [kubernetes]
2026-04-23 09:45:31.244487 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubelet : Install additional packages] ***************
2026-04-23 09:46:29.258318 | instance | [kubernetes] FAILED - RETRYING: [instance]: Install additional packages (5 retries left).
2026-04-23 09:46:29.258583 | instance | [kubernetes] FAILED - RETRYING: [instance]: Install additional packages (4 retries left).
2026-04-23 09:46:29.258598 | instance | [kubernetes] FAILED - RETRYING: [instance]: Install additional packages (3 retries left).
2026-04-23 09:46:29.258610 | instance | [kubernetes] FAILED - RETRYING: [instance]: Install additional packages (2 retries left).
2026-04-23 09:46:29.258621 | instance | [kubernetes] FAILED - RETRYING: [instance]: Install additional packages (1 retries left).
2026-04-23 09:46:29.258643 | instance | [kubernetes] fatal: [instance]: FAILED! => {"attempts": 5, "cache_update_time": 1776937294, "cache_updated": false, "changed": false, "msg": "'/usr/bin/apt-get -y -o \"Dpkg::Options::=--force-confdef\" -o \"Dpkg::Options::=--force-confold\"       install 'conntrack=1:1.4.6-2build2' 'ebtables=2.0.11-4build2' 'ethtool=1:5.16-1ubuntu0.2' 'socat=1.7.4.1-3ubuntu4'' failed: E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 14094 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n", "rc": 100, "stderr": "E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 14094 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n", "stderr_lines": ["E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 14094 (apt-get)", "E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?"], "stdout": "", "stdout_lines": []}
2026-04-23 09:46:29.258672 | instance | [kubernetes]
2026-04-23 09:46:29.258685 | instance | [kubernetes] PLAY RECAP *********************************************************************
2026-04-23 09:46:29.258698 | instance | [kubernetes] instance                   : ok=65   changed=18   unreachable=0    failed=1    skipped=17   rescued=0    ignored=2
2026-04-23 09:46:29.258711 | instance | [kubernetes]
2026-04-23 09:46:35.547752 | instance | Error: component kubernetes failed: ansible-playbook failed for kubernetes: exit status 2
2026-04-23 09:46:35.547820 | instance | Usage:
2026-04-23 09:46:35.547832 | instance |   atmosphere deploy [flags]
2026-04-23 09:46:35.547843 | instance |
2026-04-23 09:46:35.547852 | instance | Flags:
2026-04-23 09:46:35.547862 | instance |       --concurrency int    Max concurrent deployments per wave (0 = unlimited)
2026-04-23 09:46:35.547871 | instance |   -h, --help               help for deploy
2026-04-23 09:46:35.547881 | instance |   -i, --inventory string   Path to Ansible inventory file (required)
2026-04-23 09:46:35.547890 | instance |   -t, --tags string        Comma-separated list of component tags to deploy
2026-04-23 09:46:35.547899 | instance |
2026-04-23 09:46:35.547908 | instance | component kubernetes failed: ansible-playbook failed for kubernetes: exit status 2
2026-04-23 09:46:35.719246 | instance | ERROR
2026-04-23 09:46:35.719544 | instance | {
2026-04-23 09:46:35.719617 | instance |   "delta": "0:02:09.903956",
2026-04-23 09:46:35.719665 | instance |   "end": "2026-04-23 09:46:35.549020",
2026-04-23 09:46:35.719704 | instance |   "msg": "non-zero return code",
2026-04-23 09:46:35.719742 | instance |   "rc": 1,
2026-04-23 09:46:35.719770 | instance |   "start": "2026-04-23 09:44:25.645064"
2026-04-23 09:46:35.719799 | instance | }
failure
2026-04-23 09:46:35.730428 | 
2026-04-23 09:46:35.730495 | PLAY RECAP
2026-04-23 09:46:35.730549 | instance | ok: 1 changed: 0 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-23 09:46:35.730572 | 
2026-04-23 09:46:35.855087 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/molecule/csi/converge.yml@main]
2026-04-23 09:46:35.859238 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-23 09:46:41.766019 | 
2026-04-23 09:46:41.766184 | PLAY [all]
2026-04-23 09:46:41.783053 | 
2026-04-23 09:46:41.783192 | TASK [gather-host-logs : creating directory for system status]
2026-04-23 09:46:42.172144 | instance | changed
2026-04-23 09:46:42.180600 | 
2026-04-23 09:46:42.180711 | TASK [gather-host-logs : Get logs for each host]
2026-04-23 09:46:42.580924 | instance | + systemd-cgls --full --all --no-pager
2026-04-23 09:46:42.594253 | instance | + ip addr
2026-04-23 09:46:42.596913 | instance | + ip route
2026-04-23 09:46:42.598465 | instance | + lsblk
2026-04-23 09:46:42.604914 | instance | + mount
2026-04-23 09:46:42.607942 | instance | + docker images
2026-04-23 09:46:42.638590 | instance | + brctl show
2026-04-23 09:46:42.639310 | instance | /bin/bash: line 8: brctl: command not found
2026-04-23 09:46:42.639598 | instance | + ps aux --sort=-%mem
2026-04-23 09:46:42.657125 | instance | + dpkg -l
2026-04-23 09:46:42.664274 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-23 09:46:42.664649 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-23 09:46:42.684748 | instance | + '[' '!' -z '' ']'
2026-04-23 09:46:42.739032 | instance | ok: Runtime: 0:00:00.109688
2026-04-23 09:46:42.747550 | 
2026-04-23 09:46:42.747687 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-23 09:46:43.702392 | instance | changed:
2026-04-23 09:46:43.702627 | instance | created directory /var/lib/zuul/builds/bf815acf62154af79a1bb5904a8845db/work/logs/instance
2026-04-23 09:46:43.702662 | instance | cd+++++++++ system/
2026-04-23 09:46:43.702685 | instance | >f+++++++++ system/brctl-show.txt
2026-04-23 09:46:43.702727 | instance | >f+++++++++ system/docker-images.txt
2026-04-23 09:46:43.702749 | instance | >f+++++++++ system/ip-addr.txt
2026-04-23 09:46:43.702786 | instance | >f+++++++++ system/ip-route.txt
2026-04-23 09:46:43.702813 | instance | >f+++++++++ system/lsblk.txt
2026-04-23 09:46:43.702833 | instance | >f+++++++++ system/mount.txt
2026-04-23 09:46:43.702870 | instance | >f+++++++++ system/packages.txt
2026-04-23 09:46:43.702894 | instance | >f+++++++++ system/ps.txt
2026-04-23 09:46:43.702916 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-23 09:46:43.715817 | 
2026-04-23 09:46:43.715945 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-23 09:46:43.930853 | instance | changed: "values"
2026-04-23 09:46:44.107395 | instance | changed: "releases"
2026-04-23 09:46:44.130300 | 
2026-04-23 09:46:44.130527 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-23 09:46:44.409307 | instance | E0423 09:46:44.409145   16080 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:44.409876 | instance | E0423 09:46:44.409841   16080 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:44.411893 | instance | E0423 09:46:44.411848   16080 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:44.412533 | instance | E0423 09:46:44.412501   16080 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:44.414394 | instance | E0423 09:46:44.414364   16080 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:44.414464 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-23 09:46:44.672466 | instance | ok: Runtime: 0:00:00.071540
2026-04-23 09:46:44.680784 | 
2026-04-23 09:46:44.680994 | TASK [helm-release-status : Downloads logs to executor]
2026-04-23 09:46:45.206423 | instance | changed:
2026-04-23 09:46:45.206702 | instance | cd+++++++++ helm/
2026-04-23 09:46:45.206749 | instance | cd+++++++++ helm/releases/
2026-04-23 09:46:45.206786 | instance | cd+++++++++ helm/values/
2026-04-23 09:46:45.219979 | 
2026-04-23 09:46:45.220160 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-23 09:46:45.446045 | instance | changed
2026-04-23 09:46:45.452650 | 
2026-04-23 09:46:45.452766 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-23 09:46:45.720354 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-23 09:46:45.720705 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-23 09:46:45.728492 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-23 09:46:45.729184 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-23 09:46:45.789849 | instance | E0423 09:46:45.786437   16132 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.789925 | instance | E0423 09:46:45.787138   16132 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.789934 | instance | E0423 09:46:45.788786   16132 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.789951 | instance | E0423 09:46:45.789297   16132 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.791151 | instance | E0423 09:46:45.791110   16132 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.791182 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-23 09:46:45.791672 | instance | E0423 09:46:45.791609   16128 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.792590 | instance | E0423 09:46:45.792549   16128 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.794604 | instance | E0423 09:46:45.794528   16128 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.795174 | instance | E0423 09:46:45.795146   16128 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.796808 | instance | E0423 09:46:45.796770   16128 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.796830 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-23 09:46:45.800590 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-23 09:46:45.803079 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-23 09:46:45.868407 | instance | E0423 09:46:45.868207   16161 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.868868 | instance | E0423 09:46:45.868829   16161 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.870800 | instance | E0423 09:46:45.870753   16161 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.871564 | instance | E0423 09:46:45.871523   16161 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.873412 | instance | E0423 09:46:45.873265   16161 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.873496 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-23 09:46:45.882229 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-23 09:46:45.889444 | instance | E0423 09:46:45.889360   16154 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.890062 | instance | E0423 09:46:45.890036   16154 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.891942 | instance | E0423 09:46:45.891597   16154 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.892244 | instance | E0423 09:46:45.892205   16154 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.893908 | instance | E0423 09:46:45.893871   16154 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.893939 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-23 09:46:45.939790 | instance | E0423 09:46:45.939686   16178 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.940397 | instance | E0423 09:46:45.940342   16178 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.942143 | instance | E0423 09:46:45.942101   16178 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.942957 | instance | E0423 09:46:45.942912   16178 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.944561 | instance | E0423 09:46:45.944516   16178 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:45.944582 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-23 09:46:46.004437 | instance | ok: Runtime: 0:00:00.235105
2026-04-23 09:46:46.018684 | 
2026-04-23 09:46:46.018989 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-23 09:46:46.243336 | instance | changed
2026-04-23 09:46:46.248528 | 
2026-04-23 09:46:46.248610 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-23 09:46:46.532713 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-23 09:46:46.532803 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-23 09:46:46.532920 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-23 09:46:46.593099 | instance | E0423 09:46:46.592993   16208 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:46.593523 | instance | E0423 09:46:46.593497   16208 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:46.595792 | instance | E0423 09:46:46.595750   16208 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:46.596938 | instance | E0423 09:46:46.596866   16208 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:46.597712 | instance | E0423 09:46:46.597655   16208 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:46.598868 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-23 09:46:46.835759 | instance | ok: Runtime: 0:00:00.080306
2026-04-23 09:46:46.842292 | 
2026-04-23 09:46:46.842398 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-23 09:46:47.353322 | instance | changed:
2026-04-23 09:46:47.353527 | instance | cd+++++++++ objects/
2026-04-23 09:46:47.353567 | instance | cd+++++++++ objects/cluster/
2026-04-23 09:46:47.353604 | instance | cd+++++++++ objects/namespaced/
2026-04-23 09:46:47.363584 | 
2026-04-23 09:46:47.363677 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-23 09:46:47.590144 | instance | changed
2026-04-23 09:46:47.598572 | 
2026-04-23 09:46:47.598749 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-23 09:46:47.830704 | instance | changed
2026-04-23 09:46:47.839544 | 
2026-04-23 09:46:47.839715 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-23 09:46:48.143184 | instance | E0423 09:46:48.143017   16258 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:48.143860 | instance | E0423 09:46:48.143809   16258 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:48.145841 | instance | E0423 09:46:48.145808   16258 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:48.146584 | instance | E0423 09:46:48.146534   16258 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:48.148281 | instance | E0423 09:46:48.148248   16258 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:48.148400 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-23 09:46:48.380254 | instance | ok: Runtime: 0:00:00.069626
2026-04-23 09:46:48.386938 | 
2026-04-23 09:46:48.387078 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-23 09:46:48.888122 | instance | changed:
2026-04-23 09:46:48.888345 | instance | cd+++++++++ pod-logs/
2026-04-23 09:46:48.888384 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-23 09:46:48.902439 | 
2026-04-23 09:46:48.902559 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-23 09:46:49.110751 | instance | changed
2026-04-23 09:46:49.116516 | 
2026-04-23 09:46:49.116605 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-23 09:46:49.397119 | instance | E0423 09:46:49.396982   16301 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:49.398084 | instance | E0423 09:46:49.398045   16301 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:49.398727 | instance | E0423 09:46:49.398693   16301 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:49.400442 | instance | E0423 09:46:49.400416   16301 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:49.401009 | instance | E0423 09:46:49.400959   16301 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:49.402185 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-23 09:46:49.654722 | instance | ok: Runtime: 0:00:00.067301
2026-04-23 09:46:49.662629 | 
2026-04-23 09:46:49.662837 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-23 09:46:49.937997 | instance | E0423 09:46:49.937785   16323 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:49.939187 | instance | E0423 09:46:49.939152   16323 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:49.940184 | instance | E0423 09:46:49.940144   16323 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:49.941086 | instance | E0423 09:46:49.941038   16323 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:49.943221 | instance | E0423 09:46:49.943169   16323 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:49.943323 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-23 09:46:49.967297 | instance | ceph-mgr endpoints:
2026-04-23 09:46:50.215793 | instance | ok: Runtime: 0:00:00.086756
2026-04-23 09:46:50.223612 | 
2026-04-23 09:46:50.223865 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-23 09:46:50.493871 | instance | E0423 09:46:50.493766   16346 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:50.494306 | instance | E0423 09:46:50.494284   16346 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:50.495661 | instance | E0423 09:46:50.495642   16346 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:50.496100 | instance | E0423 09:46:50.496072   16346 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:50.497615 | instance | E0423 09:46:50.497591   16346 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-23 09:46:50.497702 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-23 09:46:50.761660 | instance | ok: Runtime: 0:00:00.071114
2026-04-23 09:46:50.769452 | 
2026-04-23 09:46:50.769551 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-23 09:46:51.292601 | instance | changed: cd+++++++++ prometheus/
2026-04-23 09:46:51.306028 | 
2026-04-23 09:46:51.306174 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-23 09:46:51.516381 | instance | changed
2026-04-23 09:46:51.524806 | 
2026-04-23 09:46:51.524945 | TASK [gather-selenium-data : Get selenium data]
2026-04-23 09:46:51.738088 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-23 09:46:51.739283 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-23 09:46:52.064999 | instance | ERROR
2026-04-23 09:46:52.065315 | instance | {
2026-04-23 09:46:52.065357 | instance |   "delta": "0:00:00.012256",
2026-04-23 09:46:52.065383 | instance |   "end": "2026-04-23 09:46:51.739640",
2026-04-23 09:46:52.065407 | instance |   "msg": "non-zero return code",
2026-04-23 09:46:52.065430 | instance |   "rc": 1,
2026-04-23 09:46:52.065452 | instance |   "start": "2026-04-23 09:46:51.727384"
2026-04-23 09:46:52.065473 | instance | }
2026-04-23 09:46:52.065502 | instance | ERROR: Ignoring Errors
2026-04-23 09:46:52.073197 | 
2026-04-23 09:46:52.073394 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-23 09:46:52.583269 | instance | changed: cd+++++++++ selenium/
2026-04-23 09:46:52.590413 | 
2026-04-23 09:46:52.590475 | PLAY RECAP
2026-04-23 09:46:52.590526 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-23 09:46:52.590554 | 
2026-04-23 09:46:52.763185 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-23 09:46:52.766081 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-23 09:46:53.737861 | 
2026-04-23 09:46:53.738062 | PLAY [all]
2026-04-23 09:46:53.752794 | 
2026-04-23 09:46:53.753038 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-23 09:46:53.815117 | instance | skipping: Conditional result was False
2026-04-23 09:46:53.826003 | 
2026-04-23 09:46:53.826318 | TASK [fetch-output : Set log path for single node]
2026-04-23 09:46:53.887877 | instance | ok
2026-04-23 09:46:53.892917 | 
2026-04-23 09:46:53.893001 | LOOP [fetch-output : Ensure local output dirs]
2026-04-23 09:46:54.334727 | instance -> localhost | ok: "/var/lib/zuul/builds/bf815acf62154af79a1bb5904a8845db/work/logs"
2026-04-23 09:46:54.559969 | instance -> localhost | changed: "/var/lib/zuul/builds/bf815acf62154af79a1bb5904a8845db/work/artifacts"
2026-04-23 09:46:54.778642 | instance -> localhost | changed: "/var/lib/zuul/builds/bf815acf62154af79a1bb5904a8845db/work/docs"
2026-04-23 09:46:54.794458 | 
2026-04-23 09:46:54.794649 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-23 09:46:55.467679 | instance | changed: .d..t...... ./
2026-04-23 09:46:55.467959 | instance | changed: All items complete
2026-04-23 09:46:55.467990 | 
2026-04-23 09:46:55.959289 | instance | changed: .d..t...... ./
2026-04-23 09:46:56.438668 | instance | changed: .d..t...... ./
2026-04-23 09:46:56.459032 | 
2026-04-23 09:46:56.459201 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-23 09:46:57.074539 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.084862
2026-04-23 09:46:57.348559 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.010059
2026-04-23 09:46:57.363631 | 
2026-04-23 09:46:57.363754 | PLAY [all]
2026-04-23 09:46:57.370050 | 
2026-04-23 09:46:57.370119 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-23 09:46:57.812522 | instance | changed
2026-04-23 09:46:57.831994 | 
2026-04-23 09:46:57.832148 | PLAY RECAP
2026-04-23 09:46:57.832206 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-23 09:46:57.832229 | 
2026-04-23 09:46:57.997355 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-23 09:46:58.000882 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-23 09:46:58.611267 | 
2026-04-23 09:46:58.611418 | PLAY [localhost]
2026-04-23 09:46:58.622213 | 
2026-04-23 09:46:58.622320 | TASK [Generate Zuul manifest]
2026-04-23 09:46:58.646291 | localhost | ok
2026-04-23 09:46:58.661660 | 
2026-04-23 09:46:58.661808 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-23 09:46:59.242649 | localhost | changed
2026-04-23 09:46:59.256013 | 
2026-04-23 09:46:59.256290 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-23 09:46:59.564788 | localhost | ok
2026-04-23 09:46:59.703600 | 
2026-04-23 09:46:59.703884 | TASK [Upload logs]
2026-04-23 09:46:59.731044 | localhost | ok
2026-04-23 09:46:59.812104 | 
2026-04-23 09:46:59.812264 | TASK [Set zuul-log-path fact]
2026-04-23 09:46:59.835403 | localhost | ok
2026-04-23 09:46:59.851122 | 
2026-04-23 09:46:59.851373 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-23 09:46:59.885954 | localhost | ok
2026-04-23 09:46:59.895534 | 
2026-04-23 09:46:59.895697 | TASK [upload-logs : Create log directories]
2026-04-23 09:47:01.625664 | localhost | changed
2026-04-23 09:47:01.633092 | 
2026-04-23 09:47:01.633229 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-23 09:47:02.113792 | localhost -> localhost | ok: Runtime: 0:00:00.005722
2026-04-23 09:47:02.119340 | 
2026-04-23 09:47:02.119425 | TASK [upload-logs : Upload logs to log server]
2026-04-23 09:47:02.652286 | localhost | Output suppressed because no_log was given
2026-04-23 09:47:02.657721 | 
2026-04-23 09:47:02.657857 | LOOP [upload-logs : Compress console log and json output]
2026-04-23 09:47:02.707648 | localhost | skipping: Conditional result was False
2026-04-23 09:47:02.715103 | localhost | skipping: Conditional result was False
2026-04-23 09:47:02.733633 | 
2026-04-23 09:47:02.733932 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-23 09:47:02.782980 | localhost | skipping: Conditional result was False
2026-04-23 09:47:02.783484 | 
2026-04-23 09:47:02.792332 | localhost | skipping: Conditional result was False
2026-04-23 09:47:02.810550 | 
2026-04-23 09:47:02.810760 | LOOP [upload-logs : Upload console log and json output]