2026-04-13 03:55:50.137580 | Job console starting 2026-04-13 03:55:50.152786 | Updating git repos 2026-04-13 03:55:50.228759 | Cloning repos into workspace 2026-04-13 03:55:50.346586 | Restoring repo states 2026-04-13 03:55:50.374843 | Merging changes 2026-04-13 03:55:51.309850 | Checking out repos 2026-04-13 03:55:51.441790 | Preparing playbooks 2026-04-13 03:55:54.918367 | Running Ansible setup 2026-04-13 03:55:58.566752 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-13 03:55:59.236652 | 2026-04-13 03:55:59.236785 | PLAY [localhost] 2026-04-13 03:55:59.244364 | 2026-04-13 03:55:59.244430 | TASK [Gathering Facts] 2026-04-13 03:56:00.266969 | localhost | ok 2026-04-13 03:56:00.279516 | 2026-04-13 03:56:00.279641 | TASK [Setup log path fact] 2026-04-13 03:56:00.300129 | localhost | ok 2026-04-13 03:56:00.311849 | 2026-04-13 03:56:00.311947 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-13 03:56:00.341506 | localhost | ok 2026-04-13 03:56:00.350529 | 2026-04-13 03:56:00.350639 | TASK [emit-job-header : Print job information] 2026-04-13 03:56:00.391070 | # Job Information 2026-04-13 03:56:00.391300 | Ansible Version: 2.16.16 2026-04-13 03:56:00.391345 | Job: atmosphere-molecule-aio-openvswitch 2026-04-13 03:56:00.391377 | Pipeline: check 2026-04-13 03:56:00.391409 | Executor: 0a8996d2b663 2026-04-13 03:56:00.391436 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3818 2026-04-13 03:56:00.391466 | Event ID: 8d8dac90-36ec-11f1-9147-17790853d7ac 2026-04-13 03:56:00.395566 | 2026-04-13 03:56:00.395656 | LOOP [emit-job-header : Print node information] 2026-04-13 03:56:00.502158 | localhost | ok: 2026-04-13 03:56:00.503094 | localhost | # Node Information 2026-04-13 03:56:00.503188 | localhost | Inventory Hostname: instance 2026-04-13 03:56:00.503249 | localhost | Hostname: np0000165455 2026-04-13 03:56:00.503303 | localhost | Username: zuul 2026-04-13 03:56:00.503364 | localhost | Distro: Ubuntu 22.04 2026-04-13 03:56:00.503419 | localhost | Provider: yul1 2026-04-13 03:56:00.503471 | localhost | Region: ca-ymq-1 2026-04-13 03:56:00.503521 | localhost | Label: ubuntu-jammy-16 2026-04-13 03:56:00.503570 | localhost | Product Name: OpenStack Nova 2026-04-13 03:56:00.503619 | localhost | Interface IP: 162.253.55.204 2026-04-13 03:56:00.513257 | 2026-04-13 03:56:00.513410 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-13 03:56:00.933395 | localhost -> localhost | changed 2026-04-13 03:56:00.942236 | 2026-04-13 03:56:00.942361 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-13 03:56:01.739423 | localhost -> localhost | changed 2026-04-13 03:56:01.745449 | 2026-04-13 03:56:01.745506 | PLAY [all] 2026-04-13 03:56:01.753726 | 2026-04-13 03:56:01.753795 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-13 03:56:01.992277 | instance -> localhost | ok 2026-04-13 03:56:02.001093 | 2026-04-13 03:56:02.001185 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-13 03:56:02.035441 | instance | ok 2026-04-13 03:56:02.051659 | instance | included: /var/lib/zuul/builds/c345dfa4f4a74b19a90077ff43cd5b0a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-13 03:56:02.057524 | 2026-04-13 03:56:02.057582 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-13 03:56:03.036502 | instance -> localhost | Generating public/private rsa key pair. 2026-04-13 03:56:03.036697 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/c345dfa4f4a74b19a90077ff43cd5b0a/work/c345dfa4f4a74b19a90077ff43cd5b0a_id_rsa 2026-04-13 03:56:03.036737 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/c345dfa4f4a74b19a90077ff43cd5b0a/work/c345dfa4f4a74b19a90077ff43cd5b0a_id_rsa.pub 2026-04-13 03:56:03.036769 | instance -> localhost | The key fingerprint is: 2026-04-13 03:56:03.036799 | instance -> localhost | SHA256:L+QLE8BUFF5mIOP+Ca1St7GUMxR9CSbPk3mVApTCURg zuul-build-sshkey 2026-04-13 03:56:03.036841 | instance -> localhost | The key's randomart image is: 2026-04-13 03:56:03.036871 | instance -> localhost | +---[RSA 3072]----+ 2026-04-13 03:56:03.036907 | instance -> localhost | | ++EXX+ ... | 2026-04-13 03:56:03.036938 | instance -> localhost | | + ++Xoo+.. | 2026-04-13 03:56:03.036991 | instance -> localhost | | + o.*... | 2026-04-13 03:56:03.037021 | instance -> localhost | | . + . o | 2026-04-13 03:56:03.037048 | instance -> localhost | | + X S | 2026-04-13 03:56:03.037075 | instance -> localhost | | . * @ . | 2026-04-13 03:56:03.037102 | instance -> localhost | | . . B o . | 2026-04-13 03:56:03.037130 | instance -> localhost | | . o o | 2026-04-13 03:56:03.037160 | instance -> localhost | | . | 2026-04-13 03:56:03.037188 | instance -> localhost | +----[SHA256]-----+ 2026-04-13 03:56:03.037249 | instance -> localhost | ok: Runtime: 0:00:00.534207 2026-04-13 03:56:03.044251 | 2026-04-13 03:56:03.044335 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-13 03:56:03.077987 | instance | ok 2026-04-13 03:56:03.090639 | instance | included: /var/lib/zuul/builds/c345dfa4f4a74b19a90077ff43cd5b0a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-13 03:56:03.099570 | 2026-04-13 03:56:03.099636 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-13 03:56:03.124520 | instance | skipping: Conditional result was False 2026-04-13 03:56:03.135809 | 2026-04-13 03:56:03.135945 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-13 03:56:03.584656 | instance | changed 2026-04-13 03:56:03.591425 | 2026-04-13 03:56:03.591511 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-13 03:56:03.778514 | instance | ok 2026-04-13 03:56:03.785254 | 2026-04-13 03:56:03.785342 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-13 03:56:04.263205 | instance | changed 2026-04-13 03:56:04.270472 | 2026-04-13 03:56:04.270561 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-13 03:56:04.770760 | instance | changed 2026-04-13 03:56:04.777824 | 2026-04-13 03:56:04.777920 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-13 03:56:04.803427 | instance | skipping: Conditional result was False 2026-04-13 03:56:04.814012 | 2026-04-13 03:56:04.814089 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-13 03:56:05.199457 | instance -> localhost | changed 2026-04-13 03:56:05.245683 | 2026-04-13 03:56:05.245804 | TASK [add-build-sshkey : Add back temp key] 2026-04-13 03:56:05.539270 | instance -> localhost | Identity added: /var/lib/zuul/builds/c345dfa4f4a74b19a90077ff43cd5b0a/work/c345dfa4f4a74b19a90077ff43cd5b0a_id_rsa (zuul-build-sshkey) 2026-04-13 03:56:05.539504 | instance -> localhost | ok: Runtime: 0:00:00.018380 2026-04-13 03:56:05.546529 | 2026-04-13 03:56:05.546623 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-13 03:56:05.853286 | instance | ok 2026-04-13 03:56:05.862174 | 2026-04-13 03:56:05.862268 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-13 03:56:05.887694 | instance | skipping: Conditional result was False 2026-04-13 03:56:05.906052 | 2026-04-13 03:56:05.906140 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-13 03:56:06.186157 | instance | ok 2026-04-13 03:56:06.193163 | 2026-04-13 03:56:06.193244 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-13 03:56:07.770217 | instance | Output suppressed because no_log was given 2026-04-13 03:56:07.782662 | 2026-04-13 03:56:07.782740 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-13 03:56:07.969547 | instance | ok: "logs" 2026-04-13 03:56:07.969775 | instance | ok: All items complete 2026-04-13 03:56:07.969803 | 2026-04-13 03:56:08.119275 | instance | ok: "artifacts" 2026-04-13 03:56:08.271952 | instance | ok: "docs" 2026-04-13 03:56:08.286275 | 2026-04-13 03:56:08.286436 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-13 03:56:08.497364 | instance | changed: "logs" 2026-04-13 03:56:08.652349 | instance | changed: "artifacts" 2026-04-13 03:56:08.803414 | instance | changed: "docs" 2026-04-13 03:56:08.823786 | 2026-04-13 03:56:08.823954 | PLAY RECAP 2026-04-13 03:56:08.824009 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-13 03:56:08.824037 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-13 03:56:08.824057 | 2026-04-13 03:56:08.966298 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-13 03:56:08.976507 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-13 03:56:09.622335 | 2026-04-13 03:56:09.622559 | PLAY [all] 2026-04-13 03:56:09.635574 | 2026-04-13 03:56:09.635699 | TASK [setup-uv : Extract archive] 2026-04-13 03:56:11.879933 | instance | changed 2026-04-13 03:56:11.886592 | 2026-04-13 03:56:11.886668 | TASK [setup-uv : Print version] 2026-04-13 03:56:12.105943 | instance | uv 0.8.13 2026-04-13 03:56:12.439275 | instance | ok: Runtime: 0:00:00.012486 2026-04-13 03:56:12.448400 | 2026-04-13 03:56:12.448486 | PLAY RECAP 2026-04-13 03:56:12.448553 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-13 03:56:12.448588 | 2026-04-13 03:56:12.582400 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-13 03:56:12.591736 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-13 03:56:13.240710 | 2026-04-13 03:56:13.240911 | PLAY [all] 2026-04-13 03:56:13.258432 | 2026-04-13 03:56:13.258627 | TASK [Install "jq" for log collection] 2026-04-13 03:56:24.281622 | instance | changed 2026-04-13 03:56:24.285511 | 2026-04-13 03:56:24.285591 | PLAY [all] 2026-04-13 03:56:24.295231 | 2026-04-13 03:56:24.295347 | TASK [ensure-go : Check installed go version] 2026-04-13 03:56:24.839765 | instance | ok: ERROR (ignored) 2026-04-13 03:56:24.840015 | instance | { 2026-04-13 03:56:24.840047 | instance | "failed_when_result": false, 2026-04-13 03:56:24.840072 | instance | "msg": "[Errno 2] No such file or directory: b'go'", 2026-04-13 03:56:24.840092 | instance | "rc": 2 2026-04-13 03:56:24.840111 | instance | } 2026-04-13 03:56:24.845477 | 2026-04-13 03:56:24.845552 | TASK [ensure-go : Skip if correct version of go is installed] 2026-04-13 03:56:24.899267 | instance | ok 2026-04-13 03:56:24.909228 | instance | included: /var/lib/zuul/builds/c345dfa4f4a74b19a90077ff43cd5b0a/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml 2026-04-13 03:56:24.914279 | 2026-04-13 03:56:24.914344 | TASK [ensure-go : Create temp directory] 2026-04-13 03:56:25.231282 | instance | changed 2026-04-13 03:56:25.238722 | 2026-04-13 03:56:25.239710 | TASK [ensure-go : Get archive checksum] 2026-04-13 03:56:25.873725 | instance | ok: OK (64 bytes) 2026-04-13 03:56:25.883796 | 2026-04-13 03:56:25.883874 | TASK [ensure-go : Download go archive] 2026-04-13 03:56:27.237997 | instance | changed: OK (78559214 bytes) 2026-04-13 03:56:27.243787 | 2026-04-13 03:56:27.243862 | TASK [ensure-go : Install go] 2026-04-13 03:56:33.104104 | instance | changed 2026-04-13 03:56:33.109927 | 2026-04-13 03:56:33.109978 | PLAY RECAP 2026-04-13 03:56:33.110021 | instance | ok: 7 changed: 4 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-13 03:56:33.110046 | 2026-04-13 03:56:33.218348 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-13 03:56:33.224634 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-13 03:56:33.877550 | 2026-04-13 03:56:33.877703 | PLAY [all] 2026-04-13 03:56:33.890567 | 2026-04-13 03:56:33.890666 | TASK [Copy inventory file for Zuul] 2026-04-13 03:56:34.737342 | instance | changed 2026-04-13 03:56:34.746342 | 2026-04-13 03:56:34.746612 | TASK [Switch "ansible_host" to private IP] 2026-04-13 03:56:35.057989 | instance | changed: 1 replacements made 2026-04-13 03:56:35.076451 | 2026-04-13 03:56:35.076517 | TASK [Run Molecule scenario] 2026-04-13 03:56:35.453995 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3 2026-04-13 03:56:35.454267 | instance | Creating virtual environment at: .venv 2026-04-13 03:56:35.478852 | instance | Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-13 03:56:35.504507 | instance | Downloading setuptools (1.1MiB) 2026-04-13 03:56:35.508968 | instance | Downloading rjsonnet (1.2MiB) 2026-04-13 03:56:35.510122 | instance | Downloading kubernetes (1.9MiB) 2026-04-13 03:56:35.510817 | instance | Downloading pygments (1.2MiB) 2026-04-13 03:56:35.511086 | instance | Downloading openstacksdk (1.7MiB) 2026-04-13 03:56:35.511350 | instance | Downloading ansible-core (2.1MiB) 2026-04-13 03:56:35.511623 | instance | Downloading pydantic-core (2.0MiB) 2026-04-13 03:56:35.527024 | instance | Downloading cryptography (4.2MiB) 2026-04-13 03:56:35.541750 | instance | Downloading netaddr (2.2MiB) 2026-04-13 03:56:35.838486 | instance | Building pyperclip==1.9.0 2026-04-13 03:56:35.844644 | instance | Downloading rjsonnet 2026-04-13 03:56:35.952345 | instance | Downloading pydantic-core 2026-04-13 03:56:36.009590 | instance | Downloading netaddr 2026-04-13 03:56:36.018865 | instance | Downloading pygments 2026-04-13 03:56:36.033492 | instance | Downloading cryptography 2026-04-13 03:56:36.075073 | instance | Downloading setuptools 2026-04-13 03:56:36.138422 | instance | Downloading kubernetes 2026-04-13 03:56:36.176793 | instance | Downloading ansible-core 2026-04-13 03:56:36.213955 | instance | Downloading openstacksdk 2026-04-13 03:56:36.679477 | instance | Built pyperclip==1.9.0 2026-04-13 03:56:36.769007 | instance | Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-13 03:56:36.810027 | instance | Installed 83 packages in 39ms 2026-04-13 03:56:37.448063 | instance | WARNING Molecule scenarios should migrate to 'extensions/molecule' 2026-04-13 03:56:38.046859 | instance | INFO [aio > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-04-13 03:56:38.046979 | instance | INFO [aio > prerun] Performing prerun with role_name_check=0... 2026-04-13 03:57:20.270374 | instance | INFO [aio > dependency] Executing 2026-04-13 03:57:20.270531 | instance | WARNING [aio > dependency] Missing roles requirements file: requirements.yml 2026-04-13 03:57:20.270546 | instance | WARNING [aio > dependency] Missing collections requirements file: collections.yml 2026-04-13 03:57:20.270676 | instance | WARNING [aio > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-04-13 03:57:20.278301 | instance | INFO [aio > cleanup] Executing 2026-04-13 03:57:20.278685 | instance | WARNING [aio > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-13 03:57:20.286350 | instance | INFO [aio > destroy] Executing 2026-04-13 03:57:20.286401 | instance | WARNING [aio > destroy] Skipping, '--destroy=never' requested. 2026-04-13 03:57:20.286482 | instance | INFO [aio > destroy] Executed: Successful 2026-04-13 03:57:20.293959 | instance | INFO [aio > syntax] Executing 2026-04-13 03:57:21.189164 | instance | 2026-04-13 03:57:21.189386 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml 2026-04-13 03:57:21.269975 | instance | INFO [aio > syntax] Executed: Successful 2026-04-13 03:57:21.282327 | instance | INFO [aio > create] Executing 2026-04-13 03:57:21.284124 | instance | WARNING [aio > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-13 03:57:21.292838 | instance | INFO [aio > prepare] Executing 2026-04-13 03:57:22.321086 | instance | 2026-04-13 03:57:22.321315 | instance | PLAY [Prepare] ***************************************************************** 2026-04-13 03:57:22.321573 | instance | 2026-04-13 03:57:22.321842 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-13 03:57:22.322115 | instance | Monday 13 April 2026 03:57:22 +0000 (0:00:00.027) 0:00:00.027 ********** 2026-04-13 03:57:23.476971 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-04-13 03:57:23.477227 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-13 03:57:23.477498 | instance | interpreter could change the meaning of that path. See 2026-04-13 03:57:23.477773 | instance | https://docs.ansible.com/ansible- 2026-04-13 03:57:23.478060 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-04-13 03:57:23.483096 | instance | ok: [instance] 2026-04-13 03:57:23.483284 | instance | 2026-04-13 03:57:23.483467 | instance | TASK [Configure short hostname] ************************************************ 2026-04-13 03:57:23.483650 | instance | Monday 13 April 2026 03:57:23 +0000 (0:00:01.162) 0:00:01.190 ********** 2026-04-13 03:57:24.165400 | instance | changed: [instance] 2026-04-13 03:57:24.165595 | instance | 2026-04-13 03:57:24.165872 | instance | TASK [Ensure hostname inside hosts file] *************************************** 2026-04-13 03:57:24.166150 | instance | Monday 13 April 2026 03:57:24 +0000 (0:00:00.681) 0:00:01.872 ********** 2026-04-13 03:57:24.435881 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-04-13 03:57:24.436079 | instance | with a mode of 0700, this may cause issues when running as another user. To 2026-04-13 03:57:24.436342 | instance | avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-13 03:57:24.444287 | instance | changed: [instance] 2026-04-13 03:57:24.444503 | instance | 2026-04-13 03:57:24.444781 | instance | TASK [Install "dirmngr" for GPG keyserver operations] ************************** 2026-04-13 03:57:24.445096 | instance | Monday 13 April 2026 03:57:24 +0000 (0:00:00.279) 0:00:02.151 ********** 2026-04-13 03:57:25.575095 | instance | ok: [instance] 2026-04-13 03:57:25.575295 | instance | 2026-04-13 03:57:25.575566 | instance | TASK [Purge "snapd" package] *************************************************** 2026-04-13 03:57:25.575837 | instance | Monday 13 April 2026 03:57:25 +0000 (0:00:01.130) 0:00:03.282 ********** 2026-04-13 03:57:26.219279 | instance | ok: [instance] 2026-04-13 03:57:26.219547 | instance | 2026-04-13 03:57:26.219896 | instance | PLAY [Generate workspace for Atmosphere] *************************************** 2026-04-13 03:57:26.220179 | instance | 2026-04-13 03:57:26.220479 | instance | TASK [Create folders for workspace] ******************************************** 2026-04-13 03:57:26.220776 | instance | Monday 13 April 2026 03:57:26 +0000 (0:00:00.644) 0:00:03.926 ********** 2026-04-13 03:57:27.245236 | instance | changed: [localhost] => (item=group_vars) 2026-04-13 03:57:27.245309 | instance | changed: [localhost] => (item=group_vars/all) 2026-04-13 03:57:27.245443 | instance | changed: [localhost] => (item=group_vars/controllers) 2026-04-13 03:57:27.245568 | instance | changed: [localhost] => (item=group_vars/cephs) 2026-04-13 03:57:27.245688 | instance | changed: [localhost] => (item=group_vars/computes) 2026-04-13 03:57:27.245809 | instance | changed: [localhost] => (item=host_vars) 2026-04-13 03:57:27.245942 | instance | 2026-04-13 03:57:27.246081 | instance | PLAY [Generate Ceph control plane configuration for workspace] ***************** 2026-04-13 03:57:27.246195 | instance | 2026-04-13 03:57:27.246319 | instance | TASK [Ensure the Ceph control plane configuration file exists] ***************** 2026-04-13 03:57:27.246435 | instance | Monday 13 April 2026 03:57:27 +0000 (0:00:01.026) 0:00:04.952 ********** 2026-04-13 03:57:27.418120 | instance | changed: [localhost] 2026-04-13 03:57:27.418370 | instance | 2026-04-13 03:57:27.418660 | instance | TASK [Load the current Ceph control plane configuration into a variable] ******* 2026-04-13 03:57:27.418998 | instance | Monday 13 April 2026 03:57:27 +0000 (0:00:00.172) 0:00:05.125 ********** 2026-04-13 03:57:27.445154 | instance | ok: [localhost] 2026-04-13 03:57:27.445392 | instance | 2026-04-13 03:57:27.445674 | instance | TASK [Generate Ceph control plane values for missing variables] **************** 2026-04-13 03:57:27.445944 | instance | Monday 13 April 2026 03:57:27 +0000 (0:00:00.026) 0:00:05.151 ********** 2026-04-13 03:57:27.490650 | instance | ok: [localhost] => (item={'key': 'ceph_fsid', 'value': '41827e63-1f22-5ab1-9ef7-61a00653ef81'}) 2026-04-13 03:57:27.490875 | instance | ok: [localhost] => (item={'key': 'ceph_mon_public_network', 'value': '10.96.240.0/24'}) 2026-04-13 03:57:27.491133 | instance | 2026-04-13 03:57:27.491580 | instance | TASK [Write new Ceph control plane configuration file to disk] ***************** 2026-04-13 03:57:27.491962 | instance | Monday 13 April 2026 03:57:27 +0000 (0:00:00.046) 0:00:05.197 ********** 2026-04-13 03:57:28.037368 | instance | changed: [localhost] 2026-04-13 03:57:28.037607 | instance | 2026-04-13 03:57:28.037897 | instance | PLAY [Generate Ceph OSD configuration for workspace] *************************** 2026-04-13 03:57:28.038157 | instance | 2026-04-13 03:57:28.038434 | instance | TASK [Ensure the Ceph OSDs configuration file exists] ************************** 2026-04-13 03:57:28.038711 | instance | Monday 13 April 2026 03:57:28 +0000 (0:00:00.546) 0:00:05.744 ********** 2026-04-13 03:57:28.207646 | instance | changed: [localhost] 2026-04-13 03:57:28.207849 | instance | 2026-04-13 03:57:28.208129 | instance | TASK [Load the current Ceph OSDs configuration into a variable] **************** 2026-04-13 03:57:28.208571 | instance | Monday 13 April 2026 03:57:28 +0000 (0:00:00.170) 0:00:05.914 ********** 2026-04-13 03:57:28.235268 | instance | ok: [localhost] 2026-04-13 03:57:28.235499 | instance | 2026-04-13 03:57:28.235760 | instance | TASK [Generate Ceph OSDs values for missing variables] ************************* 2026-04-13 03:57:28.236027 | instance | Monday 13 April 2026 03:57:28 +0000 (0:00:00.027) 0:00:05.942 ********** 2026-04-13 03:57:28.273047 | instance | ok: [localhost] => (item={'key': 'ceph_osd_devices', 'value': ['/dev/vdb', '/dev/vdc', '/dev/vdd']}) 2026-04-13 03:57:28.273285 | instance | 2026-04-13 03:57:28.273554 | instance | TASK [Write new Ceph OSDs configuration file to disk] ************************** 2026-04-13 03:57:28.273823 | instance | Monday 13 April 2026 03:57:28 +0000 (0:00:00.037) 0:00:05.980 ********** 2026-04-13 03:57:28.623084 | instance | changed: [localhost] 2026-04-13 03:57:28.623248 | instance | 2026-04-13 03:57:28.623484 | instance | PLAY [Generate Kubernetes configuration for workspace] ************************* 2026-04-13 03:57:28.623666 | instance | 2026-04-13 03:57:28.623869 | instance | TASK [Ensure the Kubernetes configuration file exists] ************************* 2026-04-13 03:57:28.624051 | instance | Monday 13 April 2026 03:57:28 +0000 (0:00:00.349) 0:00:06.330 ********** 2026-04-13 03:57:28.809091 | instance | changed: [localhost] 2026-04-13 03:57:28.809370 | instance | 2026-04-13 03:57:28.809665 | instance | TASK [Load the current Kubernetes configuration into a variable] *************** 2026-04-13 03:57:28.809948 | instance | Monday 13 April 2026 03:57:28 +0000 (0:00:00.185) 0:00:06.515 ********** 2026-04-13 03:57:28.836517 | instance | ok: [localhost] 2026-04-13 03:57:28.836749 | instance | 2026-04-13 03:57:28.837094 | instance | TASK [Generate Kubernetes values for missing variables] ************************ 2026-04-13 03:57:28.837474 | instance | Monday 13 April 2026 03:57:28 +0000 (0:00:00.028) 0:00:06.543 ********** 2026-04-13 03:57:28.879444 | instance | ok: [localhost] => (item={'key': 'kubernetes_hostname', 'value': '10.96.240.10'}) 2026-04-13 03:57:28.879669 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vrid', 'value': 42}) 2026-04-13 03:57:28.879940 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vip', 'value': '10.96.240.10'}) 2026-04-13 03:57:28.880189 | instance | 2026-04-13 03:57:28.880489 | instance | TASK [Write new Kubernetes configuration file to disk] ************************* 2026-04-13 03:57:28.880776 | instance | Monday 13 April 2026 03:57:28 +0000 (0:00:00.042) 0:00:06.586 ********** 2026-04-13 03:57:29.232069 | instance | changed: [localhost] 2026-04-13 03:57:29.232243 | instance | 2026-04-13 03:57:29.232517 | instance | PLAY [Generate Keepalived configuration for workspace] ************************* 2026-04-13 03:57:29.232992 | instance | 2026-04-13 03:57:29.233289 | instance | TASK [Ensure the Keeaplived configuration file exists] ************************* 2026-04-13 03:57:29.233558 | instance | Monday 13 April 2026 03:57:29 +0000 (0:00:00.352) 0:00:06.939 ********** 2026-04-13 03:57:29.406173 | instance | changed: [localhost] 2026-04-13 03:57:29.406321 | instance | 2026-04-13 03:57:29.406654 | instance | TASK [Load the current Keepalived configuration into a variable] *************** 2026-04-13 03:57:29.406935 | instance | Monday 13 April 2026 03:57:29 +0000 (0:00:00.173) 0:00:07.112 ********** 2026-04-13 03:57:29.431022 | instance | ok: [localhost] 2026-04-13 03:57:29.431210 | instance | 2026-04-13 03:57:29.431505 | instance | TASK [Generate Keepalived values for missing variables] ************************ 2026-04-13 03:57:29.431935 | instance | Monday 13 April 2026 03:57:29 +0000 (0:00:00.025) 0:00:07.138 ********** 2026-04-13 03:57:29.465730 | instance | ok: [localhost] => (item={'key': 'keepalived_interface', 'value': 'br-ex'}) 2026-04-13 03:57:29.465945 | instance | ok: [localhost] => (item={'key': 'keepalived_vip', 'value': '10.96.250.10'}) 2026-04-13 03:57:29.466211 | instance | 2026-04-13 03:57:29.466505 | instance | TASK [Write new Keepalived configuration file to disk] ************************* 2026-04-13 03:57:29.466795 | instance | Monday 13 April 2026 03:57:29 +0000 (0:00:00.034) 0:00:07.172 ********** 2026-04-13 03:57:29.830754 | instance | changed: [localhost] 2026-04-13 03:57:29.831154 | instance | 2026-04-13 03:57:29.831382 | instance | PLAY [Generate endpoints for workspace] **************************************** 2026-04-13 03:57:29.831700 | instance | 2026-04-13 03:57:29.832100 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-13 03:57:29.832452 | instance | Monday 13 April 2026 03:57:29 +0000 (0:00:00.364) 0:00:07.537 ********** 2026-04-13 03:57:30.512517 | instance | ok: [localhost] 2026-04-13 03:57:30.512720 | instance | 2026-04-13 03:57:30.513120 | instance | TASK [Ensure the endpoints file exists] **************************************** 2026-04-13 03:57:30.513402 | instance | Monday 13 April 2026 03:57:30 +0000 (0:00:00.681) 0:00:08.219 ********** 2026-04-13 03:57:30.688242 | instance | changed: [localhost] 2026-04-13 03:57:30.688465 | instance | 2026-04-13 03:57:30.688752 | instance | TASK [Load the current endpoints into a variable] ****************************** 2026-04-13 03:57:30.689065 | instance | Monday 13 April 2026 03:57:30 +0000 (0:00:00.175) 0:00:08.395 ********** 2026-04-13 03:57:30.716948 | instance | ok: [localhost] 2026-04-13 03:57:30.717094 | instance | 2026-04-13 03:57:30.717271 | instance | TASK [Generate endpoint skeleton for missing variables] ************************ 2026-04-13 03:57:30.717459 | instance | Monday 13 April 2026 03:57:30 +0000 (0:00:00.028) 0:00:08.424 ********** 2026-04-13 03:57:31.473615 | instance | ok: [localhost] => (item=keycloak_host) 2026-04-13 03:57:31.473842 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_host) 2026-04-13 03:57:31.474102 | instance | ok: [localhost] => (item=kube_prometheus_stack_alertmanager_host) 2026-04-13 03:57:31.474373 | instance | ok: [localhost] => (item=kube_prometheus_stack_prometheus_host) 2026-04-13 03:57:31.474696 | instance | ok: [localhost] => (item=openstack_helm_endpoints_region_name) 2026-04-13 03:57:31.475075 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_api_host) 2026-04-13 03:57:31.475374 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_api_host) 2026-04-13 03:57:31.475650 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_api_host) 2026-04-13 03:57:31.476092 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_api_host) 2026-04-13 03:57:31.476370 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_api_host) 2026-04-13 03:57:31.476591 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_api_host) 2026-04-13 03:57:31.476758 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_api_host) 2026-04-13 03:57:31.476988 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_novnc_host) 2026-04-13 03:57:31.477164 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_api_host) 2026-04-13 03:57:31.477338 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_api_host) 2026-04-13 03:57:31.477499 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_api_host) 2026-04-13 03:57:31.477733 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_api_host) 2026-04-13 03:57:31.477914 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_registry_host) 2026-04-13 03:57:31.478110 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_api_host) 2026-04-13 03:57:31.478282 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_cfn_api_host) 2026-04-13 03:57:31.478451 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_api_host) 2026-04-13 03:57:31.478619 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_host) 2026-04-13 03:57:31.478778 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_api_host) 2026-04-13 03:57:31.478935 | instance | 2026-04-13 03:57:31.479144 | instance | TASK [Write new endpoints file to disk] **************************************** 2026-04-13 03:57:31.479313 | instance | Monday 13 April 2026 03:57:31 +0000 (0:00:00.756) 0:00:09.180 ********** 2026-04-13 03:57:31.846689 | instance | changed: [localhost] 2026-04-13 03:57:31.846936 | instance | 2026-04-13 03:57:31.847219 | instance | TASK [Ensure the endpoints file exists] **************************************** 2026-04-13 03:57:31.847497 | instance | Monday 13 April 2026 03:57:31 +0000 (0:00:00.373) 0:00:09.553 ********** 2026-04-13 03:57:32.034959 | instance | changed: [localhost] 2026-04-13 03:57:32.035155 | instance | 2026-04-13 03:57:32.035483 | instance | PLAY [Generate Neutron configuration for workspace] **************************** 2026-04-13 03:57:32.035742 | instance | 2026-04-13 03:57:32.036017 | instance | TASK [Ensure the Neutron configuration file exists] **************************** 2026-04-13 03:57:32.036288 | instance | Monday 13 April 2026 03:57:32 +0000 (0:00:00.188) 0:00:09.742 ********** 2026-04-13 03:57:32.218217 | instance | changed: [localhost] 2026-04-13 03:57:32.218486 | instance | 2026-04-13 03:57:32.218825 | instance | TASK [Load the current Neutron configuration into a variable] ****************** 2026-04-13 03:57:32.219132 | instance | Monday 13 April 2026 03:57:32 +0000 (0:00:00.182) 0:00:09.925 ********** 2026-04-13 03:57:32.240104 | instance | ok: [localhost] 2026-04-13 03:57:32.240343 | instance | 2026-04-13 03:57:32.240603 | instance | TASK [Generate Neutron values for missing variables] *************************** 2026-04-13 03:57:32.240852 | instance | Monday 13 April 2026 03:57:32 +0000 (0:00:00.022) 0:00:09.947 ********** 2026-04-13 03:57:32.284291 | instance | ok: [localhost] => (item={'key': 'neutron_networks', 'value': [{'name': 'public', 'external': True, 'shared': True, 'mtu_size': 1500, 'port_security_enabled': True, 'provider_network_type': 'flat', 'provider_physical_network': 'external', 'subnets': [{'name': 'public-subnet', 'cidr': '10.96.250.0/24', 'gateway_ip': '10.96.250.10', 'allocation_pool_start': '10.96.250.200', 'allocation_pool_end': '10.96.250.220', 'enable_dhcp': True}]}]}) 2026-04-13 03:57:32.284503 | instance | 2026-04-13 03:57:32.284773 | instance | TASK [Write new Neutron configuration file to disk] **************************** 2026-04-13 03:57:32.285078 | instance | Monday 13 April 2026 03:57:32 +0000 (0:00:00.043) 0:00:09.991 ********** 2026-04-13 03:57:32.661723 | instance | changed: [localhost] 2026-04-13 03:57:32.661826 | instance | 2026-04-13 03:57:32.661842 | instance | PLAY [Generate Nova configuration for workspace] ******************************* 2026-04-13 03:57:32.661968 | instance | 2026-04-13 03:57:32.662237 | instance | TASK [Ensure the Nova configuration file exists] ******************************* 2026-04-13 03:57:32.662501 | instance | Monday 13 April 2026 03:57:32 +0000 (0:00:00.376) 0:00:10.367 ********** 2026-04-13 03:57:32.846899 | instance | changed: [localhost] 2026-04-13 03:57:32.847150 | instance | 2026-04-13 03:57:32.847428 | instance | TASK [Load the current Nova configuration into a variable] ********************* 2026-04-13 03:57:32.847696 | instance | Monday 13 April 2026 03:57:32 +0000 (0:00:00.185) 0:00:10.553 ********** 2026-04-13 03:57:32.881193 | instance | ok: [localhost] 2026-04-13 03:57:32.881575 | instance | 2026-04-13 03:57:32.882115 | instance | TASK [Generate Nova values for missing variables] ****************************** 2026-04-13 03:57:32.882242 | instance | Monday 13 April 2026 03:57:32 +0000 (0:00:00.034) 0:00:10.587 ********** 2026-04-13 03:57:32.925946 | instance | ok: [localhost] => (item={'key': 'nova_flavors', 'value': [{'name': 'm1.tiny', 'ram': 512, 'disk': 1, 'vcpus': 1}, {'name': 'm1.small', 'ram': 2048, 'disk': 20, 'vcpus': 1}, {'name': 'm1.medium', 'ram': 4096, 'disk': 40, 'vcpus': 2}, {'name': 'm1.large', 'ram': 8192, 'disk': 80, 'vcpus': 4}, {'name': 'm1.xlarge', 'ram': 16384, 'disk': 160, 'vcpus': 8}]}) 2026-04-13 03:57:32.926491 | instance | 2026-04-13 03:57:32.926854 | instance | TASK [Write new Nova configuration file to disk] ******************************* 2026-04-13 03:57:32.927212 | instance | Monday 13 April 2026 03:57:32 +0000 (0:00:00.044) 0:00:10.632 ********** 2026-04-13 03:57:33.292238 | instance | changed: [localhost] 2026-04-13 03:57:33.292309 | instance | 2026-04-13 03:57:33.293072 | instance | PLAY [Generate secrets for workspace] ****************************************** 2026-04-13 03:57:33.293180 | instance | 2026-04-13 03:57:33.293199 | instance | TASK [Ensure the secrets file exists] ****************************************** 2026-04-13 03:57:33.293206 | instance | Monday 13 April 2026 03:57:33 +0000 (0:00:00.367) 0:00:10.999 ********** 2026-04-13 03:57:33.468047 | instance | changed: [localhost] 2026-04-13 03:57:33.468196 | instance | 2026-04-13 03:57:33.468210 | instance | TASK [Load the current secrets into a variable] ******************************** 2026-04-13 03:57:33.468291 | instance | Monday 13 April 2026 03:57:33 +0000 (0:00:00.175) 0:00:11.174 ********** 2026-04-13 03:57:33.505124 | instance | ok: [localhost] 2026-04-13 03:57:33.505247 | instance | 2026-04-13 03:57:33.505382 | instance | TASK [Generate secrets for missing variables] ********************************** 2026-04-13 03:57:33.505646 | instance | Monday 13 April 2026 03:57:33 +0000 (0:00:00.037) 0:00:11.212 ********** 2026-04-13 03:57:33.932624 | instance | ok: [localhost] => (item=heat_auth_encryption_key) 2026-04-13 03:57:33.932734 | instance | ok: [localhost] => (item=keepalived_password) 2026-04-13 03:57:33.932746 | instance | ok: [localhost] => (item=keycloak_admin_password) 2026-04-13 03:57:33.932878 | instance | ok: [localhost] => (item=keycloak_database_password) 2026-04-13 03:57:33.933252 | instance | ok: [localhost] => (item=keystone_keycloak_client_secret) 2026-04-13 03:57:33.933494 | instance | ok: [localhost] => (item=keystone_oidc_crypto_passphrase) 2026-04-13 03:57:33.933717 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_admin_password) 2026-04-13 03:57:33.933882 | instance | ok: [localhost] => (item=octavia_heartbeat_key) 2026-04-13 03:57:33.934039 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rabbitmq_admin_password) 2026-04-13 03:57:33.934229 | instance | ok: [localhost] => (item=openstack_helm_endpoints_memcached_secret_key) 2026-04-13 03:57:33.934409 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_admin_password) 2026-04-13 03:57:33.934580 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_mariadb_password) 2026-04-13 03:57:33.934773 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_rabbitmq_password) 2026-04-13 03:57:33.935198 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_keystone_password) 2026-04-13 03:57:33.935417 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_mariadb_password) 2026-04-13 03:57:33.935627 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_rabbitmq_password) 2026-04-13 03:57:33.935834 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_keystone_password) 2026-04-13 03:57:33.936031 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_mariadb_password) 2026-04-13 03:57:33.936233 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_rabbitmq_password) 2026-04-13 03:57:33.936434 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_keystone_password) 2026-04-13 03:57:33.936654 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_mariadb_password) 2026-04-13 03:57:33.936813 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_keystone_password) 2026-04-13 03:57:33.937020 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_mariadb_password) 2026-04-13 03:57:33.937262 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_keystone_password) 2026-04-13 03:57:33.937477 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_mariadb_password) 2026-04-13 03:57:33.937692 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_rabbitmq_password) 2026-04-13 03:57:33.937883 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_metadata_secret) 2026-04-13 03:57:33.938087 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_keystone_password) 2026-04-13 03:57:33.938306 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_mariadb_password) 2026-04-13 03:57:33.938519 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_rabbitmq_password) 2026-04-13 03:57:33.938733 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_keystone_password) 2026-04-13 03:57:33.938911 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_mariadb_password) 2026-04-13 03:57:33.939062 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_rabbitmq_password) 2026-04-13 03:57:33.939212 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_keystone_password) 2026-04-13 03:57:33.939371 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_mariadb_password) 2026-04-13 03:57:33.939553 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_rabbitmq_password) 2026-04-13 03:57:33.939791 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_keystone_password) 2026-04-13 03:57:33.939960 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_mariadb_password) 2026-04-13 03:57:33.940144 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_rabbitmq_password) 2026-04-13 03:57:33.940341 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_keystone_password) 2026-04-13 03:57:33.940556 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_mariadb_password) 2026-04-13 03:57:33.940765 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_rabbitmq_password) 2026-04-13 03:57:33.940997 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_keystone_password) 2026-04-13 03:57:33.941258 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_trustee_keystone_password) 2026-04-13 03:57:33.941469 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_stack_user_keystone_password) 2026-04-13 03:57:33.941667 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_mariadb_password) 2026-04-13 03:57:33.941867 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_rabbitmq_password) 2026-04-13 03:57:33.942069 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_mariadb_password) 2026-04-13 03:57:33.942258 | instance | ok: [localhost] => (item=openstack_helm_endpoints_tempest_keystone_password) 2026-04-13 03:57:33.942418 | instance | ok: [localhost] => (item=openstack_helm_endpoints_openstack_exporter_keystone_password) 2026-04-13 03:57:33.942588 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_keystone_password) 2026-04-13 03:57:33.942803 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_keystone_password) 2026-04-13 03:57:33.943018 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_mariadb_password) 2026-04-13 03:57:33.943236 | instance | ok: [localhost] => (item=openstack_helm_endpoints_staffeln_mariadb_password) 2026-04-13 03:57:33.943423 | instance | 2026-04-13 03:57:33.943581 | instance | TASK [Generate base64 encoded secrets] ***************************************** 2026-04-13 03:57:33.943738 | instance | Monday 13 April 2026 03:57:33 +0000 (0:00:00.427) 0:00:11.639 ********** 2026-04-13 03:57:33.997639 | instance | ok: [localhost] => (item=barbican_kek) 2026-04-13 03:57:33.997734 | instance | 2026-04-13 03:57:33.997741 | instance | TASK [Generate temporary files for generating keys for missing variables] ****** 2026-04-13 03:57:33.997893 | instance | Monday 13 April 2026 03:57:33 +0000 (0:00:00.063) 0:00:11.703 ********** 2026-04-13 03:57:34.401984 | instance | changed: [localhost] => (item=manila_ssh_key) 2026-04-13 03:57:34.402192 | instance | changed: [localhost] => (item=nova_ssh_key) 2026-04-13 03:57:34.402448 | instance | 2026-04-13 03:57:34.402719 | instance | TASK [Generate SSH keys for missing variables] ********************************* 2026-04-13 03:57:34.402991 | instance | Monday 13 April 2026 03:57:34 +0000 (0:00:00.405) 0:00:12.108 ********** 2026-04-13 03:57:38.792392 | instance | changed: [localhost] => (item=manila_ssh_key) 2026-04-13 03:57:38.792614 | instance | changed: [localhost] => (item=nova_ssh_key) 2026-04-13 03:57:38.792768 | instance | 2026-04-13 03:57:38.792970 | instance | TASK [Set values for SSH keys] ************************************************* 2026-04-13 03:57:38.793152 | instance | Monday 13 April 2026 03:57:38 +0000 (0:00:04.388) 0:00:16.497 ********** 2026-04-13 03:57:38.847846 | instance | ok: [localhost] => (item=manila_ssh_key) 2026-04-13 03:57:38.848212 | instance | ok: [localhost] => (item=nova_ssh_key) 2026-04-13 03:57:38.848536 | instance | 2026-04-13 03:57:38.848879 | instance | TASK [Delete the temporary files generated for SSH keys] *********************** 2026-04-13 03:57:38.849252 | instance | Monday 13 April 2026 03:57:38 +0000 (0:00:00.057) 0:00:16.554 ********** 2026-04-13 03:57:39.187721 | instance | changed: [localhost] => (item=manila_ssh_key) 2026-04-13 03:57:39.188138 | instance | changed: [localhost] => (item=nova_ssh_key) 2026-04-13 03:57:39.188458 | instance | 2026-04-13 03:57:39.188793 | instance | TASK [Write new secrets file to disk] ****************************************** 2026-04-13 03:57:39.189169 | instance | Monday 13 April 2026 03:57:39 +0000 (0:00:00.340) 0:00:16.894 ********** 2026-04-13 03:57:39.548096 | instance | changed: [localhost] 2026-04-13 03:57:39.548160 | instance | 2026-04-13 03:57:39.548171 | instance | TASK [Encrypt secrets file with Vault password] ******************************** 2026-04-13 03:57:39.548181 | instance | Monday 13 April 2026 03:57:39 +0000 (0:00:00.359) 0:00:17.254 ********** 2026-04-13 03:57:39.583811 | instance | skipping: [localhost] 2026-04-13 03:57:39.583855 | instance | 2026-04-13 03:57:39.583861 | instance | PLAY [Setup networking] ******************************************************** 2026-04-13 03:57:39.583865 | instance | 2026-04-13 03:57:39.583870 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-13 03:57:39.583874 | instance | Monday 13 April 2026 03:57:39 +0000 (0:00:00.035) 0:00:17.290 ********** 2026-04-13 03:57:40.283825 | instance | ok: [instance] 2026-04-13 03:57:40.284115 | instance | 2026-04-13 03:57:40.284391 | instance | TASK [Create bridge for management network] ************************************ 2026-04-13 03:57:40.284660 | instance | Monday 13 April 2026 03:57:40 +0000 (0:00:00.700) 0:00:17.990 ********** 2026-04-13 03:57:40.634894 | instance | ok: [instance] 2026-04-13 03:57:40.635131 | instance | 2026-04-13 03:57:40.635404 | instance | TASK [Create fake interface for management bridge] ***************************** 2026-04-13 03:57:40.635673 | instance | Monday 13 April 2026 03:57:40 +0000 (0:00:00.351) 0:00:18.342 ********** 2026-04-13 03:57:40.847913 | instance | ok: [instance] 2026-04-13 03:57:40.848146 | instance | 2026-04-13 03:57:40.848480 | instance | TASK [Assign dummy interface to management bridge] ***************************** 2026-04-13 03:57:40.848758 | instance | Monday 13 April 2026 03:57:40 +0000 (0:00:00.213) 0:00:18.555 ********** 2026-04-13 03:57:41.059394 | instance | ok: [instance] 2026-04-13 03:57:41.059671 | instance | 2026-04-13 03:57:41.059955 | instance | TASK [Assign IP address for management bridge] ********************************* 2026-04-13 03:57:41.060224 | instance | Monday 13 April 2026 03:57:41 +0000 (0:00:00.211) 0:00:18.766 ********** 2026-04-13 03:57:41.251512 | instance | ok: [instance] 2026-04-13 03:57:41.251642 | instance | 2026-04-13 03:57:41.251809 | instance | TASK [Bring up interfaces] ***************************************************** 2026-04-13 03:57:41.251972 | instance | Monday 13 April 2026 03:57:41 +0000 (0:00:00.192) 0:00:18.958 ********** 2026-04-13 03:57:41.625607 | instance | ok: [instance] => (item=br-mgmt) 2026-04-13 03:57:41.626030 | instance | ok: [instance] => (item=dummy0) 2026-04-13 03:57:41.626363 | instance | 2026-04-13 03:57:41.626709 | instance | PLAY [Create devices for Ceph] ************************************************* 2026-04-13 03:57:41.627027 | instance | 2026-04-13 03:57:41.627365 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-13 03:57:41.627700 | instance | Monday 13 April 2026 03:57:41 +0000 (0:00:00.374) 0:00:19.332 ********** 2026-04-13 03:57:42.361805 | instance | ok: [instance] 2026-04-13 03:57:42.362204 | instance | 2026-04-13 03:57:42.362562 | instance | TASK [Install depedencies] ***************************************************** 2026-04-13 03:57:42.362911 | instance | Monday 13 April 2026 03:57:42 +0000 (0:00:00.734) 0:00:20.066 ********** 2026-04-13 03:58:06.985982 | instance | changed: [instance] 2026-04-13 03:58:06.986375 | instance | 2026-04-13 03:58:06.986752 | instance | TASK [Start up service] ******************************************************** 2026-04-13 03:58:06.987122 | instance | Monday 13 April 2026 03:58:06 +0000 (0:00:24.625) 0:00:44.692 ********** 2026-04-13 03:58:07.557582 | instance | ok: [instance] 2026-04-13 03:58:07.557674 | instance | 2026-04-13 03:58:07.557817 | instance | TASK [Generate lvm.conf] ******************************************************* 2026-04-13 03:58:07.558115 | instance | Monday 13 April 2026 03:58:07 +0000 (0:00:00.570) 0:00:45.262 ********** 2026-04-13 03:58:07.777906 | instance | ok: [instance] 2026-04-13 03:58:07.778349 | instance | 2026-04-13 03:58:07.778705 | instance | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-04-13 03:58:07.779049 | instance | Monday 13 April 2026 03:58:07 +0000 (0:00:00.220) 0:00:45.483 ********** 2026-04-13 03:58:08.245744 | instance | changed: [instance] 2026-04-13 03:58:08.246130 | instance | 2026-04-13 03:58:08.246468 | instance | TASK [Get list of all loopback devices] **************************************** 2026-04-13 03:58:08.246816 | instance | Monday 13 April 2026 03:58:08 +0000 (0:00:00.468) 0:00:45.951 ********** 2026-04-13 03:58:08.457788 | instance | ok: [instance] 2026-04-13 03:58:08.458040 | instance | 2026-04-13 03:58:08.458243 | instance | TASK [Fail if there is any existing loopback devices] ************************** 2026-04-13 03:58:08.458398 | instance | Monday 13 April 2026 03:58:08 +0000 (0:00:00.212) 0:00:46.164 ********** 2026-04-13 03:58:08.485627 | instance | skipping: [instance] 2026-04-13 03:58:08.485834 | instance | 2026-04-13 03:58:08.486000 | instance | TASK [Create devices for Ceph] ************************************************* 2026-04-13 03:58:08.486192 | instance | Monday 13 April 2026 03:58:08 +0000 (0:00:00.027) 0:00:46.191 ********** 2026-04-13 03:58:09.096581 | instance | changed: [instance] => (item=osd0) 2026-04-13 03:58:09.096854 | instance | changed: [instance] => (item=osd1) 2026-04-13 03:58:09.097107 | instance | changed: [instance] => (item=osd2) 2026-04-13 03:58:09.097370 | instance | 2026-04-13 03:58:09.097600 | instance | TASK [Set permissions on loopback devices] ************************************* 2026-04-13 03:58:09.097812 | instance | Monday 13 April 2026 03:58:09 +0000 (0:00:00.610) 0:00:46.801 ********** 2026-04-13 03:58:09.696248 | instance | changed: [instance] => (item=osd0) 2026-04-13 03:58:09.696652 | instance | changed: [instance] => (item=osd1) 2026-04-13 03:58:09.697085 | instance | changed: [instance] => (item=osd2) 2026-04-13 03:58:09.697414 | instance | 2026-04-13 03:58:09.697759 | instance | TASK [Start loop devices] ****************************************************** 2026-04-13 03:58:09.698087 | instance | Monday 13 April 2026 03:58:09 +0000 (0:00:00.601) 0:00:47.403 ********** 2026-04-13 03:58:10.450906 | instance | changed: [instance] => (item=osd0) 2026-04-13 03:58:10.451368 | instance | changed: [instance] => (item=osd1) 2026-04-13 03:58:10.451709 | instance | changed: [instance] => (item=osd2) 2026-04-13 03:58:10.452022 | instance | 2026-04-13 03:58:10.452350 | instance | TASK [Create a volume group for each loop device] ****************************** 2026-04-13 03:58:10.452679 | instance | Monday 13 April 2026 03:58:10 +0000 (0:00:00.754) 0:00:48.158 ********** 2026-04-13 03:58:13.630126 | instance | changed: [instance] => (item=osd0) 2026-04-13 03:58:13.630552 | instance | changed: [instance] => (item=osd1) 2026-04-13 03:58:13.630905 | instance | changed: [instance] => (item=osd2) 2026-04-13 03:58:13.631234 | instance | 2026-04-13 03:58:13.631582 | instance | TASK [Create a logical volume for each loop device] **************************** 2026-04-13 03:58:13.631930 | instance | Monday 13 April 2026 03:58:13 +0000 (0:00:03.178) 0:00:51.337 ********** 2026-04-13 03:58:15.572734 | instance | changed: [instance] => (item=ceph-instance-osd0) 2026-04-13 03:58:15.572844 | instance | changed: [instance] => (item=ceph-instance-osd1) 2026-04-13 03:58:15.573692 | instance | changed: [instance] => (item=ceph-instance-osd2) 2026-04-13 03:58:15.573746 | instance | 2026-04-13 03:58:15.573758 | instance | PLAY [controllers] ************************************************************* 2026-04-13 03:58:15.573765 | instance | 2026-04-13 03:58:15.573770 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-13 03:58:15.573776 | instance | Monday 13 April 2026 03:58:15 +0000 (0:00:01.943) 0:00:53.280 ********** 2026-04-13 03:58:16.492653 | instance | ok: [instance] 2026-04-13 03:58:16.492764 | instance | 2026-04-13 03:58:16.493110 | instance | TASK [Set masquerade rule] ***************************************************** 2026-04-13 03:58:16.493240 | instance | Monday 13 April 2026 03:58:16 +0000 (0:00:00.919) 0:00:54.199 ********** 2026-04-13 03:58:17.012094 | instance | changed: [instance] 2026-04-13 03:58:17.013080 | instance | 2026-04-13 03:58:17.013149 | instance | PLAY RECAP ********************************************************************* 2026-04-13 03:58:17.013162 | instance | instance : ok=24 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-13 03:58:17.014475 | instance | localhost : ok=40 changed=21 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-13 03:58:17.014580 | instance | 2026-04-13 03:58:17.014594 | instance | Monday 13 April 2026 03:58:17 +0000 (0:00:00.519) 0:00:54.719 ********** 2026-04-13 03:58:17.014605 | instance | =============================================================================== 2026-04-13 03:58:17.014675 | instance | Install depedencies ---------------------------------------------------- 24.63s 2026-04-13 03:58:17.014697 | instance | Generate SSH keys for missing variables --------------------------------- 4.39s 2026-04-13 03:58:17.014995 | instance | Create a volume group for each loop device ------------------------------ 3.18s 2026-04-13 03:58:17.015404 | instance | Create a logical volume for each loop device ---------------------------- 1.94s 2026-04-13 03:58:17.015917 | instance | Gathering Facts --------------------------------------------------------- 1.16s 2026-04-13 03:58:17.016246 | instance | Install "dirmngr" for GPG keyserver operations -------------------------- 1.13s 2026-04-13 03:58:17.016572 | instance | Create folders for workspace -------------------------------------------- 1.03s 2026-04-13 03:58:17.017000 | instance | Gathering Facts --------------------------------------------------------- 0.92s 2026-04-13 03:58:17.017431 | instance | Generate endpoint skeleton for missing variables ------------------------ 0.76s 2026-04-13 03:58:17.017798 | instance | Start loop devices ------------------------------------------------------ 0.75s 2026-04-13 03:58:17.018128 | instance | Gathering Facts --------------------------------------------------------- 0.73s 2026-04-13 03:58:17.018448 | instance | Gathering Facts --------------------------------------------------------- 0.70s 2026-04-13 03:58:17.018766 | instance | Gathering Facts --------------------------------------------------------- 0.68s 2026-04-13 03:58:17.019090 | instance | Configure short hostname ------------------------------------------------ 0.68s 2026-04-13 03:58:17.019413 | instance | Purge "snapd" package --------------------------------------------------- 0.64s 2026-04-13 03:58:17.019735 | instance | Create devices for Ceph ------------------------------------------------- 0.61s 2026-04-13 03:58:17.020058 | instance | Set permissions on loopback devices ------------------------------------- 0.60s 2026-04-13 03:58:17.020454 | instance | Start up service -------------------------------------------------------- 0.57s 2026-04-13 03:58:17.020834 | instance | Write new Ceph control plane configuration file to disk ----------------- 0.55s 2026-04-13 03:58:17.021205 | instance | Set masquerade rule ----------------------------------------------------- 0.52s 2026-04-13 03:58:17.098987 | instance | INFO [aio > prepare] Executed: Successful 2026-04-13 03:58:17.111985 | instance | INFO [aio > converge] Executing 2026-04-13 03:58:17.843785 | instance | 2026-04-13 03:58:17.844207 | instance | PLAY [localhost] *************************************************************** 2026-04-13 03:58:17.844598 | instance | 2026-04-13 03:58:17.845140 | instance | TASK [Build atmosphere binary] ************************************************* 2026-04-13 03:58:17.845474 | instance | Monday 13 April 2026 03:58:17 +0000 (0:00:00.010) 0:00:00.010 ********** 2026-04-13 03:58:25.077057 | instance | changed: [localhost] 2026-04-13 03:58:25.077353 | instance | 2026-04-13 03:58:25.077364 | instance | TASK [Deploy with parallel orchestrator] *************************************** 2026-04-13 03:58:25.077383 | instance | Monday 13 April 2026 03:58:25 +0000 (0:00:07.230) 0:00:07.241 ********** 2026-04-13 03:58:56.473474 | instance | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["/home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/../../bin/atmosphere", "deploy", "--inventory", "/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml"], "delta": "0:00:31.223069", "end": "2026-04-13 03:58:56.446187", "msg": "non-zero return code", "rc": 1, "start": "2026-04-13 03:58:25.223118", "stderr": "Error: component kubernetes failed: ansible-playbook failed for kubernetes: exit status 2\nUsage:\n atmosphere deploy [flags]\n\nFlags:\n --concurrency int Max concurrent deployments per wave (0 = unlimited)\n -h, --help help for deploy\n -i, --inventory string Path to Ansible inventory file (required)\n -t, --tags string Comma-separated list of component tags to deploy\n\ncomponent kubernetes failed: ansible-playbook failed for kubernetes: exit status 2", "stderr_lines": ["Error: component kubernetes failed: ansible-playbook failed for kubernetes: exit status 2", "Usage:", " atmosphere deploy [flags]", "", "Flags:", " --concurrency int Max concurrent deployments per wave (0 = unlimited)", " -h, --help help for deploy", " -i, --inventory string Path to Ansible inventory file (required)", " -t, --tags string Comma-separated list of component tags to deploy", "", "component kubernetes failed: ansible-playbook failed for kubernetes: exit status 2"], "stdout": "==> Starting parallel deployment\n==> [kubernetes] Starting deployment\n==> [udev] Starting deployment\n==> [lpfc] Starting deployment\n==> [ceph] Starting deployment\n==> [iscsi] Starting deployment\n==> [multipathd] Starting deployment\n[udev] \n[udev] PLAY [controllers:computes] ****************************************************\n[udev] \n[udev] TASK [Gathering Facts] *********************************************************\n[udev] Monday 13 April 2026 03:58:25 +0000 (0:00:00.012) 0:00:00.012 ********** \n[lpfc] \n[lpfc] PLAY [controllers:computes] ****************************************************\n[lpfc] \n[lpfc] TASK [Gathering Facts] *********************************************************\n[lpfc] Monday 13 April 2026 03:58:25 +0000 (0:00:00.013) 0:00:00.013 ********** \n[iscsi] \n[iscsi] PLAY [controllers:computes] ****************************************************\n[iscsi] \n[iscsi] TASK [Gathering Facts] *********************************************************\n[iscsi] Monday 13 April 2026 03:58:25 +0000 (0:00:00.014) 0:00:00.014 ********** \n[multipathd] \n[multipathd] PLAY [controllers:computes] ****************************************************\n[multipathd] \n[multipathd] TASK [Gathering Facts] *********************************************************\n[multipathd] Monday 13 April 2026 03:58:25 +0000 (0:00:00.017) 0:00:00.017 ********** \n[kubernetes] \n[kubernetes] PLAY [all] *********************************************************************\n[kubernetes] \n[kubernetes] TASK [Gathering Facts] *********************************************************\n[kubernetes] Monday 13 April 2026 03:58:26 +0000 (0:00:00.020) 0:00:00.020 ********** \n[udev] [WARNING]: Platform linux on host instance is using the discovered Python\n[udev] interpreter at /usr/bin/python3.10, but future installation of another Python\n[udev] interpreter could change the meaning of that path. See\n[udev] https://docs.ansible.com/ansible-\n[udev] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[udev] ok: [instance]\n[udev] \n[udev] TASK [vexxhost.atmosphere.udev : Add udev rules for Pure Storage FlashArray] ***\n[udev] Monday 13 April 2026 03:58:26 +0000 (0:00:01.223) 0:00:01.235 ********** \n[multipathd] [WARNING]: Platform linux on host instance is using the discovered Python\n[multipathd] interpreter at /usr/bin/python3.10, but future installation of another Python\n[multipathd] interpreter could change the meaning of that path. See\n[multipathd] https://docs.ansible.com/ansible-\n[multipathd] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[lpfc] [WARNING]: Platform linux on host instance is using the discovered Python\n[lpfc] interpreter at /usr/bin/python3.10, but future installation of another Python\n[lpfc] interpreter could change the meaning of that path. See\n[lpfc] https://docs.ansible.com/ansible-\n[lpfc] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[lpfc] ok: [instance]\n[lpfc] \n[lpfc] TASK [vexxhost.atmosphere.lpfc : Detect if the \"lpfc\" module is loaded] ********\n[lpfc] Monday 13 April 2026 03:58:27 +0000 (0:00:01.275) 0:00:01.289 ********** \n[multipathd] ok: [instance]\n[multipathd] \n[multipathd] TASK [vexxhost.atmosphere.multipathd : Add backports PPA] **********************\n[multipathd] Monday 13 April 2026 03:58:27 +0000 (0:00:01.224) 0:00:01.241 ********** \n[iscsi] [WARNING]: Platform linux on host instance is using the discovered Python\n[iscsi] interpreter at /usr/bin/python3.10, but future installation of another Python\n[iscsi] interpreter could change the meaning of that path. See\n[iscsi] https://docs.ansible.com/ansible-\n[iscsi] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[iscsi] ok: [instance]\n[iscsi] \n[iscsi] TASK [vexxhost.atmosphere.iscsi : Install iscsi package] ***********************\n[iscsi] Monday 13 April 2026 03:58:27 +0000 (0:00:01.258) 0:00:01.272 ********** \n[lpfc] ok: [instance]\n[lpfc] \n[lpfc] TASK [vexxhost.atmosphere.lpfc : Install the configuration file] ***************\n[lpfc] Monday 13 April 2026 03:58:27 +0000 (0:00:00.280) 0:00:01.569 ********** \n[lpfc] skipping: [instance]\n[lpfc] \n[lpfc] TASK [vexxhost.atmosphere.lpfc : Get the values for the module parameters] *****\n[lpfc] Monday 13 April 2026 03:58:27 +0000 (0:00:00.030) 0:00:01.600 ********** \n[lpfc] skipping: [instance] => (item=lpfc_lun_queue_depth) \n[lpfc] skipping: [instance] => (item=lpfc_sg_seg_cnt) \n[lpfc] skipping: [instance] => (item=lpfc_max_luns) \n[lpfc] skipping: [instance] => (item=lpfc_enable_fc4_type) \n[lpfc] skipping: [instance]\n[lpfc] \n[lpfc] TASK [vexxhost.atmosphere.lpfc : Detect if the run-time module parameters are set correctly] ***\n[lpfc] Monday 13 April 2026 03:58:27 +0000 (0:00:00.043) 0:00:01.644 ********** \n[lpfc] skipping: [instance] => (item=lpfc_lun_queue_depth) \n[lpfc] skipping: [instance] => (item=lpfc_sg_seg_cnt) \n[lpfc] skipping: [instance] => (item=lpfc_max_luns) \n[lpfc] skipping: [instance] => (item=lpfc_enable_fc4_type) \n[lpfc] skipping: [instance]\n[lpfc] \n[lpfc] TASK [vexxhost.atmosphere.lpfc : Update \"initramfs\" if the configuration file has changed] ***\n[lpfc] Monday 13 April 2026 03:58:27 +0000 (0:00:00.038) 0:00:01.682 ********** \n[lpfc] skipping: [instance]\n[lpfc] \n[lpfc] TASK [Reboot the system if the configuration file has changed] *****************\n[lpfc] Monday 13 April 2026 03:58:27 +0000 (0:00:00.026) 0:00:01.709 ********** \n[kubernetes] [WARNING]: Platform linux on host instance is using the discovered Python\n[kubernetes] interpreter at /usr/bin/python3.10, but future installation of another Python\n[kubernetes] interpreter could change the meaning of that path. See\n[kubernetes] https://docs.ansible.com/ansible-\n[kubernetes] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[kubernetes] ok: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.atmosphere.sysctl : Configure sysctl values] ********************\n[kubernetes] Monday 13 April 2026 03:58:27 +0000 (0:00:01.327) 0:00:01.348 ********** \n[lpfc] skipping: [instance]\n[lpfc] \n[lpfc] PLAY RECAP *********************************************************************\n[lpfc] instance : ok=2 changed=0 unreachable=0 failed=0 skipped=5 rescued=0 ignored=0 \n[lpfc] \n[lpfc] Monday 13 April 2026 03:58:27 +0000 (0:00:00.030) 0:00:01.739 ********** \n[lpfc] =============================================================================== \n[lpfc] Gathering Facts --------------------------------------------------------- 1.28s\n[lpfc] vexxhost.atmosphere.lpfc : Detect if the \"lpfc\" module is loaded -------- 0.28s\n[lpfc] vexxhost.atmosphere.lpfc : Get the values for the module parameters ----- 0.04s\n[lpfc] vexxhost.atmosphere.lpfc : Detect if the run-time module parameters are set correctly --- 0.04s\n[lpfc] vexxhost.atmosphere.lpfc : Install the configuration file --------------- 0.03s\n[lpfc] Reboot the system if the configuration file has changed ----------------- 0.03s\n[lpfc] vexxhost.atmosphere.lpfc : Update \"initramfs\" if the configuration file has changed --- 0.03s\n==> [lpfc] Deployment complete\n[udev] changed: [instance]\n[udev] \n[udev] TASK [vexxhost.atmosphere.udev : Add udev rules for SCSI Unit Attention] *******\n[udev] Monday 13 April 2026 03:58:27 +0000 (0:00:00.675) 0:00:01.910 ********** \n[udev] changed: [instance]\n[udev] \n[udev] RUNNING HANDLER [vexxhost.atmosphere.udev : Reload udev] ***********************\n[udev] Monday 13 April 2026 03:58:28 +0000 (0:00:00.507) 0:00:02.417 ********** \n[iscsi] ok: [instance]\n[iscsi] \n[iscsi] TASK [vexxhost.atmosphere.iscsi : Ensure iscsid is started] ********************\n[iscsi] Monday 13 April 2026 03:58:28 +0000 (0:00:01.390) 0:00:02.663 ********** \n[udev] ok: [instance]\n[udev] \n[udev] PLAY RECAP *********************************************************************\n[udev] instance : ok=4 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 \n[udev] \n[udev] Monday 13 April 2026 03:58:28 +0000 (0:00:00.330) 0:00:02.748 ********** \n[udev] =============================================================================== \n[udev] Gathering Facts --------------------------------------------------------- 1.22s\n[udev] vexxhost.atmosphere.udev : Add udev rules for Pure Storage FlashArray --- 0.68s\n[udev] vexxhost.atmosphere.udev : Add udev rules for SCSI Unit Attention ------- 0.51s\n[udev] vexxhost.atmosphere.udev : Reload udev ---------------------------------- 0.33s\n==> [udev] Deployment complete\n[iscsi] changed: [instance]\n[iscsi] \n[iscsi] PLAY RECAP *********************************************************************\n[iscsi] instance : ok=3 changed=1 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 \n[iscsi] \n[iscsi] Monday 13 April 2026 03:58:30 +0000 (0:00:01.593) 0:00:04.257 ********** \n[iscsi] =============================================================================== \n[iscsi] vexxhost.atmosphere.iscsi : Ensure iscsid is started -------------------- 1.59s\n[iscsi] vexxhost.atmosphere.iscsi : Install iscsi package ----------------------- 1.39s\n[iscsi] Gathering Facts --------------------------------------------------------- 1.26s\n==> [iscsi] Deployment complete\n[kubernetes] changed: [instance] => (item={'name': 'fs.aio-max-nr', 'value': 1048576})\n[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_timestamps', 'value': 0})\n[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_sack', 'value': 1})\n[kubernetes] changed: [instance] => (item={'name': 'net.core.netdev_budget', 'value': 1000})\n[kubernetes] changed: [instance] => (item={'name': 'net.core.netdev_max_backlog', 'value': 250000})\n[kubernetes] changed: [instance] => (item={'name': 'net.core.rmem_max', 'value': 4194304})\n[kubernetes] changed: [instance] => (item={'name': 'net.core.wmem_max', 'value': 4194304})\n[kubernetes] changed: [instance] => (item={'name': 'net.core.rmem_default', 'value': 4194304})\n[kubernetes] changed: [instance] => (item={'name': 'net.core.wmem_default', 'value': 4194304})\n[kubernetes] changed: [instance] => (item={'name': 'net.core.optmem_max', 'value': 4194304})\n[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_rmem', 'value': '4096 87380 4194304'})\n[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_wmem', 'value': '4096 65536 4194304'})\n[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_low_latency', 'value': 1})\n[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_adv_win_scale', 'value': 1})\n[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh1', 'value': 128})\n[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh2', 'value': 28872})\n[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh3', 'value': 32768})\n[kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh1', 'value': 128})\n[kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh2', 'value': 28872})\n[kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh3', 'value': 32768})\n[kubernetes] \n[kubernetes] TASK [vexxhost.atmosphere.ethtool : Create folder for persistent configuration] ***\n[kubernetes] Monday 13 April 2026 03:58:32 +0000 (0:00:05.152) 0:00:06.500 ********** \n[kubernetes] changed: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.atmosphere.ethtool : Install persistent \"ethtool\" tuning] *******\n[kubernetes] Monday 13 April 2026 03:58:32 +0000 (0:00:00.313) 0:00:06.813 ********** \n[multipathd] changed: [instance]\n[multipathd] \n[multipathd] TASK [vexxhost.atmosphere.multipathd : Install the multipathd package] *********\n[multipathd] Monday 13 April 2026 03:58:32 +0000 (0:00:05.941) 0:00:07.182 ********** \n[kubernetes] changed: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.atmosphere.ethtool : Run \"ethtool\" tuning] **********************\n[kubernetes] Monday 13 April 2026 03:58:33 +0000 (0:00:00.683) 0:00:07.497 ********** \n[kubernetes] ok: [instance]\n[kubernetes] \n[kubernetes] TASK [Set a fact with the \"atmosphere_images\" for other plays] *****************\n[kubernetes] Monday 13 April 2026 03:58:33 +0000 (0:00:00.333) 0:00:07.830 ********** \n[kubernetes] ok: [instance]\n[kubernetes] \n[kubernetes] PLAY [Configure Kubernetes VIP] ************************************************\n[kubernetes] \n[kubernetes] TASK [Gathering Facts] *********************************************************\n[kubernetes] Monday 13 April 2026 03:58:34 +0000 (0:00:00.129) 0:00:07.960 ********** \n[kubernetes] ok: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] ***\n[kubernetes] Monday 13 April 2026 03:58:35 +0000 (0:00:00.999) 0:00:08.960 ********** \n[kubernetes] changed: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] ****************\n[kubernetes] Monday 13 April 2026 03:58:35 +0000 (0:00:00.253) 0:00:09.213 ********** \n[kubernetes] ok: [instance] => (item=/etc/keepalived/keepalived.conf)\n[kubernetes] ok: [instance] => (item=/etc/keepalived/check_apiserver.sh)\n[kubernetes] ok: [instance] => (item=/etc/kubernetes/manifests/keepalived.yaml)\n[kubernetes] ok: [instance] => (item=/etc/haproxy/haproxy.cfg)\n[kubernetes] ok: [instance] => (item=/etc/kubernetes/manifests/haproxy.yaml)\n[kubernetes] \n[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] ****\n[kubernetes] Monday 13 April 2026 03:58:36 +0000 (0:00:00.932) 0:00:10.145 ********** \n[kubernetes] failed: [instance] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {\"ansible_loop_var\": \"item\", \"changed\": false, \"item\": \"/etc/kubernetes/manifests/kube-apiserver.yaml\", \"msg\": \"Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !\", \"rc\": 257}\n[kubernetes] failed: [instance] (item=/etc/kubernetes/controller-manager.conf) => {\"ansible_loop_var\": \"item\", \"changed\": false, \"item\": \"/etc/kubernetes/controller-manager.conf\", \"msg\": \"Path /etc/kubernetes/controller-manager.conf does not exist !\", \"rc\": 257}\n[kubernetes] failed: [instance] (item=/etc/kubernetes/scheduler.conf) => {\"ansible_loop_var\": \"item\", \"changed\": false, \"item\": \"/etc/kubernetes/scheduler.conf\", \"msg\": \"Path /etc/kubernetes/scheduler.conf does not exist !\", \"rc\": 257}\n[kubernetes] ...ignoring\n[kubernetes] \n[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] *********\n[kubernetes] Monday 13 April 2026 03:58:36 +0000 (0:00:00.679) 0:00:10.824 ********** \n[kubernetes] ok: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] *********\n[kubernetes] Monday 13 April 2026 03:58:37 +0000 (0:00:00.189) 0:00:11.014 ********** \n[kubernetes] ok: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************\n[kubernetes] Monday 13 April 2026 03:58:37 +0000 (0:00:00.191) 0:00:11.205 ********** \n[kubernetes] ok: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] ***\n[kubernetes] Monday 13 April 2026 03:58:37 +0000 (0:00:00.039) 0:00:11.244 ********** \n[kubernetes] ok: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] ***************\n[kubernetes] Monday 13 April 2026 03:58:37 +0000 (0:00:00.038) 0:00:11.283 ********** \n[kubernetes] ok: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] *******\n[kubernetes] Monday 13 April 2026 03:58:38 +0000 (0:00:00.606) 0:00:11.889 ********** \n[kubernetes] ok: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************\n[kubernetes] Monday 13 April 2026 03:58:38 +0000 (0:00:00.192) 0:00:12.081 ********** \n[kubernetes] \n[kubernetes] PLAY [Install Kubernetes] ******************************************************\n[kubernetes] \n[kubernetes] TASK [Gathering Facts] *********************************************************\n[kubernetes] Monday 13 April 2026 03:58:38 +0000 (0:00:00.088) 0:00:12.170 ********** \n[kubernetes] ok: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************\n[kubernetes] Monday 13 April 2026 03:58:39 +0000 (0:00:00.910) 0:00:13.081 ********** \n[kubernetes] ok: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.package : Update state for tar] **********************\n[kubernetes] Monday 13 April 2026 03:58:39 +0000 (0:00:00.211) 0:00:13.292 ********** \n[kubernetes] skipping: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***\n[kubernetes] Monday 13 April 2026 03:58:39 +0000 (0:00:00.045) 0:00:13.338 ********** \n[kubernetes] changed: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******\n[kubernetes] Monday 13 April 2026 03:58:39 +0000 (0:00:00.240) 0:00:13.578 ********** \n[kubernetes] ok: [instance] => {\n[kubernetes] \"msg\": \"https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64\"\n[kubernetes] }\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************\n[kubernetes] Monday 13 April 2026 03:58:39 +0000 (0:00:00.082) 0:00:13.660 ********** \n[kubernetes] changed: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************\n[kubernetes] Monday 13 April 2026 03:58:40 +0000 (0:00:00.657) 0:00:14.317 ********** \n[kubernetes] skipping: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************\n[kubernetes] Monday 13 April 2026 03:58:40 +0000 (0:00:00.044) 0:00:14.362 ********** \n[kubernetes] ok: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.package : Update state for tar] **********************\n[kubernetes] Monday 13 April 2026 03:58:40 +0000 (0:00:00.207) 0:00:14.570 ********** \n[kubernetes] ok: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******\n[kubernetes] Monday 13 April 2026 03:58:41 +0000 (0:00:01.084) 0:00:15.654 ********** \n[kubernetes] ok: [instance] => {\n[kubernetes] \"msg\": \"https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz\"\n[kubernetes] }\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************\n[kubernetes] Monday 13 April 2026 03:58:41 +0000 (0:00:00.061) 0:00:15.716 ********** \n[kubernetes] changed: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************\n[kubernetes] Monday 13 April 2026 03:58:42 +0000 (0:00:01.026) 0:00:16.742 ********** \n[kubernetes] changed: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.containerd : Install SELinux packages] ***************\n[kubernetes] Monday 13 April 2026 03:58:45 +0000 (0:00:02.776) 0:00:19.519 ********** \n[kubernetes] skipping: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***\n[kubernetes] Monday 13 April 2026 03:58:45 +0000 (0:00:00.029) 0:00:19.549 ********** \n[kubernetes] skipping: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********\n[kubernetes] Monday 13 April 2026 03:58:45 +0000 (0:00:00.030) 0:00:19.580 ********** \n[kubernetes] skipping: [instance]\n[kubernetes] \n[kubernetes] TASK [vexxhost.containers.containerd : Install AppArmor packages] **************\n[kubernetes] Monday 13 April 2026 03:58:45 +0000 (0:00:00.031) 0:00:19.612 ********** \n[kubernetes] fatal: [instance]: FAILED! => {\"cache_update_time\": 1776052712, \"cache_updated\": false, \"changed\": false, \"msg\": \"'/usr/bin/apt-get -y -o \\\"Dpkg::Options::=--force-confdef\\\" -o \\\"Dpkg::Options::=--force-confold\\\" install 'apparmor=3.0.4-2ubuntu2.5' 'apparmor-utils=3.0.4-2ubuntu2.5'' failed: E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 11771 (apt-get)\\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\\n\", \"rc\": 100, \"stderr\": \"E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 11771 (apt-get)\\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\\n\", \"stderr_lines\": [\"E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 11771 (apt-get)\", \"E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\"], \"stdout\": \"\", \"stdout_lines\": []}\n[kubernetes] \n[kubernetes] PLAY RECAP *********************************************************************\n[kubernetes] instance : ok=26 changed=8 unreachable=0 failed=1 skipped=5 rescued=0 ignored=1 \n[kubernetes] \n[kubernetes] Monday 13 April 2026 03:58:47 +0000 (0:00:01.414) 0:00:21.026 ********** \n[kubernetes] =============================================================================== \n[kubernetes] vexxhost.atmosphere.sysctl : Configure sysctl values -------------------- 5.15s\n[kubernetes] vexxhost.containers.download_artifact : Extract archive ----------------- 2.78s\n[kubernetes] vexxhost.containers.containerd : Install AppArmor packages -------------- 1.41s\n[kubernetes] Gathering Facts --------------------------------------------------------- 1.33s\n[kubernetes] vexxhost.containers.package : Update state for tar ---------------------- 1.08s\n[kubernetes] vexxhost.containers.download_artifact : Download item ------------------- 1.03s\n[kubernetes] Gathering Facts --------------------------------------------------------- 1.00s\n[kubernetes] vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack ---------------- 0.93s\n[kubernetes] Gathering Facts --------------------------------------------------------- 0.91s\n[kubernetes] vexxhost.atmosphere.ethtool : Install persistent \"ethtool\" tuning ------- 0.68s\n[kubernetes] vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443 ---- 0.68s\n[kubernetes] vexxhost.containers.download_artifact : Download item ------------------- 0.66s\n[kubernetes] vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest --------------- 0.61s\n[kubernetes] vexxhost.atmosphere.ethtool : Run \"ethtool\" tuning ---------------------- 0.33s\n[kubernetes] vexxhost.atmosphere.ethtool : Create folder for persistent configuration --- 0.31s\n[kubernetes] vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests) --- 0.25s\n[kubernetes] vexxhost.containers.directory : Create directory (/var/lib/downloads) --- 0.24s\n[kubernetes] vexxhost.containers.forget_package : Forget package --------------------- 0.21s\n[kubernetes] vexxhost.containers.forget_package : Forget package --------------------- 0.21s\n[kubernetes] vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file ------- 0.19s", "stdout_lines": ["==> Starting parallel deployment", "==> [kubernetes] Starting deployment", "==> [udev] Starting deployment", "==> [lpfc] Starting deployment", "==> [ceph] Starting deployment", "==> [iscsi] Starting deployment", "==> [multipathd] Starting deployment", "[udev] ", "[udev] PLAY [controllers:computes] ****************************************************", "[udev] ", "[udev] TASK [Gathering Facts] *********************************************************", "[udev] Monday 13 April 2026 03:58:25 +0000 (0:00:00.012) 0:00:00.012 ********** ", "[lpfc] ", "[lpfc] PLAY [controllers:computes] ****************************************************", "[lpfc] ", "[lpfc] TASK [Gathering Facts] *********************************************************", "[lpfc] Monday 13 April 2026 03:58:25 +0000 (0:00:00.013) 0:00:00.013 ********** ", "[iscsi] ", "[iscsi] PLAY [controllers:computes] ****************************************************", "[iscsi] ", "[iscsi] TASK [Gathering Facts] *********************************************************", "[iscsi] Monday 13 April 2026 03:58:25 +0000 (0:00:00.014) 0:00:00.014 ********** ", "[multipathd] ", "[multipathd] PLAY [controllers:computes] ****************************************************", "[multipathd] ", "[multipathd] TASK [Gathering Facts] *********************************************************", "[multipathd] Monday 13 April 2026 03:58:25 +0000 (0:00:00.017) 0:00:00.017 ********** ", "[kubernetes] ", "[kubernetes] PLAY [all] *********************************************************************", "[kubernetes] ", "[kubernetes] TASK [Gathering Facts] *********************************************************", "[kubernetes] Monday 13 April 2026 03:58:26 +0000 (0:00:00.020) 0:00:00.020 ********** ", "[udev] [WARNING]: Platform linux on host instance is using the discovered Python", "[udev] interpreter at /usr/bin/python3.10, but future installation of another Python", "[udev] interpreter could change the meaning of that path. See", "[udev] https://docs.ansible.com/ansible-", "[udev] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[udev] ok: [instance]", "[udev] ", "[udev] TASK [vexxhost.atmosphere.udev : Add udev rules for Pure Storage FlashArray] ***", "[udev] Monday 13 April 2026 03:58:26 +0000 (0:00:01.223) 0:00:01.235 ********** ", "[multipathd] [WARNING]: Platform linux on host instance is using the discovered Python", "[multipathd] interpreter at /usr/bin/python3.10, but future installation of another Python", "[multipathd] interpreter could change the meaning of that path. See", "[multipathd] https://docs.ansible.com/ansible-", "[multipathd] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[lpfc] [WARNING]: Platform linux on host instance is using the discovered Python", "[lpfc] interpreter at /usr/bin/python3.10, but future installation of another Python", "[lpfc] interpreter could change the meaning of that path. See", "[lpfc] https://docs.ansible.com/ansible-", "[lpfc] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[lpfc] ok: [instance]", "[lpfc] ", "[lpfc] TASK [vexxhost.atmosphere.lpfc : Detect if the \"lpfc\" module is loaded] ********", "[lpfc] Monday 13 April 2026 03:58:27 +0000 (0:00:01.275) 0:00:01.289 ********** ", "[multipathd] ok: [instance]", "[multipathd] ", "[multipathd] TASK [vexxhost.atmosphere.multipathd : Add backports PPA] **********************", "[multipathd] Monday 13 April 2026 03:58:27 +0000 (0:00:01.224) 0:00:01.241 ********** ", "[iscsi] [WARNING]: Platform linux on host instance is using the discovered Python", "[iscsi] interpreter at /usr/bin/python3.10, but future installation of another Python", "[iscsi] interpreter could change the meaning of that path. See", "[iscsi] https://docs.ansible.com/ansible-", "[iscsi] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[iscsi] ok: [instance]", "[iscsi] ", "[iscsi] TASK [vexxhost.atmosphere.iscsi : Install iscsi package] ***********************", "[iscsi] Monday 13 April 2026 03:58:27 +0000 (0:00:01.258) 0:00:01.272 ********** ", "[lpfc] ok: [instance]", "[lpfc] ", "[lpfc] TASK [vexxhost.atmosphere.lpfc : Install the configuration file] ***************", "[lpfc] Monday 13 April 2026 03:58:27 +0000 (0:00:00.280) 0:00:01.569 ********** ", "[lpfc] skipping: [instance]", "[lpfc] ", "[lpfc] TASK [vexxhost.atmosphere.lpfc : Get the values for the module parameters] *****", "[lpfc] Monday 13 April 2026 03:58:27 +0000 (0:00:00.030) 0:00:01.600 ********** ", "[lpfc] skipping: [instance] => (item=lpfc_lun_queue_depth) ", "[lpfc] skipping: [instance] => (item=lpfc_sg_seg_cnt) ", "[lpfc] skipping: [instance] => (item=lpfc_max_luns) ", "[lpfc] skipping: [instance] => (item=lpfc_enable_fc4_type) ", "[lpfc] skipping: [instance]", "[lpfc] ", "[lpfc] TASK [vexxhost.atmosphere.lpfc : Detect if the run-time module parameters are set correctly] ***", "[lpfc] Monday 13 April 2026 03:58:27 +0000 (0:00:00.043) 0:00:01.644 ********** ", "[lpfc] skipping: [instance] => (item=lpfc_lun_queue_depth) ", "[lpfc] skipping: [instance] => (item=lpfc_sg_seg_cnt) ", "[lpfc] skipping: [instance] => (item=lpfc_max_luns) ", "[lpfc] skipping: [instance] => (item=lpfc_enable_fc4_type) ", "[lpfc] skipping: [instance]", "[lpfc] ", "[lpfc] TASK [vexxhost.atmosphere.lpfc : Update \"initramfs\" if the configuration file has changed] ***", "[lpfc] Monday 13 April 2026 03:58:27 +0000 (0:00:00.038) 0:00:01.682 ********** ", "[lpfc] skipping: [instance]", "[lpfc] ", "[lpfc] TASK [Reboot the system if the configuration file has changed] *****************", "[lpfc] Monday 13 April 2026 03:58:27 +0000 (0:00:00.026) 0:00:01.709 ********** ", "[kubernetes] [WARNING]: Platform linux on host instance is using the discovered Python", "[kubernetes] interpreter at /usr/bin/python3.10, but future installation of another Python", "[kubernetes] interpreter could change the meaning of that path. See", "[kubernetes] https://docs.ansible.com/ansible-", "[kubernetes] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[kubernetes] ok: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.atmosphere.sysctl : Configure sysctl values] ********************", "[kubernetes] Monday 13 April 2026 03:58:27 +0000 (0:00:01.327) 0:00:01.348 ********** ", "[lpfc] skipping: [instance]", "[lpfc] ", "[lpfc] PLAY RECAP *********************************************************************", "[lpfc] instance : ok=2 changed=0 unreachable=0 failed=0 skipped=5 rescued=0 ignored=0 ", "[lpfc] ", "[lpfc] Monday 13 April 2026 03:58:27 +0000 (0:00:00.030) 0:00:01.739 ********** ", "[lpfc] =============================================================================== ", "[lpfc] Gathering Facts --------------------------------------------------------- 1.28s", "[lpfc] vexxhost.atmosphere.lpfc : Detect if the \"lpfc\" module is loaded -------- 0.28s", "[lpfc] vexxhost.atmosphere.lpfc : Get the values for the module parameters ----- 0.04s", "[lpfc] vexxhost.atmosphere.lpfc : Detect if the run-time module parameters are set correctly --- 0.04s", "[lpfc] vexxhost.atmosphere.lpfc : Install the configuration file --------------- 0.03s", "[lpfc] Reboot the system if the configuration file has changed ----------------- 0.03s", "[lpfc] vexxhost.atmosphere.lpfc : Update \"initramfs\" if the configuration file has changed --- 0.03s", "==> [lpfc] Deployment complete", "[udev] changed: [instance]", "[udev] ", "[udev] TASK [vexxhost.atmosphere.udev : Add udev rules for SCSI Unit Attention] *******", "[udev] Monday 13 April 2026 03:58:27 +0000 (0:00:00.675) 0:00:01.910 ********** ", "[udev] changed: [instance]", "[udev] ", "[udev] RUNNING HANDLER [vexxhost.atmosphere.udev : Reload udev] ***********************", "[udev] Monday 13 April 2026 03:58:28 +0000 (0:00:00.507) 0:00:02.417 ********** ", "[iscsi] ok: [instance]", "[iscsi] ", "[iscsi] TASK [vexxhost.atmosphere.iscsi : Ensure iscsid is started] ********************", "[iscsi] Monday 13 April 2026 03:58:28 +0000 (0:00:01.390) 0:00:02.663 ********** ", "[udev] ok: [instance]", "[udev] ", "[udev] PLAY RECAP *********************************************************************", "[udev] instance : ok=4 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 ", "[udev] ", "[udev] Monday 13 April 2026 03:58:28 +0000 (0:00:00.330) 0:00:02.748 ********** ", "[udev] =============================================================================== ", "[udev] Gathering Facts --------------------------------------------------------- 1.22s", "[udev] vexxhost.atmosphere.udev : Add udev rules for Pure Storage FlashArray --- 0.68s", "[udev] vexxhost.atmosphere.udev : Add udev rules for SCSI Unit Attention ------- 0.51s", "[udev] vexxhost.atmosphere.udev : Reload udev ---------------------------------- 0.33s", "==> [udev] Deployment complete", "[iscsi] changed: [instance]", "[iscsi] ", "[iscsi] PLAY RECAP *********************************************************************", "[iscsi] instance : ok=3 changed=1 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 ", "[iscsi] ", "[iscsi] Monday 13 April 2026 03:58:30 +0000 (0:00:01.593) 0:00:04.257 ********** ", "[iscsi] =============================================================================== ", "[iscsi] vexxhost.atmosphere.iscsi : Ensure iscsid is started -------------------- 1.59s", "[iscsi] vexxhost.atmosphere.iscsi : Install iscsi package ----------------------- 1.39s", "[iscsi] Gathering Facts --------------------------------------------------------- 1.26s", "==> [iscsi] Deployment complete", "[kubernetes] changed: [instance] => (item={'name': 'fs.aio-max-nr', 'value': 1048576})", "[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_timestamps', 'value': 0})", "[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_sack', 'value': 1})", "[kubernetes] changed: [instance] => (item={'name': 'net.core.netdev_budget', 'value': 1000})", "[kubernetes] changed: [instance] => (item={'name': 'net.core.netdev_max_backlog', 'value': 250000})", "[kubernetes] changed: [instance] => (item={'name': 'net.core.rmem_max', 'value': 4194304})", "[kubernetes] changed: [instance] => (item={'name': 'net.core.wmem_max', 'value': 4194304})", "[kubernetes] changed: [instance] => (item={'name': 'net.core.rmem_default', 'value': 4194304})", "[kubernetes] changed: [instance] => (item={'name': 'net.core.wmem_default', 'value': 4194304})", "[kubernetes] changed: [instance] => (item={'name': 'net.core.optmem_max', 'value': 4194304})", "[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_rmem', 'value': '4096 87380 4194304'})", "[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_wmem', 'value': '4096 65536 4194304'})", "[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_low_latency', 'value': 1})", "[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_adv_win_scale', 'value': 1})", "[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh1', 'value': 128})", "[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh2', 'value': 28872})", "[kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh3', 'value': 32768})", "[kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh1', 'value': 128})", "[kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh2', 'value': 28872})", "[kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh3', 'value': 32768})", "[kubernetes] ", "[kubernetes] TASK [vexxhost.atmosphere.ethtool : Create folder for persistent configuration] ***", "[kubernetes] Monday 13 April 2026 03:58:32 +0000 (0:00:05.152) 0:00:06.500 ********** ", "[kubernetes] changed: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.atmosphere.ethtool : Install persistent \"ethtool\" tuning] *******", "[kubernetes] Monday 13 April 2026 03:58:32 +0000 (0:00:00.313) 0:00:06.813 ********** ", "[multipathd] changed: [instance]", "[multipathd] ", "[multipathd] TASK [vexxhost.atmosphere.multipathd : Install the multipathd package] *********", "[multipathd] Monday 13 April 2026 03:58:32 +0000 (0:00:05.941) 0:00:07.182 ********** ", "[kubernetes] changed: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.atmosphere.ethtool : Run \"ethtool\" tuning] **********************", "[kubernetes] Monday 13 April 2026 03:58:33 +0000 (0:00:00.683) 0:00:07.497 ********** ", "[kubernetes] ok: [instance]", "[kubernetes] ", "[kubernetes] TASK [Set a fact with the \"atmosphere_images\" for other plays] *****************", "[kubernetes] Monday 13 April 2026 03:58:33 +0000 (0:00:00.333) 0:00:07.830 ********** ", "[kubernetes] ok: [instance]", "[kubernetes] ", "[kubernetes] PLAY [Configure Kubernetes VIP] ************************************************", "[kubernetes] ", "[kubernetes] TASK [Gathering Facts] *********************************************************", "[kubernetes] Monday 13 April 2026 03:58:34 +0000 (0:00:00.129) 0:00:07.960 ********** ", "[kubernetes] ok: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] ***", "[kubernetes] Monday 13 April 2026 03:58:35 +0000 (0:00:00.999) 0:00:08.960 ********** ", "[kubernetes] changed: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] ****************", "[kubernetes] Monday 13 April 2026 03:58:35 +0000 (0:00:00.253) 0:00:09.213 ********** ", "[kubernetes] ok: [instance] => (item=/etc/keepalived/keepalived.conf)", "[kubernetes] ok: [instance] => (item=/etc/keepalived/check_apiserver.sh)", "[kubernetes] ok: [instance] => (item=/etc/kubernetes/manifests/keepalived.yaml)", "[kubernetes] ok: [instance] => (item=/etc/haproxy/haproxy.cfg)", "[kubernetes] ok: [instance] => (item=/etc/kubernetes/manifests/haproxy.yaml)", "[kubernetes] ", "[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] ****", "[kubernetes] Monday 13 April 2026 03:58:36 +0000 (0:00:00.932) 0:00:10.145 ********** ", "[kubernetes] failed: [instance] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {\"ansible_loop_var\": \"item\", \"changed\": false, \"item\": \"/etc/kubernetes/manifests/kube-apiserver.yaml\", \"msg\": \"Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !\", \"rc\": 257}", "[kubernetes] failed: [instance] (item=/etc/kubernetes/controller-manager.conf) => {\"ansible_loop_var\": \"item\", \"changed\": false, \"item\": \"/etc/kubernetes/controller-manager.conf\", \"msg\": \"Path /etc/kubernetes/controller-manager.conf does not exist !\", \"rc\": 257}", "[kubernetes] failed: [instance] (item=/etc/kubernetes/scheduler.conf) => {\"ansible_loop_var\": \"item\", \"changed\": false, \"item\": \"/etc/kubernetes/scheduler.conf\", \"msg\": \"Path /etc/kubernetes/scheduler.conf does not exist !\", \"rc\": 257}", "[kubernetes] ...ignoring", "[kubernetes] ", "[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] *********", "[kubernetes] Monday 13 April 2026 03:58:36 +0000 (0:00:00.679) 0:00:10.824 ********** ", "[kubernetes] ok: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] *********", "[kubernetes] Monday 13 April 2026 03:58:37 +0000 (0:00:00.189) 0:00:11.014 ********** ", "[kubernetes] ok: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************", "[kubernetes] Monday 13 April 2026 03:58:37 +0000 (0:00:00.191) 0:00:11.205 ********** ", "[kubernetes] ok: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] ***", "[kubernetes] Monday 13 April 2026 03:58:37 +0000 (0:00:00.039) 0:00:11.244 ********** ", "[kubernetes] ok: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] ***************", "[kubernetes] Monday 13 April 2026 03:58:37 +0000 (0:00:00.038) 0:00:11.283 ********** ", "[kubernetes] ok: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] *******", "[kubernetes] Monday 13 April 2026 03:58:38 +0000 (0:00:00.606) 0:00:11.889 ********** ", "[kubernetes] ok: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************", "[kubernetes] Monday 13 April 2026 03:58:38 +0000 (0:00:00.192) 0:00:12.081 ********** ", "[kubernetes] ", "[kubernetes] PLAY [Install Kubernetes] ******************************************************", "[kubernetes] ", "[kubernetes] TASK [Gathering Facts] *********************************************************", "[kubernetes] Monday 13 April 2026 03:58:38 +0000 (0:00:00.088) 0:00:12.170 ********** ", "[kubernetes] ok: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************", "[kubernetes] Monday 13 April 2026 03:58:39 +0000 (0:00:00.910) 0:00:13.081 ********** ", "[kubernetes] ok: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.package : Update state for tar] **********************", "[kubernetes] Monday 13 April 2026 03:58:39 +0000 (0:00:00.211) 0:00:13.292 ********** ", "[kubernetes] skipping: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***", "[kubernetes] Monday 13 April 2026 03:58:39 +0000 (0:00:00.045) 0:00:13.338 ********** ", "[kubernetes] changed: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******", "[kubernetes] Monday 13 April 2026 03:58:39 +0000 (0:00:00.240) 0:00:13.578 ********** ", "[kubernetes] ok: [instance] => {", "[kubernetes] \"msg\": \"https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64\"", "[kubernetes] }", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************", "[kubernetes] Monday 13 April 2026 03:58:39 +0000 (0:00:00.082) 0:00:13.660 ********** ", "[kubernetes] changed: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************", "[kubernetes] Monday 13 April 2026 03:58:40 +0000 (0:00:00.657) 0:00:14.317 ********** ", "[kubernetes] skipping: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************", "[kubernetes] Monday 13 April 2026 03:58:40 +0000 (0:00:00.044) 0:00:14.362 ********** ", "[kubernetes] ok: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.package : Update state for tar] **********************", "[kubernetes] Monday 13 April 2026 03:58:40 +0000 (0:00:00.207) 0:00:14.570 ********** ", "[kubernetes] ok: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******", "[kubernetes] Monday 13 April 2026 03:58:41 +0000 (0:00:01.084) 0:00:15.654 ********** ", "[kubernetes] ok: [instance] => {", "[kubernetes] \"msg\": \"https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz\"", "[kubernetes] }", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************", "[kubernetes] Monday 13 April 2026 03:58:41 +0000 (0:00:00.061) 0:00:15.716 ********** ", "[kubernetes] changed: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************", "[kubernetes] Monday 13 April 2026 03:58:42 +0000 (0:00:01.026) 0:00:16.742 ********** ", "[kubernetes] changed: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.containerd : Install SELinux packages] ***************", "[kubernetes] Monday 13 April 2026 03:58:45 +0000 (0:00:02.776) 0:00:19.519 ********** ", "[kubernetes] skipping: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***", "[kubernetes] Monday 13 April 2026 03:58:45 +0000 (0:00:00.029) 0:00:19.549 ********** ", "[kubernetes] skipping: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********", "[kubernetes] Monday 13 April 2026 03:58:45 +0000 (0:00:00.030) 0:00:19.580 ********** ", "[kubernetes] skipping: [instance]", "[kubernetes] ", "[kubernetes] TASK [vexxhost.containers.containerd : Install AppArmor packages] **************", "[kubernetes] Monday 13 April 2026 03:58:45 +0000 (0:00:00.031) 0:00:19.612 ********** ", "[kubernetes] fatal: [instance]: FAILED! => {\"cache_update_time\": 1776052712, \"cache_updated\": false, \"changed\": false, \"msg\": \"'/usr/bin/apt-get -y -o \\\"Dpkg::Options::=--force-confdef\\\" -o \\\"Dpkg::Options::=--force-confold\\\" install 'apparmor=3.0.4-2ubuntu2.5' 'apparmor-utils=3.0.4-2ubuntu2.5'' failed: E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 11771 (apt-get)\\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\\n\", \"rc\": 100, \"stderr\": \"E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 11771 (apt-get)\\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\\n\", \"stderr_lines\": [\"E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 11771 (apt-get)\", \"E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\"], \"stdout\": \"\", \"stdout_lines\": []}", "[kubernetes] ", "[kubernetes] PLAY RECAP *********************************************************************", "[kubernetes] instance : ok=26 changed=8 unreachable=0 failed=1 skipped=5 rescued=0 ignored=1 ", "[kubernetes] ", "[kubernetes] Monday 13 April 2026 03:58:47 +0000 (0:00:01.414) 0:00:21.026 ********** ", "[kubernetes] =============================================================================== ", "[kubernetes] vexxhost.atmosphere.sysctl : Configure sysctl values -------------------- 5.15s", "[kubernetes] vexxhost.containers.download_artifact : Extract archive ----------------- 2.78s", "[kubernetes] vexxhost.containers.containerd : Install AppArmor packages -------------- 1.41s", "[kubernetes] Gathering Facts --------------------------------------------------------- 1.33s", "[kubernetes] vexxhost.containers.package : Update state for tar ---------------------- 1.08s", "[kubernetes] vexxhost.containers.download_artifact : Download item ------------------- 1.03s", "[kubernetes] Gathering Facts --------------------------------------------------------- 1.00s", "[kubernetes] vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack ---------------- 0.93s", "[kubernetes] Gathering Facts --------------------------------------------------------- 0.91s", "[kubernetes] vexxhost.atmosphere.ethtool : Install persistent \"ethtool\" tuning ------- 0.68s", "[kubernetes] vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443 ---- 0.68s", "[kubernetes] vexxhost.containers.download_artifact : Download item ------------------- 0.66s", "[kubernetes] vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest --------------- 0.61s", "[kubernetes] vexxhost.atmosphere.ethtool : Run \"ethtool\" tuning ---------------------- 0.33s", "[kubernetes] vexxhost.atmosphere.ethtool : Create folder for persistent configuration --- 0.31s", "[kubernetes] vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests) --- 0.25s", "[kubernetes] vexxhost.containers.directory : Create directory (/var/lib/downloads) --- 0.24s", "[kubernetes] vexxhost.containers.forget_package : Forget package --------------------- 0.21s", "[kubernetes] vexxhost.containers.forget_package : Forget package --------------------- 0.21s", "[kubernetes] vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file ------- 0.19s"]} 2026-04-13 03:58:56.473696 | instance | 2026-04-13 03:58:56.473964 | instance | PLAY RECAP ********************************************************************* 2026-04-13 03:58:56.474273 | instance | localhost : ok=1 changed=1 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0 2026-04-13 03:58:56.474541 | instance | 2026-04-13 03:58:56.474823 | instance | Monday 13 April 2026 03:58:56 +0000 (0:00:31.398) 0:00:38.640 ********** 2026-04-13 03:58:56.475089 | instance | =============================================================================== 2026-04-13 03:58:56.475363 | instance | Deploy with parallel orchestrator -------------------------------------- 31.40s 2026-04-13 03:58:56.475633 | instance | Build atmosphere binary ------------------------------------------------- 7.23s 2026-04-13 03:58:56.532367 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml 2026-04-13 03:58:56.532529 | instance | ERROR [aio > converge] Executed: Failed 2026-04-13 03:58:56.532681 | instance | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml 2026-04-13 03:58:57.022645 | instance | ERROR 2026-04-13 03:58:57.022818 | instance | { 2026-04-13 03:58:57.022862 | instance | "delta": "0:02:21.237583", 2026-04-13 03:58:57.022916 | instance | "end": "2026-04-13 03:58:56.625630", 2026-04-13 03:58:57.022945 | instance | "msg": "non-zero return code", 2026-04-13 03:58:57.022970 | instance | "rc": 2, 2026-04-13 03:58:57.023000 | instance | "start": "2026-04-13 03:56:35.388047" 2026-04-13 03:58:57.023025 | instance | } failure 2026-04-13 03:58:57.032288 | 2026-04-13 03:58:57.032341 | PLAY RECAP 2026-04-13 03:58:57.032384 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-04-13 03:58:57.032405 | 2026-04-13 03:58:57.150907 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-13 03:58:57.163382 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-13 03:58:57.773343 | 2026-04-13 03:58:57.773622 | PLAY [all] 2026-04-13 03:58:57.787453 | 2026-04-13 03:58:57.787543 | TASK [gather-host-logs : creating directory for system status] 2026-04-13 03:58:58.123639 | instance | changed 2026-04-13 03:58:58.131070 | 2026-04-13 03:58:58.131178 | TASK [gather-host-logs : Get logs for each host] 2026-04-13 03:58:58.471255 | instance | + systemd-cgls --full --all --no-pager 2026-04-13 03:58:58.485854 | instance | + ip addr 2026-04-13 03:58:58.487506 | instance | + ip route 2026-04-13 03:58:58.488843 | instance | + lsblk 2026-04-13 03:58:58.491892 | instance | + mount 2026-04-13 03:58:58.493356 | instance | + docker images 2026-04-13 03:58:58.493712 | instance | /bin/bash: line 7: docker: command not found 2026-04-13 03:58:58.493897 | instance | + brctl show 2026-04-13 03:58:58.494151 | instance | /bin/bash: line 8: brctl: command not found 2026-04-13 03:58:58.494277 | instance | + ps aux --sort=-%mem 2026-04-13 03:58:58.506425 | instance | + dpkg -l 2026-04-13 03:58:58.518823 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul)) 2026-04-13 03:58:58.519170 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul 2026-04-13 03:58:58.519199 | instance | /bin/bash: line 11: docker: command not found 2026-04-13 03:58:58.519470 | instance | + '[' '!' -z '' ']' 2026-04-13 03:58:58.669712 | instance | ok: Runtime: 0:00:00.053524 2026-04-13 03:58:58.678251 | 2026-04-13 03:58:58.678339 | TASK [gather-host-logs : Downloads logs to executor] 2026-04-13 03:58:59.285982 | instance | changed: 2026-04-13 03:58:59.286161 | instance | created directory /var/lib/zuul/builds/c345dfa4f4a74b19a90077ff43cd5b0a/work/logs/instance 2026-04-13 03:58:59.286202 | instance | cd+++++++++ system/ 2026-04-13 03:58:59.286234 | instance | >f+++++++++ system/brctl-show.txt 2026-04-13 03:58:59.286328 | instance | >f+++++++++ system/docker-images.txt 2026-04-13 03:58:59.286385 | instance | >f+++++++++ system/ip-addr.txt 2026-04-13 03:58:59.286429 | instance | >f+++++++++ system/ip-route.txt 2026-04-13 03:58:59.286465 | instance | >f+++++++++ system/lsblk.txt 2026-04-13 03:58:59.286494 | instance | >f+++++++++ system/mount.txt 2026-04-13 03:58:59.286526 | instance | >f+++++++++ system/packages.txt 2026-04-13 03:58:59.286559 | instance | >f+++++++++ system/ps.txt 2026-04-13 03:58:59.286589 | instance | >f+++++++++ system/systemd-cgls.txt 2026-04-13 03:58:59.298211 | 2026-04-13 03:58:59.298278 | LOOP [helm-release-status : creating directory for helm release status] 2026-04-13 03:58:59.501280 | instance | changed: "values" 2026-04-13 03:58:59.670778 | instance | changed: "releases" 2026-04-13 03:58:59.685177 | 2026-04-13 03:58:59.685299 | TASK [helm-release-status : Gather get release status for helm charts] 2026-04-13 03:58:59.881677 | instance | /bin/bash: line 3: kubectl: command not found 2026-04-13 03:59:00.216722 | instance | ok: Runtime: 0:00:00.003870 2026-04-13 03:59:00.222856 | 2026-04-13 03:59:00.222928 | TASK [helm-release-status : Downloads logs to executor] 2026-04-13 03:59:00.703812 | instance | changed: 2026-04-13 03:59:00.704058 | instance | cd+++++++++ helm/ 2026-04-13 03:59:00.704121 | instance | cd+++++++++ helm/releases/ 2026-04-13 03:59:00.704173 | instance | cd+++++++++ helm/values/ 2026-04-13 03:59:00.719306 | 2026-04-13 03:59:00.719438 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects] 2026-04-13 03:59:00.913492 | instance | changed 2026-04-13 03:59:00.956414 | 2026-04-13 03:59:00.956560 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects] 2026-04-13 03:59:01.179668 | instance | xargs: xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args valuewarning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 03:59:01.179854 | instance | 2026-04-13 03:59:01.184834 | instance | environment: line 1: kubectl: command not found 2026-04-13 03:59:01.187070 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 03:59:01.187547 | instance | environment: line 1: kubectl: command not found 2026-04-13 03:59:01.189138 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 03:59:01.190929 | instance | environment: line 1: kubectl: command not found 2026-04-13 03:59:01.192440 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 03:59:01.193459 | instance | environment: line 1: kubectl: command not found 2026-04-13 03:59:01.194861 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 03:59:01.196264 | instance | environment: line 1: kubectl: command not found 2026-04-13 03:59:01.197577 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 03:59:01.498869 | instance | ok: Runtime: 0:00:00.026994 2026-04-13 03:59:01.506651 | 2026-04-13 03:59:01.506792 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects] 2026-04-13 03:59:01.716015 | instance | changed 2026-04-13 03:59:01.721557 | 2026-04-13 03:59:01.721630 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects] 2026-04-13 03:59:01.931177 | instance | environment: line 5: kubectl: command not found 2026-04-13 03:59:01.931807 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 03:59:01.932652 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 03:59:01.932773 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 03:59:02.261996 | instance | ok: Runtime: 0:00:00.008469 2026-04-13 03:59:02.268778 | 2026-04-13 03:59:02.268843 | TASK [describe-kubernetes-objects : Downloads logs to executor] 2026-04-13 03:59:02.851035 | instance | changed: 2026-04-13 03:59:02.851304 | instance | cd+++++++++ objects/ 2026-04-13 03:59:02.851367 | instance | cd+++++++++ objects/cluster/ 2026-04-13 03:59:02.851415 | instance | cd+++++++++ objects/namespaced/ 2026-04-13 03:59:02.863533 | 2026-04-13 03:59:02.863604 | TASK [gather-pod-logs : creating directory for pod logs] 2026-04-13 03:59:03.060038 | instance | changed 2026-04-13 03:59:03.064893 | 2026-04-13 03:59:03.064968 | TASK [gather-pod-logs : creating directory for failed pod logs] 2026-04-13 03:59:03.261803 | instance | changed 2026-04-13 03:59:03.268254 | 2026-04-13 03:59:03.268341 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)] 2026-04-13 03:59:03.552321 | instance | environment: line 3: kubectl: command not found 2026-04-13 03:59:03.803138 | instance | ok: Runtime: 0:00:00.009468 2026-04-13 03:59:03.809168 | 2026-04-13 03:59:03.809236 | TASK [gather-pod-logs : Downloads pod logs to executor] 2026-04-13 03:59:04.299382 | instance | changed: 2026-04-13 03:59:04.299644 | instance | cd+++++++++ pod-logs/ 2026-04-13 03:59:04.299683 | instance | cd+++++++++ pod-logs/failed-pods/ 2026-04-13 03:59:04.312312 | 2026-04-13 03:59:04.312375 | TASK [gather-prom-metrics : creating directory for helm release descriptions] 2026-04-13 03:59:04.528694 | instance | changed 2026-04-13 03:59:04.536854 | 2026-04-13 03:59:04.536920 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces] 2026-04-13 03:59:04.753817 | instance | /bin/bash: line 2: kubectl: command not found 2026-04-13 03:59:05.070933 | instance | ok: Runtime: 0:00:00.037490 2026-04-13 03:59:05.077144 | 2026-04-13 03:59:05.077234 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr] 2026-04-13 03:59:05.306663 | instance | /bin/bash: line 2: kubectl: command not found 2026-04-13 03:59:05.337543 | instance | ceph-mgr endpoints: 2026-04-13 03:59:05.614686 | instance | ok: Runtime: 0:00:00.038969 2026-04-13 03:59:05.622042 | 2026-04-13 03:59:05.622134 | TASK [gather-prom-metrics : Get metrics from fluentd pods] 2026-04-13 03:59:05.834689 | instance | /bin/bash: line 4: kubectl: command not found 2026-04-13 03:59:06.157589 | instance | ok: Runtime: 0:00:00.037626 2026-04-13 03:59:06.167427 | 2026-04-13 03:59:06.167491 | TASK [gather-prom-metrics : Downloads logs to executor] 2026-04-13 03:59:06.667627 | instance | changed: cd+++++++++ prometheus/ 2026-04-13 03:59:06.677593 | 2026-04-13 03:59:06.677654 | TASK [gather-selenium-data : creating directory for helm release descriptions] 2026-04-13 03:59:06.912586 | instance | changed 2026-04-13 03:59:06.917634 | 2026-04-13 03:59:06.917714 | TASK [gather-selenium-data : Get selenium data] 2026-04-13 03:59:07.124394 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/. 2026-04-13 03:59:07.125739 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory 2026-04-13 03:59:07.460551 | instance | ERROR 2026-04-13 03:59:07.460789 | instance | { 2026-04-13 03:59:07.460836 | instance | "delta": "0:00:00.005814", 2026-04-13 03:59:07.460868 | instance | "end": "2026-04-13 03:59:07.126016", 2026-04-13 03:59:07.460895 | instance | "msg": "non-zero return code", 2026-04-13 03:59:07.460920 | instance | "rc": 1, 2026-04-13 03:59:07.460945 | instance | "start": "2026-04-13 03:59:07.120202" 2026-04-13 03:59:07.460997 | instance | } 2026-04-13 03:59:07.461031 | instance | ERROR: Ignoring Errors 2026-04-13 03:59:07.467914 | 2026-04-13 03:59:07.468000 | TASK [gather-selenium-data : Downloads logs to executor] 2026-04-13 03:59:08.061526 | instance | changed: cd+++++++++ selenium/ 2026-04-13 03:59:08.069784 | 2026-04-13 03:59:08.069877 | PLAY RECAP 2026-04-13 03:59:08.069927 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1 2026-04-13 03:59:08.069950 | 2026-04-13 03:59:08.205472 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-13 03:59:08.216674 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-13 03:59:08.825842 | 2026-04-13 03:59:08.826044 | PLAY [all] 2026-04-13 03:59:08.838026 | 2026-04-13 03:59:08.838135 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-13 03:59:08.883268 | instance | skipping: Conditional result was False 2026-04-13 03:59:08.895041 | 2026-04-13 03:59:08.895181 | TASK [fetch-output : Set log path for single node] 2026-04-13 03:59:08.939868 | instance | ok 2026-04-13 03:59:08.945293 | 2026-04-13 03:59:08.945363 | LOOP [fetch-output : Ensure local output dirs] 2026-04-13 03:59:09.323591 | instance -> localhost | ok: "/var/lib/zuul/builds/c345dfa4f4a74b19a90077ff43cd5b0a/work/logs" 2026-04-13 03:59:09.524267 | instance -> localhost | changed: "/var/lib/zuul/builds/c345dfa4f4a74b19a90077ff43cd5b0a/work/artifacts" 2026-04-13 03:59:09.729088 | instance -> localhost | changed: "/var/lib/zuul/builds/c345dfa4f4a74b19a90077ff43cd5b0a/work/docs" 2026-04-13 03:59:09.738367 | 2026-04-13 03:59:09.738442 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-13 03:59:10.351992 | instance | changed: .d..t...... ./ 2026-04-13 03:59:10.352223 | instance | changed: All items complete 2026-04-13 03:59:10.352250 | 2026-04-13 03:59:10.784640 | instance | changed: .d..t...... ./ 2026-04-13 03:59:11.235295 | instance | changed: .d..t...... ./ 2026-04-13 03:59:11.254262 | 2026-04-13 03:59:11.254428 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-13 03:59:11.655512 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007137 2026-04-13 03:59:11.895803 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.012878 2026-04-13 03:59:11.915888 | 2026-04-13 03:59:11.916065 | PLAY [all] 2026-04-13 03:59:11.924340 | 2026-04-13 03:59:11.924439 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-13 03:59:12.373854 | instance | changed 2026-04-13 03:59:12.381338 | 2026-04-13 03:59:12.381417 | PLAY RECAP 2026-04-13 03:59:12.381476 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-13 03:59:12.381506 | 2026-04-13 03:59:12.516540 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-13 03:59:12.529561 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-13 03:59:13.113355 | 2026-04-13 03:59:13.113476 | PLAY [localhost] 2026-04-13 03:59:13.123084 | 2026-04-13 03:59:13.123156 | TASK [Generate Zuul manifest] 2026-04-13 03:59:13.140913 | localhost | ok 2026-04-13 03:59:13.154543 | 2026-04-13 03:59:13.154621 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-13 03:59:13.512499 | localhost | changed 2026-04-13 03:59:13.534475 | 2026-04-13 03:59:13.535154 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-13 03:59:13.619037 | localhost | ok 2026-04-13 03:59:13.628742 | 2026-04-13 03:59:13.628815 | TASK [Upload logs] 2026-04-13 03:59:13.649938 | localhost | ok 2026-04-13 03:59:13.754196 | 2026-04-13 03:59:13.754333 | TASK [Set zuul-log-path fact] 2026-04-13 03:59:13.775610 | localhost | ok 2026-04-13 03:59:13.788617 | 2026-04-13 03:59:13.788688 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-13 03:59:13.816575 | localhost | ok 2026-04-13 03:59:13.823979 | 2026-04-13 03:59:13.824043 | TASK [upload-logs : Create log directories] 2026-04-13 03:59:14.179960 | localhost | changed 2026-04-13 03:59:14.188685 | 2026-04-13 03:59:14.188768 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-13 03:59:14.546260 | localhost -> localhost | ok: Runtime: 0:00:00.005621 2026-04-13 03:59:14.553146 | 2026-04-13 03:59:14.553214 | TASK [upload-logs : Upload logs to log server] 2026-04-13 03:59:14.992187 | localhost | Output suppressed because no_log was given 2026-04-13 03:59:14.997150 | 2026-04-13 03:59:14.997238 | LOOP [upload-logs : Compress console log and json output] 2026-04-13 03:59:15.040351 | localhost | skipping: Conditional result was False 2026-04-13 03:59:15.047325 | localhost | skipping: Conditional result was False 2026-04-13 03:59:15.060247 | 2026-04-13 03:59:15.060384 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-13 03:59:15.113174 | localhost | skipping: Conditional result was False 2026-04-13 03:59:15.113598 | 2026-04-13 03:59:15.117454 | localhost | skipping: Conditional result was False 2026-04-13 03:59:15.135202 | 2026-04-13 03:59:15.135386 | LOOP [upload-logs : Upload console log and json output]