2026-04-13 03:19:14.656226 | Job console starting 2026-04-13 03:19:14.674128 | Updating git repos 2026-04-13 03:19:14.767249 | Cloning repos into workspace 2026-04-13 03:19:14.874089 | Restoring repo states 2026-04-13 03:19:14.893589 | Merging changes 2026-04-13 03:19:16.248928 | Checking out repos 2026-04-13 03:19:16.408222 | Preparing playbooks 2026-04-13 03:19:21.360866 | Running Ansible setup 2026-04-13 03:19:24.993378 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-13 03:19:25.641998 | 2026-04-13 03:19:25.642107 | PLAY [localhost] 2026-04-13 03:19:25.649491 | 2026-04-13 03:19:25.649559 | TASK [Gathering Facts] 2026-04-13 03:19:26.476574 | localhost | ok 2026-04-13 03:19:26.487157 | 2026-04-13 03:19:26.487253 | TASK [Setup log path fact] 2026-04-13 03:19:26.509600 | localhost | ok 2026-04-13 03:19:26.522803 | 2026-04-13 03:19:26.522914 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-13 03:19:26.563506 | localhost | ok 2026-04-13 03:19:26.570962 | 2026-04-13 03:19:26.571035 | TASK [emit-job-header : Print job information] 2026-04-13 03:19:26.611973 | # Job Information 2026-04-13 03:19:26.612172 | Ansible Version: 2.16.16 2026-04-13 03:19:26.612217 | Job: atmosphere-molecule-aio-ovn 2026-04-13 03:19:26.612249 | Pipeline: check 2026-04-13 03:19:26.612278 | Executor: 0a8996d2b663 2026-04-13 03:19:26.612306 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3818 2026-04-13 03:19:26.612337 | Event ID: 72d011e0-36e7-11f1-9d04-92185c998148 2026-04-13 03:19:26.616116 | 2026-04-13 03:19:26.617954 | LOOP [emit-job-header : Print node information] 2026-04-13 03:19:26.712262 | localhost | ok: 2026-04-13 03:19:26.712483 | localhost | # Node Information 2026-04-13 03:19:26.712512 | localhost | Inventory Hostname: instance 2026-04-13 03:19:26.712534 | localhost | Hostname: np0000165441 2026-04-13 03:19:26.712554 | localhost | Username: zuul 2026-04-13 03:19:26.712577 | localhost | Distro: Ubuntu 22.04 2026-04-13 03:19:26.712597 | localhost | Provider: yul1 2026-04-13 03:19:26.712615 | localhost | Region: ca-ymq-1 2026-04-13 03:19:26.712634 | localhost | Label: ubuntu-jammy-16 2026-04-13 03:19:26.712652 | localhost | Product Name: OpenStack Nova 2026-04-13 03:19:26.712673 | localhost | Interface IP: 199.204.45.115 2026-04-13 03:19:26.727327 | 2026-04-13 03:19:26.727474 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-13 03:19:27.098677 | localhost -> localhost | changed 2026-04-13 03:19:27.105241 | 2026-04-13 03:19:27.105339 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-13 03:19:28.021938 | localhost -> localhost | changed 2026-04-13 03:19:28.032691 | 2026-04-13 03:19:28.032809 | PLAY [all] 2026-04-13 03:19:28.042266 | 2026-04-13 03:19:28.042352 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-13 03:19:28.270461 | instance -> localhost | ok 2026-04-13 03:19:28.279840 | 2026-04-13 03:19:28.279927 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-13 03:19:28.314604 | instance | ok 2026-04-13 03:19:28.330514 | instance | included: /var/lib/zuul/builds/725904b5ddb447ea8e4f924ca923c03e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-13 03:19:28.336035 | 2026-04-13 03:19:28.336095 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-13 03:19:29.208374 | instance -> localhost | Generating public/private rsa key pair. 2026-04-13 03:19:29.208664 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/725904b5ddb447ea8e4f924ca923c03e/work/725904b5ddb447ea8e4f924ca923c03e_id_rsa 2026-04-13 03:19:29.208713 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/725904b5ddb447ea8e4f924ca923c03e/work/725904b5ddb447ea8e4f924ca923c03e_id_rsa.pub 2026-04-13 03:19:29.208747 | instance -> localhost | The key fingerprint is: 2026-04-13 03:19:29.208778 | instance -> localhost | SHA256:G0+M5TV+Z0qw/fb3ePWoNXq3GiOfkfy21COTdlz0ZR0 zuul-build-sshkey 2026-04-13 03:19:29.208831 | instance -> localhost | The key's randomart image is: 2026-04-13 03:19:29.208866 | instance -> localhost | +---[RSA 3072]----+ 2026-04-13 03:19:29.208913 | instance -> localhost | | E | 2026-04-13 03:19:29.208948 | instance -> localhost | | o| 2026-04-13 03:19:29.209012 | instance -> localhost | | . + =| 2026-04-13 03:19:29.209045 | instance -> localhost | | = o = oo| 2026-04-13 03:19:29.209076 | instance -> localhost | | S + o + =| 2026-04-13 03:19:29.209106 | instance -> localhost | | = .o+=+| 2026-04-13 03:19:29.209137 | instance -> localhost | | . .. @+**| 2026-04-13 03:19:29.209167 | instance -> localhost | | +o&=B| 2026-04-13 03:19:29.209200 | instance -> localhost | | o*+*B| 2026-04-13 03:19:29.209231 | instance -> localhost | +----[SHA256]-----+ 2026-04-13 03:19:29.209337 | instance -> localhost | ok: Runtime: 0:00:00.339960 2026-04-13 03:19:29.217701 | 2026-04-13 03:19:29.217819 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-13 03:19:29.262606 | instance | ok 2026-04-13 03:19:29.274395 | instance | included: /var/lib/zuul/builds/725904b5ddb447ea8e4f924ca923c03e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-13 03:19:29.285246 | 2026-04-13 03:19:29.285424 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-13 03:19:29.311855 | instance | skipping: Conditional result was False 2026-04-13 03:19:29.320606 | 2026-04-13 03:19:29.320740 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-13 03:19:29.763350 | instance | changed 2026-04-13 03:19:29.771672 | 2026-04-13 03:19:29.771786 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-13 03:19:29.972101 | instance | ok 2026-04-13 03:19:29.980051 | 2026-04-13 03:19:29.980432 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-13 03:19:30.462479 | instance | changed 2026-04-13 03:19:30.469506 | 2026-04-13 03:19:30.469598 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-13 03:19:30.929155 | instance | changed 2026-04-13 03:19:30.936595 | 2026-04-13 03:19:30.936692 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-13 03:19:30.962124 | instance | skipping: Conditional result was False 2026-04-13 03:19:30.971699 | 2026-04-13 03:19:30.971832 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-13 03:19:31.362526 | instance -> localhost | changed 2026-04-13 03:19:31.406863 | 2026-04-13 03:19:31.406992 | TASK [add-build-sshkey : Add back temp key] 2026-04-13 03:19:31.702697 | instance -> localhost | Identity added: /var/lib/zuul/builds/725904b5ddb447ea8e4f924ca923c03e/work/725904b5ddb447ea8e4f924ca923c03e_id_rsa (zuul-build-sshkey) 2026-04-13 03:19:31.702927 | instance -> localhost | ok: Runtime: 0:00:00.013692 2026-04-13 03:19:31.713216 | 2026-04-13 03:19:31.713444 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-13 03:19:31.991702 | instance | ok 2026-04-13 03:19:31.998059 | 2026-04-13 03:19:31.998147 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-13 03:19:32.023766 | instance | skipping: Conditional result was False 2026-04-13 03:19:32.039601 | 2026-04-13 03:19:32.039695 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-13 03:19:32.327583 | instance | ok 2026-04-13 03:19:32.333511 | 2026-04-13 03:19:32.333577 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-13 03:19:33.954532 | instance | Output suppressed because no_log was given 2026-04-13 03:19:33.965820 | 2026-04-13 03:19:33.965884 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-13 03:19:34.161728 | instance | ok: "logs" 2026-04-13 03:19:34.161936 | instance | ok: All items complete 2026-04-13 03:19:34.161963 | 2026-04-13 03:19:34.319106 | instance | ok: "artifacts" 2026-04-13 03:19:34.482459 | instance | ok: "docs" 2026-04-13 03:19:34.492368 | 2026-04-13 03:19:34.492431 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-13 03:19:34.686549 | instance | changed: "logs" 2026-04-13 03:19:34.844001 | instance | changed: "artifacts" 2026-04-13 03:19:35.001805 | instance | changed: "docs" 2026-04-13 03:19:35.020846 | 2026-04-13 03:19:35.020912 | PLAY RECAP 2026-04-13 03:19:35.020984 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-13 03:19:35.021027 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-13 03:19:35.021058 | 2026-04-13 03:19:35.123751 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-13 03:19:35.134013 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-13 03:19:35.693951 | 2026-04-13 03:19:35.694066 | PLAY [all] 2026-04-13 03:19:35.705298 | 2026-04-13 03:19:35.705372 | TASK [setup-uv : Extract archive] 2026-04-13 03:19:37.916063 | instance | changed 2026-04-13 03:19:37.923011 | 2026-04-13 03:19:37.923087 | TASK [setup-uv : Print version] 2026-04-13 03:19:37.778191 | instance | uv 0.8.13 2026-04-13 03:19:38.460728 | instance | ok: Runtime: 0:00:00.013473 2026-04-13 03:19:38.469535 | 2026-04-13 03:19:38.469602 | PLAY RECAP 2026-04-13 03:19:38.469664 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-13 03:19:38.469698 | 2026-04-13 03:19:38.575824 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-13 03:19:38.587397 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-13 03:19:39.187321 | 2026-04-13 03:19:39.187857 | PLAY [all] 2026-04-13 03:19:39.199191 | 2026-04-13 03:19:39.199274 | TASK [Install "jq" for log collection] 2026-04-13 03:19:53.699185 | instance | changed 2026-04-13 03:19:53.703357 | 2026-04-13 03:19:53.703451 | PLAY [all] 2026-04-13 03:19:53.712013 | 2026-04-13 03:19:53.712114 | TASK [ensure-go : Check installed go version] 2026-04-13 03:19:54.255405 | instance | ok: ERROR (ignored) 2026-04-13 03:19:54.256035 | instance | { 2026-04-13 03:19:54.256095 | instance | "failed_when_result": false, 2026-04-13 03:19:54.256138 | instance | "msg": "[Errno 2] No such file or directory: b'go'", 2026-04-13 03:19:54.256172 | instance | "rc": 2 2026-04-13 03:19:54.256207 | instance | } 2026-04-13 03:19:54.265742 | 2026-04-13 03:19:54.265846 | TASK [ensure-go : Skip if correct version of go is installed] 2026-04-13 03:19:54.331298 | instance | ok 2026-04-13 03:19:54.340421 | instance | included: /var/lib/zuul/builds/725904b5ddb447ea8e4f924ca923c03e/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml 2026-04-13 03:19:54.345623 | 2026-04-13 03:19:54.345696 | TASK [ensure-go : Create temp directory] 2026-04-13 03:19:54.686788 | instance | changed 2026-04-13 03:19:54.694607 | 2026-04-13 03:19:54.694705 | TASK [ensure-go : Get archive checksum] 2026-04-13 03:19:55.237152 | instance | ok: OK (64 bytes) 2026-04-13 03:19:55.243883 | 2026-04-13 03:19:55.243955 | TASK [ensure-go : Download go archive] 2026-04-13 03:19:56.424529 | instance | changed: OK (78559214 bytes) 2026-04-13 03:19:56.431776 | 2026-04-13 03:19:56.431862 | TASK [ensure-go : Install go] 2026-04-13 03:20:02.407375 | instance | changed 2026-04-13 03:20:02.415542 | 2026-04-13 03:20:02.415625 | PLAY RECAP 2026-04-13 03:20:02.415684 | instance | ok: 7 changed: 4 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-13 03:20:02.415717 | 2026-04-13 03:20:02.530597 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-13 03:20:02.537516 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-13 03:20:03.255441 | 2026-04-13 03:20:03.255560 | PLAY [all] 2026-04-13 03:20:03.266734 | 2026-04-13 03:20:03.266807 | TASK [Copy inventory file for Zuul] 2026-04-13 03:20:04.109426 | instance | changed 2026-04-13 03:20:04.116408 | 2026-04-13 03:20:04.116510 | TASK [Switch "ansible_host" to private IP] 2026-04-13 03:20:04.437267 | instance | changed: 1 replacements made 2026-04-13 03:20:04.443090 | 2026-04-13 03:20:04.443169 | TASK [Run Molecule scenario] 2026-04-13 03:20:04.856768 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3 2026-04-13 03:20:04.856858 | instance | Creating virtual environment at: .venv 2026-04-13 03:20:04.881641 | instance | Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-13 03:20:04.910671 | instance | Downloading rjsonnet (1.2MiB) 2026-04-13 03:20:04.912193 | instance | Downloading netaddr (2.2MiB) 2026-04-13 03:20:04.914371 | instance | Downloading ansible-core (2.1MiB) 2026-04-13 03:20:04.915171 | instance | Downloading pydantic-core (2.0MiB) 2026-04-13 03:20:04.915394 | instance | Downloading openstacksdk (1.7MiB) 2026-04-13 03:20:04.915651 | instance | Downloading cryptography (4.2MiB) 2026-04-13 03:20:04.916539 | instance | Downloading pygments (1.2MiB) 2026-04-13 03:20:04.916809 | instance | Downloading setuptools (1.1MiB) 2026-04-13 03:20:04.917072 | instance | Downloading kubernetes (1.9MiB) 2026-04-13 03:20:05.224753 | instance | Building pyperclip==1.9.0 2026-04-13 03:20:05.230123 | instance | Downloading rjsonnet 2026-04-13 03:20:05.345275 | instance | Downloading pydantic-core 2026-04-13 03:20:05.402492 | instance | Downloading netaddr 2026-04-13 03:20:05.415177 | instance | Downloading pygments 2026-04-13 03:20:05.428323 | instance | Downloading cryptography 2026-04-13 03:20:05.468585 | instance | Downloading setuptools 2026-04-13 03:20:05.526917 | instance | Downloading kubernetes 2026-04-13 03:20:05.558630 | instance | Downloading ansible-core 2026-04-13 03:20:05.598269 | instance | Downloading openstacksdk 2026-04-13 03:20:05.978127 | instance | Built pyperclip==1.9.0 2026-04-13 03:20:06.170251 | instance | Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-13 03:20:06.215470 | instance | Installed 83 packages in 42ms 2026-04-13 03:20:06.824942 | instance | WARNING Molecule scenarios should migrate to 'extensions/molecule' 2026-04-13 03:20:07.406020 | instance | INFO [aio > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-04-13 03:20:07.406106 | instance | INFO [aio > prerun] Performing prerun with role_name_check=0... 2026-04-13 03:20:49.453635 | instance | INFO [aio > dependency] Executing 2026-04-13 03:20:49.453877 | instance | WARNING [aio > dependency] Missing roles requirements file: requirements.yml 2026-04-13 03:20:49.454020 | instance | WARNING [aio > dependency] Missing collections requirements file: collections.yml 2026-04-13 03:20:49.454183 | instance | WARNING [aio > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-04-13 03:20:49.462782 | instance | INFO [aio > cleanup] Executing 2026-04-13 03:20:49.463174 | instance | WARNING [aio > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-13 03:20:49.471646 | instance | INFO [aio > destroy] Executing 2026-04-13 03:20:49.471734 | instance | WARNING [aio > destroy] Skipping, '--destroy=never' requested. 2026-04-13 03:20:49.471896 | instance | INFO [aio > destroy] Executed: Successful 2026-04-13 03:20:49.480155 | instance | INFO [aio > syntax] Executing 2026-04-13 03:20:50.282931 | instance | 2026-04-13 03:20:50.283239 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml 2026-04-13 03:20:50.324270 | instance | INFO [aio > syntax] Executed: Successful 2026-04-13 03:20:50.336720 | instance | INFO [aio > create] Executing 2026-04-13 03:20:50.338612 | instance | WARNING [aio > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-13 03:20:50.346310 | instance | INFO [aio > prepare] Executing 2026-04-13 03:20:51.202375 | instance | 2026-04-13 03:20:51.202604 | instance | PLAY [Prepare] ***************************************************************** 2026-04-13 03:20:51.202851 | instance | 2026-04-13 03:20:51.203197 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-13 03:20:51.203468 | instance | Monday 13 April 2026 03:20:51 +0000 (0:00:00.025) 0:00:00.025 ********** 2026-04-13 03:20:52.304314 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-04-13 03:20:52.304587 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-13 03:20:52.304884 | instance | interpreter could change the meaning of that path. See 2026-04-13 03:20:52.305171 | instance | https://docs.ansible.com/ansible- 2026-04-13 03:20:52.305457 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-04-13 03:20:52.316474 | instance | ok: [instance] 2026-04-13 03:20:52.316645 | instance | 2026-04-13 03:20:52.316916 | instance | TASK [Configure short hostname] ************************************************ 2026-04-13 03:20:52.317187 | instance | Monday 13 April 2026 03:20:52 +0000 (0:00:01.114) 0:00:01.139 ********** 2026-04-13 03:20:53.011090 | instance | changed: [instance] 2026-04-13 03:20:53.011331 | instance | 2026-04-13 03:20:53.011707 | instance | TASK [Ensure hostname inside hosts file] *************************************** 2026-04-13 03:20:53.011930 | instance | Monday 13 April 2026 03:20:53 +0000 (0:00:00.694) 0:00:01.834 ********** 2026-04-13 03:20:53.290147 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-04-13 03:20:53.290427 | instance | with a mode of 0700, this may cause issues when running as another user. To 2026-04-13 03:20:53.290820 | instance | avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-13 03:20:53.300052 | instance | changed: [instance] 2026-04-13 03:20:53.300297 | instance | 2026-04-13 03:20:53.300569 | instance | TASK [Install "dirmngr" for GPG keyserver operations] ************************** 2026-04-13 03:20:53.300838 | instance | Monday 13 April 2026 03:20:53 +0000 (0:00:00.289) 0:00:02.123 ********** 2026-04-13 03:20:54.562685 | instance | ok: [instance] 2026-04-13 03:20:54.562901 | instance | 2026-04-13 03:20:54.563181 | instance | TASK [Purge "snapd" package] *************************************************** 2026-04-13 03:20:54.563503 | instance | Monday 13 April 2026 03:20:54 +0000 (0:00:01.261) 0:00:03.385 ********** 2026-04-13 03:20:55.302364 | instance | ok: [instance] 2026-04-13 03:20:55.302702 | instance | 2026-04-13 03:20:55.302987 | instance | PLAY [Generate workspace for Atmosphere] *************************************** 2026-04-13 03:20:55.303248 | instance | 2026-04-13 03:20:55.303558 | instance | TASK [Create folders for workspace] ******************************************** 2026-04-13 03:20:55.303851 | instance | Monday 13 April 2026 03:20:55 +0000 (0:00:00.740) 0:00:04.125 ********** 2026-04-13 03:20:56.326132 | instance | changed: [localhost] => (item=group_vars) 2026-04-13 03:20:56.326198 | instance | changed: [localhost] => (item=group_vars/all) 2026-04-13 03:20:56.326367 | instance | changed: [localhost] => (item=group_vars/controllers) 2026-04-13 03:20:56.326472 | instance | changed: [localhost] => (item=group_vars/cephs) 2026-04-13 03:20:56.326604 | instance | changed: [localhost] => (item=group_vars/computes) 2026-04-13 03:20:56.326775 | instance | changed: [localhost] => (item=host_vars) 2026-04-13 03:20:56.326830 | instance | 2026-04-13 03:20:56.326973 | instance | PLAY [Generate Ceph control plane configuration for workspace] ***************** 2026-04-13 03:20:56.327068 | instance | 2026-04-13 03:20:56.327198 | instance | TASK [Ensure the Ceph control plane configuration file exists] ***************** 2026-04-13 03:20:56.327310 | instance | Monday 13 April 2026 03:20:56 +0000 (0:00:01.024) 0:00:05.149 ********** 2026-04-13 03:20:56.499991 | instance | changed: [localhost] 2026-04-13 03:20:56.500264 | instance | 2026-04-13 03:20:56.500581 | instance | TASK [Load the current Ceph control plane configuration into a variable] ******* 2026-04-13 03:20:56.500858 | instance | Monday 13 April 2026 03:20:56 +0000 (0:00:00.173) 0:00:05.323 ********** 2026-04-13 03:20:56.520523 | instance | ok: [localhost] 2026-04-13 03:20:56.520791 | instance | 2026-04-13 03:20:56.521079 | instance | TASK [Generate Ceph control plane values for missing variables] **************** 2026-04-13 03:20:56.521330 | instance | Monday 13 April 2026 03:20:56 +0000 (0:00:00.020) 0:00:05.343 ********** 2026-04-13 03:20:56.563535 | instance | ok: [localhost] => (item={'key': 'ceph_fsid', 'value': '012dd75b-15e2-5baa-952c-b122b82d93e9'}) 2026-04-13 03:20:56.563773 | instance | ok: [localhost] => (item={'key': 'ceph_mon_public_network', 'value': '10.96.240.0/24'}) 2026-04-13 03:20:56.564050 | instance | 2026-04-13 03:20:56.564326 | instance | TASK [Write new Ceph control plane configuration file to disk] ***************** 2026-04-13 03:20:56.564597 | instance | Monday 13 April 2026 03:20:56 +0000 (0:00:00.042) 0:00:05.386 ********** 2026-04-13 03:20:57.128505 | instance | changed: [localhost] 2026-04-13 03:20:57.128759 | instance | 2026-04-13 03:20:57.128989 | instance | PLAY [Generate Ceph OSD configuration for workspace] *************************** 2026-04-13 03:20:57.129235 | instance | 2026-04-13 03:20:57.129503 | instance | TASK [Ensure the Ceph OSDs configuration file exists] ************************** 2026-04-13 03:20:57.129768 | instance | Monday 13 April 2026 03:20:57 +0000 (0:00:00.564) 0:00:05.951 ********** 2026-04-13 03:20:57.303221 | instance | changed: [localhost] 2026-04-13 03:20:57.303337 | instance | 2026-04-13 03:20:57.303535 | instance | TASK [Load the current Ceph OSDs configuration into a variable] **************** 2026-04-13 03:20:57.303682 | instance | Monday 13 April 2026 03:20:57 +0000 (0:00:00.174) 0:00:06.126 ********** 2026-04-13 03:20:57.336051 | instance | ok: [localhost] 2026-04-13 03:20:57.336286 | instance | 2026-04-13 03:20:57.336549 | instance | TASK [Generate Ceph OSDs values for missing variables] ************************* 2026-04-13 03:20:57.336817 | instance | Monday 13 April 2026 03:20:57 +0000 (0:00:00.033) 0:00:06.159 ********** 2026-04-13 03:20:57.368923 | instance | ok: [localhost] => (item={'key': 'ceph_osd_devices', 'value': ['/dev/vdb', '/dev/vdc', '/dev/vdd']}) 2026-04-13 03:20:57.369153 | instance | 2026-04-13 03:20:57.369415 | instance | TASK [Write new Ceph OSDs configuration file to disk] ************************** 2026-04-13 03:20:57.369758 | instance | Monday 13 April 2026 03:20:57 +0000 (0:00:00.032) 0:00:06.192 ********** 2026-04-13 03:20:57.738091 | instance | changed: [localhost] 2026-04-13 03:20:57.738353 | instance | 2026-04-13 03:20:57.738682 | instance | PLAY [Generate Kubernetes configuration for workspace] ************************* 2026-04-13 03:20:57.738942 | instance | 2026-04-13 03:20:57.739222 | instance | TASK [Ensure the Kubernetes configuration file exists] ************************* 2026-04-13 03:20:57.739470 | instance | Monday 13 April 2026 03:20:57 +0000 (0:00:00.369) 0:00:06.561 ********** 2026-04-13 03:20:57.932652 | instance | changed: [localhost] 2026-04-13 03:20:57.932929 | instance | 2026-04-13 03:20:57.933218 | instance | TASK [Load the current Kubernetes configuration into a variable] *************** 2026-04-13 03:20:57.933501 | instance | Monday 13 April 2026 03:20:57 +0000 (0:00:00.194) 0:00:06.756 ********** 2026-04-13 03:20:57.957573 | instance | ok: [localhost] 2026-04-13 03:20:57.957843 | instance | 2026-04-13 03:20:57.958145 | instance | TASK [Generate Kubernetes values for missing variables] ************************ 2026-04-13 03:20:57.958371 | instance | Monday 13 April 2026 03:20:57 +0000 (0:00:00.024) 0:00:06.781 ********** 2026-04-13 03:20:57.999132 | instance | ok: [localhost] => (item={'key': 'kubernetes_hostname', 'value': '10.96.240.10'}) 2026-04-13 03:20:57.999429 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vrid', 'value': 42}) 2026-04-13 03:20:57.999762 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vip', 'value': '10.96.240.10'}) 2026-04-13 03:20:58.000024 | instance | 2026-04-13 03:20:58.000307 | instance | TASK [Write new Kubernetes configuration file to disk] ************************* 2026-04-13 03:20:58.000590 | instance | Monday 13 April 2026 03:20:57 +0000 (0:00:00.041) 0:00:06.822 ********** 2026-04-13 03:20:58.356945 | instance | changed: [localhost] 2026-04-13 03:20:58.357184 | instance | 2026-04-13 03:20:58.357453 | instance | PLAY [Generate Keepalived configuration for workspace] ************************* 2026-04-13 03:20:58.357698 | instance | 2026-04-13 03:20:58.357964 | instance | TASK [Ensure the Keeaplived configuration file exists] ************************* 2026-04-13 03:20:58.358232 | instance | Monday 13 April 2026 03:20:58 +0000 (0:00:00.357) 0:00:07.180 ********** 2026-04-13 03:20:58.541903 | instance | changed: [localhost] 2026-04-13 03:20:58.542037 | instance | 2026-04-13 03:20:58.542211 | instance | TASK [Load the current Keepalived configuration into a variable] *************** 2026-04-13 03:20:58.542387 | instance | Monday 13 April 2026 03:20:58 +0000 (0:00:00.185) 0:00:07.365 ********** 2026-04-13 03:20:58.570141 | instance | ok: [localhost] 2026-04-13 03:20:58.570271 | instance | 2026-04-13 03:20:58.570467 | instance | TASK [Generate Keepalived values for missing variables] ************************ 2026-04-13 03:20:58.570653 | instance | Monday 13 April 2026 03:20:58 +0000 (0:00:00.028) 0:00:07.393 ********** 2026-04-13 03:20:58.610262 | instance | ok: [localhost] => (item={'key': 'keepalived_interface', 'value': 'br-ex'}) 2026-04-13 03:20:58.610534 | instance | ok: [localhost] => (item={'key': 'keepalived_vip', 'value': '10.96.250.10'}) 2026-04-13 03:20:58.610780 | instance | 2026-04-13 03:20:58.611060 | instance | TASK [Write new Keepalived configuration file to disk] ************************* 2026-04-13 03:20:58.611380 | instance | Monday 13 April 2026 03:20:58 +0000 (0:00:00.039) 0:00:07.433 ********** 2026-04-13 03:20:58.961324 | instance | changed: [localhost] 2026-04-13 03:20:58.961633 | instance | 2026-04-13 03:20:58.961987 | instance | PLAY [Generate endpoints for workspace] **************************************** 2026-04-13 03:20:58.962310 | instance | 2026-04-13 03:20:58.962706 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-13 03:20:58.963061 | instance | Monday 13 April 2026 03:20:58 +0000 (0:00:00.350) 0:00:07.784 ********** 2026-04-13 03:20:59.650380 | instance | ok: [localhost] 2026-04-13 03:20:59.650617 | instance | 2026-04-13 03:20:59.650926 | instance | TASK [Ensure the endpoints file exists] **************************************** 2026-04-13 03:20:59.651195 | instance | Monday 13 April 2026 03:20:59 +0000 (0:00:00.689) 0:00:08.473 ********** 2026-04-13 03:20:59.817543 | instance | changed: [localhost] 2026-04-13 03:20:59.817792 | instance | 2026-04-13 03:20:59.818078 | instance | TASK [Load the current endpoints into a variable] ****************************** 2026-04-13 03:20:59.818356 | instance | Monday 13 April 2026 03:20:59 +0000 (0:00:00.167) 0:00:08.640 ********** 2026-04-13 03:20:59.846478 | instance | ok: [localhost] 2026-04-13 03:20:59.846808 | instance | 2026-04-13 03:20:59.847091 | instance | TASK [Generate endpoint skeleton for missing variables] ************************ 2026-04-13 03:20:59.847364 | instance | Monday 13 April 2026 03:20:59 +0000 (0:00:00.028) 0:00:08.669 ********** 2026-04-13 03:21:00.601653 | instance | ok: [localhost] => (item=keycloak_host) 2026-04-13 03:21:00.601930 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_host) 2026-04-13 03:21:00.602199 | instance | ok: [localhost] => (item=kube_prometheus_stack_alertmanager_host) 2026-04-13 03:21:00.602533 | instance | ok: [localhost] => (item=kube_prometheus_stack_prometheus_host) 2026-04-13 03:21:00.602812 | instance | ok: [localhost] => (item=openstack_helm_endpoints_region_name) 2026-04-13 03:21:00.603081 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_api_host) 2026-04-13 03:21:00.603349 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_api_host) 2026-04-13 03:21:00.603557 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_api_host) 2026-04-13 03:21:00.603817 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_api_host) 2026-04-13 03:21:00.604084 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_api_host) 2026-04-13 03:21:00.604344 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_api_host) 2026-04-13 03:21:00.604666 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_api_host) 2026-04-13 03:21:00.604931 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_novnc_host) 2026-04-13 03:21:00.605197 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_api_host) 2026-04-13 03:21:00.605466 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_api_host) 2026-04-13 03:21:00.605733 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_api_host) 2026-04-13 03:21:00.606016 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_api_host) 2026-04-13 03:21:00.606220 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_registry_host) 2026-04-13 03:21:00.606617 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_api_host) 2026-04-13 03:21:00.606834 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_cfn_api_host) 2026-04-13 03:21:00.607094 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_api_host) 2026-04-13 03:21:00.607359 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_host) 2026-04-13 03:21:00.607686 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_api_host) 2026-04-13 03:21:00.607939 | instance | 2026-04-13 03:21:00.608218 | instance | TASK [Write new endpoints file to disk] **************************************** 2026-04-13 03:21:00.608489 | instance | Monday 13 April 2026 03:21:00 +0000 (0:00:00.754) 0:00:09.424 ********** 2026-04-13 03:21:00.941185 | instance | changed: [localhost] 2026-04-13 03:21:00.941309 | instance | 2026-04-13 03:21:00.941455 | instance | TASK [Ensure the endpoints file exists] **************************************** 2026-04-13 03:21:00.941609 | instance | Monday 13 April 2026 03:21:00 +0000 (0:00:00.339) 0:00:09.764 ********** 2026-04-13 03:21:01.126909 | instance | changed: [localhost] 2026-04-13 03:21:01.127199 | instance | 2026-04-13 03:21:01.127520 | instance | PLAY [Generate Neutron configuration for workspace] **************************** 2026-04-13 03:21:01.127914 | instance | 2026-04-13 03:21:01.128235 | instance | TASK [Ensure the Neutron configuration file exists] **************************** 2026-04-13 03:21:01.128547 | instance | Monday 13 April 2026 03:21:01 +0000 (0:00:00.185) 0:00:09.950 ********** 2026-04-13 03:21:01.313703 | instance | changed: [localhost] 2026-04-13 03:21:01.313955 | instance | 2026-04-13 03:21:01.314282 | instance | TASK [Load the current Neutron configuration into a variable] ****************** 2026-04-13 03:21:01.314592 | instance | Monday 13 April 2026 03:21:01 +0000 (0:00:00.186) 0:00:10.136 ********** 2026-04-13 03:21:01.344970 | instance | ok: [localhost] 2026-04-13 03:21:01.345225 | instance | 2026-04-13 03:21:01.345496 | instance | TASK [Generate Neutron values for missing variables] *************************** 2026-04-13 03:21:01.345738 | instance | Monday 13 April 2026 03:21:01 +0000 (0:00:00.032) 0:00:10.168 ********** 2026-04-13 03:21:01.381076 | instance | ok: [localhost] => (item={'key': 'neutron_networks', 'value': [{'name': 'public', 'external': True, 'shared': True, 'mtu_size': 1500, 'port_security_enabled': True, 'provider_network_type': 'flat', 'provider_physical_network': 'external', 'subnets': [{'name': 'public-subnet', 'cidr': '10.96.250.0/24', 'gateway_ip': '10.96.250.10', 'allocation_pool_start': '10.96.250.200', 'allocation_pool_end': '10.96.250.220', 'enable_dhcp': True}]}]}) 2026-04-13 03:21:01.381258 | instance | 2026-04-13 03:21:01.381531 | instance | TASK [Write new Neutron configuration file to disk] **************************** 2026-04-13 03:21:01.381788 | instance | Monday 13 April 2026 03:21:01 +0000 (0:00:00.036) 0:00:10.204 ********** 2026-04-13 03:21:01.742666 | instance | changed: [localhost] 2026-04-13 03:21:01.742867 | instance | 2026-04-13 03:21:01.743133 | instance | PLAY [Generate Nova configuration for workspace] ******************************* 2026-04-13 03:21:01.743376 | instance | 2026-04-13 03:21:01.743642 | instance | TASK [Ensure the Nova configuration file exists] ******************************* 2026-04-13 03:21:01.743904 | instance | Monday 13 April 2026 03:21:01 +0000 (0:00:00.361) 0:00:10.565 ********** 2026-04-13 03:21:01.921953 | instance | changed: [localhost] 2026-04-13 03:21:01.922182 | instance | 2026-04-13 03:21:01.922495 | instance | TASK [Load the current Nova configuration into a variable] ********************* 2026-04-13 03:21:01.922784 | instance | Monday 13 April 2026 03:21:01 +0000 (0:00:00.179) 0:00:10.744 ********** 2026-04-13 03:21:01.952643 | instance | ok: [localhost] 2026-04-13 03:21:01.952874 | instance | 2026-04-13 03:21:01.953117 | instance | TASK [Generate Nova values for missing variables] ****************************** 2026-04-13 03:21:01.953384 | instance | Monday 13 April 2026 03:21:01 +0000 (0:00:00.031) 0:00:10.776 ********** 2026-04-13 03:21:01.999976 | instance | ok: [localhost] => (item={'key': 'nova_flavors', 'value': [{'name': 'm1.tiny', 'ram': 512, 'disk': 1, 'vcpus': 1}, {'name': 'm1.small', 'ram': 2048, 'disk': 20, 'vcpus': 1}, {'name': 'm1.medium', 'ram': 4096, 'disk': 40, 'vcpus': 2}, {'name': 'm1.large', 'ram': 8192, 'disk': 80, 'vcpus': 4}, {'name': 'm1.xlarge', 'ram': 16384, 'disk': 160, 'vcpus': 8}]}) 2026-04-13 03:21:02.000174 | instance | 2026-04-13 03:21:02.000446 | instance | TASK [Write new Nova configuration file to disk] ******************************* 2026-04-13 03:21:02.000728 | instance | Monday 13 April 2026 03:21:01 +0000 (0:00:00.047) 0:00:10.823 ********** 2026-04-13 03:21:02.353254 | instance | changed: [localhost] 2026-04-13 03:21:02.353530 | instance | 2026-04-13 03:21:02.353805 | instance | PLAY [Generate secrets for workspace] ****************************************** 2026-04-13 03:21:02.354063 | instance | 2026-04-13 03:21:02.354375 | instance | TASK [Ensure the secrets file exists] ****************************************** 2026-04-13 03:21:02.354680 | instance | Monday 13 April 2026 03:21:02 +0000 (0:00:00.353) 0:00:11.176 ********** 2026-04-13 03:21:02.526795 | instance | changed: [localhost] 2026-04-13 03:21:02.527015 | instance | 2026-04-13 03:21:02.527332 | instance | TASK [Load the current secrets into a variable] ******************************** 2026-04-13 03:21:02.527601 | instance | Monday 13 April 2026 03:21:02 +0000 (0:00:00.173) 0:00:11.349 ********** 2026-04-13 03:21:02.553189 | instance | ok: [localhost] 2026-04-13 03:21:02.553488 | instance | 2026-04-13 03:21:02.553830 | instance | TASK [Generate secrets for missing variables] ********************************** 2026-04-13 03:21:02.554114 | instance | Monday 13 April 2026 03:21:02 +0000 (0:00:00.026) 0:00:11.376 ********** 2026-04-13 03:21:02.958096 | instance | ok: [localhost] => (item=heat_auth_encryption_key) 2026-04-13 03:21:02.958532 | instance | ok: [localhost] => (item=keepalived_password) 2026-04-13 03:21:02.958875 | instance | ok: [localhost] => (item=keycloak_admin_password) 2026-04-13 03:21:02.959206 | instance | ok: [localhost] => (item=keycloak_database_password) 2026-04-13 03:21:02.959533 | instance | ok: [localhost] => (item=keystone_keycloak_client_secret) 2026-04-13 03:21:02.959859 | instance | ok: [localhost] => (item=keystone_oidc_crypto_passphrase) 2026-04-13 03:21:02.960192 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_admin_password) 2026-04-13 03:21:02.960518 | instance | ok: [localhost] => (item=octavia_heartbeat_key) 2026-04-13 03:21:02.960847 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rabbitmq_admin_password) 2026-04-13 03:21:02.961238 | instance | ok: [localhost] => (item=openstack_helm_endpoints_memcached_secret_key) 2026-04-13 03:21:02.961574 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_admin_password) 2026-04-13 03:21:02.961896 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_mariadb_password) 2026-04-13 03:21:02.962101 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_rabbitmq_password) 2026-04-13 03:21:02.962523 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_keystone_password) 2026-04-13 03:21:02.962740 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_mariadb_password) 2026-04-13 03:21:02.962951 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_rabbitmq_password) 2026-04-13 03:21:02.963156 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_keystone_password) 2026-04-13 03:21:02.963363 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_mariadb_password) 2026-04-13 03:21:02.963571 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_rabbitmq_password) 2026-04-13 03:21:02.963776 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_keystone_password) 2026-04-13 03:21:02.963989 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_mariadb_password) 2026-04-13 03:21:02.964195 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_keystone_password) 2026-04-13 03:21:02.964399 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_mariadb_password) 2026-04-13 03:21:02.964604 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_keystone_password) 2026-04-13 03:21:02.964809 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_mariadb_password) 2026-04-13 03:21:02.965020 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_rabbitmq_password) 2026-04-13 03:21:02.965246 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_metadata_secret) 2026-04-13 03:21:02.965452 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_keystone_password) 2026-04-13 03:21:02.965656 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_mariadb_password) 2026-04-13 03:21:02.965861 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_rabbitmq_password) 2026-04-13 03:21:02.966066 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_keystone_password) 2026-04-13 03:21:02.966270 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_mariadb_password) 2026-04-13 03:21:02.966495 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_rabbitmq_password) 2026-04-13 03:21:02.966705 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_keystone_password) 2026-04-13 03:21:02.966909 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_mariadb_password) 2026-04-13 03:21:02.967114 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_rabbitmq_password) 2026-04-13 03:21:02.967342 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_keystone_password) 2026-04-13 03:21:02.967548 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_mariadb_password) 2026-04-13 03:21:02.967754 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_rabbitmq_password) 2026-04-13 03:21:02.967958 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_keystone_password) 2026-04-13 03:21:02.968164 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_mariadb_password) 2026-04-13 03:21:02.968369 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_rabbitmq_password) 2026-04-13 03:21:02.968578 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_keystone_password) 2026-04-13 03:21:02.968796 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_trustee_keystone_password) 2026-04-13 03:21:02.969009 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_stack_user_keystone_password) 2026-04-13 03:21:02.969233 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_mariadb_password) 2026-04-13 03:21:02.969437 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_rabbitmq_password) 2026-04-13 03:21:02.969641 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_mariadb_password) 2026-04-13 03:21:02.969846 | instance | ok: [localhost] => (item=openstack_helm_endpoints_tempest_keystone_password) 2026-04-13 03:21:02.970056 | instance | ok: [localhost] => (item=openstack_helm_endpoints_openstack_exporter_keystone_password) 2026-04-13 03:21:02.970261 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_keystone_password) 2026-04-13 03:21:02.970485 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_keystone_password) 2026-04-13 03:21:02.970693 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_mariadb_password) 2026-04-13 03:21:02.970897 | instance | ok: [localhost] => (item=openstack_helm_endpoints_staffeln_mariadb_password) 2026-04-13 03:21:02.971097 | instance | 2026-04-13 03:21:02.971301 | instance | TASK [Generate base64 encoded secrets] ***************************************** 2026-04-13 03:21:02.971512 | instance | Monday 13 April 2026 03:21:02 +0000 (0:00:00.404) 0:00:11.781 ********** 2026-04-13 03:21:03.015436 | instance | ok: [localhost] => (item=barbican_kek) 2026-04-13 03:21:03.015835 | instance | 2026-04-13 03:21:03.016171 | instance | TASK [Generate temporary files for generating keys for missing variables] ****** 2026-04-13 03:21:03.016503 | instance | Monday 13 April 2026 03:21:03 +0000 (0:00:00.056) 0:00:11.837 ********** 2026-04-13 03:21:03.391640 | instance | changed: [localhost] => (item=manila_ssh_key) 2026-04-13 03:21:03.392160 | instance | changed: [localhost] => (item=nova_ssh_key) 2026-04-13 03:21:03.392474 | instance | 2026-04-13 03:21:03.392802 | instance | TASK [Generate SSH keys for missing variables] ********************************* 2026-04-13 03:21:03.393156 | instance | Monday 13 April 2026 03:21:03 +0000 (0:00:00.375) 0:00:12.213 ********** 2026-04-13 03:21:07.403239 | instance | changed: [localhost] => (item=manila_ssh_key) 2026-04-13 03:21:07.403454 | instance | changed: [localhost] => (item=nova_ssh_key) 2026-04-13 03:21:07.403608 | instance | 2026-04-13 03:21:07.403766 | instance | TASK [Set values for SSH keys] ************************************************* 2026-04-13 03:21:07.403925 | instance | Monday 13 April 2026 03:21:07 +0000 (0:00:04.012) 0:00:16.226 ********** 2026-04-13 03:21:07.455058 | instance | ok: [localhost] => (item=manila_ssh_key) 2026-04-13 03:21:07.455235 | instance | ok: [localhost] => (item=nova_ssh_key) 2026-04-13 03:21:07.455490 | instance | 2026-04-13 03:21:07.455702 | instance | TASK [Delete the temporary files generated for SSH keys] *********************** 2026-04-13 03:21:07.455912 | instance | Monday 13 April 2026 03:21:07 +0000 (0:00:00.051) 0:00:16.277 ********** 2026-04-13 03:21:07.803444 | instance | changed: [localhost] => (item=manila_ssh_key) 2026-04-13 03:21:07.804186 | instance | changed: [localhost] => (item=nova_ssh_key) 2026-04-13 03:21:07.804233 | instance | 2026-04-13 03:21:07.804241 | instance | TASK [Write new secrets file to disk] ****************************************** 2026-04-13 03:21:07.804249 | instance | Monday 13 April 2026 03:21:07 +0000 (0:00:00.348) 0:00:16.626 ********** 2026-04-13 03:21:08.149376 | instance | changed: [localhost] 2026-04-13 03:21:08.149432 | instance | 2026-04-13 03:21:08.149737 | instance | TASK [Encrypt secrets file with Vault password] ******************************** 2026-04-13 03:21:08.149790 | instance | Monday 13 April 2026 03:21:08 +0000 (0:00:00.345) 0:00:16.972 ********** 2026-04-13 03:21:08.191212 | instance | skipping: [localhost] 2026-04-13 03:21:08.191836 | instance | 2026-04-13 03:21:08.191863 | instance | PLAY [Setup networking] ******************************************************** 2026-04-13 03:21:08.191869 | instance | 2026-04-13 03:21:08.191873 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-13 03:21:08.191878 | instance | Monday 13 April 2026 03:21:08 +0000 (0:00:00.042) 0:00:17.014 ********** 2026-04-13 03:21:08.891597 | instance | ok: [instance] 2026-04-13 03:21:08.891698 | instance | 2026-04-13 03:21:08.891715 | instance | TASK [Create bridge for management network] ************************************ 2026-04-13 03:21:08.891881 | instance | Monday 13 April 2026 03:21:08 +0000 (0:00:00.700) 0:00:17.714 ********** 2026-04-13 03:21:09.236613 | instance | ok: [instance] 2026-04-13 03:21:09.236724 | instance | 2026-04-13 03:21:09.236801 | instance | TASK [Create fake interface for management bridge] ***************************** 2026-04-13 03:21:09.236925 | instance | Monday 13 April 2026 03:21:09 +0000 (0:00:00.345) 0:00:18.060 ********** 2026-04-13 03:21:09.448435 | instance | ok: [instance] 2026-04-13 03:21:09.448546 | instance | 2026-04-13 03:21:09.448692 | instance | TASK [Assign dummy interface to management bridge] ***************************** 2026-04-13 03:21:09.448908 | instance | Monday 13 April 2026 03:21:09 +0000 (0:00:00.211) 0:00:18.271 ********** 2026-04-13 03:21:09.650243 | instance | ok: [instance] 2026-04-13 03:21:09.650326 | instance | 2026-04-13 03:21:09.650517 | instance | TASK [Assign IP address for management bridge] ********************************* 2026-04-13 03:21:09.650681 | instance | Monday 13 April 2026 03:21:09 +0000 (0:00:00.201) 0:00:18.473 ********** 2026-04-13 03:21:09.848791 | instance | ok: [instance] 2026-04-13 03:21:09.849045 | instance | 2026-04-13 03:21:09.849326 | instance | TASK [Bring up interfaces] ***************************************************** 2026-04-13 03:21:09.849586 | instance | Monday 13 April 2026 03:21:09 +0000 (0:00:00.198) 0:00:18.671 ********** 2026-04-13 03:21:10.219874 | instance | ok: [instance] => (item=br-mgmt) 2026-04-13 03:21:10.220108 | instance | ok: [instance] => (item=dummy0) 2026-04-13 03:21:10.220363 | instance | 2026-04-13 03:21:10.220630 | instance | PLAY [Create devices for Ceph] ************************************************* 2026-04-13 03:21:10.220880 | instance | 2026-04-13 03:21:10.221151 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-13 03:21:10.221416 | instance | Monday 13 April 2026 03:21:10 +0000 (0:00:00.370) 0:00:19.042 ********** 2026-04-13 03:21:10.965652 | instance | ok: [instance] 2026-04-13 03:21:10.965862 | instance | 2026-04-13 03:21:10.966130 | instance | TASK [Install depedencies] ***************************************************** 2026-04-13 03:21:10.966427 | instance | Monday 13 April 2026 03:21:10 +0000 (0:00:00.745) 0:00:19.788 ********** 2026-04-13 03:21:30.374013 | instance | changed: [instance] 2026-04-13 03:21:30.374320 | instance | 2026-04-13 03:21:30.374343 | instance | TASK [Start up service] ******************************************************** 2026-04-13 03:21:30.374356 | instance | Monday 13 April 2026 03:21:30 +0000 (0:00:19.407) 0:00:39.196 ********** 2026-04-13 03:21:30.891497 | instance | ok: [instance] 2026-04-13 03:21:30.891585 | instance | 2026-04-13 03:21:30.891597 | instance | TASK [Generate lvm.conf] ******************************************************* 2026-04-13 03:21:30.891742 | instance | Monday 13 April 2026 03:21:30 +0000 (0:00:00.518) 0:00:39.715 ********** 2026-04-13 03:21:31.114264 | instance | ok: [instance] 2026-04-13 03:21:31.114964 | instance | 2026-04-13 03:21:31.114993 | instance | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-04-13 03:21:31.115004 | instance | Monday 13 April 2026 03:21:31 +0000 (0:00:00.222) 0:00:39.937 ********** 2026-04-13 03:21:31.578394 | instance | changed: [instance] 2026-04-13 03:21:31.578530 | instance | 2026-04-13 03:21:31.578699 | instance | TASK [Get list of all loopback devices] **************************************** 2026-04-13 03:21:31.578867 | instance | Monday 13 April 2026 03:21:31 +0000 (0:00:00.464) 0:00:40.401 ********** 2026-04-13 03:21:31.782626 | instance | ok: [instance] 2026-04-13 03:21:31.782878 | instance | 2026-04-13 03:21:31.783162 | instance | TASK [Fail if there is any existing loopback devices] ************************** 2026-04-13 03:21:31.783437 | instance | Monday 13 April 2026 03:21:31 +0000 (0:00:00.204) 0:00:40.605 ********** 2026-04-13 03:21:31.806621 | instance | skipping: [instance] 2026-04-13 03:21:31.806883 | instance | 2026-04-13 03:21:31.807164 | instance | TASK [Create devices for Ceph] ************************************************* 2026-04-13 03:21:31.807440 | instance | Monday 13 April 2026 03:21:31 +0000 (0:00:00.024) 0:00:40.630 ********** 2026-04-13 03:21:32.367589 | instance | changed: [instance] => (item=osd0) 2026-04-13 03:21:32.367808 | instance | changed: [instance] => (item=osd1) 2026-04-13 03:21:32.368076 | instance | changed: [instance] => (item=osd2) 2026-04-13 03:21:32.368329 | instance | 2026-04-13 03:21:32.368601 | instance | TASK [Set permissions on loopback devices] ************************************* 2026-04-13 03:21:32.368870 | instance | Monday 13 April 2026 03:21:32 +0000 (0:00:00.560) 0:00:41.190 ********** 2026-04-13 03:21:32.918190 | instance | changed: [instance] => (item=osd0) 2026-04-13 03:21:32.918422 | instance | changed: [instance] => (item=osd1) 2026-04-13 03:21:32.918711 | instance | changed: [instance] => (item=osd2) 2026-04-13 03:21:32.918967 | instance | 2026-04-13 03:21:32.919287 | instance | TASK [Start loop devices] ****************************************************** 2026-04-13 03:21:32.919555 | instance | Monday 13 April 2026 03:21:32 +0000 (0:00:00.550) 0:00:41.741 ********** 2026-04-13 03:21:33.674204 | instance | changed: [instance] => (item=osd0) 2026-04-13 03:21:33.674638 | instance | changed: [instance] => (item=osd1) 2026-04-13 03:21:33.674872 | instance | changed: [instance] => (item=osd2) 2026-04-13 03:21:33.675139 | instance | 2026-04-13 03:21:33.675459 | instance | TASK [Create a volume group for each loop device] ****************************** 2026-04-13 03:21:33.675779 | instance | Monday 13 April 2026 03:21:33 +0000 (0:00:00.756) 0:00:42.497 ********** 2026-04-13 03:21:36.826525 | instance | changed: [instance] => (item=osd0) 2026-04-13 03:21:36.826590 | instance | changed: [instance] => (item=osd1) 2026-04-13 03:21:36.826602 | instance | changed: [instance] => (item=osd2) 2026-04-13 03:21:36.827311 | instance | 2026-04-13 03:21:36.827410 | instance | TASK [Create a logical volume for each loop device] **************************** 2026-04-13 03:21:36.827423 | instance | Monday 13 April 2026 03:21:36 +0000 (0:00:03.151) 0:00:45.648 ********** 2026-04-13 03:21:38.852063 | instance | changed: [instance] => (item=ceph-instance-osd0) 2026-04-13 03:21:38.852172 | instance | changed: [instance] => (item=ceph-instance-osd1) 2026-04-13 03:21:38.853190 | instance | changed: [instance] => (item=ceph-instance-osd2) 2026-04-13 03:21:38.853247 | instance | 2026-04-13 03:21:38.853256 | instance | PLAY [controllers] ************************************************************* 2026-04-13 03:21:38.853263 | instance | 2026-04-13 03:21:38.853269 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-13 03:21:38.853276 | instance | Monday 13 April 2026 03:21:38 +0000 (0:00:02.026) 0:00:47.675 ********** 2026-04-13 03:21:39.735102 | instance | ok: [instance] 2026-04-13 03:21:39.735181 | instance | 2026-04-13 03:21:39.735242 | instance | TASK [Set masquerade rule] ***************************************************** 2026-04-13 03:21:39.735389 | instance | Monday 13 April 2026 03:21:39 +0000 (0:00:00.883) 0:00:48.558 ********** 2026-04-13 03:21:40.259683 | instance | changed: [instance] 2026-04-13 03:21:40.262474 | instance | 2026-04-13 03:21:40.262527 | instance | PLAY RECAP ********************************************************************* 2026-04-13 03:21:40.262536 | instance | instance : ok=24 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-13 03:21:40.262542 | instance | localhost : ok=40 changed=21 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-13 03:21:40.262548 | instance | 2026-04-13 03:21:40.262554 | instance | Monday 13 April 2026 03:21:40 +0000 (0:00:00.524) 0:00:49.082 ********** 2026-04-13 03:21:40.262560 | instance | =============================================================================== 2026-04-13 03:21:40.262583 | instance | Install depedencies ---------------------------------------------------- 19.41s 2026-04-13 03:21:40.262589 | instance | Generate SSH keys for missing variables --------------------------------- 4.01s 2026-04-13 03:21:40.262595 | instance | Create a volume group for each loop device ------------------------------ 3.15s 2026-04-13 03:21:40.262606 | instance | Create a logical volume for each loop device ---------------------------- 2.03s 2026-04-13 03:21:40.262789 | instance | Install "dirmngr" for GPG keyserver operations -------------------------- 1.26s 2026-04-13 03:21:40.263187 | instance | Gathering Facts --------------------------------------------------------- 1.11s 2026-04-13 03:21:40.263515 | instance | Create folders for workspace -------------------------------------------- 1.02s 2026-04-13 03:21:40.263861 | instance | Gathering Facts --------------------------------------------------------- 0.88s 2026-04-13 03:21:40.264184 | instance | Start loop devices ------------------------------------------------------ 0.76s 2026-04-13 03:21:40.264507 | instance | Generate endpoint skeleton for missing variables ------------------------ 0.75s 2026-04-13 03:21:40.264825 | instance | Gathering Facts --------------------------------------------------------- 0.75s 2026-04-13 03:21:40.265144 | instance | Purge "snapd" package --------------------------------------------------- 0.74s 2026-04-13 03:21:40.265530 | instance | Gathering Facts --------------------------------------------------------- 0.70s 2026-04-13 03:21:40.265885 | instance | Configure short hostname ------------------------------------------------ 0.69s 2026-04-13 03:21:40.266206 | instance | Gathering Facts --------------------------------------------------------- 0.69s 2026-04-13 03:21:40.266570 | instance | Write new Ceph control plane configuration file to disk ----------------- 0.56s 2026-04-13 03:21:40.266900 | instance | Create devices for Ceph ------------------------------------------------- 0.56s 2026-04-13 03:21:40.267224 | instance | Set permissions on loopback devices ------------------------------------- 0.55s 2026-04-13 03:21:40.267554 | instance | Set masquerade rule ----------------------------------------------------- 0.52s 2026-04-13 03:21:40.267927 | instance | Start up service -------------------------------------------------------- 0.52s 2026-04-13 03:21:40.344819 | instance | INFO [aio > prepare] Executed: Successful 2026-04-13 03:21:40.357646 | instance | INFO [aio > converge] Executing 2026-04-13 03:21:41.137585 | instance | 2026-04-13 03:21:41.137895 | instance | PLAY [localhost] *************************************************************** 2026-04-13 03:21:41.138093 | instance | 2026-04-13 03:21:41.138302 | instance | TASK [Build atmosphere binary] ************************************************* 2026-04-13 03:21:41.138546 | instance | Monday 13 April 2026 03:21:41 +0000 (0:00:00.010) 0:00:00.010 ********** 2026-04-13 03:21:48.227287 | instance | changed: [localhost] 2026-04-13 03:21:48.227340 | instance | 2026-04-13 03:21:48.227350 | instance | TASK [Deploy with parallel orchestrator] *************************************** 2026-04-13 03:21:48.227358 | instance | Monday 13 April 2026 03:21:48 +0000 (0:00:07.086) 0:00:07.097 ********** 2026-04-13 03:21:48.949760 | instance | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["/home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/../../bin/atmosphere", "deploy", "--inventory", "/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml", "--playbook-dir", "/home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/../../playbooks"], "delta": "0:00:00.554947", "end": "2026-04-13 03:21:48.921495", "msg": "non-zero return code", "rc": 1, "start": "2026-04-13 03:21:48.366548", "stderr": "Error: prerequisite openstacksdk failed: ansible-playbook failed for prerequisite-openstacksdk: exit status 1\nUsage:\n atmosphere deploy [flags]\n\nFlags:\n --concurrency int Max concurrent deployments per wave (0 = unlimited)\n -h, --help help for deploy\n -i, --inventory string Path to Ansible inventory file (required)\n --playbook-dir string Directory containing playbook files (default: playbooks)\n -t, --tags string Comma-separated list of component tags to deploy\n\nprerequisite openstacksdk failed: ansible-playbook failed for prerequisite-openstacksdk: exit status 1", "stderr_lines": ["Error: prerequisite openstacksdk failed: ansible-playbook failed for prerequisite-openstacksdk: exit status 1", "Usage:", " atmosphere deploy [flags]", "", "Flags:", " --concurrency int Max concurrent deployments per wave (0 = unlimited)", " -h, --help help for deploy", " -i, --inventory string Path to Ansible inventory file (required)", " --playbook-dir string Directory containing playbook files (default: playbooks)", " -t, --tags string Comma-separated list of component tags to deploy", "", "prerequisite openstacksdk failed: ansible-playbook failed for prerequisite-openstacksdk: exit status 1"], "stdout": "==> Running prerequisite: openstacksdk\n[prerequisite-openstacksdk] ERROR! the role 'openstacksdk' was not found in /dev/roles:/home/zuul/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/dev\n[prerequisite-openstacksdk] \n[prerequisite-openstacksdk] The error appears to be in '/dev/stdin': line 5, column 7, but may\n[prerequisite-openstacksdk] be elsewhere in the file depending on the exact syntax problem.\n[prerequisite-openstacksdk] \n[prerequisite-openstacksdk] (specified line no longer in file, maybe it changed?)", "stdout_lines": ["==> Running prerequisite: openstacksdk", "[prerequisite-openstacksdk] ERROR! the role 'openstacksdk' was not found in /dev/roles:/home/zuul/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/dev", "[prerequisite-openstacksdk] ", "[prerequisite-openstacksdk] The error appears to be in '/dev/stdin': line 5, column 7, but may", "[prerequisite-openstacksdk] be elsewhere in the file depending on the exact syntax problem.", "[prerequisite-openstacksdk] ", "[prerequisite-openstacksdk] (specified line no longer in file, maybe it changed?)"]} 2026-04-13 03:21:48.953710 | instance | 2026-04-13 03:21:48.953743 | instance | PLAY RECAP ********************************************************************* 2026-04-13 03:21:48.953755 | instance | localhost : ok=1 changed=1 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0 2026-04-13 03:21:48.953766 | instance | 2026-04-13 03:21:48.953776 | instance | Monday 13 April 2026 03:21:48 +0000 (0:00:00.728) 0:00:07.825 ********** 2026-04-13 03:21:48.953786 | instance | =============================================================================== 2026-04-13 03:21:48.953795 | instance | Build atmosphere binary ------------------------------------------------- 7.09s 2026-04-13 03:21:48.953805 | instance | Deploy with parallel orchestrator --------------------------------------- 0.73s 2026-04-13 03:21:49.010474 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml 2026-04-13 03:21:49.010650 | instance | ERROR [aio > converge] Executed: Failed 2026-04-13 03:21:49.010658 | instance | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml 2026-04-13 03:21:49.131794 | instance | ERROR 2026-04-13 03:21:49.132005 | instance | { 2026-04-13 03:21:49.132048 | instance | "delta": "0:01:44.290551", 2026-04-13 03:21:49.132079 | instance | "end": "2026-04-13 03:21:49.084248", 2026-04-13 03:21:49.132106 | instance | "msg": "non-zero return code", 2026-04-13 03:21:49.132133 | instance | "rc": 2, 2026-04-13 03:21:49.132163 | instance | "start": "2026-04-13 03:20:04.793697" 2026-04-13 03:21:49.132190 | instance | } failure 2026-04-13 03:21:49.139935 | 2026-04-13 03:21:49.140214 | PLAY RECAP 2026-04-13 03:21:49.140273 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-04-13 03:21:49.140396 | 2026-04-13 03:21:49.306197 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-13 03:21:49.318282 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-13 03:21:49.928395 | 2026-04-13 03:21:49.928518 | PLAY [all] 2026-04-13 03:21:49.942828 | 2026-04-13 03:21:49.942934 | TASK [gather-host-logs : creating directory for system status] 2026-04-13 03:21:50.313139 | instance | changed 2026-04-13 03:21:50.322205 | 2026-04-13 03:21:50.322353 | TASK [gather-host-logs : Get logs for each host] 2026-04-13 03:21:50.704911 | instance | + systemd-cgls --full --all --no-pager 2026-04-13 03:21:50.717129 | instance | + ip addr 2026-04-13 03:21:50.719163 | instance | + ip route 2026-04-13 03:21:50.720566 | instance | + lsblk 2026-04-13 03:21:50.723216 | instance | + mount 2026-04-13 03:21:50.724559 | instance | + docker images 2026-04-13 03:21:50.724939 | instance | /bin/bash: line 7: docker: command not found 2026-04-13 03:21:50.725134 | instance | + brctl show 2026-04-13 03:21:50.725481 | instance | /bin/bash: line 8: brctl: command not found 2026-04-13 03:21:50.725675 | instance | + ps aux --sort=-%mem 2026-04-13 03:21:50.739274 | instance | + dpkg -l 2026-04-13 03:21:50.750144 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul)) 2026-04-13 03:21:50.751753 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul 2026-04-13 03:21:50.752570 | instance | /bin/bash: line 11: docker: command not found 2026-04-13 03:21:50.752589 | instance | + '[' '!' -z '' ']' 2026-04-13 03:21:50.869170 | instance | ok: Runtime: 0:00:00.052871 2026-04-13 03:21:50.878174 | 2026-04-13 03:21:50.878305 | TASK [gather-host-logs : Downloads logs to executor] 2026-04-13 03:21:51.562224 | instance | changed: 2026-04-13 03:21:51.562437 | instance | created directory /var/lib/zuul/builds/725904b5ddb447ea8e4f924ca923c03e/work/logs/instance 2026-04-13 03:21:51.562477 | instance | cd+++++++++ system/ 2026-04-13 03:21:51.562509 | instance | >f+++++++++ system/brctl-show.txt 2026-04-13 03:21:51.562539 | instance | >f+++++++++ system/docker-images.txt 2026-04-13 03:21:51.562567 | instance | >f+++++++++ system/ip-addr.txt 2026-04-13 03:21:51.562601 | instance | >f+++++++++ system/ip-route.txt 2026-04-13 03:21:51.562631 | instance | >f+++++++++ system/lsblk.txt 2026-04-13 03:21:51.562660 | instance | >f+++++++++ system/mount.txt 2026-04-13 03:21:51.562690 | instance | >f+++++++++ system/packages.txt 2026-04-13 03:21:51.562731 | instance | >f+++++++++ system/ps.txt 2026-04-13 03:21:51.562759 | instance | >f+++++++++ system/systemd-cgls.txt 2026-04-13 03:21:51.573936 | 2026-04-13 03:21:51.574006 | LOOP [helm-release-status : creating directory for helm release status] 2026-04-13 03:21:51.775664 | instance | changed: "values" 2026-04-13 03:21:51.936539 | instance | changed: "releases" 2026-04-13 03:21:51.949701 | 2026-04-13 03:21:51.949857 | TASK [helm-release-status : Gather get release status for helm charts] 2026-04-13 03:21:52.156743 | instance | /bin/bash: line 3: kubectl: command not found 2026-04-13 03:21:52.486864 | instance | ok: Runtime: 0:00:00.006997 2026-04-13 03:21:52.494086 | 2026-04-13 03:21:52.494175 | TASK [helm-release-status : Downloads logs to executor] 2026-04-13 03:21:53.003619 | instance | changed: 2026-04-13 03:21:53.003813 | instance | cd+++++++++ helm/ 2026-04-13 03:21:53.003849 | instance | cd+++++++++ helm/releases/ 2026-04-13 03:21:53.003878 | instance | cd+++++++++ helm/values/ 2026-04-13 03:21:53.015649 | 2026-04-13 03:21:53.015729 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects] 2026-04-13 03:21:53.214090 | instance | changed 2026-04-13 03:21:53.254145 | 2026-04-13 03:21:53.254299 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects] 2026-04-13 03:21:53.466151 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 03:21:53.466986 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 03:21:53.471238 | instance | environment: line 1: kubectl: command not found 2026-04-13 03:21:53.472281 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 03:21:53.473625 | instance | environment: line 1: kubectl: command not found 2026-04-13 03:21:53.474575 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 03:21:53.475524 | instance | environment: line 1: kubectl: command not found 2026-04-13 03:21:53.476410 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 03:21:53.478395 | instance | environment: line 1: kubectl: command not found 2026-04-13 03:21:53.479986 | instance | environment: line 1: kubectl: command not found 2026-04-13 03:21:53.480390 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 03:21:53.481118 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 03:21:53.792180 | instance | ok: Runtime: 0:00:00.023972 2026-04-13 03:21:53.797578 | 2026-04-13 03:21:53.797657 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects] 2026-04-13 03:21:54.004882 | instance | changed 2026-04-13 03:21:54.011718 | 2026-04-13 03:21:54.011796 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects] 2026-04-13 03:21:54.225917 | instance | environment: line 5: kubectl: command not found 2026-04-13 03:21:54.227234 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 03:21:54.227268 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 03:21:54.227836 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 03:21:54.547504 | instance | ok: Runtime: 0:00:00.013592 2026-04-13 03:21:54.555025 | 2026-04-13 03:21:54.555129 | TASK [describe-kubernetes-objects : Downloads logs to executor] 2026-04-13 03:21:55.052943 | instance | changed: 2026-04-13 03:21:55.053185 | instance | cd+++++++++ objects/ 2026-04-13 03:21:55.053226 | instance | cd+++++++++ objects/cluster/ 2026-04-13 03:21:55.053259 | instance | cd+++++++++ objects/namespaced/ 2026-04-13 03:21:55.066511 | 2026-04-13 03:21:55.066609 | TASK [gather-pod-logs : creating directory for pod logs] 2026-04-13 03:21:55.269283 | instance | changed 2026-04-13 03:21:55.275845 | 2026-04-13 03:21:55.275909 | TASK [gather-pod-logs : creating directory for failed pod logs] 2026-04-13 03:21:55.469948 | instance | changed 2026-04-13 03:21:55.475553 | 2026-04-13 03:21:55.475631 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)] 2026-04-13 03:21:55.683436 | instance | environment: line 3: kubectl: command not found 2026-04-13 03:21:56.012247 | instance | ok: Runtime: 0:00:00.009781 2026-04-13 03:21:56.019057 | 2026-04-13 03:21:56.019162 | TASK [gather-pod-logs : Downloads pod logs to executor] 2026-04-13 03:21:56.529617 | instance | changed: 2026-04-13 03:21:56.529877 | instance | cd+++++++++ pod-logs/ 2026-04-13 03:21:56.529935 | instance | cd+++++++++ pod-logs/failed-pods/ 2026-04-13 03:21:56.540929 | 2026-04-13 03:21:56.541077 | TASK [gather-prom-metrics : creating directory for helm release descriptions] 2026-04-13 03:21:56.743796 | instance | changed 2026-04-13 03:21:56.748772 | 2026-04-13 03:21:56.748843 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces] 2026-04-13 03:21:56.949035 | instance | /bin/bash: line 2: kubectl: command not found 2026-04-13 03:21:57.279566 | instance | ok: Runtime: 0:00:00.039326 2026-04-13 03:21:57.284571 | 2026-04-13 03:21:57.284665 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr] 2026-04-13 03:21:57.498669 | instance | /bin/bash: line 2: kubectl: command not found 2026-04-13 03:21:57.527966 | instance | ceph-mgr endpoints: 2026-04-13 03:21:57.818997 | instance | ok: Runtime: 0:00:00.036001 2026-04-13 03:21:57.825611 | 2026-04-13 03:21:57.825684 | TASK [gather-prom-metrics : Get metrics from fluentd pods] 2026-04-13 03:21:58.031120 | instance | /bin/bash: line 4: kubectl: command not found 2026-04-13 03:21:58.364764 | instance | ok: Runtime: 0:00:00.035873 2026-04-13 03:21:58.370813 | 2026-04-13 03:21:58.370888 | TASK [gather-prom-metrics : Downloads logs to executor] 2026-04-13 03:21:58.860723 | instance | changed: cd+++++++++ prometheus/ 2026-04-13 03:21:58.870045 | 2026-04-13 03:21:58.870109 | TASK [gather-selenium-data : creating directory for helm release descriptions] 2026-04-13 03:21:59.103560 | instance | changed 2026-04-13 03:21:59.108402 | 2026-04-13 03:21:59.108464 | TASK [gather-selenium-data : Get selenium data] 2026-04-13 03:21:59.326894 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/. 2026-04-13 03:21:59.328391 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory 2026-04-13 03:21:59.646960 | instance | ERROR 2026-04-13 03:21:59.647132 | instance | { 2026-04-13 03:21:59.647179 | instance | "delta": "0:00:00.007441", 2026-04-13 03:21:59.647211 | instance | "end": "2026-04-13 03:21:59.328810", 2026-04-13 03:21:59.647239 | instance | "msg": "non-zero return code", 2026-04-13 03:21:59.647267 | instance | "rc": 1, 2026-04-13 03:21:59.647293 | instance | "start": "2026-04-13 03:21:59.321369" 2026-04-13 03:21:59.647320 | instance | } 2026-04-13 03:21:59.647353 | instance | ERROR: Ignoring Errors 2026-04-13 03:21:59.654551 | 2026-04-13 03:21:59.654645 | TASK [gather-selenium-data : Downloads logs to executor] 2026-04-13 03:22:00.205650 | instance | changed: cd+++++++++ selenium/ 2026-04-13 03:22:00.213289 | 2026-04-13 03:22:00.213378 | PLAY RECAP 2026-04-13 03:22:00.213439 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1 2026-04-13 03:22:00.213496 | 2026-04-13 03:22:00.325517 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-13 03:22:00.338033 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-13 03:22:00.942177 | 2026-04-13 03:22:00.942284 | PLAY [all] 2026-04-13 03:22:00.953292 | 2026-04-13 03:22:00.953391 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-13 03:22:00.997621 | instance | skipping: Conditional result was False 2026-04-13 03:22:01.009717 | 2026-04-13 03:22:01.009796 | TASK [fetch-output : Set log path for single node] 2026-04-13 03:22:01.043972 | instance | ok 2026-04-13 03:22:01.051739 | 2026-04-13 03:22:01.051806 | LOOP [fetch-output : Ensure local output dirs] 2026-04-13 03:22:01.429042 | instance -> localhost | ok: "/var/lib/zuul/builds/725904b5ddb447ea8e4f924ca923c03e/work/logs" 2026-04-13 03:22:01.684677 | instance -> localhost | changed: "/var/lib/zuul/builds/725904b5ddb447ea8e4f924ca923c03e/work/artifacts" 2026-04-13 03:22:01.899724 | instance -> localhost | changed: "/var/lib/zuul/builds/725904b5ddb447ea8e4f924ca923c03e/work/docs" 2026-04-13 03:22:01.916497 | 2026-04-13 03:22:01.916621 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-13 03:22:02.538174 | instance | changed: .d..t...... ./ 2026-04-13 03:22:02.538431 | instance | changed: All items complete 2026-04-13 03:22:02.538474 | 2026-04-13 03:22:03.004913 | instance | changed: .d..t...... ./ 2026-04-13 03:22:03.451625 | instance | changed: .d..t...... ./ 2026-04-13 03:22:03.477623 | 2026-04-13 03:22:03.477775 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-13 03:22:03.901314 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.006004 2026-04-13 03:22:04.124877 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007425 2026-04-13 03:22:04.145348 | 2026-04-13 03:22:04.145493 | PLAY [all] 2026-04-13 03:22:04.153076 | 2026-04-13 03:22:04.153142 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-13 03:22:04.541561 | instance | changed 2026-04-13 03:22:04.547875 | 2026-04-13 03:22:04.547929 | PLAY RECAP 2026-04-13 03:22:04.547971 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-13 03:22:04.547994 | 2026-04-13 03:22:04.654388 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-13 03:22:04.667160 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-13 03:22:05.295308 | 2026-04-13 03:22:05.295482 | PLAY [localhost] 2026-04-13 03:22:05.309182 | 2026-04-13 03:22:05.309282 | TASK [Generate Zuul manifest] 2026-04-13 03:22:05.332814 | localhost | ok 2026-04-13 03:22:05.355769 | 2026-04-13 03:22:05.355952 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-13 03:22:05.717199 | localhost | changed 2026-04-13 03:22:05.731600 | 2026-04-13 03:22:05.731719 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-13 03:22:05.764884 | localhost | ok 2026-04-13 03:22:05.774330 | 2026-04-13 03:22:05.774425 | TASK [Upload logs] 2026-04-13 03:22:05.797538 | localhost | ok 2026-04-13 03:22:05.943355 | 2026-04-13 03:22:05.943477 | TASK [Set zuul-log-path fact] 2026-04-13 03:22:05.963975 | localhost | ok 2026-04-13 03:22:05.987202 | 2026-04-13 03:22:05.987440 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-13 03:22:06.021315 | localhost | ok 2026-04-13 03:22:06.032103 | 2026-04-13 03:22:06.032281 | TASK [upload-logs : Create log directories] 2026-04-13 03:22:06.392843 | localhost | changed 2026-04-13 03:22:06.398941 | 2026-04-13 03:22:06.399020 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-13 03:22:06.747002 | localhost -> localhost | ok: Runtime: 0:00:00.005129 2026-04-13 03:22:06.754608 | 2026-04-13 03:22:06.754684 | TASK [upload-logs : Upload logs to log server] 2026-04-13 03:22:07.212921 | localhost | Output suppressed because no_log was given 2026-04-13 03:22:07.220570 | 2026-04-13 03:22:07.220749 | LOOP [upload-logs : Compress console log and json output] 2026-04-13 03:22:07.278346 | localhost | skipping: Conditional result was False 2026-04-13 03:22:07.286374 | localhost | skipping: Conditional result was False 2026-04-13 03:22:07.300144 | 2026-04-13 03:22:07.300437 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-13 03:22:07.352039 | localhost | skipping: Conditional result was False 2026-04-13 03:22:07.352409 | 2026-04-13 03:22:07.356925 | localhost | skipping: Conditional result was False 2026-04-13 03:22:07.369975 | 2026-04-13 03:22:07.370278 | LOOP [upload-logs : Upload console log and json output]