2026-04-07 03:16:19.908587 | Job console starting
2026-04-07 03:16:19.923501 | Updating git repos
2026-04-07 03:16:20.016604 | Cloning repos into workspace
2026-04-07 03:16:20.105867 | Restoring repo states
2026-04-07 03:16:20.124220 | Merging changes
2026-04-07 03:16:21.459359 | Checking out repos
2026-04-07 03:16:21.561600 | Preparing playbooks
2026-04-07 03:16:24.414519 | Running Ansible setup
2026-04-07 03:16:28.726224 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-07 03:16:29.327283 | 
2026-04-07 03:16:29.399695 | PLAY [localhost]
2026-04-07 03:16:29.416678 | 
2026-04-07 03:16:29.417107 | TASK [Gathering Facts]
2026-04-07 03:16:30.259161 | localhost | ok
2026-04-07 03:16:30.267191 | 
2026-04-07 03:16:30.267292 | TASK [Setup log path fact]
2026-04-07 03:16:30.288711 | localhost | ok
2026-04-07 03:16:30.303277 | 
2026-04-07 03:16:30.303393 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-07 03:16:30.337438 | localhost | ok
2026-04-07 03:16:30.345467 | 
2026-04-07 03:16:30.345538 | TASK [emit-job-header : Print job information]
2026-04-07 03:16:30.385890 | # Job Information
2026-04-07 03:16:30.386137 | Ansible Version: 2.16.16
2026-04-07 03:16:30.386206 | Job: atmosphere-molecule-keycloak
2026-04-07 03:16:30.386253 | Pipeline: check
2026-04-07 03:16:30.386296 | Executor: 0a8996d2b663
2026-04-07 03:16:30.386338 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3809
2026-04-07 03:16:30.386386 | Event ID: 0f3b4e80-3230-11f1-81f7-cadc69d6f48b
2026-04-07 03:16:30.390737 | 
2026-04-07 03:16:30.390807 | LOOP [emit-job-header : Print node information]
2026-04-07 03:16:30.489997 | localhost | ok:
2026-04-07 03:16:30.490301 | localhost | # Node Information
2026-04-07 03:16:30.490363 | localhost | Inventory Hostname: instance
2026-04-07 03:16:30.490411 | localhost | Hostname: np0000163793
2026-04-07 03:16:30.490456 | localhost | Username: zuul
2026-04-07 03:16:30.490503 | localhost | Distro: Ubuntu 22.04
2026-04-07 03:16:30.490546 | localhost | Provider: yul1
2026-04-07 03:16:30.490588 | localhost | Region: ca-ymq-1
2026-04-07 03:16:30.490629 | localhost | Label: ubuntu-jammy
2026-04-07 03:16:30.490670 | localhost | Product Name: OpenStack Nova
2026-04-07 03:16:30.490711 | localhost | Interface IP: 162.253.55.43
2026-04-07 03:16:30.511686 | 
2026-04-07 03:16:30.511895 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-07 03:16:30.923278 | localhost -> localhost | changed
2026-04-07 03:16:30.931444 | 
2026-04-07 03:16:30.931525 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-07 03:16:31.772171 | localhost -> localhost | changed
2026-04-07 03:16:31.784798 | 
2026-04-07 03:16:31.784866 | PLAY [all]
2026-04-07 03:16:31.799758 | 
2026-04-07 03:16:31.799848 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-07 03:16:32.027701 | instance -> localhost | ok
2026-04-07 03:16:32.036789 | 
2026-04-07 03:16:32.036860 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-07 03:16:32.065331 | instance | ok
2026-04-07 03:16:32.083069 | instance | included: /var/lib/zuul/builds/2aa6b9753f0f42e880dddb2835c51bb5/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-07 03:16:32.092132 | 
2026-04-07 03:16:32.092246 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-07 03:16:33.516479 | instance -> localhost | Generating public/private rsa key pair.
2026-04-07 03:16:33.516781 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/2aa6b9753f0f42e880dddb2835c51bb5/work/2aa6b9753f0f42e880dddb2835c51bb5_id_rsa
2026-04-07 03:16:33.516844 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/2aa6b9753f0f42e880dddb2835c51bb5/work/2aa6b9753f0f42e880dddb2835c51bb5_id_rsa.pub
2026-04-07 03:16:33.516893 | instance -> localhost | The key fingerprint is:
2026-04-07 03:16:33.516941 | instance -> localhost | SHA256:cZ41VMn3mY2F6IvOdZZExtUT6XWQRRCA9QAR2QA7M30 zuul-build-sshkey
2026-04-07 03:16:33.517096 | instance -> localhost | The key's randomart image is:
2026-04-07 03:16:33.517142 | instance -> localhost | +---[RSA 3072]----+
2026-04-07 03:16:33.517188 | instance -> localhost | |        ..=X=*=%B|
2026-04-07 03:16:33.517229 | instance -> localhost | |         oo.ooOo*|
2026-04-07 03:16:33.517296 | instance -> localhost | |        * o.Eoo+O|
2026-04-07 03:16:33.517334 | instance -> localhost | |         B +..o+o|
2026-04-07 03:16:33.517365 | instance -> localhost | |        S o. o . |
2026-04-07 03:16:33.517392 | instance -> localhost | |          . o +  |
2026-04-07 03:16:33.517419 | instance -> localhost | |         o . o   |
2026-04-07 03:16:33.517446 | instance -> localhost | |          o      |
2026-04-07 03:16:33.517476 | instance -> localhost | |                 |
2026-04-07 03:16:33.517504 | instance -> localhost | +----[SHA256]-----+
2026-04-07 03:16:33.517581 | instance -> localhost | ok: Runtime: 0:00:00.977688
2026-04-07 03:16:33.523943 | 
2026-04-07 03:16:33.524008 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-07 03:16:33.558370 | instance | ok
2026-04-07 03:16:33.566941 | instance | included: /var/lib/zuul/builds/2aa6b9753f0f42e880dddb2835c51bb5/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-07 03:16:33.574451 | 
2026-04-07 03:16:33.574517 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-07 03:16:33.599678 | instance | skipping: Conditional result was False
2026-04-07 03:16:33.611644 | 
2026-04-07 03:16:33.611735 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-07 03:16:34.079458 | instance | changed
2026-04-07 03:16:34.084899 | 
2026-04-07 03:16:34.084980 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-07 03:16:34.270112 | instance | ok
2026-04-07 03:16:34.277080 | 
2026-04-07 03:16:34.277159 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-07 03:16:34.767356 | instance | changed
2026-04-07 03:16:34.773554 | 
2026-04-07 03:16:34.773631 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-07 03:16:35.233083 | instance | changed
2026-04-07 03:16:35.238146 | 
2026-04-07 03:16:35.238209 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-07 03:16:35.263100 | instance | skipping: Conditional result was False
2026-04-07 03:16:35.273805 | 
2026-04-07 03:16:35.273912 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-07 03:16:35.700512 | instance -> localhost | changed
2026-04-07 03:16:35.714502 | 
2026-04-07 03:16:35.714618 | TASK [add-build-sshkey : Add back temp key]
2026-04-07 03:16:35.995667 | instance -> localhost | Identity added: /var/lib/zuul/builds/2aa6b9753f0f42e880dddb2835c51bb5/work/2aa6b9753f0f42e880dddb2835c51bb5_id_rsa (zuul-build-sshkey)
2026-04-07 03:16:35.995924 | instance -> localhost | ok: Runtime: 0:00:00.012830
2026-04-07 03:16:36.001707 | 
2026-04-07 03:16:36.001777 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-07 03:16:36.325555 | instance | ok
2026-04-07 03:16:36.334767 | 
2026-04-07 03:16:36.334968 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-07 03:16:36.360401 | instance | skipping: Conditional result was False
2026-04-07 03:16:36.375227 | 
2026-04-07 03:16:36.375292 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-07 03:16:36.709532 | instance | ok
2026-04-07 03:16:36.718722 | 
2026-04-07 03:16:36.718805 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-07 03:16:38.413201 | instance | Output suppressed because no_log was given
2026-04-07 03:16:38.422728 | 
2026-04-07 03:16:38.422824 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-07 03:16:38.613435 | instance | ok: "logs"
2026-04-07 03:16:38.613709 | instance | ok: All items complete
2026-04-07 03:16:38.613737 | 
2026-04-07 03:16:38.760648 | instance | ok: "artifacts"
2026-04-07 03:16:38.906634 | instance | ok: "docs"
2026-04-07 03:16:38.929537 | 
2026-04-07 03:16:38.929711 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-07 03:16:39.112030 | instance | changed: "logs"
2026-04-07 03:16:39.268443 | instance | changed: "artifacts"
2026-04-07 03:16:39.424222 | instance | changed: "docs"
2026-04-07 03:16:39.439953 | 
2026-04-07 03:16:39.440145 | PLAY RECAP
2026-04-07 03:16:39.440218 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-07 03:16:39.440260 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-07 03:16:39.440287 | 
2026-04-07 03:16:39.591954 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-07 03:16:39.597158 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-07 03:16:40.141000 | 
2026-04-07 03:16:40.141445 | PLAY [all]
2026-04-07 03:16:40.153630 | 
2026-04-07 03:16:40.153703 | TASK [setup-uv : Extract archive]
2026-04-07 03:16:42.338789 | instance | changed
2026-04-07 03:16:42.350069 | 
2026-04-07 03:16:42.350158 | TASK [setup-uv : Print version]
2026-04-07 03:16:41.037814 | instance | uv 0.8.13
2026-04-07 03:16:42.904841 | instance | ok: Runtime: 0:00:00.010426
2026-04-07 03:16:42.911099 | 
2026-04-07 03:16:42.911150 | PLAY RECAP
2026-04-07 03:16:42.911201 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-07 03:16:42.911225 | 
2026-04-07 03:16:43.017966 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-07 03:16:43.022600 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-07 03:16:43.580104 | 
2026-04-07 03:16:43.580654 | PLAY [all]
2026-04-07 03:16:43.592158 | 
2026-04-07 03:16:43.592241 | TASK [Install "jq" for log collection]
2026-04-07 03:17:01.007092 | instance | changed
2026-04-07 03:17:01.009623 | 
2026-04-07 03:17:01.009704 | PLAY RECAP
2026-04-07 03:17:01.009775 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-07 03:17:01.009843 | 
2026-04-07 03:17:01.133500 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-07 03:17:01.138359 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-07 03:17:01.690095 | 
2026-04-07 03:17:01.690643 | PLAY [all]
2026-04-07 03:17:01.701809 | 
2026-04-07 03:17:01.701880 | TASK [Copy inventory file for Zuul]
2026-04-07 03:17:02.553535 | instance | changed
2026-04-07 03:17:02.560551 | 
2026-04-07 03:17:02.560626 | TASK [Switch "ansible_host" to private IP]
2026-04-07 03:17:02.827352 | instance | changed: 1 replacements made
2026-04-07 03:17:02.834578 | 
2026-04-07 03:17:02.834650 | TASK [Run Molecule scenario]
2026-04-07 03:17:03.237454 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-07 03:17:03.237591 | instance | Creating virtual environment at: .venv
2026-04-07 03:17:03.263345 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-07 03:17:03.287277 | instance | Downloading pygments (1.2MiB)
2026-04-07 03:17:03.292400 | instance | Downloading pydantic-core (2.0MiB)
2026-04-07 03:17:03.292681 | instance | Downloading cryptography (4.2MiB)
2026-04-07 03:17:03.293038 | instance | Downloading kubernetes (1.9MiB)
2026-04-07 03:17:03.294752 | instance | Downloading openstacksdk (1.7MiB)
2026-04-07 03:17:03.295003 | instance | Downloading ansible-core (2.1MiB)
2026-04-07 03:17:03.296013 | instance | Downloading setuptools (1.1MiB)
2026-04-07 03:17:03.296539 | instance | Downloading netaddr (2.2MiB)
2026-04-07 03:17:03.343415 | instance | Downloading rjsonnet (1.2MiB)
2026-04-07 03:17:03.642966 | instance |    Building pyperclip==1.9.0
2026-04-07 03:17:03.679601 | instance |  Downloading rjsonnet
2026-04-07 03:17:03.774736 | instance |  Downloading pydantic-core
2026-04-07 03:17:03.828790 | instance |  Downloading netaddr
2026-04-07 03:17:03.840645 | instance |  Downloading pygments
2026-04-07 03:17:03.853091 | instance |  Downloading cryptography
2026-04-07 03:17:03.893746 | instance |  Downloading setuptools
2026-04-07 03:17:03.954357 | instance |  Downloading kubernetes
2026-04-07 03:17:03.986461 | instance |  Downloading ansible-core
2026-04-07 03:17:04.020905 | instance |  Downloading openstacksdk
2026-04-07 03:17:04.397250 | instance |       Built pyperclip==1.9.0
2026-04-07 03:17:04.576075 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-07 03:17:04.622715 | instance | Installed 83 packages in 44ms
2026-04-07 03:17:05.300597 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-07 03:17:05.923602 | instance | INFO     [keycloak > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-07 03:17:05.923680 | instance | INFO     [keycloak > prerun] Performing prerun with role_name_check=0...
2026-04-07 03:17:45.238514 | instance | CRITICAL The source path '/home/zuul/src/github.com/vexxhost/atmosphere/molecule/keycloak/host_vars' does not exist.
2026-04-07 03:17:45.238843 | instance | Traceback (most recent call last):
2026-04-07 03:17:45.238971 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/molecule", line 10, in <module>
2026-04-07 03:17:45.239160 | instance |     sys.exit(main())
2026-04-07 03:17:45.239288 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1442, in __call__
2026-04-07 03:17:45.239601 | instance |     return self.main(*args, **kwargs)
2026-04-07 03:17:45.239727 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1363, in main
2026-04-07 03:17:45.240051 | instance |     rv = self.invoke(ctx)
2026-04-07 03:17:45.240178 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1830, in invoke
2026-04-07 03:17:45.240532 | instance |     return _process_result(sub_ctx.command.invoke(sub_ctx))
2026-04-07 03:17:45.240657 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1226, in invoke
2026-04-07 03:17:45.240935 | instance |     return ctx.invoke(self.callback, **ctx.params)
2026-04-07 03:17:45.241061 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 794, in invoke
2026-04-07 03:17:45.241299 | instance |     return callback(*args, **kwargs)
2026-04-07 03:17:45.241425 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/click_cfg.py", line 583, in wrapper
2026-04-07 03:17:45.241638 | instance |     return func(*args, **kwargs)
2026-04-07 03:17:45.241763 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/decorators.py", line 34, in new_func
2026-04-07 03:17:45.241921 | instance |     return f(get_current_context(), *args, **kwargs)
2026-04-07 03:17:45.242043 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/click_cfg.py", line 418, in wrapper
2026-04-07 03:17:45.242245 | instance |     return func(ctx)
2026-04-07 03:17:45.242366 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/test.py", line 81, in test
2026-04-07 03:17:45.242538 | instance |     base.execute_cmdline_scenarios(scenario_name, args, command_args, ansible_args, exclude)
2026-04-07 03:17:45.242661 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 169, in execute_cmdline_scenarios
2026-04-07 03:17:45.242886 | instance |     _run_scenarios(scenarios, command_args, default_config)
2026-04-07 03:17:45.242998 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 254, in _run_scenarios
2026-04-07 03:17:45.243188 | instance |     execute_scenario(scenario, shared_state=scenarios.shared_state)
2026-04-07 03:17:45.243310 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 373, in execute_scenario
2026-04-07 03:17:45.243506 | instance |     execute_subcommand(scenario.config, action)
2026-04-07 03:17:45.243629 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 358, in execute_subcommand
2026-04-07 03:17:45.243828 | instance |     return command(current_config).execute(args)
2026-04-07 03:17:45.243951 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 77, in __init__
2026-04-07 03:17:45.244115 | instance |     self._setup()
2026-04-07 03:17:45.244234 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 111, in _setup
2026-04-07 03:17:45.244400 | instance |     self._config.provisioner.manage_inventory()
2026-04-07 03:17:45.244534 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/provisioner/ansible.py", line 445, in manage_inventory
2026-04-07 03:17:45.244735 | instance |     self._link_or_update_vars()
2026-04-07 03:17:45.244857 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/provisioner/ansible.py", line 513, in _link_or_update_vars
2026-04-07 03:17:45.245061 | instance |     raise MoleculeError(msg)
2026-04-07 03:17:45.245181 | instance | molecule.exceptions.MoleculeError
2026-04-07 03:17:45.439102 | instance | ERROR
2026-04-07 03:17:45.439371 | instance | {
2026-04-07 03:17:45.439406 | instance |   "delta": "0:00:42.151005",
2026-04-07 03:17:45.439429 | instance |   "end": "2026-04-07 03:17:45.325321",
2026-04-07 03:17:45.439448 | instance |   "msg": "non-zero return code",
2026-04-07 03:17:45.439467 | instance |   "rc": 1,
2026-04-07 03:17:45.439487 | instance |   "start": "2026-04-07 03:17:03.174316"
2026-04-07 03:17:45.439506 | instance | }
failure
2026-04-07 03:17:45.441810 | 
2026-04-07 03:17:45.441860 | PLAY RECAP
2026-04-07 03:17:45.441906 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-07 03:17:45.441928 | 
2026-04-07 03:17:45.584525 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-07 03:17:45.587699 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-07 03:17:46.189884 | 
2026-04-07 03:17:46.190379 | PLAY [all]
2026-04-07 03:17:46.225249 | 
2026-04-07 03:17:46.225444 | TASK [gather-host-logs : creating directory for system status]
2026-04-07 03:17:46.582568 | instance | changed
2026-04-07 03:17:46.587965 | 
2026-04-07 03:17:46.588049 | TASK [gather-host-logs : Get logs for each host]
2026-04-07 03:17:46.931424 | instance | + systemd-cgls --full --all --no-pager
2026-04-07 03:17:46.943458 | instance | + ip addr
2026-04-07 03:17:46.945036 | instance | + ip route
2026-04-07 03:17:46.946546 | instance | + lsblk
2026-04-07 03:17:46.949300 | instance | + mount
2026-04-07 03:17:46.951239 | instance | + docker images
2026-04-07 03:17:46.951624 | instance | /bin/bash: line 7: docker: command not found
2026-04-07 03:17:46.951888 | instance | + brctl show
2026-04-07 03:17:46.952234 | instance | /bin/bash: line 8: brctl: command not found
2026-04-07 03:17:46.952431 | instance | + ps aux --sort=-%mem
2026-04-07 03:17:46.962642 | instance | + dpkg -l
2026-04-07 03:17:46.970646 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-07 03:17:46.971034 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-07 03:17:46.971077 | instance | /bin/bash: line 11: docker: command not found
2026-04-07 03:17:46.971367 | instance | + '[' '!' -z '' ']'
2026-04-07 03:17:47.125514 | instance | ok: Runtime: 0:00:00.045274
2026-04-07 03:17:47.134788 | 
2026-04-07 03:17:47.134857 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-07 03:17:47.793682 | instance | changed:
2026-04-07 03:17:47.793898 | instance | created directory /var/lib/zuul/builds/2aa6b9753f0f42e880dddb2835c51bb5/work/logs/instance
2026-04-07 03:17:47.793936 | instance | cd+++++++++ system/
2026-04-07 03:17:47.793966 | instance | >f+++++++++ system/brctl-show.txt
2026-04-07 03:17:47.793998 | instance | >f+++++++++ system/docker-images.txt
2026-04-07 03:17:47.794025 | instance | >f+++++++++ system/ip-addr.txt
2026-04-07 03:17:47.794056 | instance | >f+++++++++ system/ip-route.txt
2026-04-07 03:17:47.794084 | instance | >f+++++++++ system/lsblk.txt
2026-04-07 03:17:47.794110 | instance | >f+++++++++ system/mount.txt
2026-04-07 03:17:47.794139 | instance | >f+++++++++ system/packages.txt
2026-04-07 03:17:47.794165 | instance | >f+++++++++ system/ps.txt
2026-04-07 03:17:47.794190 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-07 03:17:47.805180 | 
2026-04-07 03:17:47.805244 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-07 03:17:48.014274 | instance | changed: "values"
2026-04-07 03:17:48.172631 | instance | changed: "releases"
2026-04-07 03:17:48.193277 | 
2026-04-07 03:17:48.193425 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-07 03:17:48.403873 | instance | /bin/bash: line 3: kubectl: command not found
2026-04-07 03:17:48.733532 | instance | ok: Runtime: 0:00:00.006164
2026-04-07 03:17:48.740675 | 
2026-04-07 03:17:48.740768 | TASK [helm-release-status : Downloads logs to executor]
2026-04-07 03:17:49.231204 | instance | changed:
2026-04-07 03:17:49.231491 | instance | cd+++++++++ helm/
2026-04-07 03:17:49.231552 | instance | cd+++++++++ helm/releases/
2026-04-07 03:17:49.231601 | instance | cd+++++++++ helm/values/
2026-04-07 03:17:49.241820 | 
2026-04-07 03:17:49.241897 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-07 03:17:49.440349 | instance | changed
2026-04-07 03:17:49.537635 | 
2026-04-07 03:17:49.537768 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-07 03:17:49.749055 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-07 03:17:49.749153 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-07 03:17:49.754232 | instance | environment: line 1: kubectl: command not found
2026-04-07 03:17:49.755368 | instance | environment: line 1: kubectl: command not found
2026-04-07 03:17:49.755399 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-07 03:17:49.757232 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-07 03:17:49.758610 | instance | environment: line 1: kubectl: command not found
2026-04-07 03:17:49.759521 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-07 03:17:49.760104 | instance | environment: line 1: kubectl: command not found
2026-04-07 03:17:49.761745 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-07 03:17:49.762512 | instance | environment: line 1: kubectl: command not found
2026-04-07 03:17:49.762845 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-07 03:17:50.074505 | instance | ok: Runtime: 0:00:00.024025
2026-04-07 03:17:50.081588 | 
2026-04-07 03:17:50.081682 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-07 03:17:50.286458 | instance | changed
2026-04-07 03:17:50.294707 | 
2026-04-07 03:17:50.294809 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-07 03:17:50.567655 | instance | environment: line 5: kubectl: command not found
2026-04-07 03:17:50.568976 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-07 03:17:50.569129 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-07 03:17:50.569370 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-07 03:17:50.889272 | instance | ok: Runtime: 0:00:00.009942
2026-04-07 03:17:50.896403 | 
2026-04-07 03:17:50.896489 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-07 03:17:51.390278 | instance | changed:
2026-04-07 03:17:51.390539 | instance | cd+++++++++ objects/
2026-04-07 03:17:51.390598 | instance | cd+++++++++ objects/cluster/
2026-04-07 03:17:51.390645 | instance | cd+++++++++ objects/namespaced/
2026-04-07 03:17:51.402378 | 
2026-04-07 03:17:51.402440 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-07 03:17:51.629241 | instance | changed
2026-04-07 03:17:51.637314 | 
2026-04-07 03:17:51.637396 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-07 03:17:51.865623 | instance | changed
2026-04-07 03:17:51.872179 | 
2026-04-07 03:17:51.872307 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-07 03:17:52.081133 | instance | environment: line 3: kubectl: command not found
2026-04-07 03:17:52.408890 | instance | ok: Runtime: 0:00:00.010672
2026-04-07 03:17:52.415557 | 
2026-04-07 03:17:52.415623 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-07 03:17:52.900834 | instance | changed:
2026-04-07 03:17:52.901082 | instance | cd+++++++++ pod-logs/
2026-04-07 03:17:52.901121 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-07 03:17:52.913204 | 
2026-04-07 03:17:52.913273 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-07 03:17:53.160012 | instance | changed
2026-04-07 03:17:53.166724 | 
2026-04-07 03:17:53.166814 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-07 03:17:53.372042 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-07 03:17:53.704774 | instance | ok: Runtime: 0:00:00.040736
2026-04-07 03:17:53.713563 | 
2026-04-07 03:17:53.713633 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-07 03:17:53.924506 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-07 03:17:53.952915 | instance | ceph-mgr endpoints:
2026-04-07 03:17:54.250472 | instance | ok: Runtime: 0:00:00.038675
2026-04-07 03:17:54.256005 | 
2026-04-07 03:17:54.256069 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-07 03:17:54.465304 | instance | /bin/bash: line 4: kubectl: command not found
2026-04-07 03:17:54.791350 | instance | ok: Runtime: 0:00:00.037781
2026-04-07 03:17:54.798185 | 
2026-04-07 03:17:54.798270 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-07 03:17:55.292882 | instance | changed: cd+++++++++ prometheus/
2026-04-07 03:17:55.304776 | 
2026-04-07 03:17:55.304835 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-07 03:17:55.511414 | instance | changed
2026-04-07 03:17:55.517850 | 
2026-04-07 03:17:55.517934 | TASK [gather-selenium-data : Get selenium data]
2026-04-07 03:17:55.725197 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-07 03:17:55.726778 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-07 03:17:56.053168 | instance | ERROR
2026-04-07 03:17:56.053505 | instance | {
2026-04-07 03:17:56.053549 | instance |   "delta": "0:00:00.007255",
2026-04-07 03:17:56.053578 | instance |   "end": "2026-04-07 03:17:55.727123",
2026-04-07 03:17:56.053604 | instance |   "msg": "non-zero return code",
2026-04-07 03:17:56.053630 | instance |   "rc": 1,
2026-04-07 03:17:56.053655 | instance |   "start": "2026-04-07 03:17:55.719868"
2026-04-07 03:17:56.053679 | instance | }
2026-04-07 03:17:56.053711 | instance | ERROR: Ignoring Errors
2026-04-07 03:17:56.060703 | 
2026-04-07 03:17:56.060795 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-07 03:17:56.546748 | instance | changed: cd+++++++++ selenium/
2026-04-07 03:17:56.554745 | 
2026-04-07 03:17:56.554810 | PLAY RECAP
2026-04-07 03:17:56.554866 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-07 03:17:56.554895 | 
2026-04-07 03:17:56.701160 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-07 03:17:56.703707 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-07 03:17:57.302355 | 
2026-04-07 03:17:57.302493 | PLAY [all]
2026-04-07 03:17:57.314439 | 
2026-04-07 03:17:57.314549 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-07 03:17:57.360820 | instance | skipping: Conditional result was False
2026-04-07 03:17:57.372476 | 
2026-04-07 03:17:57.372667 | TASK [fetch-output : Set log path for single node]
2026-04-07 03:17:57.417862 | instance | ok
2026-04-07 03:17:57.425423 | 
2026-04-07 03:17:57.425498 | LOOP [fetch-output : Ensure local output dirs]
2026-04-07 03:17:57.810305 | instance -> localhost | ok: "/var/lib/zuul/builds/2aa6b9753f0f42e880dddb2835c51bb5/work/logs"
2026-04-07 03:17:58.021804 | instance -> localhost | changed: "/var/lib/zuul/builds/2aa6b9753f0f42e880dddb2835c51bb5/work/artifacts"
2026-04-07 03:17:58.229859 | instance -> localhost | changed: "/var/lib/zuul/builds/2aa6b9753f0f42e880dddb2835c51bb5/work/docs"
2026-04-07 03:17:58.255730 | 
2026-04-07 03:17:58.255928 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-07 03:17:58.886754 | instance | changed: .d..t...... ./
2026-04-07 03:17:58.887042 | instance | changed: All items complete
2026-04-07 03:17:58.887071 | 
2026-04-07 03:17:59.345204 | instance | changed: .d..t...... ./
2026-04-07 03:17:59.793445 | instance | changed: .d..t...... ./
2026-04-07 03:17:59.817833 | 
2026-04-07 03:17:59.817994 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-07 03:18:00.247204 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.009790
2026-04-07 03:18:00.481669 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.008479
2026-04-07 03:18:00.500931 | 
2026-04-07 03:18:00.501140 | PLAY [all]
2026-04-07 03:18:00.507931 | 
2026-04-07 03:18:00.508007 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-07 03:18:00.928716 | instance | changed
2026-04-07 03:18:00.934662 | 
2026-04-07 03:18:00.934717 | PLAY RECAP
2026-04-07 03:18:00.934762 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-07 03:18:00.934784 | 
2026-04-07 03:18:01.071446 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-07 03:18:01.076481 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-07 03:18:01.625265 | 
2026-04-07 03:18:01.625393 | PLAY [localhost]
2026-04-07 03:18:01.635821 | 
2026-04-07 03:18:01.635896 | TASK [Generate Zuul manifest]
2026-04-07 03:18:01.654298 | localhost | ok
2026-04-07 03:18:01.670036 | 
2026-04-07 03:18:01.670120 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-07 03:18:02.024854 | localhost | changed
2026-04-07 03:18:02.037639 | 
2026-04-07 03:18:02.037714 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-07 03:18:02.068603 | localhost | ok
2026-04-07 03:18:02.077690 | 
2026-04-07 03:18:02.077755 | TASK [Upload logs]
2026-04-07 03:18:02.098191 | localhost | ok
2026-04-07 03:18:02.154894 | 
2026-04-07 03:18:02.154997 | TASK [Set zuul-log-path fact]
2026-04-07 03:18:02.177352 | localhost | ok
2026-04-07 03:18:02.188975 | 
2026-04-07 03:18:02.189044 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-07 03:18:02.220759 | localhost | ok
2026-04-07 03:18:02.229549 | 
2026-04-07 03:18:02.229634 | TASK [upload-logs : Create log directories]
2026-04-07 03:18:02.666316 | localhost | changed
2026-04-07 03:18:02.672713 | 
2026-04-07 03:18:02.672805 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-07 03:18:03.091964 | localhost -> localhost | ok: Runtime: 0:00:00.005905
2026-04-07 03:18:03.098664 | 
2026-04-07 03:18:03.098765 | TASK [upload-logs : Upload logs to log server]
2026-04-07 03:18:03.578044 | localhost | Output suppressed because no_log was given
2026-04-07 03:18:03.583637 | 
2026-04-07 03:18:03.583725 | LOOP [upload-logs : Compress console log and json output]
2026-04-07 03:18:03.635898 | localhost | skipping: Conditional result was False
2026-04-07 03:18:03.643215 | localhost | skipping: Conditional result was False
2026-04-07 03:18:03.658681 | 
2026-04-07 03:18:03.658849 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-07 03:18:03.702118 | localhost | skipping: Conditional result was False
2026-04-07 03:18:03.702510 | 
2026-04-07 03:18:03.707252 | localhost | skipping: Conditional result was False
2026-04-07 03:18:03.724483 | 
2026-04-07 03:18:03.724716 | LOOP [upload-logs : Upload console log and json output]