2026-04-22 16:20:20.200411 | Job console starting
2026-04-22 16:20:20.211740 | Updating git repos
2026-04-22 16:20:20.356839 | Cloning repos into workspace
2026-04-22 16:20:20.475111 | Restoring repo states
2026-04-22 16:20:20.512269 | Merging changes
2026-04-22 16:20:22.588910 | Checking out repos
2026-04-22 16:20:23.420679 | Preparing playbooks
2026-04-22 16:20:41.665293 | Running Ansible setup
2026-04-22 16:20:46.049628 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-22 16:20:46.743551 | 
2026-04-22 16:20:46.758958 | PLAY [localhost]
2026-04-22 16:20:46.773821 | 
2026-04-22 16:20:46.773935 | TASK [Gathering Facts]
2026-04-22 16:20:47.716409 | localhost | ok
2026-04-22 16:20:47.726426 | 
2026-04-22 16:20:47.726534 | TASK [Setup log path fact]
2026-04-22 16:20:47.746022 | localhost | ok
2026-04-22 16:20:47.760865 | 
2026-04-22 16:20:47.760985 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-22 16:20:47.795259 | localhost | ok
2026-04-22 16:20:47.806380 | 
2026-04-22 16:20:47.806474 | TASK [emit-job-header : Print job information]
2026-04-22 16:20:47.849316 | # Job Information
2026-04-22 16:20:48.086349 | Ansible Version: 2.16.16
2026-04-22 16:20:48.086552 | Job: atmosphere-molecule-keycloak
2026-04-22 16:20:48.086699 | Pipeline: check
2026-04-22 16:20:48.086847 | Executor: 0a8996d2b663
2026-04-22 16:20:48.086920 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3738
2026-04-22 16:20:48.087548 | Event ID: 06796a50-3e67-11f1-9ad5-786a71ff14ec
2026-04-22 16:20:48.101348 | 
2026-04-22 16:20:48.101521 | LOOP [emit-job-header : Print node information]
2026-04-22 16:20:48.204704 | localhost | ok:
2026-04-22 16:20:48.205217 | localhost | # Node Information
2026-04-22 16:20:48.205271 | localhost | Inventory Hostname: instance
2026-04-22 16:20:48.205304 | localhost | Hostname: np0000169511
2026-04-22 16:20:48.205334 | localhost | Username: zuul
2026-04-22 16:20:48.205367 | localhost | Distro: Ubuntu 22.04
2026-04-22 16:20:48.205396 | localhost | Provider: yul1
2026-04-22 16:20:48.205424 | localhost | Region: ca-ymq-1
2026-04-22 16:20:48.205452 | localhost | Label: ubuntu-jammy
2026-04-22 16:20:48.205480 | localhost | Product Name: OpenStack Nova
2026-04-22 16:20:48.205508 | localhost | Interface IP: 199.19.213.199
2026-04-22 16:20:48.219985 | 
2026-04-22 16:20:48.220318 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-22 16:20:48.760302 | localhost -> localhost | changed
2026-04-22 16:20:48.776687 | 
2026-04-22 16:20:48.776839 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-22 16:20:50.722668 | localhost -> localhost | changed
2026-04-22 16:20:50.732301 | 
2026-04-22 16:20:50.732386 | PLAY [all]
2026-04-22 16:20:50.743543 | 
2026-04-22 16:20:50.743850 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-22 16:20:51.110658 | instance -> localhost | ok
2026-04-22 16:20:51.121519 | 
2026-04-22 16:20:51.121634 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-22 16:20:51.159282 | instance | ok
2026-04-22 16:20:51.179742 | instance | included: /var/lib/zuul/builds/11472aaffb034a12a1ec4618515c1c6a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-22 16:20:51.190422 | 
2026-04-22 16:20:51.190615 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-22 16:20:53.278617 | instance -> localhost | Generating public/private rsa key pair.
2026-04-22 16:20:53.278777 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/11472aaffb034a12a1ec4618515c1c6a/work/11472aaffb034a12a1ec4618515c1c6a_id_rsa
2026-04-22 16:20:53.278807 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/11472aaffb034a12a1ec4618515c1c6a/work/11472aaffb034a12a1ec4618515c1c6a_id_rsa.pub
2026-04-22 16:20:53.278830 | instance -> localhost | The key fingerprint is:
2026-04-22 16:20:53.278851 | instance -> localhost | SHA256:M1JZxfTKbQvb/IscW0+bqb77OxEQt4UxBgad5dZDDLs zuul-build-sshkey
2026-04-22 16:20:53.278883 | instance -> localhost | The key's randomart image is:
2026-04-22 16:20:53.278905 | instance -> localhost | +---[RSA 3072]----+
2026-04-22 16:20:53.278969 | instance -> localhost | |          o*=*O=.|
2026-04-22 16:20:53.279000 | instance -> localhost | |         o .+==+o|
2026-04-22 16:20:53.279021 | instance -> localhost | |        o    .=o.|
2026-04-22 16:20:53.279041 | instance -> localhost | |       .   . +...|
2026-04-22 16:20:53.279060 | instance -> localhost | |      . S   +Eo .|
2026-04-22 16:20:53.279079 | instance -> localhost | |       . o   * o |
2026-04-22 16:20:53.279098 | instance -> localhost | |            ..+.o|
2026-04-22 16:20:53.279117 | instance -> localhost | |            . =+=|
2026-04-22 16:20:53.279140 | instance -> localhost | |            .O=B*|
2026-04-22 16:20:53.279160 | instance -> localhost | +----[SHA256]-----+
2026-04-22 16:20:53.279213 | instance -> localhost | ok: Runtime: 0:00:01.618036
2026-04-22 16:20:53.286447 | 
2026-04-22 16:20:53.286531 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-22 16:20:53.317577 | instance | ok
2026-04-22 16:20:53.330041 | instance | included: /var/lib/zuul/builds/11472aaffb034a12a1ec4618515c1c6a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-22 16:20:53.338405 | 
2026-04-22 16:20:53.338490 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-22 16:20:53.363413 | instance | skipping: Conditional result was False
2026-04-22 16:20:53.373532 | 
2026-04-22 16:20:53.373615 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-22 16:20:53.822486 | instance | changed
2026-04-22 16:20:53.830901 | 
2026-04-22 16:20:53.831082 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-22 16:20:54.034903 | instance | ok
2026-04-22 16:20:54.041894 | 
2026-04-22 16:20:54.041987 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-22 16:20:54.533809 | instance | changed
2026-04-22 16:20:54.656523 | 
2026-04-22 16:20:54.656763 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-22 16:20:55.190752 | instance | changed
2026-04-22 16:20:55.201635 | 
2026-04-22 16:20:55.201722 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-22 16:20:55.224521 | instance | skipping: Conditional result was False
2026-04-22 16:20:55.235421 | 
2026-04-22 16:20:55.235541 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-22 16:20:55.675387 | instance -> localhost | changed
2026-04-22 16:20:55.691941 | 
2026-04-22 16:20:55.692034 | TASK [add-build-sshkey : Add back temp key]
2026-04-22 16:20:55.988575 | instance -> localhost | Identity added: /var/lib/zuul/builds/11472aaffb034a12a1ec4618515c1c6a/work/11472aaffb034a12a1ec4618515c1c6a_id_rsa (zuul-build-sshkey)
2026-04-22 16:20:55.988794 | instance -> localhost | ok: Runtime: 0:00:00.013305
2026-04-22 16:20:55.996084 | 
2026-04-22 16:20:55.996190 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-22 16:20:56.305157 | instance | ok
2026-04-22 16:20:56.312004 | 
2026-04-22 16:20:56.312116 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-22 16:20:56.336912 | instance | skipping: Conditional result was False
2026-04-22 16:20:56.354030 | 
2026-04-22 16:20:56.354177 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-22 16:20:56.711125 | instance | ok
2026-04-22 16:20:56.717007 | 
2026-04-22 16:20:56.717080 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-22 16:20:58.497347 | instance | Output suppressed because no_log was given
2026-04-22 16:20:58.508448 | 
2026-04-22 16:20:58.508509 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-22 16:20:58.704390 | instance | ok: "logs"
2026-04-22 16:20:58.704701 | instance | ok: All items complete
2026-04-22 16:20:58.704733 | 
2026-04-22 16:20:58.929531 | instance | ok: "artifacts"
2026-04-22 16:20:59.140698 | instance | ok: "docs"
2026-04-22 16:20:59.163194 | 
2026-04-22 16:20:59.163397 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-22 16:20:59.363126 | instance | changed: "logs"
2026-04-22 16:20:59.556611 | instance | changed: "artifacts"
2026-04-22 16:20:59.716764 | instance | changed: "docs"
2026-04-22 16:20:59.735305 | 
2026-04-22 16:20:59.735485 | PLAY RECAP
2026-04-22 16:20:59.735562 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-22 16:20:59.735602 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-22 16:20:59.735630 | 
2026-04-22 16:20:59.914493 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-22 16:20:59.919577 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-22 16:21:00.614994 | 
2026-04-22 16:21:01.373838 | PLAY [all]
2026-04-22 16:21:01.393620 | 
2026-04-22 16:21:01.393746 | TASK [setup-uv : Extract archive]
2026-04-22 16:21:03.558880 | instance | changed
2026-04-22 16:21:03.565737 | 
2026-04-22 16:21:03.565830 | TASK [setup-uv : Print version]
2026-04-22 16:21:03.892646 | instance | uv 0.8.13
2026-04-22 16:21:04.225861 | instance | ok: Runtime: 0:00:00.012417
2026-04-22 16:21:04.231741 | 
2026-04-22 16:21:04.231791 | PLAY RECAP
2026-04-22 16:21:04.231837 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-22 16:21:04.231862 | 
2026-04-22 16:21:04.329141 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-22 16:21:04.331904 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@stable/2025.1]
2026-04-22 16:21:04.902266 | 
2026-04-22 16:21:04.902389 | PLAY [all]
2026-04-22 16:21:04.915006 | 
2026-04-22 16:21:04.915088 | TASK [Install "jq" for log collection]
2026-04-22 16:21:15.392452 | instance | changed
2026-04-22 16:21:15.396502 | 
2026-04-22 16:21:15.396591 | PLAY RECAP
2026-04-22 16:21:15.396664 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-22 16:21:15.396749 | 
2026-04-22 16:21:15.514368 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@stable/2025.1]
2026-04-22 16:21:15.521259 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-22 16:21:16.207675 | 
2026-04-22 16:21:16.207811 | PLAY [all]
2026-04-22 16:21:16.218823 | 
2026-04-22 16:21:16.218897 | TASK [Copy inventory file for Zuul]
2026-04-22 16:21:17.122005 | instance | changed
2026-04-22 16:21:17.179329 | 
2026-04-22 16:21:17.179488 | TASK [Switch "ansible_host" to private IP]
2026-04-22 16:21:17.467345 | instance | changed: 1 replacements made
2026-04-22 16:21:17.475487 | 
2026-04-22 16:21:17.475663 | TASK [Run Molecule scenario]
2026-04-22 16:21:17.874137 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-22 16:21:17.874400 | instance | Creating virtual environment at: .venv
2026-04-22 16:21:17.900985 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-22 16:21:17.933615 | instance | Downloading netaddr (2.2MiB)
2026-04-22 16:21:17.934116 | instance | Downloading kubernetes (1.9MiB)
2026-04-22 16:21:17.935085 | instance | Downloading setuptools (1.1MiB)
2026-04-22 16:21:17.937782 | instance | Downloading pygments (1.2MiB)
2026-04-22 16:21:17.938245 | instance | Downloading openstacksdk (1.7MiB)
2026-04-22 16:21:17.938459 | instance | Downloading rjsonnet (1.2MiB)
2026-04-22 16:21:17.939049 | instance | Downloading cryptography (4.2MiB)
2026-04-22 16:21:17.939290 | instance | Downloading ansible-core (2.1MiB)
2026-04-22 16:21:18.253993 | instance |    Building pyperclip==1.9.0
2026-04-22 16:21:18.282865 | instance |  Downloading rjsonnet
2026-04-22 16:21:18.419145 | instance |  Downloading netaddr
2026-04-22 16:21:18.430805 | instance |  Downloading pygments
2026-04-22 16:21:18.447519 | instance |  Downloading cryptography
2026-04-22 16:21:18.478710 | instance |  Downloading setuptools
2026-04-22 16:21:18.537175 | instance |  Downloading kubernetes
2026-04-22 16:21:18.563605 | instance |  Downloading ansible-core
2026-04-22 16:21:18.590240 | instance |  Downloading openstacksdk
2026-04-22 16:21:18.991976 | instance |       Built pyperclip==1.9.0
2026-04-22 16:21:19.179235 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-22 16:21:19.226518 | instance | Installed 79 packages in 45ms
2026-04-22 16:21:19.918755 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-22 16:21:20.550359 | instance | INFO     [keycloak > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-22 16:21:20.550551 | instance | INFO     [keycloak > prerun] Performing prerun with role_name_check=0...
2026-04-22 16:21:29.942317 | instance | WARNING  Retrying execution failure 1 of: ansible-galaxy collection install -vvv ansible.utils:>=2.9.0
2026-04-22 16:21:29.942664 | instance | ERROR    Command ansible-galaxy collection install -vvv ansible.utils:>=2.9.0, returned 1 code:
2026-04-22 16:21:29.942689 | instance | Starting galaxy collection install process
2026-04-22 16:21:29.942702 | instance | Process install dependency map
2026-04-22 16:21:29.942714 | instance | Starting collection install process
2026-04-22 16:21:29.942735 | instance | Downloading https://galaxy.ansible.com/api/v3/plugin/ansible/content/published/collections/artifacts/ansible-utils-6.0.2.tar.gz to /home/zuul/.ansible/tmp/ansible-local-12831r52cjk0/tmppk38nnxg/ansible-utils-6.0.2-zm1lonuq
2026-04-22 16:21:29.942750 | instance |
2026-04-22 16:21:29.942761 | instance | ansible-galaxy
2026-04-22 16:21:29.942770 | instance |   config file = None
2026-04-22 16:21:29.942780 | instance |   configured module search path =
2026-04-22 16:21:29.942790 | instance |   ansible python module location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible
2026-04-22 16:21:29.942801 | instance |   ansible collection location = /home/zuul/.ansible/collections:/usr/share/ansible/collections:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/local/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages
2026-04-22 16:21:29.942818 | instance |   executable location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/ansible-galaxy
2026-04-22 16:21:29.942827 | instance |   python version = 3.10.12 (main, Mar  3 2026, 11:56:32)  (/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/python)
2026-04-22 16:21:29.942837 | instance |   jinja version = 3.1.6
2026-04-22 16:21:29.942847 | instance |   libyaml = True
2026-04-22 16:21:29.942856 | instance | No config file found; using defaults
2026-04-22 16:21:29.942866 | instance | : Collection ansible.netcommon does not support Ansible version
2026-04-22 16:21:29.942876 | instance | 2.17.12
2026-04-22 16:21:29.942886 | instance | Found installed collection ansible.netcommon:1.2.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-04-22 16:21:29.942896 | instance | Found installed collection ansible.posix:1.6.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-04-22 16:21:29.942924 | instance | Opened /home/zuul/.ansible/galaxy_token
2026-04-22 16:21:29.942934 | instance | ERROR! Failed to download collection tar from 'default' due to the following unforeseen error: HTTP Error 502: Bad Gateway. HTTP Error 502: Bad Gateway
2026-04-22 16:21:29.942945 | instance |
2026-04-22 16:21:29.943642 | instance | Traceback (most recent call last):
2026-04-22 16:21:29.944039 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/molecule", line 10, in <module>
2026-04-22 16:21:29.944550 | instance |     sys.exit(main())
2026-04-22 16:21:29.944991 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1442, in __call__
2026-04-22 16:21:29.945861 | instance |     return self.main(*args, **kwargs)
2026-04-22 16:21:29.946238 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1363, in main
2026-04-22 16:21:29.947002 | instance |     rv = self.invoke(ctx)
2026-04-22 16:21:29.947372 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1830, in invoke
2026-04-22 16:21:29.948244 | instance |     return _process_result(sub_ctx.command.invoke(sub_ctx))
2026-04-22 16:21:29.948609 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1226, in invoke
2026-04-22 16:21:29.949380 | instance |     return ctx.invoke(self.callback, **ctx.params)
2026-04-22 16:21:29.949804 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 794, in invoke
2026-04-22 16:21:29.950169 | instance |     return callback(*args, **kwargs)
2026-04-22 16:21:29.950385 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/click_cfg.py", line 583, in wrapper
2026-04-22 16:21:29.950724 | instance |     return func(*args, **kwargs)
2026-04-22 16:21:29.950941 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/decorators.py", line 34, in new_func
2026-04-22 16:21:29.951220 | instance |     return f(get_current_context(), *args, **kwargs)
2026-04-22 16:21:29.951434 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/click_cfg.py", line 418, in wrapper
2026-04-22 16:21:29.951781 | instance |     return func(ctx)
2026-04-22 16:21:29.952014 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/test.py", line 81, in test
2026-04-22 16:21:29.952313 | instance |     base.execute_cmdline_scenarios(scenario_name, args, command_args, ansible_args, exclude)
2026-04-22 16:21:29.952529 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 169, in execute_cmdline_scenarios
2026-04-22 16:21:29.952868 | instance |     _run_scenarios(scenarios, command_args, default_config)
2026-04-22 16:21:29.953088 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 240, in _run_scenarios
2026-04-22 16:21:29.953409 | instance |     scenario.config.runtime.prepare_environment(
2026-04-22 16:21:29.953629 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible_compat/runtime.py", line 694, in prepare_environment
2026-04-22 16:21:29.953987 | instance |     self.install_collection(
2026-04-22 16:21:29.954199 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible_compat/runtime.py", line 552, in install_collection
2026-04-22 16:21:29.954526 | instance |     raise InvalidPrerequisiteError(msg)
2026-04-22 16:21:29.955535 | instance | ansible_compat.errors.InvalidPrerequisiteError: Command ansible-galaxy collection install -vvv ansible.utils:>=2.9.0, returned 1 code:
2026-04-22 16:21:29.955551 | instance | Starting galaxy collection install process
2026-04-22 16:21:29.955557 | instance | Process install dependency map
2026-04-22 16:21:29.955563 | instance | Starting collection install process
2026-04-22 16:21:29.955576 | instance | Downloading https://galaxy.ansible.com/api/v3/plugin/ansible/content/published/collections/artifacts/ansible-utils-6.0.2.tar.gz to /home/zuul/.ansible/tmp/ansible-local-12831r52cjk0/tmppk38nnxg/ansible-utils-6.0.2-zm1lonuq
2026-04-22 16:21:29.955582 | instance |
2026-04-22 16:21:29.955588 | instance | ansible-galaxy [core 2.17.12]
2026-04-22 16:21:29.955593 | instance |   config file = None
2026-04-22 16:21:29.955599 | instance |   configured module search path = ['/home/zuul/src/github.com/vexxhost/atmosphere/plugins/modules', '/home/zuul/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
2026-04-22 16:21:29.955606 | instance |   ansible python module location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible
2026-04-22 16:21:29.955612 | instance |   ansible collection location = /home/zuul/.ansible/collections:/usr/share/ansible/collections:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/local/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages
2026-04-22 16:21:29.955618 | instance |   executable location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/ansible-galaxy
2026-04-22 16:21:29.955624 | instance |   python version = 3.10.12 (main, Mar  3 2026, 11:56:32) [GCC 11.4.0] (/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/python)
2026-04-22 16:21:29.955629 | instance |   jinja version = 3.1.6
2026-04-22 16:21:29.955635 | instance |   libyaml = True
2026-04-22 16:21:29.955640 | instance | No config file found; using defaults
2026-04-22 16:21:29.955646 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-04-22 16:21:29.955651 | instance | 2.17.12
2026-04-22 16:21:29.955657 | instance | Found installed collection ansible.netcommon:1.2.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-04-22 16:21:29.955663 | instance | Found installed collection ansible.posix:1.6.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-04-22 16:21:29.955668 | instance | Opened /home/zuul/.ansible/galaxy_token
2026-04-22 16:21:29.955674 | instance | ERROR! Failed to download collection tar from 'default' due to the following unforeseen error: HTTP Error 502: Bad Gateway. HTTP Error 502: Bad Gateway
2026-04-22 16:21:29.955879 | instance |
2026-04-22 16:21:30.534565 | instance | ERROR
2026-04-22 16:21:30.534801 | instance | {
2026-04-22 16:21:30.534850 | instance |   "delta": "0:00:12.215856",
2026-04-22 16:21:30.534890 | instance |   "end": "2026-04-22 16:21:30.029021",
2026-04-22 16:21:30.534925 | instance |   "msg": "non-zero return code",
2026-04-22 16:21:30.534959 | instance |   "rc": 1,
2026-04-22 16:21:30.534995 | instance |   "start": "2026-04-22 16:21:17.813165"
2026-04-22 16:21:30.535023 | instance | }
failure
2026-04-22 16:21:30.538933 | 
2026-04-22 16:21:30.538990 | PLAY RECAP
2026-04-22 16:21:30.539173 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-22 16:21:30.539218 | 
2026-04-22 16:21:30.752405 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-22 16:21:31.014960 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@stable/2025.1]
2026-04-22 16:21:31.674999 | 
2026-04-22 16:21:34.061836 | PLAY [all]
2026-04-22 16:21:34.087277 | 
2026-04-22 16:21:34.087479 | TASK [gather-host-logs : creating directory for system status]
2026-04-22 16:21:34.447889 | instance | changed
2026-04-22 16:21:34.455914 | 
2026-04-22 16:21:34.456073 | TASK [gather-host-logs : Get logs for each host]
2026-04-22 16:21:34.822987 | instance | + systemd-cgls --full --all --no-pager
2026-04-22 16:21:34.831889 | instance | + ip addr
2026-04-22 16:21:34.833738 | instance | + ip route
2026-04-22 16:21:34.835390 | instance | + lsblk
2026-04-22 16:21:34.838714 | instance | + mount
2026-04-22 16:21:34.840226 | instance | + docker images
2026-04-22 16:21:34.840655 | instance | /bin/bash: line 7: docker: command not found
2026-04-22 16:21:34.840898 | instance | + brctl show
2026-04-22 16:21:34.841273 | instance | /bin/bash: line 8: brctl: command not found
2026-04-22 16:21:34.841468 | instance | + ps aux --sort=-%mem
2026-04-22 16:21:34.852305 | instance | + dpkg -l
2026-04-22 16:21:34.862375 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-22 16:21:34.862828 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-22 16:21:34.862854 | instance | /bin/bash: line 11: docker: command not found
2026-04-22 16:21:34.863205 | instance | + '[' '!' -z '' ']'
2026-04-22 16:21:35.390347 | instance | ok: Runtime: 0:00:00.046017
2026-04-22 16:21:35.398328 | 
2026-04-22 16:21:35.398402 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-22 16:21:36.066391 | instance | changed:
2026-04-22 16:21:36.135329 | instance | created directory /var/lib/zuul/builds/11472aaffb034a12a1ec4618515c1c6a/work/logs/instance
2026-04-22 16:21:36.135482 | instance | cd+++++++++ system/
2026-04-22 16:21:36.135539 | instance | >f+++++++++ system/brctl-show.txt
2026-04-22 16:21:36.135587 | instance | >f+++++++++ system/docker-images.txt
2026-04-22 16:21:36.135631 | instance | >f+++++++++ system/ip-addr.txt
2026-04-22 16:21:36.135680 | instance | >f+++++++++ system/ip-route.txt
2026-04-22 16:21:36.135728 | instance | >f+++++++++ system/lsblk.txt
2026-04-22 16:21:36.135773 | instance | >f+++++++++ system/mount.txt
2026-04-22 16:21:36.135822 | instance | >f+++++++++ system/packages.txt
2026-04-22 16:21:36.135866 | instance | >f+++++++++ system/ps.txt
2026-04-22 16:21:36.135909 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-22 16:21:36.152169 | 
2026-04-22 16:21:36.152283 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-22 16:21:36.355003 | instance | changed: "values"
2026-04-22 16:21:36.542742 | instance | changed: "releases"
2026-04-22 16:21:36.605306 | 
2026-04-22 16:21:36.605447 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-22 16:21:36.837091 | instance | /bin/bash: line 3: kubectl: command not found
2026-04-22 16:21:37.298337 | instance | ok: Runtime: 0:00:00.006099
2026-04-22 16:21:37.304705 | 
2026-04-22 16:21:37.304825 | TASK [helm-release-status : Downloads logs to executor]
2026-04-22 16:21:37.922626 | instance | changed:
2026-04-22 16:21:38.080025 | instance | cd+++++++++ helm/
2026-04-22 16:21:38.080216 | instance | cd+++++++++ helm/releases/
2026-04-22 16:21:38.080278 | instance | cd+++++++++ helm/values/
2026-04-22 16:21:38.111544 | 
2026-04-22 16:21:38.111692 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-22 16:21:38.320990 | instance | changed
2026-04-22 16:21:38.380824 | 
2026-04-22 16:21:38.380930 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-22 16:21:38.622671 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-22 16:21:38.622939 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-22 16:21:38.628189 | instance | environment: line 1: kubectl: command not found
2026-04-22 16:21:38.630062 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-22 16:21:38.630948 | instance | environment: line 1: kubectl: command not found
2026-04-22 16:21:38.632107 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-22 16:21:38.634142 | instance | environment: line 1: kubectl: command not found
2026-04-22 16:21:38.634848 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-22 16:21:38.635054 | instance | environment: line 1: kubectl: command not found
2026-04-22 16:21:38.636074 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-22 16:21:38.638629 | instance | environment: line 1: kubectl: command not found
2026-04-22 16:21:38.639600 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-22 16:21:38.993784 | instance | ok: Runtime: 0:00:00.029493
2026-04-22 16:21:39.007513 | 
2026-04-22 16:21:39.007595 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-22 16:21:39.224238 | instance | changed
2026-04-22 16:21:40.705060 | 
2026-04-22 16:21:40.705213 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-22 16:21:40.973046 | instance | environment: line 5: kubectl: command not found
2026-04-22 16:21:40.973171 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-22 16:21:40.973352 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-22 16:21:40.973847 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-22 16:21:41.294552 | instance | ok: Runtime: 0:00:00.007065
2026-04-22 16:21:41.303015 | 
2026-04-22 16:21:41.303146 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-22 16:21:41.822902 | instance | changed:
2026-04-22 16:21:41.823120 | instance | cd+++++++++ objects/
2026-04-22 16:21:41.823156 | instance | cd+++++++++ objects/cluster/
2026-04-22 16:21:41.823185 | instance | cd+++++++++ objects/namespaced/
2026-04-22 16:21:41.835509 | 
2026-04-22 16:21:41.835641 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-22 16:21:42.039573 | instance | changed
2026-04-22 16:21:42.046188 | 
2026-04-22 16:21:42.046276 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-22 16:21:42.267093 | instance | changed
2026-04-22 16:21:42.272787 | 
2026-04-22 16:21:42.272866 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-22 16:21:42.503368 | instance | environment: line 3: kubectl: command not found
2026-04-22 16:21:42.997794 | instance | ok: Runtime: 0:00:00.010501
2026-04-22 16:21:43.005156 | 
2026-04-22 16:21:43.005274 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-22 16:21:43.528474 | instance | changed:
2026-04-22 16:21:43.589080 | instance | cd+++++++++ pod-logs/
2026-04-22 16:21:43.589252 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-22 16:21:43.607499 | 
2026-04-22 16:21:43.607733 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-22 16:21:43.840198 | instance | changed
2026-04-22 16:21:43.847923 | 
2026-04-22 16:21:43.847997 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-22 16:21:44.074298 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-22 16:21:44.399387 | instance | ok: Runtime: 0:00:00.038696
2026-04-22 16:21:44.411985 | 
2026-04-22 16:21:44.412735 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-22 16:21:44.640173 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-22 16:21:44.676419 | instance | ceph-mgr endpoints:
2026-04-22 16:21:45.034574 | instance | ok: Runtime: 0:00:00.044051
2026-04-22 16:21:45.039768 | 
2026-04-22 16:21:45.039866 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-22 16:21:45.257813 | instance | /bin/bash: line 4: kubectl: command not found
2026-04-22 16:21:45.571459 | instance | ok: Runtime: 0:00:00.039560
2026-04-22 16:21:45.578020 | 
2026-04-22 16:21:45.578099 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-22 16:21:46.116625 | instance | changed: cd+++++++++ prometheus/
2026-04-22 16:21:46.295703 | 
2026-04-22 16:21:46.295836 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-22 16:21:46.519596 | instance | changed
2026-04-22 16:21:46.525185 | 
2026-04-22 16:21:46.525269 | TASK [gather-selenium-data : Get selenium data]
2026-04-22 16:21:46.755862 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-22 16:21:46.757639 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-22 16:21:47.079684 | instance | ERROR
2026-04-22 16:21:47.079944 | instance | {
2026-04-22 16:21:47.080008 | instance |   "delta": "0:00:00.008443",
2026-04-22 16:21:47.080044 | instance |   "end": "2026-04-22 16:21:46.758308",
2026-04-22 16:21:47.080073 | instance |   "msg": "non-zero return code",
2026-04-22 16:21:47.080103 | instance |   "rc": 1,
2026-04-22 16:21:47.080134 | instance |   "start": "2026-04-22 16:21:46.749865"
2026-04-22 16:21:47.080162 | instance | }
2026-04-22 16:21:47.080198 | instance | ERROR: Ignoring Errors
2026-04-22 16:21:47.088249 | 
2026-04-22 16:21:47.088383 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-22 16:21:47.595792 | instance | changed: cd+++++++++ selenium/
2026-04-22 16:21:47.603998 | 
2026-04-22 16:21:47.604091 | PLAY RECAP
2026-04-22 16:21:47.604152 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-22 16:21:47.604184 | 
2026-04-22 16:21:47.742474 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@stable/2025.1]
2026-04-22 16:21:47.746223 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-22 16:21:48.602074 | 
2026-04-22 16:21:48.721690 | PLAY [all]
2026-04-22 16:21:48.745862 | 
2026-04-22 16:21:48.746059 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-22 16:21:48.791968 | instance | skipping: Conditional result was False
2026-04-22 16:21:48.797653 | 
2026-04-22 16:21:48.797758 | TASK [fetch-output : Set log path for single node]
2026-04-22 16:21:48.843706 | instance | ok
2026-04-22 16:21:48.854609 | 
2026-04-22 16:21:48.854816 | LOOP [fetch-output : Ensure local output dirs]
2026-04-22 16:21:49.262041 | instance -> localhost | ok: "/var/lib/zuul/builds/11472aaffb034a12a1ec4618515c1c6a/work/logs"
2026-04-22 16:21:49.470614 | instance -> localhost | changed: "/var/lib/zuul/builds/11472aaffb034a12a1ec4618515c1c6a/work/artifacts"
2026-04-22 16:21:49.715191 | instance -> localhost | changed: "/var/lib/zuul/builds/11472aaffb034a12a1ec4618515c1c6a/work/docs"
2026-04-22 16:21:49.732303 | 
2026-04-22 16:21:49.732458 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-22 16:21:50.436143 | instance | changed: .d..t...... ./
2026-04-22 16:21:50.436450 | instance | changed: All items complete
2026-04-22 16:21:50.436512 | 
2026-04-22 16:21:50.937599 | instance | changed: .d..t...... ./
2026-04-22 16:21:51.404622 | instance | changed: .d..t...... ./
2026-04-22 16:21:51.429367 | 
2026-04-22 16:21:51.429492 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-22 16:21:52.030538 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.142961
2026-04-22 16:21:52.301126 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.006449
2026-04-22 16:21:52.320135 | 
2026-04-22 16:21:52.320622 | PLAY [all]
2026-04-22 16:21:52.327262 | 
2026-04-22 16:21:52.327328 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-22 16:21:52.830323 | instance | changed
2026-04-22 16:21:52.836346 | 
2026-04-22 16:21:52.836400 | PLAY RECAP
2026-04-22 16:21:52.836443 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-22 16:21:52.836464 | 
2026-04-22 16:21:52.936120 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-22 16:21:52.941317 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-22 16:21:53.651267 | 
2026-04-22 16:21:53.651423 | PLAY [localhost]
2026-04-22 16:21:53.663084 | 
2026-04-22 16:21:53.663186 | TASK [Generate Zuul manifest]
2026-04-22 16:21:53.687022 | localhost | ok
2026-04-22 16:21:53.709265 | 
2026-04-22 16:21:53.709475 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-22 16:21:54.113348 | localhost | changed
2026-04-22 16:21:54.390691 | 
2026-04-22 16:21:54.390883 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-22 16:21:54.501871 | localhost | ok
2026-04-22 16:21:54.514076 | 
2026-04-22 16:21:54.514261 | TASK [Upload logs]
2026-04-22 16:21:54.534518 | localhost | ok
2026-04-22 16:21:55.128407 | 
2026-04-22 16:21:55.128547 | TASK [Set zuul-log-path fact]
2026-04-22 16:21:55.151418 | localhost | ok
2026-04-22 16:21:55.167754 | 
2026-04-22 16:21:55.167911 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-22 16:21:55.202652 | localhost | ok
2026-04-22 16:21:55.213246 | 
2026-04-22 16:21:55.213385 | TASK [upload-logs : Create log directories]
2026-04-22 16:21:55.650630 | localhost | changed
2026-04-22 16:21:55.658069 | 
2026-04-22 16:21:55.658175 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-22 16:21:59.334959 | localhost -> localhost | ok: Runtime: 0:00:00.006096
2026-04-22 16:21:59.341865 | 
2026-04-22 16:21:59.341983 | TASK [upload-logs : Upload logs to log server]
2026-04-22 16:21:59.875528 | localhost | Output suppressed because no_log was given
2026-04-22 16:21:59.883767 | 
2026-04-22 16:21:59.883897 | LOOP [upload-logs : Compress console log and json output]
2026-04-22 16:21:59.937967 | localhost | skipping: Conditional result was False
2026-04-22 16:21:59.950698 | localhost | skipping: Conditional result was False
2026-04-22 16:21:59.971477 | 
2026-04-22 16:21:59.971671 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-22 16:22:00.019061 | localhost | skipping: Conditional result was False
2026-04-22 16:22:00.019563 | 
2026-04-22 16:22:00.023607 | localhost | skipping: Conditional result was False
2026-04-22 16:22:00.040353 | 
2026-04-22 16:22:00.040575 | LOOP [upload-logs : Upload console log and json output]