2026-03-11 05:00:31.020628 | Job console starting
2026-03-11 05:00:31.032670 | Updating git repos
2026-03-11 05:00:31.099885 | Cloning repos into workspace
2026-03-11 05:00:31.205216 | Restoring repo states
2026-03-11 05:00:31.226545 | Merging changes
2026-03-11 05:00:32.441067 | Checking out repos
2026-03-11 05:00:32.544916 | Preparing playbooks
2026-03-11 05:00:34.723559 | Running Ansible setup
2026-03-11 05:00:38.008275 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-11 05:00:38.683995 | 
2026-03-11 05:00:38.684220 | PLAY [localhost]
2026-03-11 05:00:38.693397 | 
2026-03-11 05:00:38.693496 | TASK [Gathering Facts]
2026-03-11 05:00:39.556836 | localhost | ok
2026-03-11 05:00:39.568635 | 
2026-03-11 05:00:39.568887 | TASK [Setup log path fact]
2026-03-11 05:00:39.590958 | localhost | ok
2026-03-11 05:00:39.608198 | 
2026-03-11 05:00:39.608413 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-11 05:00:39.641414 | localhost | ok
2026-03-11 05:00:39.650274 | 
2026-03-11 05:00:39.650379 | TASK [emit-job-header : Print job information]
2026-03-11 05:00:39.694648 | # Job Information
2026-03-11 05:00:39.694986 | Ansible Version: 2.16.16
2026-03-11 05:00:39.695101 | Job: atmosphere-molecule-aio-ovn
2026-03-11 05:00:39.695187 | Pipeline: check
2026-03-11 05:00:39.695248 | Executor: 0a8996d2b663
2026-03-11 05:00:39.695297 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3501
2026-03-11 05:00:39.695357 | Event ID: 230da770-1d07-11f1-9a1b-2c80b02e34a9
2026-03-11 05:00:39.699752 | 
2026-03-11 05:00:39.699923 | LOOP [emit-job-header : Print node information]
2026-03-11 05:00:39.802553 | localhost | ok:
2026-03-11 05:00:39.802812 | localhost | # Node Information
2026-03-11 05:00:39.802854 | localhost | Inventory Hostname: instance
2026-03-11 05:00:39.802886 | localhost | Hostname: np0000158321
2026-03-11 05:00:39.802916 | localhost | Username: zuul
2026-03-11 05:00:39.802949 | localhost | Distro: Ubuntu 22.04
2026-03-11 05:00:39.802977 | localhost | Provider: yul1
2026-03-11 05:00:39.803005 | localhost | Region: ca-ymq-1
2026-03-11 05:00:39.803033 | localhost | Label: ubuntu-jammy-16
2026-03-11 05:00:39.803060 | localhost | Product Name: OpenStack Nova
2026-03-11 05:00:39.803087 | localhost | Interface IP: 162.253.55.204
2026-03-11 05:00:39.822652 | 
2026-03-11 05:00:39.822837 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-11 05:00:40.214324 | localhost -> localhost | changed
2026-03-11 05:00:40.222088 | 
2026-03-11 05:00:40.616234 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-11 05:00:41.736604 | localhost -> localhost | changed
2026-03-11 05:00:41.748539 | 
2026-03-11 05:00:41.748619 | PLAY [all]
2026-03-11 05:00:41.758346 | 
2026-03-11 05:00:41.758418 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-11 05:00:41.979367 | instance -> localhost | ok
2026-03-11 05:00:41.991366 | 
2026-03-11 05:00:41.991434 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-11 05:00:42.024114 | instance | ok
2026-03-11 05:00:42.054247 | instance | included: /var/lib/zuul/builds/972ac0a57596476bb1ad23a0b9c92137/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-11 05:00:42.091603 | 
2026-03-11 05:00:42.091843 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-11 05:00:42.787968 | instance -> localhost | Generating public/private rsa key pair.
2026-03-11 05:00:42.788351 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/972ac0a57596476bb1ad23a0b9c92137/work/972ac0a57596476bb1ad23a0b9c92137_id_rsa
2026-03-11 05:00:42.788397 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/972ac0a57596476bb1ad23a0b9c92137/work/972ac0a57596476bb1ad23a0b9c92137_id_rsa.pub
2026-03-11 05:00:42.788432 | instance -> localhost | The key fingerprint is:
2026-03-11 05:00:42.788466 | instance -> localhost | SHA256:0ux/VLcfFhuYODNMfhmjVvw+Azjj2e6fYndzQBZy+Co zuul-build-sshkey
2026-03-11 05:00:42.788508 | instance -> localhost | The key's randomart image is:
2026-03-11 05:00:42.788539 | instance -> localhost | +---[RSA 3072]----+
2026-03-11 05:00:42.788571 | instance -> localhost | |            ..   |
2026-03-11 05:00:42.788601 | instance -> localhost | |           .o=o  |
2026-03-11 05:00:42.788630 | instance -> localhost | |          + =+B. |
2026-03-11 05:00:42.788658 | instance -> localhost | |       o   & *=+.|
2026-03-11 05:00:42.788686 | instance -> localhost | |      . S o X=o.=|
2026-03-11 05:00:42.788713 | instance -> localhost | |       o  Eoo..O |
2026-03-11 05:00:42.788741 | instance -> localhost | |        .  o. ..=|
2026-03-11 05:00:42.788768 | instance -> localhost | |         .  .+ o=|
2026-03-11 05:00:42.788800 | instance -> localhost | |          ..o.+o+|
2026-03-11 05:00:42.788828 | instance -> localhost | +----[SHA256]-----+
2026-03-11 05:00:42.788889 | instance -> localhost | ok: Runtime: 0:00:00.282135
2026-03-11 05:00:42.795733 | 
2026-03-11 05:00:42.795795 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-11 05:00:42.826925 | instance | ok
2026-03-11 05:00:42.836442 | instance | included: /var/lib/zuul/builds/972ac0a57596476bb1ad23a0b9c92137/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-11 05:00:42.844997 | 
2026-03-11 05:00:42.845061 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-11 05:00:42.868505 | instance | skipping: Conditional result was False
2026-03-11 05:00:42.876807 | 
2026-03-11 05:00:42.876898 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-11 05:00:43.342290 | instance | changed
2026-03-11 05:00:43.351100 | 
2026-03-11 05:00:43.351172 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-11 05:00:43.527874 | instance | ok
2026-03-11 05:00:43.534962 | 
2026-03-11 05:00:43.535028 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-11 05:00:43.996184 | instance | changed
2026-03-11 05:00:44.003504 | 
2026-03-11 05:00:44.003599 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-11 05:00:44.460652 | instance | changed
2026-03-11 05:00:44.465666 | 
2026-03-11 05:00:44.465730 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-11 05:00:44.490701 | instance | skipping: Conditional result was False
2026-03-11 05:00:44.501758 | 
2026-03-11 05:00:44.501832 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-11 05:00:44.861303 | instance -> localhost | changed
2026-03-11 05:00:44.908211 | 
2026-03-11 05:00:44.908344 | TASK [add-build-sshkey : Add back temp key]
2026-03-11 05:00:45.209041 | instance -> localhost | Identity added: /var/lib/zuul/builds/972ac0a57596476bb1ad23a0b9c92137/work/972ac0a57596476bb1ad23a0b9c92137_id_rsa (zuul-build-sshkey)
2026-03-11 05:00:45.209257 | instance -> localhost | ok: Runtime: 0:00:00.013328
2026-03-11 05:00:45.216435 | 
2026-03-11 05:00:45.216523 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-11 05:00:45.482720 | instance | ok
2026-03-11 05:00:45.489242 | 
2026-03-11 05:00:45.489349 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-11 05:00:45.524070 | instance | skipping: Conditional result was False
2026-03-11 05:00:45.538815 | 
2026-03-11 05:00:45.538882 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-11 05:00:45.805176 | instance | ok
2026-03-11 05:00:45.812405 | 
2026-03-11 05:00:45.812469 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-11 05:00:47.257062 | instance | Output suppressed because no_log was given
2026-03-11 05:00:47.265516 | 
2026-03-11 05:00:47.265582 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-11 05:00:47.432342 | instance | ok: "logs"
2026-03-11 05:00:47.432620 | instance | ok: All items complete
2026-03-11 05:00:47.432658 | 
2026-03-11 05:00:47.581321 | instance | ok: "artifacts"
2026-03-11 05:00:47.730522 | instance | ok: "docs"
2026-03-11 05:00:47.746855 | 
2026-03-11 05:00:47.746995 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-11 05:00:47.931598 | instance | changed: "logs"
2026-03-11 05:00:48.083052 | instance | changed: "artifacts"
2026-03-11 05:00:48.236658 | instance | changed: "docs"
2026-03-11 05:00:48.257589 | 
2026-03-11 05:00:48.257694 | PLAY RECAP
2026-03-11 05:00:48.257760 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-11 05:00:48.257802 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-11 05:00:48.257846 | 
2026-03-11 05:00:48.399343 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-11 05:00:48.409807 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-11 05:00:49.018654 | 
2026-03-11 05:00:49.018832 | PLAY [all]
2026-03-11 05:00:49.032433 | 
2026-03-11 05:00:49.032509 | TASK [setup-uv : Extract archive]
2026-03-11 05:00:51.222747 | instance | changed
2026-03-11 05:00:51.231275 | 
2026-03-11 05:00:51.231391 | TASK [setup-uv : Print version]
2026-03-11 05:00:50.109013 | instance | uv 0.8.13
2026-03-11 05:00:51.769455 | instance | ok: Runtime: 0:00:00.017964
2026-03-11 05:00:51.777684 | 
2026-03-11 05:00:51.777746 | PLAY RECAP
2026-03-11 05:00:51.777787 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-11 05:00:51.777811 | 
2026-03-11 05:00:51.870580 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-11 05:00:51.882824 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-03-11 05:00:52.457508 | 
2026-03-11 05:00:52.457620 | PLAY [all]
2026-03-11 05:00:52.469959 | 
2026-03-11 05:00:52.470031 | TASK [Install "jq" for log collection]
2026-03-11 05:01:01.675456 | instance | changed
2026-03-11 05:01:01.678316 | 
2026-03-11 05:01:01.678375 | PLAY RECAP
2026-03-11 05:01:01.678428 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-11 05:01:01.678477 | 
2026-03-11 05:01:01.809211 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-03-11 05:01:01.817635 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-11 05:01:02.389363 | 
2026-03-11 05:01:02.389475 | PLAY [all]
2026-03-11 05:01:02.401131 | 
2026-03-11 05:01:02.401206 | TASK [Copy inventory file for Zuul]
2026-03-11 05:01:03.213817 | instance | changed
2026-03-11 05:01:03.220713 | 
2026-03-11 05:01:03.220814 | TASK [Switch "ansible_host" to private IP]
2026-03-11 05:01:03.517097 | instance | changed: 1 replacements made
2026-03-11 05:01:03.522361 | 
2026-03-11 05:01:03.522422 | TASK [Run Molecule scenario]
2026-03-11 05:01:03.936284 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-03-11 05:01:03.936379 | instance | Creating virtual environment at: .venv
2026-03-11 05:01:03.960924 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-03-11 05:01:03.982180 | instance | Downloading openstacksdk (1.7MiB)
2026-03-11 05:01:03.986758 | instance | Downloading pydantic-core (2.0MiB)
2026-03-11 05:01:03.986958 | instance | Downloading cryptography (4.2MiB)
2026-03-11 05:01:03.987167 | instance | Downloading pygments (1.2MiB)
2026-03-11 05:01:03.987403 | instance | Downloading rjsonnet (1.2MiB)
2026-03-11 05:01:03.987634 | instance | Downloading kubernetes (1.9MiB)
2026-03-11 05:01:03.988357 | instance | Downloading setuptools (1.1MiB)
2026-03-11 05:01:03.988613 | instance | Downloading ansible-core (2.1MiB)
2026-03-11 05:01:03.989638 | instance | Downloading netaddr (2.2MiB)
2026-03-11 05:01:04.323452 | instance |    Building pyperclip==1.9.0
2026-03-11 05:01:04.343285 | instance |  Downloading rjsonnet
2026-03-11 05:01:04.446720 | instance |  Downloading pydantic-core
2026-03-11 05:01:04.492073 | instance |  Downloading netaddr
2026-03-11 05:01:04.506878 | instance |  Downloading pygments
2026-03-11 05:01:04.515207 | instance |  Downloading cryptography
2026-03-11 05:01:04.557171 | instance |  Downloading setuptools
2026-03-11 05:01:04.619315 | instance |  Downloading kubernetes
2026-03-11 05:01:04.654418 | instance |  Downloading ansible-core
2026-03-11 05:01:04.694725 | instance |  Downloading openstacksdk
2026-03-11 05:01:05.019965 | instance |       Built pyperclip==1.9.0
2026-03-11 05:01:05.287852 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-03-11 05:01:05.331150 | instance | Installed 83 packages in 41ms
2026-03-11 05:01:05.999470 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-03-11 05:01:06.627780 | instance | INFO     [aio > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-03-11 05:01:06.627838 | instance | INFO     [aio > prerun] Performing prerun with role_name_check=0...
2026-03-11 05:03:52.587181 | instance | WARNING  Retrying execution failure 1 of: ansible-galaxy collection install -vvv vexxhost.ceph:>=3.2.0
2026-03-11 05:03:52.587313 | instance | ERROR    Command ansible-galaxy collection install -vvv vexxhost.ceph:>=3.2.0, returned 1 code:
2026-03-11 05:03:52.587327 | instance | Starting galaxy collection install process
2026-03-11 05:03:52.587337 | instance | Process install dependency map
2026-03-11 05:03:52.587348 | instance |
2026-03-11 05:03:52.587358 | instance | ansible-galaxy
2026-03-11 05:03:52.587367 | instance |   config file = None
2026-03-11 05:03:52.587376 | instance |   configured module search path =
2026-03-11 05:03:52.587385 | instance |   ansible python module location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible
2026-03-11 05:03:52.587396 | instance |   ansible collection location = /home/zuul/.ansible/collections:/usr/share/ansible/collections:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/local/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages
2026-03-11 05:03:52.587425 | instance |   executable location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/ansible-galaxy
2026-03-11 05:03:52.587434 | instance |   python version = 3.10.12 (main, Jan 26 2026, 14:55:28)  (/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/python)
2026-03-11 05:03:52.587444 | instance |   jinja version = 3.1.6
2026-03-11 05:03:52.587453 | instance |   libyaml = True
2026-03-11 05:03:52.587469 | instance | No config file found; using defaults
2026-03-11 05:03:52.587479 | instance | Found installed collection openstack.cloud:2.5.0 at '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud'
2026-03-11 05:03:52.587488 | instance | : Collection ansible.netcommon does not support Ansible version
2026-03-11 05:03:52.587497 | instance | 2.17.12
2026-03-11 05:03:52.587507 | instance | Found installed collection ansible.netcommon:1.2.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-03-11 05:03:52.587516 | instance | Found installed collection community.mysql:3.6.0 at '/home/zuul/.ansible/collections/ansible_collections/community/mysql'
2026-03-11 05:03:52.587561 | instance | Found installed collection ansible.utils:6.0.1 at '/home/zuul/.ansible/collections/ansible_collections/ansible/utils'
2026-03-11 05:03:52.587571 | instance | Found installed collection ansible.posix:1.6.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-03-11 05:03:52.587580 | instance | Found installed collection community.crypto:2.2.3 at '/home/zuul/.ansible/collections/ansible_collections/community/crypto'
2026-03-11 05:03:52.587589 | instance | Found installed collection kubernetes.core:2.4.0 at '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core'
2026-03-11 05:03:52.587598 | instance | Found installed collection community.general:7.3.0 at '/home/zuul/.ansible/collections/ansible_collections/community/general'
2026-03-11 05:03:52.587608 | instance | Opened /home/zuul/.ansible/galaxy_token
2026-03-11 05:03:52.587618 | instance | ERROR! Error when getting collection version metadata for vexxhost.containers:1.6.4 from default (https://galaxy.ansible.com/api/) (HTTP Code: 500, Message: Internal Server Error Code: Unknown)
2026-03-11 05:03:52.587633 | instance |
2026-03-11 05:03:52.587642 | instance | Traceback (most recent call last):
2026-03-11 05:03:52.587651 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/molecule", line 10, in <module>
2026-03-11 05:03:52.587660 | instance |     sys.exit(main())
2026-03-11 05:03:52.587674 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1442, in __call__
2026-03-11 05:03:52.588260 | instance |     return self.main(*args, **kwargs)
2026-03-11 05:03:52.588527 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1363, in main
2026-03-11 05:03:52.589151 | instance |     rv = self.invoke(ctx)
2026-03-11 05:03:52.589450 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1830, in invoke
2026-03-11 05:03:52.590175 | instance |     return _process_result(sub_ctx.command.invoke(sub_ctx))
2026-03-11 05:03:52.590508 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1226, in invoke
2026-03-11 05:03:52.591083 | instance |     return ctx.invoke(self.callback, **ctx.params)
2026-03-11 05:03:52.591351 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 794, in invoke
2026-03-11 05:03:52.591902 | instance |     return callback(*args, **kwargs)
2026-03-11 05:03:52.592135 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/click_cfg.py", line 583, in wrapper
2026-03-11 05:03:52.592594 | instance |     return func(*args, **kwargs)
2026-03-11 05:03:52.592865 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/decorators.py", line 34, in new_func
2026-03-11 05:03:52.593212 | instance |     return f(get_current_context(), *args, **kwargs)
2026-03-11 05:03:52.593522 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/click_cfg.py", line 418, in wrapper
2026-03-11 05:03:52.593942 | instance |     return func(ctx)
2026-03-11 05:03:52.594213 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/test.py", line 81, in test
2026-03-11 05:03:52.594631 | instance |     base.execute_cmdline_scenarios(scenario_name, args, command_args, ansible_args, exclude)
2026-03-11 05:03:52.594755 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 169, in execute_cmdline_scenarios
2026-03-11 05:03:52.594931 | instance |     _run_scenarios(scenarios, command_args, default_config)
2026-03-11 05:03:52.595054 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 240, in _run_scenarios
2026-03-11 05:03:52.595241 | instance |     scenario.config.runtime.prepare_environment(
2026-03-11 05:03:52.595368 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible_compat/runtime.py", line 694, in prepare_environment
2026-03-11 05:03:52.595604 | instance |     self.install_collection(
2026-03-11 05:03:52.595721 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible_compat/runtime.py", line 552, in install_collection
2026-03-11 05:03:52.595928 | instance |     raise InvalidPrerequisiteError(msg)
2026-03-11 05:03:52.596807 | instance | ansible_compat.errors.InvalidPrerequisiteError: Command ansible-galaxy collection install -vvv vexxhost.ceph:>=3.2.0, returned 1 code:
2026-03-11 05:03:52.596818 | instance | Starting galaxy collection install process
2026-03-11 05:03:52.596827 | instance | Process install dependency map
2026-03-11 05:03:52.596836 | instance |
2026-03-11 05:03:52.596845 | instance | ansible-galaxy [core 2.17.12]
2026-03-11 05:03:52.596854 | instance |   config file = None
2026-03-11 05:03:52.596863 | instance |   configured module search path = ['/home/zuul/src/github.com/vexxhost/atmosphere/plugins/modules', '/home/zuul/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
2026-03-11 05:03:52.596873 | instance |   ansible python module location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible
2026-03-11 05:03:52.596882 | instance |   ansible collection location = /home/zuul/.ansible/collections:/usr/share/ansible/collections:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/local/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages
2026-03-11 05:03:52.596892 | instance |   executable location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/ansible-galaxy
2026-03-11 05:03:52.596902 | instance |   python version = 3.10.12 (main, Jan 26 2026, 14:55:28) [GCC 11.4.0] (/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/python)
2026-03-11 05:03:52.596911 | instance |   jinja version = 3.1.6
2026-03-11 05:03:52.596919 | instance |   libyaml = True
2026-03-11 05:03:52.596928 | instance | No config file found; using defaults
2026-03-11 05:03:52.596937 | instance | Found installed collection openstack.cloud:2.5.0 at '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud'
2026-03-11 05:03:52.596947 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-03-11 05:03:52.596956 | instance | 2.17.12
2026-03-11 05:03:52.596965 | instance | Found installed collection ansible.netcommon:1.2.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-03-11 05:03:52.596974 | instance | Found installed collection community.mysql:3.6.0 at '/home/zuul/.ansible/collections/ansible_collections/community/mysql'
2026-03-11 05:03:52.596983 | instance | Found installed collection ansible.utils:6.0.1 at '/home/zuul/.ansible/collections/ansible_collections/ansible/utils'
2026-03-11 05:03:52.596992 | instance | Found installed collection ansible.posix:1.6.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-03-11 05:03:52.597001 | instance | Found installed collection community.crypto:2.2.3 at '/home/zuul/.ansible/collections/ansible_collections/community/crypto'
2026-03-11 05:03:52.597016 | instance | Found installed collection kubernetes.core:2.4.0 at '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core'
2026-03-11 05:03:52.597026 | instance | Found installed collection community.general:7.3.0 at '/home/zuul/.ansible/collections/ansible_collections/community/general'
2026-03-11 05:03:52.597036 | instance | Opened /home/zuul/.ansible/galaxy_token
2026-03-11 05:03:52.597045 | instance | ERROR! Error when getting collection version metadata for vexxhost.containers:1.6.4 from default (https://galaxy.ansible.com/api/) (HTTP Code: 500, Message: Internal Server Error Code: Unknown)
2026-03-11 05:03:52.597057 | instance |
2026-03-11 05:03:52.763222 | instance | ERROR
2026-03-11 05:03:52.763374 | instance | {
2026-03-11 05:03:52.763404 | instance |   "delta": "0:02:48.813038",
2026-03-11 05:03:52.763425 | instance |   "end": "2026-03-11 05:03:52.687640",
2026-03-11 05:03:52.763444 | instance |   "msg": "non-zero return code",
2026-03-11 05:03:52.763470 | instance |   "rc": 1,
2026-03-11 05:03:52.763493 | instance |   "start": "2026-03-11 05:01:03.874602"
2026-03-11 05:03:52.763513 | instance | }
failure
2026-03-11 05:03:52.771679 | 
2026-03-11 05:03:52.771743 | PLAY RECAP
2026-03-11 05:03:52.771804 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-03-11 05:03:52.771834 | 
2026-03-11 05:03:52.958514 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-11 05:03:52.970345 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-03-11 05:03:53.604329 | 
2026-03-11 05:03:53.604481 | PLAY [all]
2026-03-11 05:03:53.618698 | 
2026-03-11 05:03:53.618780 | TASK [gather-host-logs : creating directory for system status]
2026-03-11 05:03:53.966985 | instance | changed
2026-03-11 05:03:53.972392 | 
2026-03-11 05:03:53.972474 | TASK [gather-host-logs : Get logs for each host]
2026-03-11 05:03:54.303487 | instance | + systemd-cgls --full --all --no-pager
2026-03-11 05:03:54.315482 | instance | + ip addr
2026-03-11 05:03:54.318607 | instance | + ip route
2026-03-11 05:03:54.320639 | instance | + lsblk
2026-03-11 05:03:54.325136 | instance | + mount
2026-03-11 05:03:54.328308 | instance | + docker images
2026-03-11 05:03:54.328921 | instance | /bin/bash: line 7: docker: command not found
2026-03-11 05:03:54.329254 | instance | + brctl show
2026-03-11 05:03:54.329869 | instance | /bin/bash: line 8: brctl: command not found
2026-03-11 05:03:54.330160 | instance | + ps aux --sort=-%mem
2026-03-11 05:03:54.346294 | instance | + dpkg -l
2026-03-11 05:03:54.356773 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-03-11 05:03:54.357378 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-03-11 05:03:54.357417 | instance | /bin/bash: line 11: docker: command not found
2026-03-11 05:03:54.357843 | instance | + '[' '!' -z '' ']'
2026-03-11 05:03:54.512298 | instance | ok: Runtime: 0:00:00.060738
2026-03-11 05:03:54.521082 | 
2026-03-11 05:03:54.521152 | TASK [gather-host-logs : Downloads logs to executor]
2026-03-11 05:03:55.120135 | instance | changed:
2026-03-11 05:03:55.120308 | instance | created directory /var/lib/zuul/builds/972ac0a57596476bb1ad23a0b9c92137/work/logs/instance
2026-03-11 05:03:55.120346 | instance | cd+++++++++ system/
2026-03-11 05:03:55.120376 | instance | >f+++++++++ system/brctl-show.txt
2026-03-11 05:03:55.120405 | instance | >f+++++++++ system/docker-images.txt
2026-03-11 05:03:55.120432 | instance | >f+++++++++ system/ip-addr.txt
2026-03-11 05:03:55.120462 | instance | >f+++++++++ system/ip-route.txt
2026-03-11 05:03:55.120490 | instance | >f+++++++++ system/lsblk.txt
2026-03-11 05:03:55.120517 | instance | >f+++++++++ system/mount.txt
2026-03-11 05:03:55.120546 | instance | >f+++++++++ system/packages.txt
2026-03-11 05:03:55.120573 | instance | >f+++++++++ system/ps.txt
2026-03-11 05:03:55.120599 | instance | >f+++++++++ system/systemd-cgls.txt
2026-03-11 05:03:55.130883 | 
2026-03-11 05:03:55.131016 | LOOP [helm-release-status : creating directory for helm release status]
2026-03-11 05:03:55.329643 | instance | changed: "values"
2026-03-11 05:03:55.510759 | instance | changed: "releases"
2026-03-11 05:03:55.524571 | 
2026-03-11 05:03:55.524728 | TASK [helm-release-status : Gather get release status for helm charts]
2026-03-11 05:03:55.732445 | instance | /bin/bash: line 3: kubectl: command not found
2026-03-11 05:03:56.060288 | instance | ok: Runtime: 0:00:00.007358
2026-03-11 05:03:56.067724 | 
2026-03-11 05:03:56.067811 | TASK [helm-release-status : Downloads logs to executor]
2026-03-11 05:03:56.527427 | instance | changed:
2026-03-11 05:03:56.527592 | instance | cd+++++++++ helm/
2026-03-11 05:03:56.527629 | instance | cd+++++++++ helm/releases/
2026-03-11 05:03:56.527658 | instance | cd+++++++++ helm/values/
2026-03-11 05:03:56.538639 | 
2026-03-11 05:03:56.538705 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-03-11 05:03:56.736946 | instance | changed
2026-03-11 05:03:56.770567 | 
2026-03-11 05:03:56.770709 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-03-11 05:03:56.986733 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-11 05:03:56.986880 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-11 05:03:56.992338 | instance | environment: line 1: kubectl: command not found
2026-03-11 05:03:56.994416 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-11 05:03:56.994652 | instance | environment: line 1: kubectl: command not found
2026-03-11 05:03:56.996201 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-11 05:03:56.998425 | instance | environment: line 1: kubectl: command not found
2026-03-11 05:03:56.998879 | instance | environment: line 1: kubectl: command not found
2026-03-11 05:03:56.999629 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-11 05:03:57.000414 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-11 05:03:57.002594 | instance | environment: line 1: kubectl: command not found
2026-03-11 05:03:57.003951 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-11 05:03:57.309049 | instance | ok: Runtime: 0:00:00.028731
2026-03-11 05:03:57.314593 | 
2026-03-11 05:03:57.314660 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-03-11 05:03:57.508593 | instance | changed
2026-03-11 05:03:57.514706 | 
2026-03-11 05:03:57.514779 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-03-11 05:03:57.728262 | instance | environment: line 5: kubectl: command not found
2026-03-11 05:03:57.729090 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-11 05:03:57.729130 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-11 05:03:57.729651 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-11 05:03:58.052467 | instance | ok: Runtime: 0:00:00.009563
2026-03-11 05:03:58.058489 | 
2026-03-11 05:03:58.058557 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-03-11 05:03:58.516620 | instance | changed:
2026-03-11 05:03:58.516806 | instance | cd+++++++++ objects/
2026-03-11 05:03:58.516862 | instance | cd+++++++++ objects/cluster/
2026-03-11 05:03:58.516892 | instance | cd+++++++++ objects/namespaced/
2026-03-11 05:03:58.527053 | 
2026-03-11 05:03:58.527118 | TASK [gather-pod-logs : creating directory for pod logs]
2026-03-11 05:03:58.721450 | instance | changed
2026-03-11 05:03:58.726735 | 
2026-03-11 05:03:58.726795 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-03-11 05:03:58.920820 | instance | changed
2026-03-11 05:03:58.927045 | 
2026-03-11 05:03:58.927115 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-03-11 05:03:59.128678 | instance | environment: line 3: kubectl: command not found
2026-03-11 05:03:59.460332 | instance | ok: Runtime: 0:00:00.009565
2026-03-11 05:03:59.467188 | 
2026-03-11 05:03:59.467254 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-03-11 05:03:59.956549 | instance | changed:
2026-03-11 05:03:59.956699 | instance | cd+++++++++ pod-logs/
2026-03-11 05:03:59.956726 | instance | cd+++++++++ pod-logs/failed-pods/
2026-03-11 05:03:59.966265 | 
2026-03-11 05:03:59.966326 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-03-11 05:04:00.171328 | instance | changed
2026-03-11 05:04:00.177484 | 
2026-03-11 05:04:00.177555 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-03-11 05:04:00.385724 | instance | /bin/bash: line 2: kubectl: command not found
2026-03-11 05:04:00.715774 | instance | ok: Runtime: 0:00:00.037156
2026-03-11 05:04:00.721104 | 
2026-03-11 05:04:00.721176 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-03-11 05:04:00.918364 | instance | /bin/bash: line 2: kubectl: command not found
2026-03-11 05:04:00.947963 | instance | ceph-mgr endpoints:
2026-03-11 05:04:01.257154 | instance | ok: Runtime: 0:00:00.035012
2026-03-11 05:04:01.264502 | 
2026-03-11 05:04:01.264569 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-03-11 05:04:01.465422 | instance | /bin/bash: line 4: kubectl: command not found
2026-03-11 05:04:01.800227 | instance | ok: Runtime: 0:00:00.045890
2026-03-11 05:04:01.805687 | 
2026-03-11 05:04:01.805752 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-03-11 05:04:02.315146 | instance | changed: cd+++++++++ prometheus/
2026-03-11 05:04:02.324429 | 
2026-03-11 05:04:02.324498 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-03-11 05:04:02.549758 | instance | changed
2026-03-11 05:04:02.554607 | 
2026-03-11 05:04:02.554671 | TASK [gather-selenium-data : Get selenium data]
2026-03-11 05:04:02.748020 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-03-11 05:04:02.749602 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-03-11 05:04:03.090273 | instance | ERROR
2026-03-11 05:04:03.090541 | instance | {
2026-03-11 05:04:03.090611 | instance |   "delta": "0:00:00.006971",
2026-03-11 05:04:03.090660 | instance |   "end": "2026-03-11 05:04:02.750020",
2026-03-11 05:04:03.090704 | instance |   "msg": "non-zero return code",
2026-03-11 05:04:03.090745 | instance |   "rc": 1,
2026-03-11 05:04:03.090785 | instance |   "start": "2026-03-11 05:04:02.743049"
2026-03-11 05:04:03.090825 | instance | }
2026-03-11 05:04:03.090876 | instance | ERROR: Ignoring Errors
2026-03-11 05:04:03.097512 | 
2026-03-11 05:04:03.097577 | TASK [gather-selenium-data : Downloads logs to executor]
2026-03-11 05:04:03.566440 | instance | changed: cd+++++++++ selenium/
2026-03-11 05:04:03.571933 | 
2026-03-11 05:04:03.572422 | PLAY RECAP
2026-03-11 05:04:03.572472 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-03-11 05:04:03.572495 | 
2026-03-11 05:04:03.674909 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-03-11 05:04:03.687290 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-11 05:04:04.256235 | 
2026-03-11 05:04:04.256351 | PLAY [all]
2026-03-11 05:04:04.266972 | 
2026-03-11 05:04:04.267047 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-11 05:04:04.311194 | instance | skipping: Conditional result was False
2026-03-11 05:04:04.323050 | 
2026-03-11 05:04:04.323124 | TASK [fetch-output : Set log path for single node]
2026-03-11 05:04:04.364602 | instance | ok
2026-03-11 05:04:04.370829 | 
2026-03-11 05:04:04.370917 | LOOP [fetch-output : Ensure local output dirs]
2026-03-11 05:04:04.711744 | instance -> localhost | ok: "/var/lib/zuul/builds/972ac0a57596476bb1ad23a0b9c92137/work/logs"
2026-03-11 05:04:04.917247 | instance -> localhost | changed: "/var/lib/zuul/builds/972ac0a57596476bb1ad23a0b9c92137/work/artifacts"
2026-03-11 05:04:05.122015 | instance -> localhost | changed: "/var/lib/zuul/builds/972ac0a57596476bb1ad23a0b9c92137/work/docs"
2026-03-11 05:04:05.137504 | 
2026-03-11 05:04:05.137600 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-11 05:04:05.748105 | instance | changed: .d..t...... ./
2026-03-11 05:04:05.748333 | instance | changed: All items complete
2026-03-11 05:04:05.748374 | 
2026-03-11 05:04:06.176401 | instance | changed: .d..t...... ./
2026-03-11 05:04:06.608625 | instance | changed: .d..t...... ./
2026-03-11 05:04:06.628535 | 
2026-03-11 05:04:06.628641 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-11 05:04:07.040780 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.006736
2026-03-11 05:04:07.251129 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.006503
2026-03-11 05:04:07.267982 | 
2026-03-11 05:04:07.268080 | PLAY [all]
2026-03-11 05:04:07.274579 | 
2026-03-11 05:04:07.274639 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-11 05:04:07.672467 | instance | changed
2026-03-11 05:04:07.679611 | 
2026-03-11 05:04:07.679687 | PLAY RECAP
2026-03-11 05:04:07.679742 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-11 05:04:07.679770 | 
2026-03-11 05:04:07.818231 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-11 05:04:07.835442 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-03-11 05:04:08.417761 | 
2026-03-11 05:04:08.417884 | PLAY [localhost]
2026-03-11 05:04:08.427051 | 
2026-03-11 05:04:08.427122 | TASK [Generate Zuul manifest]
2026-03-11 05:04:08.444937 | localhost | ok
2026-03-11 05:04:08.459596 | 
2026-03-11 05:04:08.459671 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-11 05:04:08.803088 | localhost | changed
2026-03-11 05:04:08.813490 | 
2026-03-11 05:04:08.813566 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-11 05:04:08.844450 | localhost | ok
2026-03-11 05:04:08.851970 | 
2026-03-11 05:04:08.852035 | TASK [Upload logs]
2026-03-11 05:04:08.874497 | localhost | ok
2026-03-11 05:04:08.970972 | 
2026-03-11 05:04:08.971102 | TASK [Set zuul-log-path fact]
2026-03-11 05:04:08.990137 | localhost | ok
2026-03-11 05:04:09.004028 | 
2026-03-11 05:04:09.004095 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-11 05:04:09.035013 | localhost | ok
2026-03-11 05:04:09.046768 | 
2026-03-11 05:04:09.046832 | TASK [upload-logs : Create log directories]
2026-03-11 05:04:09.377296 | localhost | changed
2026-03-11 05:04:09.382870 | 
2026-03-11 05:04:09.382936 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-11 05:04:09.751703 | localhost -> localhost | ok: Runtime: 0:00:00.006422
2026-03-11 05:04:09.758256 | 
2026-03-11 05:04:09.758342 | TASK [upload-logs : Upload logs to log server]
2026-03-11 05:04:10.152116 | localhost | Output suppressed because no_log was given
2026-03-11 05:04:10.158070 | 
2026-03-11 05:04:10.158187 | LOOP [upload-logs : Compress console log and json output]
2026-03-11 05:04:10.201451 | localhost | skipping: Conditional result was False
2026-03-11 05:04:10.208316 | localhost | skipping: Conditional result was False
2026-03-11 05:04:10.222320 | 
2026-03-11 05:04:10.222519 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-11 05:04:10.266509 | localhost | skipping: Conditional result was False
2026-03-11 05:04:10.266861 | 
2026-03-11 05:04:10.270966 | localhost | skipping: Conditional result was False
2026-03-11 05:04:10.286805 | 
2026-03-11 05:04:10.287005 | LOOP [upload-logs : Upload console log and json output]