2026-03-18 12:38:23.111674 | Job console starting
2026-03-18 12:38:23.204298 | Updating git repos
2026-03-18 12:38:23.345136 | Cloning repos into workspace
2026-03-18 12:38:23.454871 | Restoring repo states
2026-03-18 12:38:23.521063 | Merging changes
2026-03-18 12:38:25.101156 | Checking out repos
2026-03-18 12:38:25.420745 | Preparing playbooks
2026-03-18 12:38:29.480263 | Running Ansible setup
2026-03-18 12:38:34.321006 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-18 12:38:34.975524 | 
2026-03-18 12:38:34.975736 | PLAY [localhost]
2026-03-18 12:38:34.985941 | 
2026-03-18 12:38:34.986054 | TASK [Gathering Facts]
2026-03-18 12:38:35.935971 | localhost | ok
2026-03-18 12:38:35.948333 | 
2026-03-18 12:38:35.948455 | TASK [Setup log path fact]
2026-03-18 12:38:35.970183 | localhost | ok
2026-03-18 12:38:35.983837 | 
2026-03-18 12:38:35.983946 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-18 12:38:36.011742 | localhost | ok
2026-03-18 12:38:36.017775 | 
2026-03-18 12:38:36.017840 | TASK [emit-job-header : Print job information]
2026-03-18 12:38:36.059509 | # Job Information
2026-03-18 12:38:36.059848 | Ansible Version: 2.16.16
2026-03-18 12:38:36.059965 | Job: atmosphere-molecule-csi-rbd
2026-03-18 12:38:36.060017 | Pipeline: check
2026-03-18 12:38:36.060061 | Executor: 0a8996d2b663
2026-03-18 12:38:36.060104 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3501
2026-03-18 12:38:36.060189 | Event ID: 22b80e80-22c7-11f1-9939-0f4f6e9b239e
2026-03-18 12:38:36.065807 | 
2026-03-18 12:38:36.065871 | LOOP [emit-job-header : Print node information]
2026-03-18 12:38:36.163047 | localhost | ok:
2026-03-18 12:38:36.163748 | localhost | # Node Information
2026-03-18 12:38:36.163795 | localhost | Inventory Hostname: instance
2026-03-18 12:38:36.163827 | localhost | Hostname: np0000159826
2026-03-18 12:38:36.163855 | localhost | Username: zuul
2026-03-18 12:38:36.163886 | localhost | Distro: Ubuntu 22.04
2026-03-18 12:38:36.163914 | localhost | Provider: yul1
2026-03-18 12:38:36.163940 | localhost | Region: ca-ymq-1
2026-03-18 12:38:36.163967 | localhost | Label: ubuntu-jammy
2026-03-18 12:38:36.163993 | localhost | Product Name: OpenStack Nova
2026-03-18 12:38:36.164018 | localhost | Interface IP: 199.204.45.102
2026-03-18 12:38:36.180176 | 
2026-03-18 12:38:36.180323 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-18 12:38:36.620601 | localhost -> localhost | changed
2026-03-18 12:38:36.632063 | 
2026-03-18 12:38:36.632170 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-18 12:38:37.584672 | localhost -> localhost | changed
2026-03-18 12:38:37.595753 | 
2026-03-18 12:38:37.595807 | PLAY [all]
2026-03-18 12:38:37.604289 | 
2026-03-18 12:38:37.604356 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-18 12:38:37.892613 | instance -> localhost | ok
2026-03-18 12:38:37.904696 | 
2026-03-18 12:38:37.904799 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-18 12:38:37.937954 | instance | ok
2026-03-18 12:38:37.953519 | instance | included: /var/lib/zuul/builds/89218bf8a5c1403bb3cda85f450e737c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-18 12:38:37.960727 | 
2026-03-18 12:38:37.960805 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-18 12:38:39.907040 | instance -> localhost | Generating public/private rsa key pair.
2026-03-18 12:38:39.907372 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/89218bf8a5c1403bb3cda85f450e737c/work/89218bf8a5c1403bb3cda85f450e737c_id_rsa
2026-03-18 12:38:39.907426 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/89218bf8a5c1403bb3cda85f450e737c/work/89218bf8a5c1403bb3cda85f450e737c_id_rsa.pub
2026-03-18 12:38:39.907455 | instance -> localhost | The key fingerprint is:
2026-03-18 12:38:39.907481 | instance -> localhost | SHA256:utqQTP7dkv+fcVdZoVkdbdCm9gSzDDzC6joiTgeBieU zuul-build-sshkey
2026-03-18 12:38:39.907527 | instance -> localhost | The key's randomart image is:
2026-03-18 12:38:39.907558 | instance -> localhost | +---[RSA 3072]----+
2026-03-18 12:38:39.907589 | instance -> localhost | |  .      . .  .*+|
2026-03-18 12:38:39.907616 | instance -> localhost | |.=        o + * B|
2026-03-18 12:38:39.907643 | instance -> localhost | |+ E      . . * B.|
2026-03-18 12:38:39.907671 | instance -> localhost | |   .    .     = +|
2026-03-18 12:38:39.907697 | instance -> localhost | |  . .  .S    . +.|
2026-03-18 12:38:39.907722 | instance -> localhost | |   = . ..       o|
2026-03-18 12:38:39.907747 | instance -> localhost | |  . * .. .    . o|
2026-03-18 12:38:39.907771 | instance -> localhost | | ....+ooo.     +.|
2026-03-18 12:38:39.907799 | instance -> localhost | | ....o+..oo...o  |
2026-03-18 12:38:39.907825 | instance -> localhost | +----[SHA256]-----+
2026-03-18 12:38:39.907916 | instance -> localhost | ok: Runtime: 0:00:01.501934
2026-03-18 12:38:39.913893 | 
2026-03-18 12:38:39.913975 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-18 12:38:39.945155 | instance | ok
2026-03-18 12:38:39.969825 | instance | included: /var/lib/zuul/builds/89218bf8a5c1403bb3cda85f450e737c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-18 12:38:39.980313 | 
2026-03-18 12:38:39.980399 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-18 12:38:40.006034 | instance | skipping: Conditional result was False
2026-03-18 12:38:40.015650 | 
2026-03-18 12:38:40.015779 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-18 12:38:40.516885 | instance | changed
2026-03-18 12:38:40.524425 | 
2026-03-18 12:38:40.524584 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-18 12:38:40.725415 | instance | ok
2026-03-18 12:38:40.732261 | 
2026-03-18 12:38:40.732348 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-18 12:38:41.231359 | instance | changed
2026-03-18 12:38:41.239932 | 
2026-03-18 12:38:41.289216 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-18 12:38:41.773537 | instance | changed
2026-03-18 12:38:41.779905 | 
2026-03-18 12:38:41.779982 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-18 12:38:41.804935 | instance | skipping: Conditional result was False
2026-03-18 12:38:41.815489 | 
2026-03-18 12:38:41.815681 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-18 12:38:42.225721 | instance -> localhost | changed
2026-03-18 12:38:42.241551 | 
2026-03-18 12:38:42.241685 | TASK [add-build-sshkey : Add back temp key]
2026-03-18 12:38:42.537071 | instance -> localhost | Identity added: /var/lib/zuul/builds/89218bf8a5c1403bb3cda85f450e737c/work/89218bf8a5c1403bb3cda85f450e737c_id_rsa (zuul-build-sshkey)
2026-03-18 12:38:42.537302 | instance -> localhost | ok: Runtime: 0:00:00.018395
2026-03-18 12:38:42.544591 | 
2026-03-18 12:38:42.544662 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-18 12:38:42.862606 | instance | ok
2026-03-18 12:38:42.867391 | 
2026-03-18 12:38:42.867451 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-18 12:38:42.892118 | instance | skipping: Conditional result was False
2026-03-18 12:38:42.921793 | 
2026-03-18 12:38:42.929568 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-18 12:38:43.276740 | instance | ok
2026-03-18 12:38:43.285001 | 
2026-03-18 12:38:43.285083 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-18 12:38:45.013217 | instance | Output suppressed because no_log was given
2026-03-18 12:38:45.024659 | 
2026-03-18 12:38:45.024750 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-18 12:38:45.225808 | instance | ok: "logs"
2026-03-18 12:38:45.226125 | instance | ok: All items complete
2026-03-18 12:38:45.226167 | 
2026-03-18 12:38:45.397565 | instance | ok: "artifacts"
2026-03-18 12:38:45.560896 | instance | ok: "docs"
2026-03-18 12:38:45.576851 | 
2026-03-18 12:38:45.577140 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-18 12:38:45.792309 | instance | changed: "logs"
2026-03-18 12:38:45.950904 | instance | changed: "artifacts"
2026-03-18 12:38:46.125597 | instance | changed: "docs"
2026-03-18 12:38:46.139649 | 
2026-03-18 12:38:46.139797 | PLAY RECAP
2026-03-18 12:38:46.139846 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-18 12:38:46.139874 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-18 12:38:46.139898 | 
2026-03-18 12:38:46.283555 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-18 12:38:46.288719 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-18 12:38:46.898730 | 
2026-03-18 12:38:46.898876 | PLAY [all]
2026-03-18 12:38:46.910468 | 
2026-03-18 12:38:46.957102 | TASK [setup-uv : Extract archive]
2026-03-18 12:38:49.566205 | instance | changed
2026-03-18 12:38:49.747948 | 
2026-03-18 12:38:49.748078 | TASK [setup-uv : Print version]
2026-03-18 12:38:50.132371 | instance | uv 0.8.13
2026-03-18 12:38:50.290802 | instance | ok: Runtime: 0:00:00.022209
2026-03-18 12:38:50.300193 | 
2026-03-18 12:38:50.300307 | PLAY RECAP
2026-03-18 12:38:50.300367 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-18 12:38:50.300393 | 
2026-03-18 12:38:50.432407 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-18 12:38:50.436669 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-03-18 12:38:51.103716 | 
2026-03-18 12:38:51.103863 | PLAY [all]
2026-03-18 12:38:51.116449 | 
2026-03-18 12:38:51.116551 | TASK [Install "jq" for log collection]
2026-03-18 12:39:08.820495 | instance | ERROR
2026-03-18 12:39:08.820741 | instance | {
2026-03-18 12:39:08.820779 | instance |   "cache_update_time": 1773837537,
2026-03-18 12:39:08.820808 | instance |   "cache_updated": true,
2026-03-18 12:39:08.820861 | instance |   "msg": "'/usr/bin/apt-get -y -o \"Dpkg::Options::=--force-confdef\" -o \"Dpkg::Options::=--force-confold\"       install 'jq=1.6-2.1ubuntu3.1'' failed: E: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/libo/libonig/libonig5_6.9.7.1-2build1_amd64.deb  503  Service Unavailable [IP: 91.189.91.94 80]\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n",
2026-03-18 12:39:08.820887 | instance |   "rc": 100
2026-03-18 12:39:08.820908 | instance | }
failure
2026-03-18 12:39:08.822418 | 
2026-03-18 12:39:08.822472 | PLAY RECAP
2026-03-18 12:39:08.822521 | instance | ok: 0 changed: 0 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-03-18 12:39:08.822543 | 
2026-03-18 12:39:08.932700 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-03-18 12:39:08.935997 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-03-18 12:39:09.610712 | 
2026-03-18 12:39:09.610856 | PLAY [all]
2026-03-18 12:39:09.625071 | 
2026-03-18 12:39:09.625179 | TASK [gather-host-logs : creating directory for system status]
2026-03-18 12:39:09.974873 | instance | changed
2026-03-18 12:39:09.980515 | 
2026-03-18 12:39:09.980599 | TASK [gather-host-logs : Get logs for each host]
2026-03-18 12:39:10.357317 | instance | + systemd-cgls --full --all --no-pager
2026-03-18 12:39:10.367432 | instance | + ip addr
2026-03-18 12:39:10.370737 | instance | + ip route
2026-03-18 12:39:10.373137 | instance | + lsblk
2026-03-18 12:39:10.376370 | instance | + mount
2026-03-18 12:39:10.378294 | instance | + docker images
2026-03-18 12:39:10.378697 | instance | /bin/bash: line 7: docker: command not found
2026-03-18 12:39:10.378884 | instance | + brctl show
2026-03-18 12:39:10.379175 | instance | /bin/bash: line 8: brctl: command not found
2026-03-18 12:39:10.379321 | instance | + ps aux --sort=-%mem
2026-03-18 12:39:10.392956 | instance | + dpkg -l
2026-03-18 12:39:10.401238 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-03-18 12:39:10.401582 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-03-18 12:39:10.401658 | instance | /bin/bash: line 11: docker: command not found
2026-03-18 12:39:10.402089 | instance | + '[' '!' -z '' ']'
2026-03-18 12:39:10.560636 | instance | ok: Runtime: 0:00:00.050737
2026-03-18 12:39:10.568242 | 
2026-03-18 12:39:10.568326 | TASK [gather-host-logs : Downloads logs to executor]
2026-03-18 12:39:11.217743 | instance | changed:
2026-03-18 12:39:11.217925 | instance | created directory /var/lib/zuul/builds/89218bf8a5c1403bb3cda85f450e737c/work/logs/instance
2026-03-18 12:39:11.217955 | instance | cd+++++++++ system/
2026-03-18 12:39:11.217977 | instance | >f+++++++++ system/brctl-show.txt
2026-03-18 12:39:11.217997 | instance | >f+++++++++ system/docker-images.txt
2026-03-18 12:39:11.218017 | instance | >f+++++++++ system/ip-addr.txt
2026-03-18 12:39:11.218040 | instance | >f+++++++++ system/ip-route.txt
2026-03-18 12:39:11.218061 | instance | >f+++++++++ system/lsblk.txt
2026-03-18 12:39:11.218081 | instance | >f+++++++++ system/mount.txt
2026-03-18 12:39:11.218102 | instance | >f+++++++++ system/packages.txt
2026-03-18 12:39:11.218122 | instance | >f+++++++++ system/ps.txt
2026-03-18 12:39:11.218142 | instance | >f+++++++++ system/systemd-cgls.txt
2026-03-18 12:39:11.228939 | 
2026-03-18 12:39:11.229049 | LOOP [helm-release-status : creating directory for helm release status]
2026-03-18 12:39:11.434968 | instance | changed: "values"
2026-03-18 12:39:11.618944 | instance | changed: "releases"
2026-03-18 12:39:11.638449 | 
2026-03-18 12:39:11.638626 | TASK [helm-release-status : Gather get release status for helm charts]
2026-03-18 12:39:11.850995 | instance | /bin/bash: line 3: kubectl: command not found
2026-03-18 12:39:12.178138 | instance | ok: Runtime: 0:00:00.006939
2026-03-18 12:39:12.185875 | 
2026-03-18 12:39:12.185972 | TASK [helm-release-status : Downloads logs to executor]
2026-03-18 12:39:12.732141 | instance | changed:
2026-03-18 12:39:12.732406 | instance | cd+++++++++ helm/
2026-03-18 12:39:12.732447 | instance | cd+++++++++ helm/releases/
2026-03-18 12:39:12.732479 | instance | cd+++++++++ helm/values/
2026-03-18 12:39:12.743768 | 
2026-03-18 12:39:12.743848 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-03-18 12:39:12.958485 | instance | changed
2026-03-18 12:39:12.966709 | 
2026-03-18 12:39:12.966802 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-03-18 12:39:13.183969 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-18 12:39:13.184087 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-18 12:39:13.188793 | instance | environment: line 1: kubectl: command not found
2026-03-18 12:39:13.189751 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-18 12:39:13.190478 | instance | environment: line 1: kubectl: command not found
2026-03-18 12:39:13.191860 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-18 12:39:13.193074 | instance | environment: line 1: kubectl: command not found
2026-03-18 12:39:13.195001 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-18 12:39:13.196453 | instance | environment: line 1: kubectl: command not found
2026-03-18 12:39:13.197390 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-18 12:39:13.197933 | instance | environment: line 1: kubectl: command not found
2026-03-18 12:39:13.198755 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-18 12:39:13.507598 | instance | ok: Runtime: 0:00:00.025854
2026-03-18 12:39:13.514915 | 
2026-03-18 12:39:13.515044 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-03-18 12:39:13.719843 | instance | changed
2026-03-18 12:39:13.724899 | 
2026-03-18 12:39:13.725028 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-03-18 12:39:13.980142 | instance | environment: line 5: kubectl: command not found
2026-03-18 12:39:13.981198 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-18 12:39:13.981427 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-18 12:39:13.981719 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-18 12:39:14.309667 | instance | ok: Runtime: 0:00:00.009989
2026-03-18 12:39:14.317768 | 
2026-03-18 12:39:14.317888 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-03-18 12:39:14.818920 | instance | changed:
2026-03-18 12:39:14.819121 | instance | cd+++++++++ objects/
2026-03-18 12:39:14.819159 | instance | cd+++++++++ objects/cluster/
2026-03-18 12:39:14.819188 | instance | cd+++++++++ objects/namespaced/
2026-03-18 12:39:14.830075 | 
2026-03-18 12:39:14.830139 | TASK [gather-pod-logs : creating directory for pod logs]
2026-03-18 12:39:15.035552 | instance | changed
2026-03-18 12:39:15.040920 | 
2026-03-18 12:39:15.041041 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-03-18 12:39:15.260007 | instance | changed
2026-03-18 12:39:15.267153 | 
2026-03-18 12:39:15.267259 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-03-18 12:39:15.485462 | instance | environment: line 3: kubectl: command not found
2026-03-18 12:39:15.813985 | instance | ok: Runtime: 0:00:00.010102
2026-03-18 12:39:15.825599 | 
2026-03-18 12:39:15.825736 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-03-18 12:39:16.347596 | instance | changed:
2026-03-18 12:39:16.347868 | instance | cd+++++++++ pod-logs/
2026-03-18 12:39:16.347920 | instance | cd+++++++++ pod-logs/failed-pods/
2026-03-18 12:39:16.367525 | 
2026-03-18 12:39:16.367683 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-03-18 12:39:16.578002 | instance | changed
2026-03-18 12:39:16.584638 | 
2026-03-18 12:39:16.584716 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-03-18 12:39:16.826798 | instance | /bin/bash: line 2: kubectl: command not found
2026-03-18 12:39:16.827133 | instance | /bin/bash: line 2: jq: command not found
2026-03-18 12:39:17.130663 | instance | ERROR
2026-03-18 12:39:17.130945 | instance | {
2026-03-18 12:39:17.131000 | instance |   "delta": "0:00:00.007546",
2026-03-18 12:39:17.131034 | instance |   "end": "2026-03-18 12:39:16.828235",
2026-03-18 12:39:17.131062 | instance |   "msg": "non-zero return code",
2026-03-18 12:39:17.131098 | instance |   "rc": 127,
2026-03-18 12:39:17.131127 | instance |   "start": "2026-03-18 12:39:16.820689"
2026-03-18 12:39:17.131153 | instance | }
2026-03-18 12:39:17.131196 | instance | ERROR: Ignoring Errors
2026-03-18 12:39:17.136831 | 
2026-03-18 12:39:17.136907 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-03-18 12:39:17.354853 | instance | /bin/bash: line 2: kubectl: command not found
2026-03-18 12:39:17.355109 | instance | /bin/bash: line 2: jq: command not found
2026-03-18 12:39:17.675325 | instance | ERROR
2026-03-18 12:39:17.675580 | instance | {
2026-03-18 12:39:17.675626 | instance |   "delta": "0:00:00.007994",
2026-03-18 12:39:17.675673 | instance |   "end": "2026-03-18 12:39:17.356414",
2026-03-18 12:39:17.675721 | instance |   "msg": "non-zero return code",
2026-03-18 12:39:17.675758 | instance |   "rc": 127,
2026-03-18 12:39:17.675788 | instance |   "start": "2026-03-18 12:39:17.348420"
2026-03-18 12:39:17.675816 | instance | }
2026-03-18 12:39:17.675856 | instance | ERROR: Ignoring Errors
2026-03-18 12:39:17.685500 | 
2026-03-18 12:39:17.685603 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-03-18 12:39:17.893716 | instance | /bin/bash: line 4: kubectl: command not found
2026-03-18 12:39:17.893933 | instance | /bin/bash: line 4: jq: command not found
2026-03-18 12:39:18.219847 | instance | ERROR
2026-03-18 12:39:18.220034 | instance | {
2026-03-18 12:39:18.220064 | instance |   "delta": "0:00:00.008096",
2026-03-18 12:39:18.220084 | instance |   "end": "2026-03-18 12:39:17.895043",
2026-03-18 12:39:18.220103 | instance |   "msg": "non-zero return code",
2026-03-18 12:39:18.220121 | instance |   "rc": 127,
2026-03-18 12:39:18.220138 | instance |   "start": "2026-03-18 12:39:17.886947"
2026-03-18 12:39:18.220156 | instance | }
2026-03-18 12:39:18.220179 | instance | ERROR: Ignoring Errors
2026-03-18 12:39:18.228431 | 
2026-03-18 12:39:18.228595 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-03-18 12:39:18.757885 | instance | changed: cd+++++++++ prometheus/
2026-03-18 12:39:18.771807 | 
2026-03-18 12:39:18.771965 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-03-18 12:39:18.981386 | instance | changed
2026-03-18 12:39:18.986420 | 
2026-03-18 12:39:18.986486 | TASK [gather-selenium-data : Get selenium data]
2026-03-18 12:39:19.195963 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-03-18 12:39:19.197523 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-03-18 12:39:19.521997 | instance | ERROR
2026-03-18 12:39:19.522325 | instance | {
2026-03-18 12:39:19.522389 | instance |   "delta": "0:00:00.006901",
2026-03-18 12:39:19.522435 | instance |   "end": "2026-03-18 12:39:19.197938",
2026-03-18 12:39:19.522475 | instance |   "msg": "non-zero return code",
2026-03-18 12:39:19.522515 | instance |   "rc": 1,
2026-03-18 12:39:19.522554 | instance |   "start": "2026-03-18 12:39:19.191037"
2026-03-18 12:39:19.522593 | instance | }
2026-03-18 12:39:19.522642 | instance | ERROR: Ignoring Errors
2026-03-18 12:39:19.529906 | 
2026-03-18 12:39:19.529997 | TASK [gather-selenium-data : Downloads logs to executor]
2026-03-18 12:39:20.079675 | instance | changed: cd+++++++++ selenium/
2026-03-18 12:39:20.085570 | 
2026-03-18 12:39:20.085641 | PLAY RECAP
2026-03-18 12:39:20.085684 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 4
2026-03-18 12:39:20.085705 | 
2026-03-18 12:39:20.242722 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-03-18 12:39:20.247277 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-18 12:39:20.858990 | 
2026-03-18 12:39:20.859137 | PLAY [all]
2026-03-18 12:39:20.871369 | 
2026-03-18 12:39:20.871450 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-18 12:39:20.916689 | instance | skipping: Conditional result was False
2026-03-18 12:39:20.925939 | 
2026-03-18 12:39:20.926047 | TASK [fetch-output : Set log path for single node]
2026-03-18 12:39:20.969587 | instance | ok
2026-03-18 12:39:20.976069 | 
2026-03-18 12:39:20.976139 | LOOP [fetch-output : Ensure local output dirs]
2026-03-18 12:39:21.388285 | instance -> localhost | ok: "/var/lib/zuul/builds/89218bf8a5c1403bb3cda85f450e737c/work/logs"
2026-03-18 12:39:21.620542 | instance -> localhost | changed: "/var/lib/zuul/builds/89218bf8a5c1403bb3cda85f450e737c/work/artifacts"
2026-03-18 12:39:21.829191 | instance -> localhost | changed: "/var/lib/zuul/builds/89218bf8a5c1403bb3cda85f450e737c/work/docs"
2026-03-18 12:39:21.847722 | 
2026-03-18 12:39:21.847887 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-18 12:39:22.487708 | instance | changed: .d..t...... ./
2026-03-18 12:39:22.487981 | instance | changed: All items complete
2026-03-18 12:39:22.488021 | 
2026-03-18 12:39:22.941204 | instance | changed: .d..t...... ./
2026-03-18 12:39:23.398957 | instance | changed: .d..t...... ./
2026-03-18 12:39:23.417182 | 
2026-03-18 12:39:23.417342 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-18 12:39:23.883215 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.006163
2026-03-18 12:39:24.125663 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.008519
2026-03-18 12:39:24.140739 | 
2026-03-18 12:39:24.140896 | PLAY [all]
2026-03-18 12:39:24.149684 | 
2026-03-18 12:39:24.149789 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-18 12:39:25.140041 | instance | changed
2026-03-18 12:39:25.148357 | 
2026-03-18 12:39:25.148413 | PLAY RECAP
2026-03-18 12:39:25.148459 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-18 12:39:25.148481 | 
2026-03-18 12:39:25.269005 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-18 12:39:25.274686 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-03-18 12:39:25.876490 | 
2026-03-18 12:39:25.876679 | PLAY [localhost]
2026-03-18 12:39:25.888755 | 
2026-03-18 12:39:25.888918 | TASK [Generate Zuul manifest]
2026-03-18 12:39:25.913093 | localhost | ok
2026-03-18 12:39:25.933943 | 
2026-03-18 12:39:25.961225 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-18 12:39:26.307707 | localhost | changed
2026-03-18 12:39:26.319407 | 
2026-03-18 12:39:26.319588 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-18 12:39:26.393772 | localhost | ok
2026-03-18 12:39:26.402344 | 
2026-03-18 12:39:26.402428 | TASK [Upload logs]
2026-03-18 12:39:26.436357 | localhost | ok
2026-03-18 12:39:26.497368 | 
2026-03-18 12:39:26.525661 | TASK [Set zuul-log-path fact]
2026-03-18 12:39:26.548276 | localhost | ok
2026-03-18 12:39:26.563348 | 
2026-03-18 12:39:26.580697 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-18 12:39:26.616790 | localhost | ok
2026-03-18 12:39:26.625763 | 
2026-03-18 12:39:26.625841 | TASK [upload-logs : Create log directories]
2026-03-18 12:39:27.037849 | localhost | changed
2026-03-18 12:39:27.044174 | 
2026-03-18 12:39:27.044275 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-18 12:39:27.493014 | localhost -> localhost | ok: Runtime: 0:00:00.007588
2026-03-18 12:39:27.499539 | 
2026-03-18 12:39:27.499614 | TASK [upload-logs : Upload logs to log server]
2026-03-18 12:39:28.664076 | localhost | Output suppressed because no_log was given
2026-03-18 12:39:28.669128 | 
2026-03-18 12:39:28.669195 | LOOP [upload-logs : Compress console log and json output]
2026-03-18 12:39:28.715817 | localhost | skipping: Conditional result was False
2026-03-18 12:39:28.723831 | localhost | skipping: Conditional result was False
2026-03-18 12:39:28.733448 | 
2026-03-18 12:39:28.733613 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-18 12:39:28.785068 | localhost | skipping: Conditional result was False
2026-03-18 12:39:28.785579 | 
2026-03-18 12:39:28.789674 | localhost | skipping: Conditional result was False
2026-03-18 12:39:28.807724 | 
2026-03-18 12:39:28.807864 | LOOP [upload-logs : Upload console log and json output]