2026-07-21 02:47:36.622010 | Job console starting
2026-07-21 02:47:36.632806 | Updating git repos
2026-07-21 02:47:38.392758 | Cloning repos into workspace
2026-07-21 02:47:44.048109 | Restoring repo states
2026-07-21 02:47:45.541996 | Merging changes
2026-07-21 02:47:46.058289 | Checking out repos
2026-07-21 02:47:50.251172 | Preparing playbooks
2026-07-21 02:48:36.899525 | Running Ansible setup
2026-07-21 02:48:43.242230 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-07-21 02:48:43.925560 | 
2026-07-21 02:48:43.925762 | PLAY [localhost]
2026-07-21 02:48:43.934785 | 
2026-07-21 02:48:43.934890 | TASK [Gathering Facts]
2026-07-21 02:48:44.990700 | localhost | ok
2026-07-21 02:48:45.002455 | 
2026-07-21 02:48:45.002565 | TASK [Setup log path fact]
2026-07-21 02:48:45.027152 | localhost | ok
2026-07-21 02:48:46.903937 | 
2026-07-21 02:48:46.904077 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-07-21 02:48:46.932397 | localhost | ok
2026-07-21 02:48:46.940088 | 
2026-07-21 02:48:46.940171 | TASK [emit-job-header : Print job information]
2026-07-21 02:48:46.979137 | # Job Information
2026-07-21 02:48:46.979284 | Ansible Version: 2.16.18
2026-07-21 02:48:46.979319 | Job: magnum-cluster-api-hydrophone-v1.34.8-cilium
2026-07-21 02:48:46.979343 | Pipeline: check
2026-07-21 02:48:46.979366 | Executor: 2d72f0692154
2026-07-21 02:48:46.979387 | Triggered by: https://github.com/vexxhost/magnum-cluster-api/pull/1109
2026-07-21 02:48:46.979412 | Event ID: 1cf10710-84ae-11f1-958c-add38e59e7a3
2026-07-21 02:48:46.982606 | 
2026-07-21 02:48:46.982677 | LOOP [emit-job-header : Print node information]
2026-07-21 02:48:47.927547 | localhost | ok:
2026-07-21 02:48:47.927792 | localhost | # Node Information
2026-07-21 02:48:47.927845 | localhost | Inventory Hostname: controller
2026-07-21 02:48:47.927881 | localhost | Hostname: np0000185939
2026-07-21 02:48:47.927934 | localhost | Username: zuul
2026-07-21 02:48:47.927998 | localhost | Distro: Ubuntu 24.04
2026-07-21 02:48:47.928074 | localhost | Provider: yul1
2026-07-21 02:48:47.928116 | localhost | Region: ca-ymq-1
2026-07-21 02:48:47.928153 | localhost | Label: ubuntu-noble-16
2026-07-21 02:48:47.928190 | localhost | Product Name: OpenStack Nova
2026-07-21 02:48:47.928226 | localhost | Interface IP: 199.19.213.241
2026-07-21 02:48:47.938546 | 
2026-07-21 02:48:47.938764 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-07-21 02:48:48.423250 | localhost -> localhost | changed
2026-07-21 02:48:48.428730 | 
2026-07-21 02:48:48.428820 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-07-21 02:48:49.513892 | localhost -> localhost | changed
2026-07-21 02:48:49.524697 | 
2026-07-21 02:48:49.524755 | PLAY [all]
2026-07-21 02:48:49.532832 | 
2026-07-21 02:48:49.532899 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-07-21 02:48:49.772178 | controller -> localhost | ok
2026-07-21 02:48:49.782602 | 
2026-07-21 02:48:49.782695 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-07-21 02:48:49.818770 | controller | ok
2026-07-21 02:48:49.832097 | controller | included: /var/lib/zuul/builds/8fb8207e33a54e199f5cb923b2f64a1d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-07-21 02:48:49.838176 | 
2026-07-21 02:48:49.838235 | TASK [add-build-sshkey : Create Temp SSH key]
2026-07-21 02:48:51.288411 | controller -> localhost | Generating public/private rsa key pair.
2026-07-21 02:48:51.288624 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/8fb8207e33a54e199f5cb923b2f64a1d/work/8fb8207e33a54e199f5cb923b2f64a1d_id_rsa
2026-07-21 02:48:51.288669 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/8fb8207e33a54e199f5cb923b2f64a1d/work/8fb8207e33a54e199f5cb923b2f64a1d_id_rsa.pub
2026-07-21 02:48:51.288704 | controller -> localhost | The key fingerprint is:
2026-07-21 02:48:51.288737 | controller -> localhost | SHA256:HvyRN3ltjSLfuH/HmfmBCK/NhYXTk9K/GiX6NusM3Nc zuul-build-sshkey
2026-07-21 02:48:51.288785 | controller -> localhost | The key's randomart image is:
2026-07-21 02:48:51.288820 | controller -> localhost | +---[RSA 3072]----+
2026-07-21 02:48:51.288858 | controller -> localhost | |                 |
2026-07-21 02:48:51.288892 | controller -> localhost | |                 |
2026-07-21 02:48:51.288923 | controller -> localhost | |                 |
2026-07-21 02:48:51.288955 | controller -> localhost | |       .   .+..o.|
2026-07-21 02:48:51.289025 | controller -> localhost | |        S.++=Bo.+|
2026-07-21 02:48:51.289067 | controller -> localhost | |       . o+=O**..|
2026-07-21 02:48:51.289098 | controller -> localhost | |        . .Bo=.=E|
2026-07-21 02:48:51.289128 | controller -> localhost | |          + =+o+*|
2026-07-21 02:48:51.289164 | controller -> localhost | |         . o+B=o+|
2026-07-21 02:48:51.289194 | controller -> localhost | +----[SHA256]-----+
2026-07-21 02:48:51.289266 | controller -> localhost | ok: Runtime: 0:00:00.999819
2026-07-21 02:48:51.296647 | 
2026-07-21 02:48:51.296721 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-07-21 02:48:51.330704 | controller | ok
2026-07-21 02:48:51.341677 | controller | included: /var/lib/zuul/builds/8fb8207e33a54e199f5cb923b2f64a1d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-07-21 02:48:51.350347 | 
2026-07-21 02:48:51.350429 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-07-21 02:48:51.366797 | controller | skipping: Conditional result was False
2026-07-21 02:48:51.377301 | 
2026-07-21 02:48:51.377439 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-07-21 02:48:51.943803 | controller | changed
2026-07-21 02:48:51.952741 | 
2026-07-21 02:48:51.952864 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-07-21 02:48:52.171060 | controller | ok
2026-07-21 02:48:52.177056 | 
2026-07-21 02:48:52.177137 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-07-21 02:48:52.737438 | controller | changed
2026-07-21 02:48:52.743960 | 
2026-07-21 02:48:52.744051 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-07-21 02:48:53.413214 | controller | changed
2026-07-21 02:48:53.418647 | 
2026-07-21 02:48:53.418711 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-07-21 02:48:53.443583 | controller | skipping: Conditional result was False
2026-07-21 02:48:53.454154 | 
2026-07-21 02:48:53.454246 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-07-21 02:48:53.779036 | controller -> localhost | changed
2026-07-21 02:48:53.795025 | 
2026-07-21 02:48:53.795102 | TASK [add-build-sshkey : Add back temp key]
2026-07-21 02:48:54.232828 | controller -> localhost | Identity added: /var/lib/zuul/builds/8fb8207e33a54e199f5cb923b2f64a1d/work/8fb8207e33a54e199f5cb923b2f64a1d_id_rsa (zuul-build-sshkey)
2026-07-21 02:48:54.233369 | controller -> localhost | ok: Runtime: 0:00:00.160190
2026-07-21 02:48:54.242526 | 
2026-07-21 02:48:54.242621 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-07-21 02:48:54.542805 | controller | ok
2026-07-21 02:48:54.548779 | 
2026-07-21 02:48:54.548850 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-07-21 02:48:54.574070 | controller | skipping: Conditional result was False
2026-07-21 02:48:54.592709 | 
2026-07-21 02:48:54.592855 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-07-21 02:48:54.905647 | controller | ok
2026-07-21 02:48:54.913038 | 
2026-07-21 02:48:54.913107 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-07-21 02:49:37.955129 | controller | Output suppressed because no_log was given
2026-07-21 02:49:37.968588 | 
2026-07-21 02:49:37.968740 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-07-21 02:49:38.200596 | controller | ok: "logs"
2026-07-21 02:49:38.200853 | controller | ok: All items complete
2026-07-21 02:49:38.200890 | 
2026-07-21 02:49:38.384251 | controller | ok: "artifacts"
2026-07-21 02:49:38.584094 | controller | ok: "docs"
2026-07-21 02:49:38.595546 | 
2026-07-21 02:49:38.595727 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-07-21 02:49:38.817345 | controller | changed: "logs"
2026-07-21 02:49:39.353318 | controller | changed: "artifacts"
2026-07-21 02:49:39.564141 | controller | changed: "docs"
2026-07-21 02:49:39.581150 | 
2026-07-21 02:49:39.581292 | PLAY RECAP
2026-07-21 02:49:39.581365 | controller | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-07-21 02:49:39.581410 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-21 02:49:39.581442 | 
2026-07-21 02:49:39.761924 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-07-21 02:49:39.769207 | PRE-RUN START: [untrusted : opendev.org/openstack/devstack/playbooks/pre.yaml@master]
2026-07-21 02:49:40.474771 | 
2026-07-21 02:49:40.475001 | PLAY [all]
2026-07-21 02:49:40.496592 | 
2026-07-21 02:49:40.496817 | TASK [Fix the permissions of the zuul home directory]
2026-07-21 02:53:55.513411 | controller | ERROR
2026-07-21 02:53:55.514150 | controller | {
2026-07-21 02:53:55.514195 | controller |   "msg": "Data could not be sent to remote host \"199.19.213.241\". Make sure this host can be reached over ssh: ssh: connect to host 199.19.213.241 port 22: No route to host\r\n",
2026-07-21 02:53:55.514229 | controller |   "unreachable": true
2026-07-21 02:53:55.514278 | controller | }
unreachable
2026-07-21 02:53:55.515136 | 
2026-07-21 02:53:55.515179 | PLAY RECAP
2026-07-21 02:53:55.515222 | controller | ok: 0 changed: 0 unreachable: 1 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-21 02:53:55.515245 | 
2026-07-21 02:53:55.675493 | PRE-RUN END RESULT_UNREACHABLE: [untrusted : opendev.org/openstack/devstack/playbooks/pre.yaml@master]
2026-07-21 02:53:55.688217 | POST-RUN START: [untrusted : opendev.org/openstack/devstack/playbooks/post.yaml@master]
2026-07-21 02:53:56.451434 | 
2026-07-21 02:53:56.451601 | PLAY [all]
2026-07-21 02:53:56.480946 | 
2026-07-21 02:53:56.481177 | TASK [export-devstack-journal : Ensure /home/zuul/logs exists]
2026-07-21 02:54:12.982835 | controller | ERROR
2026-07-21 02:54:12.983195 | controller | {
2026-07-21 02:54:12.983270 | controller |   "msg": "Data could not be sent to remote host \"199.19.213.241\". Make sure this host can be reached over ssh: ssh: connect to host 199.19.213.241 port 22: No route to host\r\n",
2026-07-21 02:54:12.983319 | controller |   "unreachable": true
2026-07-21 02:54:12.983392 | controller | }
unreachable
2026-07-21 02:54:12.984660 | 
2026-07-21 02:54:12.984783 | PLAY RECAP
2026-07-21 02:54:12.984852 | controller | ok: 0 changed: 0 unreachable: 1 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-07-21 02:54:12.984886 | 
2026-07-21 02:54:13.166593 | POST-RUN END RESULT_UNREACHABLE: [untrusted : opendev.org/openstack/devstack/playbooks/post.yaml@master]
2026-07-21 02:54:13.177555 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-07-21 02:54:13.948777 | 
2026-07-21 02:54:13.949035 | PLAY [all]
2026-07-21 02:54:13.965590 | 
2026-07-21 02:54:13.965775 | TASK [fetch-output : Set log path for multiple nodes]
2026-07-21 02:54:14.012299 | controller | skipping: Conditional result was False
2026-07-21 02:54:14.026444 | 
2026-07-21 02:54:14.026686 | TASK [fetch-output : Set log path for single node]
2026-07-21 02:54:14.071476 | controller | ok
2026-07-21 02:54:14.078936 | 
2026-07-21 02:54:14.079051 | LOOP [fetch-output : Ensure local output dirs]
2026-07-21 02:54:14.497374 | controller -> localhost | ok: "/var/lib/zuul/builds/8fb8207e33a54e199f5cb923b2f64a1d/work/logs"
2026-07-21 02:54:14.719647 | controller -> localhost | changed: "/var/lib/zuul/builds/8fb8207e33a54e199f5cb923b2f64a1d/work/artifacts"
2026-07-21 02:54:14.946381 | controller -> localhost | changed: "/var/lib/zuul/builds/8fb8207e33a54e199f5cb923b2f64a1d/work/docs"
2026-07-21 02:54:14.961638 | 
2026-07-21 02:54:14.961824 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-07-21 02:54:18.454015 | controller | ERROR: Item: {'dest': '/var/lib/zuul/builds/8fb8207e33a54e199f5cb923b2f64a1d/work/logs', 'src': 'logs'}
2026-07-21 02:54:18.454538 | controller | {
2026-07-21 02:54:18.454573 | controller |   "ansible_loop_var": "zj_output",
2026-07-21 02:54:18.454606 | controller |   "msg": "ssh: connect to host 199.19.213.241 port 22: No route to host\r\nrsync: connection unexpectedly closed (0 bytes received so far) [Receiver]\nrsync error: unexplained error (code 255) at io.c(232) [Receiver=3.2.7]\n",
2026-07-21 02:54:18.454633 | controller |   "rc": 255,
2026-07-21 02:54:18.454653 | controller |   "zj_output": {
2026-07-21 02:54:18.454673 | controller |     "dest": "/var/lib/zuul/builds/8fb8207e33a54e199f5cb923b2f64a1d/work/logs",
2026-07-21 02:54:18.454692 | controller |     "src": "logs"
2026-07-21 02:54:18.454907 | controller |   }
2026-07-21 02:54:18.454934 | controller | }
2026-07-21 02:54:18.454976 | controller | changed: All items complete
2026-07-21 02:54:18.455002 | 
2026-07-21 02:54:21.778333 | controller | ERROR: Item: {'dest': '/var/lib/zuul/builds/8fb8207e33a54e199f5cb923b2f64a1d/work/artifacts', 'src': 'artifacts'}
2026-07-21 02:54:21.778633 | controller | {
2026-07-21 02:54:21.778697 | controller |   "ansible_loop_var": "zj_output",
2026-07-21 02:54:21.778731 | controller |   "msg": "ssh: connect to host 199.19.213.241 port 22: No route to host\r\nrsync: connection unexpectedly closed (0 bytes received so far) [Receiver]\nrsync error: unexplained error (code 255) at io.c(232) [Receiver=3.2.7]\n",
2026-07-21 02:54:21.778759 | controller |   "rc": 255,
2026-07-21 02:54:21.778785 | controller |   "zj_output": {
2026-07-21 02:54:21.778812 | controller |     "dest": "/var/lib/zuul/builds/8fb8207e33a54e199f5cb923b2f64a1d/work/artifacts",
2026-07-21 02:54:21.778876 | controller |     "src": "artifacts"
2026-07-21 02:54:21.778913 | controller |   }
2026-07-21 02:54:21.778939 | controller | }
2026-07-21 02:54:25.105599 | controller | ERROR: Item: {'dest': '/var/lib/zuul/builds/8fb8207e33a54e199f5cb923b2f64a1d/work/docs', 'src': 'docs'}
2026-07-21 02:54:25.105835 | controller | {
2026-07-21 02:54:25.105892 | controller |   "ansible_loop_var": "zj_output",
2026-07-21 02:54:25.105935 | controller |   "msg": "ssh: connect to host 199.19.213.241 port 22: No route to host\r\nrsync: connection unexpectedly closed (0 bytes received so far) [Receiver]\nrsync error: unexplained error (code 255) at io.c(232) [Receiver=3.2.7]\n",
2026-07-21 02:54:25.105984 | controller |   "rc": 255,
2026-07-21 02:54:25.106024 | controller |   "zj_output": {
2026-07-21 02:54:25.106056 | controller |     "dest": "/var/lib/zuul/builds/8fb8207e33a54e199f5cb923b2f64a1d/work/docs",
2026-07-21 02:54:25.106086 | controller |     "src": "docs"
2026-07-21 02:54:25.106114 | controller |   }
2026-07-21 02:54:25.106141 | controller | }
failure
2026-07-21 02:54:25.121193 | 
2026-07-21 02:54:25.121293 | PLAY RECAP
2026-07-21 02:54:25.121358 | controller | ok: 2 changed: 1 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0
2026-07-21 02:54:25.121392 | 
2026-07-21 02:54:25.298114 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-07-21 02:54:25.308606 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-07-21 02:54:25.958361 | 
2026-07-21 02:54:25.958524 | PLAY [localhost]
2026-07-21 02:54:25.968878 | 
2026-07-21 02:54:25.969012 | TASK [Generate Zuul manifest]
2026-07-21 02:54:25.988584 | localhost | ok
2026-07-21 02:54:26.013631 | 
2026-07-21 02:54:26.013814 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-07-21 02:54:26.445801 | localhost | changed
2026-07-21 02:54:26.462390 | 
2026-07-21 02:54:26.462531 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-07-21 02:54:26.496751 | localhost | ok
2026-07-21 02:54:26.505709 | 
2026-07-21 02:54:26.505860 | TASK [Upload logs]
2026-07-21 02:54:26.528841 | localhost | ok
2026-07-21 02:54:26.686279 | 
2026-07-21 02:54:26.686490 | TASK [Set zuul-log-path fact]
2026-07-21 02:54:26.710429 | localhost | ok
2026-07-21 02:54:26.722901 | 
2026-07-21 02:54:26.722973 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-07-21 02:54:26.756231 | localhost | ok
2026-07-21 02:54:26.766792 | 
2026-07-21 02:54:26.766867 | TASK [upload-logs : Create log directories]
2026-07-21 02:54:27.164013 | localhost | changed
2026-07-21 02:54:27.170684 | 
2026-07-21 02:54:27.170788 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-07-21 02:54:27.560185 | localhost -> localhost | ok: Runtime: 0:00:00.005083
2026-07-21 02:54:27.565399 | 
2026-07-21 02:54:27.565464 | TASK [upload-logs : Upload logs to log server]
2026-07-21 02:54:28.036682 | localhost | Output suppressed because no_log was given
2026-07-21 02:54:28.044590 | 
2026-07-21 02:54:28.044657 | LOOP [upload-logs : Compress console log and json output]
2026-07-21 02:54:28.096184 | localhost | skipping: Conditional result was False
2026-07-21 02:54:28.103580 | localhost | skipping: Conditional result was False
2026-07-21 02:54:28.117281 | 
2026-07-21 02:54:28.117454 | LOOP [upload-logs : Upload compressed console log and json output]
2026-07-21 02:54:28.174649 | localhost | skipping: Conditional result was False
2026-07-21 02:54:28.175161 | 
2026-07-21 02:54:28.181691 | localhost | skipping: Conditional result was False
2026-07-21 02:54:28.192145 | 
2026-07-21 02:54:28.192315 | LOOP [upload-logs : Upload console log and json output]