2026-08-26 20:50:52.243584 | Job console starting
2026-08-26 20:50:52.277921 | Updating git repos
2026-08-26 20:50:52.304857 | Cloning repos into workspace
2026-08-26 20:50:52.381496 | Restoring repo states
2026-08-26 20:50:52.388220 | Merging changes
2026-08-26 20:50:52.762835 | Checking out repos
2026-08-26 20:50:52.803892 | Preparing playbooks
2026-08-26 20:50:54.572547 | Running Ansible setup
2026-08-26 20:51:00.534248 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-26 20:51:01.143329 | 
2026-08-26 20:51:01.143481 | PLAY [localhost]
2026-08-26 20:51:01.151405 | 
2026-08-26 20:51:01.151476 | TASK [Gathering Facts]
2026-08-26 20:51:02.083054 | localhost | ok
2026-08-26 20:51:02.094747 | 
2026-08-26 20:51:02.094826 | TASK [Setup log path fact]
2026-08-26 20:51:02.117756 | localhost | ok
2026-08-26 20:51:02.130569 | 
2026-08-26 20:51:02.130644 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-26 20:51:02.162744 | localhost | ok
2026-08-26 20:51:02.172456 | 
2026-08-26 20:51:02.172668 | TASK [emit-job-header : Print job information]
2026-08-26 20:51:02.227066 | # Job Information
2026-08-26 20:51:02.227266 | Ansible Version: 2.16.18
2026-08-26 20:51:02.227313 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble
2026-08-26 20:51:02.227347 | Pipeline: check
2026-08-26 20:51:02.227377 | Executor: 2d72f0692154
2026-08-26 20:51:02.227406 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/116
2026-08-26 20:51:02.227440 | Event ID: 6fcc1630-a18e-11f1-934f-9f0631f6bf76
2026-08-26 20:51:02.231786 | 
2026-08-26 20:51:02.231885 | LOOP [emit-job-header : Print node information]
2026-08-26 20:51:02.330104 | localhost | ok:
2026-08-26 20:51:02.330683 | localhost | # Node Information
2026-08-26 20:51:02.330716 | localhost | Inventory Hostname: mon1
2026-08-26 20:51:02.330738 | localhost | Hostname: np0000191303
2026-08-26 20:51:02.330759 | localhost | Username: zuul
2026-08-26 20:51:02.330782 | localhost | Distro: Ubuntu 24.04
2026-08-26 20:51:02.330802 | localhost | Provider: yul1
2026-08-26 20:51:02.330821 | localhost | Region: ca-ymq-1
2026-08-26 20:51:02.330840 | localhost | Label: ubuntu-noble
2026-08-26 20:51:02.330859 | localhost | Product Name: OpenStack Nova
2026-08-26 20:51:02.330878 | localhost | Interface IP: 162.253.55.250
2026-08-26 20:51:02.388500 | localhost | ok:
2026-08-26 20:51:02.388562 | localhost | # Node Information
2026-08-26 20:51:02.388588 | localhost | Inventory Hostname: osd1
2026-08-26 20:51:02.388610 | localhost | Hostname: np0000191304
2026-08-26 20:51:02.388630 | localhost | Username: zuul
2026-08-26 20:51:02.388650 | localhost | Distro: Ubuntu 24.04
2026-08-26 20:51:02.388669 | localhost | Provider: yul1
2026-08-26 20:51:02.388708 | localhost | Region: ca-ymq-1
2026-08-26 20:51:02.388728 | localhost | Label: ubuntu-noble
2026-08-26 20:51:02.388747 | localhost | Product Name: OpenStack Nova
2026-08-26 20:51:02.388766 | localhost | Interface IP: 162.253.55.76
2026-08-26 20:51:02.399045 | 
2026-08-26 20:51:02.399180 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-08-26 20:51:02.788785 | localhost -> localhost | changed
2026-08-26 20:51:02.797112 | 
2026-08-26 20:51:02.797358 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-08-26 20:51:03.635288 | localhost -> localhost | changed
2026-08-26 20:51:03.641136 | 
2026-08-26 20:51:03.641188 | PLAY [all]
2026-08-26 20:51:03.652168 | 
2026-08-26 20:51:03.652235 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-08-26 20:51:03.878977 | mon1 -> localhost | ok
2026-08-26 20:51:03.889940 | 
2026-08-26 20:51:03.890006 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-08-26 20:51:03.923235 | mon1 | ok
2026-08-26 20:51:03.928678 | osd1 | ok
2026-08-26 20:51:03.947519 | mon1 | included: /var/lib/zuul/builds/1b8a7a3452284165b54b5bfac718d732/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-26 20:51:03.947570 | osd1 | included: /var/lib/zuul/builds/1b8a7a3452284165b54b5bfac718d732/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-26 20:51:03.954143 | 
2026-08-26 20:51:03.954204 | TASK [add-build-sshkey : Create Temp SSH key]
2026-08-26 20:51:05.229793 | mon1 -> localhost | Generating public/private rsa key pair.
2026-08-26 20:51:05.229987 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/1b8a7a3452284165b54b5bfac718d732/work/1b8a7a3452284165b54b5bfac718d732_id_rsa
2026-08-26 20:51:05.230033 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/1b8a7a3452284165b54b5bfac718d732/work/1b8a7a3452284165b54b5bfac718d732_id_rsa.pub
2026-08-26 20:51:05.230069 | mon1 -> localhost | The key fingerprint is:
2026-08-26 20:51:05.230102 | mon1 -> localhost | SHA256:mABd2j+hNWqRvE5Mw3LzDIOab8VK2jzk448ud5Zfnao zuul-build-sshkey
2026-08-26 20:51:05.230134 | mon1 -> localhost | The key's randomart image is:
2026-08-26 20:51:05.230166 | mon1 -> localhost | +---[RSA 3072]----+
2026-08-26 20:51:05.230196 | mon1 -> localhost | |  .. ..          |
2026-08-26 20:51:05.230228 | mon1 -> localhost | |   ..* .         |
2026-08-26 20:51:05.230260 | mon1 -> localhost | |    = & +        |
2026-08-26 20:51:05.230291 | mon1 -> localhost | |   o B ^ o       |
2026-08-26 20:51:05.230322 | mon1 -> localhost | |  o o % S        |
2026-08-26 20:51:05.230353 | mon1 -> localhost | |   O *   . . .   |
2026-08-26 20:51:05.230384 | mon1 -> localhost | |  . X ..  . o    |
2026-08-26 20:51:05.230414 | mon1 -> localhost | |  .o.++  . .     |
2026-08-26 20:51:05.230444 | mon1 -> localhost | |   +++..E..      |
2026-08-26 20:51:05.230474 | mon1 -> localhost | +----[SHA256]-----+
2026-08-26 20:51:05.230541 | mon1 -> localhost | ok: Runtime: 0:00:00.836126
2026-08-26 20:51:05.237525 | 
2026-08-26 20:51:05.237604 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-08-26 20:51:05.283882 | mon1 | ok
2026-08-26 20:51:05.288689 | osd1 | ok
2026-08-26 20:51:05.302828 | mon1 | included: /var/lib/zuul/builds/1b8a7a3452284165b54b5bfac718d732/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-26 20:51:05.302877 | osd1 | included: /var/lib/zuul/builds/1b8a7a3452284165b54b5bfac718d732/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-26 20:51:05.314122 | 
2026-08-26 20:51:05.314194 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-08-26 20:51:05.341580 | mon1 | skipping: Conditional result was False
2026-08-26 20:51:05.353232 | osd1 | skipping: Conditional result was False
2026-08-26 20:51:05.364200 | 
2026-08-26 20:51:05.364268 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-08-26 20:51:05.943023 | mon1 | changed
2026-08-26 20:51:05.949885 | osd1 | changed
2026-08-26 20:51:05.955229 | 
2026-08-26 20:51:05.955296 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-08-26 20:51:06.170173 | mon1 | ok
2026-08-26 20:51:06.210836 | osd1 | ok
2026-08-26 20:51:06.219075 | 
2026-08-26 20:51:06.219174 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-08-26 20:51:06.818387 | mon1 | changed
2026-08-26 20:51:06.916495 | osd1 | changed
2026-08-26 20:51:06.924067 | 
2026-08-26 20:51:06.924150 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-08-26 20:51:07.516679 | mon1 | changed
2026-08-26 20:51:07.561812 | osd1 | changed
2026-08-26 20:51:07.568617 | 
2026-08-26 20:51:07.568741 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-08-26 20:51:07.591912 | mon1 | skipping: Conditional result was False
2026-08-26 20:51:07.603291 | osd1 | skipping: Conditional result was False
2026-08-26 20:51:07.614186 | 
2026-08-26 20:51:07.614346 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-08-26 20:51:07.975306 | mon1 -> localhost | changed
2026-08-26 20:51:07.998436 | 
2026-08-26 20:51:07.998519 | TASK [add-build-sshkey : Add back temp key]
2026-08-26 20:51:08.297807 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/1b8a7a3452284165b54b5bfac718d732/work/1b8a7a3452284165b54b5bfac718d732_id_rsa (zuul-build-sshkey)
2026-08-26 20:51:08.298589 | mon1 -> localhost | ok: Runtime: 0:00:00.014711
2026-08-26 20:51:08.307781 | 
2026-08-26 20:51:08.307849 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-08-26 20:51:08.630701 | osd1 | ok
2026-08-26 20:51:08.638285 | mon1 | ok
2026-08-26 20:51:08.643300 | 
2026-08-26 20:51:08.643367 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-08-26 20:51:08.671562 | mon1 | skipping: Conditional result was False
2026-08-26 20:51:08.682696 | osd1 | skipping: Conditional result was False
2026-08-26 20:51:08.703459 | 
2026-08-26 20:51:08.703531 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-08-26 20:51:09.051848 | osd1 | ok
2026-08-26 20:51:09.056783 | mon1 | ok
2026-08-26 20:51:09.063214 | 
2026-08-26 20:51:09.063284 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-08-26 20:51:09.919723 | osd1 | Output suppressed because no_log was given
2026-08-26 20:51:09.936640 | mon1 | Output suppressed because no_log was given
2026-08-26 20:51:09.952897 | 
2026-08-26 20:51:09.952979 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-08-26 20:51:10.210194 | mon1 | ok: "logs"
2026-08-26 20:51:10.210478 | mon1 | ok: All items complete
2026-08-26 20:51:10.210518 | 
2026-08-26 20:51:10.217441 | osd1 | ok: "logs"
2026-08-26 20:51:10.423901 | mon1 | ok: "artifacts"
2026-08-26 20:51:10.430684 | osd1 | ok: "artifacts"
2026-08-26 20:51:10.640670 | mon1 | ok: "docs"
2026-08-26 20:51:10.646779 | osd1 | ok: "docs"
2026-08-26 20:51:10.660587 | 
2026-08-26 20:51:10.660734 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-08-26 20:51:10.894461 | mon1 | changed: "logs"
2026-08-26 20:51:10.894702 | mon1 | ok: All items complete
2026-08-26 20:51:10.894732 | 
2026-08-26 20:51:10.921962 | osd1 | changed: "logs"
2026-08-26 20:51:11.074926 | mon1 | changed: "artifacts"
2026-08-26 20:51:11.119683 | osd1 | changed: "artifacts"
2026-08-26 20:51:11.261235 | mon1 | changed: "docs"
2026-08-26 20:51:11.338365 | osd1 | changed: "docs"
2026-08-26 20:51:11.355324 | 
2026-08-26 20:51:11.355453 | PLAY RECAP
2026-08-26 20:51:11.355503 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-26 20:51:11.355535 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-26 20:51:11.355559 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-26 20:51:11.355578 | 
2026-08-26 20:51:11.530269 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-26 20:51:11.534118 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-26 20:51:12.135823 | 
2026-08-26 20:51:12.135990 | PLAY [all]
2026-08-26 20:51:12.149002 | 
2026-08-26 20:51:12.149293 | TASK [setup-uv : Extract archive]
2026-08-26 20:51:15.772739 | osd1 | ERROR
2026-08-26 20:51:15.773129 | osd1 | {
2026-08-26 20:51:15.773188 | osd1 |   "msg": "Failure downloading https://github.com/astral-sh/uv/releases/download/0.8.13/uv-x86_64-unknown-linux-gnu.tar.gz, Request failed: <urlopen error [Errno -5] No address associated with hostname>"
2026-08-26 20:51:15.773231 | osd1 | }
failure
2026-08-26 20:51:30.504838 | mon1 | changed
2026-08-26 20:51:30.511094 | 
2026-08-26 20:51:30.511165 | TASK [setup-uv : Print version]
2026-08-26 20:51:30.934193 | mon1 | uv 0.8.13
2026-08-26 20:51:41.095477 | mon1 | ok: Runtime: 0:00:00.020106
2026-08-26 20:51:41.110589 | 
2026-08-26 20:51:41.110766 | TASK [Install Ansible collection siblings]
2026-08-26 20:51:41.530297 | mon1 | ok:
2026-08-26 20:51:41.530520 | mon1 | Skipping community.general: no checked-out sibling
2026-08-26 20:51:41.530564 | mon1 | Skipping ansible.utils: no checked-out sibling
2026-08-26 20:51:41.530597 | mon1 | Skipping vexxhost.containers: no checked-out sibling
2026-08-26 20:51:41.532831 | 
2026-08-26 20:51:41.532894 | PLAY RECAP
2026-08-26 20:51:41.532981 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-26 20:51:41.533025 | osd1 | ok: 0 changed: 0 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-08-26 20:51:41.533052 | 
2026-08-26 20:51:41.679669 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-26 20:51:41.685700 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-26 20:51:42.269651 | 
2026-08-26 20:51:42.269780 | PLAY [all]
2026-08-26 20:51:42.282212 | 
2026-08-26 20:51:42.282290 | TASK [fetch-output : Set log path for multiple nodes]
2026-08-26 20:51:42.346283 | mon1 | ok
2026-08-26 20:51:42.350950 | osd1 | ok
2026-08-26 20:51:42.355675 | 
2026-08-26 20:51:42.355765 | TASK [fetch-output : Set log path for single node]
2026-08-26 20:51:42.382144 | mon1 | skipping: Conditional result was False
2026-08-26 20:51:42.393769 | osd1 | skipping: Conditional result was False
2026-08-26 20:51:42.403238 | 
2026-08-26 20:51:42.403338 | LOOP [fetch-output : Ensure local output dirs]
2026-08-26 20:51:42.804161 | osd1 -> localhost | changed: "/var/lib/zuul/builds/1b8a7a3452284165b54b5bfac718d732/work/logs/osd1"
2026-08-26 20:51:42.806497 | mon1 -> localhost | changed: "/var/lib/zuul/builds/1b8a7a3452284165b54b5bfac718d732/work/logs/mon1"
2026-08-26 20:51:43.017557 | mon1 -> localhost | changed: "/var/lib/zuul/builds/1b8a7a3452284165b54b5bfac718d732/work/artifacts"
2026-08-26 20:51:43.034562 | osd1 -> localhost | ok: "/var/lib/zuul/builds/1b8a7a3452284165b54b5bfac718d732/work/artifacts"
2026-08-26 20:51:43.234540 | mon1 -> localhost | changed: "/var/lib/zuul/builds/1b8a7a3452284165b54b5bfac718d732/work/docs"
2026-08-26 20:51:43.254213 | osd1 -> localhost | ok: "/var/lib/zuul/builds/1b8a7a3452284165b54b5bfac718d732/work/docs"
2026-08-26 20:51:43.254339 | osd1 -> localhost | changed: All items complete
2026-08-26 20:51:43.254398 | 
2026-08-26 20:51:43.267824 | 
2026-08-26 20:51:43.268001 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-08-26 20:51:43.953599 | mon1 | changed: .d..t...... ./
2026-08-26 20:51:43.961087 | osd1 | changed: .d..t...... ./
2026-08-26 20:51:44.416931 | mon1 | changed: .d..t...... ./
2026-08-26 20:51:44.459245 | osd1 | ok
2026-08-26 20:51:44.913862 | mon1 | changed: .d..t...... ./
2026-08-26 20:51:44.957488 | osd1 | ok
2026-08-26 20:51:44.957588 | osd1 | changed: All items complete
2026-08-26 20:51:44.957624 | 
2026-08-26 20:51:44.985161 | 
2026-08-26 20:51:44.985315 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-08-26 20:51:45.385143 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007018
2026-08-26 20:51:45.640181 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007055
2026-08-26 20:51:45.668169 | 
2026-08-26 20:51:45.668272 | PLAY [all]
2026-08-26 20:51:45.674702 | 
2026-08-26 20:51:45.674772 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-08-26 20:51:46.131991 | mon1 | changed
2026-08-26 20:51:46.164783 | osd1 | changed
2026-08-26 20:51:46.177174 | 
2026-08-26 20:51:46.177224 | PLAY RECAP
2026-08-26 20:51:46.177272 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-26 20:51:46.177301 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-26 20:51:46.177320 | 
2026-08-26 20:51:46.293352 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-26 20:51:46.296327 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-08-26 20:51:46.881803 | 
2026-08-26 20:51:46.881932 | PLAY [localhost]
2026-08-26 20:51:46.891927 | 
2026-08-26 20:51:46.892000 | TASK [Generate Zuul manifest]
2026-08-26 20:51:46.915002 | localhost | ok
2026-08-26 20:51:46.933971 | 
2026-08-26 20:51:46.934049 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-08-26 20:51:47.300781 | localhost | changed
2026-08-26 20:51:47.314819 | 
2026-08-26 20:51:47.314927 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-08-26 20:51:47.343580 | localhost | ok
2026-08-26 20:51:47.352921 | 
2026-08-26 20:51:47.353035 | TASK [Upload logs]
2026-08-26 20:51:47.373381 | localhost | ok
2026-08-26 20:51:47.439017 | 
2026-08-26 20:51:47.439171 | TASK [Set zuul-log-path fact]
2026-08-26 20:51:47.461888 | localhost | ok
2026-08-26 20:51:47.474733 | 
2026-08-26 20:51:47.474837 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-26 20:51:47.502902 | localhost | ok
2026-08-26 20:51:47.510277 | 
2026-08-26 20:51:47.510357 | TASK [upload-logs : Create log directories]
2026-08-26 20:51:47.925679 | localhost | changed
2026-08-26 20:51:47.931927 | 
2026-08-26 20:51:47.932018 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-08-26 20:51:48.349865 | localhost -> localhost | ok: Runtime: 0:00:00.006361
2026-08-26 20:51:48.357543 | 
2026-08-26 20:51:48.357633 | TASK [upload-logs : Upload logs to log server]
2026-08-26 20:51:48.836299 | localhost | Output suppressed because no_log was given
2026-08-26 20:51:48.841346 | 
2026-08-26 20:51:48.841439 | LOOP [upload-logs : Compress console log and json output]
2026-08-26 20:51:48.938563 | localhost | skipping: Conditional result was False
2026-08-26 20:51:48.945897 | localhost | skipping: Conditional result was False
2026-08-26 20:51:48.961172 | 
2026-08-26 20:51:48.961340 | LOOP [upload-logs : Upload compressed console log and json output]
2026-08-26 20:51:49.055175 | localhost | skipping: Conditional result was False
2026-08-26 20:51:49.055740 | 
2026-08-26 20:51:49.059019 | localhost | skipping: Conditional result was False
2026-08-26 20:51:49.110656 | 
2026-08-26 20:51:49.110821 | LOOP [upload-logs : Upload console log and json output]