2026-04-18 16:16:00.953571 | Job console starting
2026-04-18 16:16:00.970792 | Updating git repos
2026-04-18 16:16:00.992081 | Cloning repos into workspace
2026-04-18 16:16:03.461274 | Restoring repo states
2026-04-18 16:16:03.469826 | Merging changes
2026-04-18 16:16:03.954164 | Checking out repos
2026-04-18 16:16:04.595526 | Preparing playbooks
2026-04-18 16:16:21.148918 | Running Ansible setup
2026-04-18 16:16:25.164094 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-18 16:16:25.746594 | 
2026-04-18 16:16:25.746723 | PLAY [localhost]
2026-04-18 16:16:25.754459 | 
2026-04-18 16:16:25.754529 | TASK [Gathering Facts]
2026-04-18 16:16:27.635954 | localhost | ok
2026-04-18 16:16:27.645202 | 
2026-04-18 16:16:27.645295 | TASK [Setup log path fact]
2026-04-18 16:16:27.665726 | localhost | ok
2026-04-18 16:16:27.678044 | 
2026-04-18 16:16:27.678156 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-18 16:16:27.707802 | localhost | ok
2026-04-18 16:16:27.715918 | 
2026-04-18 16:16:27.715986 | TASK [emit-job-header : Print job information]
2026-04-18 16:16:27.758175 | # Job Information
2026-04-18 16:16:27.758410 | Ansible Version: 2.16.16
2026-04-18 16:16:27.758489 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy
2026-04-18 16:16:27.758543 | Pipeline: check
2026-04-18 16:16:27.758658 | Executor: 0a8996d2b663
2026-04-18 16:16:27.758722 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/103
2026-04-18 16:16:27.758779 | Event ID: bcf0b280-3b41-11f1-9349-0bdc5a4d9f14
2026-04-18 16:16:27.761751 | 
2026-04-18 16:16:27.761819 | LOOP [emit-job-header : Print node information]
2026-04-18 16:16:27.853412 | localhost | ok:
2026-04-18 16:16:27.854017 | localhost | # Node Information
2026-04-18 16:16:27.854087 | localhost | Inventory Hostname: mon1
2026-04-18 16:16:27.854137 | localhost | Hostname: np0000167280
2026-04-18 16:16:27.854186 | localhost | Username: zuul
2026-04-18 16:16:27.854244 | localhost | Distro: Ubuntu 22.04
2026-04-18 16:16:27.854290 | localhost | Provider: yul1
2026-04-18 16:16:27.854333 | localhost | Region: ca-ymq-1
2026-04-18 16:16:27.854374 | localhost | Label: ubuntu-jammy
2026-04-18 16:16:27.854415 | localhost | Product Name: OpenStack Nova
2026-04-18 16:16:27.854456 | localhost | Interface IP: 199.204.45.129
2026-04-18 16:16:27.894508 | localhost | ok:
2026-04-18 16:16:27.894623 | localhost | # Node Information
2026-04-18 16:16:27.894682 | localhost | Inventory Hostname: osd1
2026-04-18 16:16:27.894730 | localhost | Hostname: np0000167281
2026-04-18 16:16:27.894773 | localhost | Username: zuul
2026-04-18 16:16:27.894814 | localhost | Distro: Ubuntu 22.04
2026-04-18 16:16:27.894855 | localhost | Provider: yul1
2026-04-18 16:16:27.894896 | localhost | Region: ca-ymq-1
2026-04-18 16:16:27.894937 | localhost | Label: ubuntu-jammy
2026-04-18 16:16:27.894977 | localhost | Product Name: OpenStack Nova
2026-04-18 16:16:27.895019 | localhost | Interface IP: 199.204.45.4
2026-04-18 16:16:27.908774 | 
2026-04-18 16:16:27.908931 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-18 16:16:28.309770 | localhost -> localhost | changed
2026-04-18 16:16:28.316456 | 
2026-04-18 16:16:28.316638 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-18 16:16:29.154636 | localhost -> localhost | changed
2026-04-18 16:16:29.163837 | 
2026-04-18 16:16:29.163891 | PLAY [all]
2026-04-18 16:16:29.172111 | 
2026-04-18 16:16:29.172172 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-18 16:16:29.398637 | mon1 -> localhost | ok
2026-04-18 16:16:29.407651 | 
2026-04-18 16:16:29.407747 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-18 16:16:29.440086 | mon1 | ok
2026-04-18 16:16:29.444113 | osd1 | ok
2026-04-18 16:16:29.462094 | mon1 | included: /var/lib/zuul/builds/32dd0e7d882c4ae7bf9fecabbb602914/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-18 16:16:29.462196 | osd1 | included: /var/lib/zuul/builds/32dd0e7d882c4ae7bf9fecabbb602914/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-18 16:16:29.468051 | 
2026-04-18 16:16:29.468117 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-18 16:16:31.008683 | mon1 -> localhost | Generating public/private rsa key pair.
2026-04-18 16:16:31.008930 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/32dd0e7d882c4ae7bf9fecabbb602914/work/32dd0e7d882c4ae7bf9fecabbb602914_id_rsa
2026-04-18 16:16:31.008990 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/32dd0e7d882c4ae7bf9fecabbb602914/work/32dd0e7d882c4ae7bf9fecabbb602914_id_rsa.pub
2026-04-18 16:16:31.009017 | mon1 -> localhost | The key fingerprint is:
2026-04-18 16:16:31.009039 | mon1 -> localhost | SHA256:drVqsoJ+RCTQH0CBMMrVsoIqK6nLKAt/N8DKGtXNvhc zuul-build-sshkey
2026-04-18 16:16:31.009061 | mon1 -> localhost | The key's randomart image is:
2026-04-18 16:16:31.009106 | mon1 -> localhost | +---[RSA 3072]----+
2026-04-18 16:16:31.009143 | mon1 -> localhost | |o..*=o           |
2026-04-18 16:16:31.009168 | mon1 -> localhost | |o.o.o.o          |
2026-04-18 16:16:31.009188 | mon1 -> localhost | |o.  o+ .    .    |
2026-04-18 16:16:31.009211 | mon1 -> localhost | |.. o oo    . .   |
2026-04-18 16:16:31.009233 | mon1 -> localhost | |. o...o S . .    |
2026-04-18 16:16:31.009252 | mon1 -> localhost | |o.  o...E. .     |
2026-04-18 16:16:31.009270 | mon1 -> localhost | |++ . +. ..o      |
2026-04-18 16:16:31.009289 | mon1 -> localhost | |Ooo o =..+       |
2026-04-18 16:16:31.009307 | mon1 -> localhost | |X=.o.o.+.        |
2026-04-18 16:16:31.009326 | mon1 -> localhost | +----[SHA256]-----+
2026-04-18 16:16:31.009378 | mon1 -> localhost | ok: Runtime: 0:00:01.139182
2026-04-18 16:16:31.014654 | 
2026-04-18 16:16:31.014725 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-18 16:16:31.053311 | mon1 | ok
2026-04-18 16:16:31.072227 | osd1 | ok
2026-04-18 16:16:31.084338 | mon1 | included: /var/lib/zuul/builds/32dd0e7d882c4ae7bf9fecabbb602914/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-18 16:16:31.084389 | osd1 | included: /var/lib/zuul/builds/32dd0e7d882c4ae7bf9fecabbb602914/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-18 16:16:31.094238 | 
2026-04-18 16:16:31.094304 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-18 16:16:31.119481 | mon1 | skipping: Conditional result was False
2026-04-18 16:16:31.130706 | osd1 | skipping: Conditional result was False
2026-04-18 16:16:31.139760 | 
2026-04-18 16:16:31.139907 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-18 16:16:31.621303 | osd1 | changed
2026-04-18 16:16:31.671170 | mon1 | changed
2026-04-18 16:16:31.678158 | 
2026-04-18 16:16:31.678261 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-18 16:16:31.858794 | mon1 | ok
2026-04-18 16:16:31.863744 | osd1 | ok
2026-04-18 16:16:31.868832 | 
2026-04-18 16:16:31.868901 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-18 16:16:32.316982 | mon1 | changed
2026-04-18 16:16:32.335136 | osd1 | changed
2026-04-18 16:16:32.342017 | 
2026-04-18 16:16:32.342083 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-18 16:16:32.805183 | mon1 | changed
2026-04-18 16:16:32.811525 | osd1 | changed
2026-04-18 16:16:32.816359 | 
2026-04-18 16:16:32.816429 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-18 16:16:32.841183 | mon1 | skipping: Conditional result was False
2026-04-18 16:16:32.852107 | osd1 | skipping: Conditional result was False
2026-04-18 16:16:32.901454 | 
2026-04-18 16:16:32.901666 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-18 16:16:33.201207 | mon1 -> localhost | changed
2026-04-18 16:16:33.222853 | 
2026-04-18 16:16:33.222937 | TASK [add-build-sshkey : Add back temp key]
2026-04-18 16:16:33.478786 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/32dd0e7d882c4ae7bf9fecabbb602914/work/32dd0e7d882c4ae7bf9fecabbb602914_id_rsa (zuul-build-sshkey)
2026-04-18 16:16:33.479075 | mon1 -> localhost | ok: Runtime: 0:00:00.014602
2026-04-18 16:16:33.485121 | 
2026-04-18 16:16:33.485191 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-18 16:16:33.735421 | osd1 | ok
2026-04-18 16:16:33.741166 | mon1 | ok
2026-04-18 16:16:33.745749 | 
2026-04-18 16:16:33.745819 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-18 16:16:33.771655 | mon1 | skipping: Conditional result was False
2026-04-18 16:16:33.783046 | osd1 | skipping: Conditional result was False
2026-04-18 16:16:33.803190 | 
2026-04-18 16:16:33.803324 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-18 16:16:34.074713 | mon1 | ok
2026-04-18 16:16:34.081044 | osd1 | ok
2026-04-18 16:16:34.091352 | 
2026-04-18 16:16:34.091495 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-18 16:16:34.735789 | mon1 | Output suppressed because no_log was given
2026-04-18 16:16:34.765515 | osd1 | Output suppressed because no_log was given
2026-04-18 16:16:34.778788 | 
2026-04-18 16:16:34.778907 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-18 16:16:34.960116 | mon1 | ok: "logs"
2026-04-18 16:16:34.960374 | mon1 | ok: All items complete
2026-04-18 16:16:34.960402 | 
2026-04-18 16:16:34.975543 | osd1 | ok: "logs"
2026-04-18 16:16:35.104432 | mon1 | ok: "artifacts"
2026-04-18 16:16:35.125394 | osd1 | ok: "artifacts"
2026-04-18 16:16:35.281923 | mon1 | ok: "docs"
2026-04-18 16:16:35.288151 | osd1 | ok: "docs"
2026-04-18 16:16:35.302323 | 
2026-04-18 16:16:35.302463 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-18 16:16:35.488229 | osd1 | changed: "logs"
2026-04-18 16:16:35.488547 | osd1 | ok: All items complete
2026-04-18 16:16:35.488588 | 
2026-04-18 16:16:35.494283 | mon1 | changed: "logs"
2026-04-18 16:16:35.642326 | osd1 | changed: "artifacts"
2026-04-18 16:16:35.649261 | mon1 | changed: "artifacts"
2026-04-18 16:16:35.793888 | osd1 | changed: "docs"
2026-04-18 16:16:35.810422 | mon1 | changed: "docs"
2026-04-18 16:16:35.829601 | 
2026-04-18 16:16:35.829715 | PLAY RECAP
2026-04-18 16:16:35.829762 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:16:35.829792 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-18 16:16:35.829818 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-18 16:16:35.829836 | 
2026-04-18 16:16:35.947423 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-18 16:16:35.953095 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-18 16:16:36.550640 | 
2026-04-18 16:16:36.550770 | PLAY [all]
2026-04-18 16:16:36.562723 | 
2026-04-18 16:16:36.562797 | TASK [setup-uv : Extract archive]
2026-04-18 16:16:38.661197 | osd1 | changed
2026-04-18 16:16:44.006114 | mon1 | changed
2026-04-18 16:16:44.012903 | 
2026-04-18 16:16:44.013003 | TASK [setup-uv : Print version]
2026-04-18 16:16:44.372621 | mon1 | uv 0.8.13
2026-04-18 16:16:44.374402 | osd1 | uv 0.8.13
2026-04-18 16:16:44.571967 | osd1 | ok: Runtime: 0:00:00.012824
2026-04-18 16:16:44.583608 | mon1 | ok: Runtime: 0:00:00.012070
2026-04-18 16:16:44.593290 | 
2026-04-18 16:16:44.593341 | PLAY RECAP
2026-04-18 16:16:44.593387 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:16:44.593415 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:16:44.593434 | 
2026-04-18 16:16:44.709568 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-18 16:16:44.715509 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-18 16:16:45.251159 | 
2026-04-18 16:16:45.251692 | PLAY [all]
2026-04-18 16:16:45.262553 | 
2026-04-18 16:16:45.262622 | TASK [Copy inventory file for Zuul]
2026-04-18 16:16:46.115216 | mon1 | changed
2026-04-18 16:16:46.121363 | 
2026-04-18 16:16:46.121440 | TASK [Switch "ansible_host" to private IP]
2026-04-18 16:16:46.398063 | mon1 | changed: 2 replacements made
2026-04-18 16:16:46.404622 | 
2026-04-18 16:16:46.404684 | TASK [Run Molecule scenario]
2026-04-18 16:16:50.981289 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-04-18 16:16:51.691333 | mon1 |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-04-18 16:16:51.873156 | mon1 | Using CPython 3.13.7
2026-04-18 16:16:51.873273 | mon1 | Creating virtual environment at: .venv
2026-04-18 16:16:52.118504 | mon1 | Downloading netaddr (2.2MiB)
2026-04-18 16:16:52.120607 | mon1 | Downloading pygments (1.2MiB)
2026-04-18 16:16:52.121456 | mon1 | Downloading cryptography (4.3MiB)
2026-04-18 16:16:52.121683 | mon1 | Downloading ansible-core (2.1MiB)
2026-04-18 16:16:52.305753 | mon1 |  Downloading netaddr
2026-04-18 16:16:52.315135 | mon1 |  Downloading cryptography
2026-04-18 16:16:52.363580 | mon1 |  Downloading pygments
2026-04-18 16:16:52.497063 | mon1 |  Downloading ansible-core
2026-04-18 16:16:52.526958 | mon1 | Installed 36 packages in 29ms
2026-04-18 16:16:53.689214 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-04-18 16:16:53.689358 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-04-18 16:16:54.326934 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-18 16:16:54.327150 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-04-18 16:17:06.213927 | mon1 | INFO     [default > dependency] Executing
2026-04-18 16:17:06.214280 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-04-18 16:17:06.214504 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-04-18 16:17:06.214655 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-04-18 16:17:06.220068 | mon1 | INFO     [default > cleanup] Executing
2026-04-18 16:17:06.220393 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-18 16:17:06.225493 | mon1 | INFO     [default > destroy] Executing
2026-04-18 16:17:06.225605 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-04-18 16:17:06.225695 | mon1 | INFO     [default > destroy] Executed: Successful
2026-04-18 16:17:06.230655 | mon1 | INFO     [default > syntax] Executing
2026-04-18 16:17:07.213566 | mon1 |
2026-04-18 16:17:07.214080 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-04-18 16:17:07.267876 | mon1 | INFO     [default > syntax] Executed: Successful
2026-04-18 16:17:07.279049 | mon1 | INFO     [default > create] Executing
2026-04-18 16:17:07.280419 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-18 16:17:07.285338 | mon1 | INFO     [default > prepare] Executing
2026-04-18 16:17:07.930725 | mon1 |
2026-04-18 16:17:07.931116 | mon1 | PLAY [Prepare] *****************************************************************
2026-04-18 16:17:07.931379 | mon1 |
2026-04-18 16:17:07.931697 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-18 16:17:07.931972 | mon1 | Saturday 18 April 2026  16:17:07 +0000 (0:00:00.030)       0:00:00.030 ********
2026-04-18 16:17:09.067885 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-04-18 16:17:09.067944 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-18 16:17:09.067953 | mon1 | interpreter could change the meaning of that path. See
2026-04-18 16:17:09.067968 | mon1 | https://docs.ansible.com/ansible-
2026-04-18 16:17:09.068135 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-18 16:17:09.105956 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-04-18 16:17:09.106219 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-18 16:17:09.106427 | mon1 | interpreter could change the meaning of that path. See
2026-04-18 16:17:09.106635 | mon1 | https://docs.ansible.com/ansible-
2026-04-18 16:17:09.106847 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-18 16:17:09.123328 | mon1 | ok: [mon1]
2026-04-18 16:17:09.123665 | mon1 | ok: [osd1]
2026-04-18 16:17:09.123875 | mon1 |
2026-04-18 16:17:09.124096 | mon1 | TASK [Configure short hostname] ************************************************
2026-04-18 16:17:09.124321 | mon1 | Saturday 18 April 2026  16:17:09 +0000 (0:00:01.184)       0:00:01.215 ********
2026-04-18 16:17:09.864478 | mon1 | changed: [mon1]
2026-04-18 16:17:09.864661 | mon1 | changed: [osd1]
2026-04-18 16:17:09.864856 | mon1 |
2026-04-18 16:17:09.865107 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-18 16:17:09.865358 | mon1 | Saturday 18 April 2026  16:17:09 +0000 (0:00:00.749)       0:00:01.965 ********
2026-04-18 16:17:10.130964 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-18 16:17:10.131197 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-04-18 16:17:10.131416 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-18 16:17:10.145584 | mon1 | changed: [mon1]
2026-04-18 16:17:10.145687 | mon1 | changed: [osd1]
2026-04-18 16:17:10.145809 | mon1 |
2026-04-18 16:17:10.145966 | mon1 | TASK [Update apt cache] ********************************************************
2026-04-18 16:17:10.146139 | mon1 | Saturday 18 April 2026  16:17:10 +0000 (0:00:00.281)       0:00:02.246 ********
2026-04-18 16:17:19.595476 | mon1 | changed: [osd1]
2026-04-18 16:17:19.595627 | mon1 | changed: [mon1]
2026-04-18 16:17:19.595639 | mon1 |
2026-04-18 16:17:19.595877 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-04-18 16:17:19.596052 | mon1 |
2026-04-18 16:17:19.596263 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-18 16:17:19.596476 | mon1 | Saturday 18 April 2026  16:17:19 +0000 (0:00:09.449)       0:00:11.696 ********
2026-04-18 16:17:20.289446 | mon1 | ok: [osd1]
2026-04-18 16:17:20.289598 | mon1 |
2026-04-18 16:17:20.289811 | mon1 | TASK [Install depedencies] *****************************************************
2026-04-18 16:17:20.290033 | mon1 | Saturday 18 April 2026  16:17:20 +0000 (0:00:00.694)       0:00:12.390 ********
2026-04-18 16:17:48.184604 | mon1 | changed: [osd1]
2026-04-18 16:17:48.184680 | mon1 |
2026-04-18 16:17:48.184801 | mon1 | TASK [Start up service] ********************************************************
2026-04-18 16:17:48.184924 | mon1 | Saturday 18 April 2026  16:17:48 +0000 (0:00:27.895)       0:00:40.285 ********
2026-04-18 16:17:48.737138 | mon1 | ok: [osd1]
2026-04-18 16:17:48.737330 | mon1 |
2026-04-18 16:17:48.737574 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-04-18 16:17:48.737808 | mon1 | Saturday 18 April 2026  16:17:48 +0000 (0:00:00.552)       0:00:40.837 ********
2026-04-18 16:17:49.026811 | mon1 | ok: [osd1]
2026-04-18 16:17:49.026993 | mon1 |
2026-04-18 16:17:49.027217 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-18 16:17:49.027449 | mon1 | Saturday 18 April 2026  16:17:49 +0000 (0:00:00.289)       0:00:41.127 ********
2026-04-18 16:17:49.673027 | mon1 | changed: [osd1]
2026-04-18 16:17:49.673163 | mon1 |
2026-04-18 16:17:49.673377 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-04-18 16:17:49.673582 | mon1 | Saturday 18 April 2026  16:17:49 +0000 (0:00:00.646)       0:00:41.773 ********
2026-04-18 16:17:49.869363 | mon1 | ok: [osd1]
2026-04-18 16:17:49.869563 | mon1 |
2026-04-18 16:17:49.869800 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-04-18 16:17:49.870029 | mon1 | Saturday 18 April 2026  16:17:49 +0000 (0:00:00.196)       0:00:41.970 ********
2026-04-18 16:17:49.886349 | mon1 | skipping: [osd1]
2026-04-18 16:17:49.886549 | mon1 |
2026-04-18 16:17:49.886777 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-04-18 16:17:49.886997 | mon1 | Saturday 18 April 2026  16:17:49 +0000 (0:00:00.017)       0:00:41.987 ********
2026-04-18 16:17:50.449911 | mon1 | changed: [osd1] => (item=osd0)
2026-04-18 16:17:50.450093 | mon1 | changed: [osd1] => (item=osd1)
2026-04-18 16:17:50.450402 | mon1 | changed: [osd1] => (item=osd2)
2026-04-18 16:17:50.450564 | mon1 |
2026-04-18 16:17:50.450753 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-04-18 16:17:50.450938 | mon1 | Saturday 18 April 2026  16:17:50 +0000 (0:00:00.563)       0:00:42.550 ********
2026-04-18 16:17:51.075170 | mon1 | changed: [osd1] => (item=osd0)
2026-04-18 16:17:51.075239 | mon1 | changed: [osd1] => (item=osd1)
2026-04-18 16:17:51.075383 | mon1 | changed: [osd1] => (item=osd2)
2026-04-18 16:17:51.075505 | mon1 |
2026-04-18 16:17:51.075635 | mon1 | TASK [Start loop devices] ******************************************************
2026-04-18 16:17:51.075767 | mon1 | Saturday 18 April 2026  16:17:51 +0000 (0:00:00.625)       0:00:43.176 ********
2026-04-18 16:17:51.833722 | mon1 | changed: [osd1] => (item=osd0)
2026-04-18 16:17:51.833830 | mon1 | changed: [osd1] => (item=osd1)
2026-04-18 16:17:51.833841 | mon1 | changed: [osd1] => (item=osd2)
2026-04-18 16:17:51.833853 | mon1 |
2026-04-18 16:17:51.833955 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-04-18 16:17:51.834069 | mon1 | Saturday 18 April 2026  16:17:51 +0000 (0:00:00.757)       0:00:43.934 ********
2026-04-18 16:17:54.900593 | mon1 | changed: [osd1] => (item=osd0)
2026-04-18 16:17:54.900701 | mon1 | changed: [osd1] => (item=osd1)
2026-04-18 16:17:54.900882 | mon1 | changed: [osd1] => (item=osd2)
2026-04-18 16:17:54.901053 | mon1 |
2026-04-18 16:17:54.901239 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-04-18 16:17:54.901429 | mon1 | Saturday 18 April 2026  16:17:54 +0000 (0:00:03.062)       0:00:46.997 ********
2026-04-18 16:17:56.738151 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-04-18 16:17:56.738258 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-04-18 16:17:56.738280 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-04-18 16:17:56.738291 | mon1 |
2026-04-18 16:17:56.738444 | mon1 | PLAY RECAP *********************************************************************
2026-04-18 16:17:56.738584 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-04-18 16:17:56.738720 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-18 16:17:56.738831 | mon1 |
2026-04-18 16:17:56.738933 | mon1 |
2026-04-18 16:17:56.739082 | mon1 | TASKS RECAP ********************************************************************
2026-04-18 16:17:56.739186 | mon1 | Saturday 18 April 2026  16:17:56 +0000 (0:00:01.842)       0:00:48.839 ********
2026-04-18 16:17:56.739304 | mon1 | ===============================================================================
2026-04-18 16:17:56.739428 | mon1 | Install depedencies ---------------------------------------------------- 27.90s
2026-04-18 16:17:56.739550 | mon1 | Update apt cache -------------------------------------------------------- 9.45s
2026-04-18 16:17:56.739672 | mon1 | Create a volume group for each loop device ------------------------------ 3.06s
2026-04-18 16:17:56.739797 | mon1 | Create a logical volume for each loop device ---------------------------- 1.84s
2026-04-18 16:17:56.739919 | mon1 | Gathering Facts --------------------------------------------------------- 1.18s
2026-04-18 16:17:56.740041 | mon1 | Start loop devices ------------------------------------------------------ 0.76s
2026-04-18 16:17:56.740165 | mon1 | Configure short hostname ------------------------------------------------ 0.75s
2026-04-18 16:17:56.740289 | mon1 | Gathering Facts --------------------------------------------------------- 0.69s
2026-04-18 16:17:56.740411 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.65s
2026-04-18 16:17:56.740535 | mon1 | Set permissions on loopback devices ------------------------------------- 0.63s
2026-04-18 16:17:56.740661 | mon1 | Create devices for Ceph ------------------------------------------------- 0.56s
2026-04-18 16:17:56.740782 | mon1 | Start up service -------------------------------------------------------- 0.55s
2026-04-18 16:17:56.740902 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.29s
2026-04-18 16:17:56.741026 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.28s
2026-04-18 16:17:56.741154 | mon1 | Get list of all loopback devices ---------------------------------------- 0.20s
2026-04-18 16:17:56.741281 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-04-18 16:17:56.809552 | mon1 | INFO     [default > prepare] Executed: Successful
2026-04-18 16:17:56.819102 | mon1 | INFO     [default > converge] Executing
2026-04-18 16:17:57.594190 | mon1 |
2026-04-18 16:17:57.594326 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-04-18 16:17:57.594530 | mon1 |
2026-04-18 16:17:57.594736 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-18 16:17:57.594968 | mon1 | Saturday 18 April 2026  16:17:57 +0000 (0:00:00.044)       0:00:00.044 ********
2026-04-18 16:17:58.526667 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-04-18 16:17:58.526967 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-18 16:17:58.527321 | mon1 | interpreter could change the meaning of that path. See
2026-04-18 16:17:58.527661 | mon1 | https://docs.ansible.com/ansible-
2026-04-18 16:17:58.528004 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-18 16:17:58.539717 | mon1 | ok: [mon1]
2026-04-18 16:17:58.539956 | mon1 |
2026-04-18 16:17:58.540198 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-18 16:17:58.540427 | mon1 | Saturday 18 April 2026  16:17:58 +0000 (0:00:00.945)       0:00:00.990 ********
2026-04-18 16:17:58.829557 | mon1 | ok: [mon1]
2026-04-18 16:17:58.829619 | mon1 |
2026-04-18 16:17:58.829762 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-18 16:17:58.829890 | mon1 | Saturday 18 April 2026  16:17:58 +0000 (0:00:00.290)       0:00:01.280 ********
2026-04-18 16:17:58.863466 | mon1 | skipping: [mon1]
2026-04-18 16:17:58.863504 | mon1 |
2026-04-18 16:17:58.863703 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-18 16:17:58.863775 | mon1 | Saturday 18 April 2026  16:17:58 +0000 (0:00:00.034)       0:00:01.314 ********
2026-04-18 16:17:59.154553 | mon1 | changed: [mon1]
2026-04-18 16:17:59.154613 | mon1 |
2026-04-18 16:17:59.154703 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-18 16:17:59.154789 | mon1 | Saturday 18 April 2026  16:17:59 +0000 (0:00:00.291)       0:00:01.605 ********
2026-04-18 16:17:59.250374 | mon1 | ok: [mon1] => {
2026-04-18 16:17:59.250592 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-18 16:17:59.250785 | mon1 | }
2026-04-18 16:17:59.250965 | mon1 |
2026-04-18 16:17:59.251170 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-18 16:17:59.251367 | mon1 | Saturday 18 April 2026  16:17:59 +0000 (0:00:00.095)       0:00:01.700 ********
2026-04-18 16:18:20.946709 | mon1 | fatal: [mon1]: FAILED! => {"attempts": 4, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
2026-04-18 16:18:20.948815 | mon1 | FAILED - RETRYING: [mon1]: Download item (4 retries left).
2026-04-18 16:18:20.949035 | mon1 | FAILED - RETRYING: [mon1]: Download item (3 retries left).
2026-04-18 16:18:20.949249 | mon1 | FAILED - RETRYING: [mon1]: Download item (2 retries left).
2026-04-18 16:18:20.949458 | mon1 | FAILED - RETRYING: [mon1]: Download item (1 retries left).
2026-04-18 16:18:20.949649 | mon1 |
2026-04-18 16:18:20.949852 | mon1 | PLAY RECAP *********************************************************************
2026-04-18 16:18:20.950097 | mon1 | mon1                       : ok=4    changed=1    unreachable=0    failed=1    skipped=1    rescued=0    ignored=0
2026-04-18 16:18:20.950286 | mon1 |
2026-04-18 16:18:20.950468 | mon1 |
2026-04-18 16:18:20.950681 | mon1 | TASKS RECAP ********************************************************************
2026-04-18 16:18:20.950881 | mon1 | Saturday 18 April 2026  16:18:20 +0000 (0:00:21.698)       0:00:23.399 ********
2026-04-18 16:18:20.951123 | mon1 | ===============================================================================
2026-04-18 16:18:20.951334 | mon1 | vexxhost.containers.download_artifact : Download item ------------------ 21.70s
2026-04-18 16:18:20.951554 | mon1 | Gathering Facts --------------------------------------------------------- 0.95s
2026-04-18 16:18:20.951793 | mon1 | vexxhost.containers.directory : Create directory (/var/lib/downloads) --- 0.29s
2026-04-18 16:18:20.951997 | mon1 | vexxhost.containers.forget_package : Forget package --------------------- 0.29s
2026-04-18 16:18:20.952199 | mon1 | vexxhost.containers.download_artifact : Starting download of file ------- 0.10s
2026-04-18 16:18:20.952401 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 0.03s
2026-04-18 16:18:21.025836 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-04-18 16:18:21.025975 | mon1 | ERROR    [default > converge] Executed: Failed
2026-04-18 16:18:21.026119 | mon1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-04-18 16:18:31.629452 | mon1 | ERROR
2026-04-18 16:18:31.629743 | mon1 | {
2026-04-18 16:18:31.629784 | mon1 |   "delta": "0:01:34.323707",
2026-04-18 16:18:31.629813 | mon1 |   "end": "2026-04-18 16:18:21.094539",
2026-04-18 16:18:31.629839 | mon1 |   "msg": "non-zero return code",
2026-04-18 16:18:31.629864 | mon1 |   "rc": 2,
2026-04-18 16:18:31.629892 | mon1 |   "start": "2026-04-18 16:16:46.770832"
2026-04-18 16:18:31.629917 | mon1 | }
failure
2026-04-18 16:18:31.643412 | 
2026-04-18 16:18:31.643467 | PLAY RECAP
2026-04-18 16:18:31.643515 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:18:31.643536 | 
2026-04-18 16:18:31.779010 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-18 16:18:31.784480 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-18 16:18:32.374822 | 
2026-04-18 16:18:32.375003 | PLAY [all]
2026-04-18 16:18:32.388511 | 
2026-04-18 16:18:32.388607 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-18 16:18:32.446701 | mon1 | ok
2026-04-18 16:18:32.452223 | osd1 | ok
2026-04-18 16:18:32.456533 | 
2026-04-18 16:18:32.456609 | TASK [fetch-output : Set log path for single node]
2026-04-18 16:18:32.484331 | mon1 | skipping: Conditional result was False
2026-04-18 16:18:32.495641 | osd1 | skipping: Conditional result was False
2026-04-18 16:18:32.505257 | 
2026-04-18 16:18:32.505364 | LOOP [fetch-output : Ensure local output dirs]
2026-04-18 16:18:32.924020 | mon1 -> localhost | changed: "/var/lib/zuul/builds/32dd0e7d882c4ae7bf9fecabbb602914/work/logs/mon1"
2026-04-18 16:18:32.933061 | osd1 -> localhost | changed: "/var/lib/zuul/builds/32dd0e7d882c4ae7bf9fecabbb602914/work/logs/osd1"
2026-04-18 16:18:33.131315 | mon1 -> localhost | changed: "/var/lib/zuul/builds/32dd0e7d882c4ae7bf9fecabbb602914/work/artifacts"
2026-04-18 16:18:33.142543 | osd1 -> localhost | ok: "/var/lib/zuul/builds/32dd0e7d882c4ae7bf9fecabbb602914/work/artifacts"
2026-04-18 16:18:33.349585 | mon1 -> localhost | changed: "/var/lib/zuul/builds/32dd0e7d882c4ae7bf9fecabbb602914/work/docs"
2026-04-18 16:18:33.385468 | osd1 -> localhost | ok: "/var/lib/zuul/builds/32dd0e7d882c4ae7bf9fecabbb602914/work/docs"
2026-04-18 16:18:33.385612 | osd1 -> localhost | changed: All items complete
2026-04-18 16:18:33.385668 | 
2026-04-18 16:18:33.402661 | 
2026-04-18 16:18:33.402870 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-18 16:18:34.004188 | mon1 | changed: .d..t...... ./
2026-04-18 16:18:34.010051 | osd1 | changed: .d..t...... ./
2026-04-18 16:18:34.450703 | mon1 | changed: .d..t...... ./
2026-04-18 16:18:34.500438 | osd1 | ok
2026-04-18 16:18:34.883284 | mon1 | changed: .d..t...... ./
2026-04-18 16:18:34.944539 | osd1 | ok
2026-04-18 16:18:34.944858 | osd1 | changed: All items complete
2026-04-18 16:18:34.945060 | 
2026-04-18 16:18:34.976403 | 
2026-04-18 16:18:34.976622 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-18 16:18:35.404928 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007983
2026-04-18 16:18:35.621919 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006789
2026-04-18 16:18:35.648130 | 
2026-04-18 16:18:35.648246 | PLAY [all]
2026-04-18 16:18:35.654454 | 
2026-04-18 16:18:35.654520 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-18 16:18:36.051566 | mon1 | changed
2026-04-18 16:18:36.253830 | osd1 | changed
2026-04-18 16:18:36.266675 | 
2026-04-18 16:18:36.266750 | PLAY RECAP
2026-04-18 16:18:36.266802 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-18 16:18:36.266930 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-18 16:18:36.266976 | 
2026-04-18 16:18:36.383542 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-18 16:18:36.389242 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-18 16:18:36.962908 | 
2026-04-18 16:18:36.963172 | PLAY [localhost]
2026-04-18 16:18:36.985035 | 
2026-04-18 16:18:36.985112 | TASK [Generate Zuul manifest]
2026-04-18 16:18:37.009868 | localhost | ok
2026-04-18 16:18:37.023901 | 
2026-04-18 16:18:37.023979 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-18 16:18:37.347988 | localhost | changed
2026-04-18 16:18:37.361092 | 
2026-04-18 16:18:37.361169 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-18 16:18:37.391969 | localhost | ok
2026-04-18 16:18:37.401231 | 
2026-04-18 16:18:37.401298 | TASK [Upload logs]
2026-04-18 16:18:37.434483 | localhost | ok
2026-04-18 16:18:37.490867 | 
2026-04-18 16:18:37.490971 | TASK [Set zuul-log-path fact]
2026-04-18 16:18:37.512216 | localhost | ok
2026-04-18 16:18:37.523177 | 
2026-04-18 16:18:37.523242 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-18 16:18:37.555627 | localhost | ok
2026-04-18 16:18:37.566522 | 
2026-04-18 16:18:37.566667 | TASK [upload-logs : Create log directories]
2026-04-18 16:18:37.986034 | localhost | changed
2026-04-18 16:18:37.994644 | 
2026-04-18 16:18:37.994715 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-18 16:18:38.413503 | localhost -> localhost | ok: Runtime: 0:00:00.006644
2026-04-18 16:18:38.422417 | 
2026-04-18 16:18:38.422487 | TASK [upload-logs : Upload logs to log server]
2026-04-18 16:18:38.899958 | localhost | Output suppressed because no_log was given
2026-04-18 16:18:38.904715 | 
2026-04-18 16:18:38.904801 | LOOP [upload-logs : Compress console log and json output]
2026-04-18 16:18:38.953968 | localhost | skipping: Conditional result was False
2026-04-18 16:18:38.960713 | localhost | skipping: Conditional result was False
2026-04-18 16:18:38.970563 | 
2026-04-18 16:18:38.970774 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-18 16:18:39.017650 | localhost | skipping: Conditional result was False
2026-04-18 16:18:39.018121 | 
2026-04-18 16:18:39.021576 | localhost | skipping: Conditional result was False
2026-04-18 16:18:39.039910 | 
2026-04-18 16:18:39.040230 | LOOP [upload-logs : Upload console log and json output]