2026-09-15 11:39:06.604815 | Job console starting
2026-09-15 11:39:06.868234 | Updating git repos
2026-09-15 11:39:06.911566 | Cloning repos into workspace
2026-09-15 11:39:07.671404 | Restoring repo states
2026-09-15 11:39:07.680854 | Merging changes
2026-09-15 11:39:08.338262 | Checking out repos
2026-09-15 11:39:08.408425 | Preparing playbooks
2026-09-15 11:39:11.617787 | Running Ansible setup
2026-09-15 11:39:16.230467 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-09-15 11:39:16.863177 | 
2026-09-15 11:39:16.863357 | PLAY [localhost]
2026-09-15 11:39:16.871755 | 
2026-09-15 11:39:16.871862 | TASK [Gathering Facts]
2026-09-15 11:39:18.791439 | localhost | ok
2026-09-15 11:39:18.801484 | 
2026-09-15 11:39:18.801664 | TASK [Setup log path fact]
2026-09-15 11:39:18.820518 | localhost | ok
2026-09-15 11:39:18.833719 | 
2026-09-15 11:39:18.833854 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-09-15 11:39:18.873039 | localhost | ok
2026-09-15 11:39:18.880737 | 
2026-09-15 11:39:18.880840 | TASK [emit-job-header : Print job information]
2026-09-15 11:39:18.921799 | # Job Information
2026-09-15 11:39:18.922013 | Ansible Version: 2.16.18
2026-09-15 11:39:18.922062 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy
2026-09-15 11:39:18.922093 | Pipeline: check
2026-09-15 11:39:18.922122 | Executor: 2d72f0692154
2026-09-15 11:39:18.922150 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/117
2026-09-15 11:39:18.922182 | Event ID: 7c9cc470-b0f9-11f1-9f58-9ec8e2f5aac2
2026-09-15 11:39:18.926222 | 
2026-09-15 11:39:18.926337 | LOOP [emit-job-header : Print node information]
2026-09-15 11:39:19.035435 | localhost | ok:
2026-09-15 11:39:19.036047 | localhost | # Node Information
2026-09-15 11:39:19.036101 | localhost | Inventory Hostname: mon1
2026-09-15 11:39:19.036140 | localhost | Hostname: np0000192827
2026-09-15 11:39:19.036175 | localhost | Username: zuul
2026-09-15 11:39:19.036210 | localhost | Distro: Ubuntu 22.04
2026-09-15 11:39:19.036242 | localhost | Provider: yul1
2026-09-15 11:39:19.036274 | localhost | Region: ca-ymq-1
2026-09-15 11:39:19.036323 | localhost | Label: ubuntu-jammy
2026-09-15 11:39:19.036356 | localhost | Product Name: OpenStack Nova
2026-09-15 11:39:19.036387 | localhost | Interface IP: 162.253.55.3
2026-09-15 11:39:19.077614 | localhost | ok:
2026-09-15 11:39:19.077747 | localhost | # Node Information
2026-09-15 11:39:19.077776 | localhost | Inventory Hostname: osd1
2026-09-15 11:39:19.077800 | localhost | Hostname: np0000192828
2026-09-15 11:39:19.077822 | localhost | Username: zuul
2026-09-15 11:39:19.077844 | localhost | Distro: Ubuntu 22.04
2026-09-15 11:39:19.077866 | localhost | Provider: yul1
2026-09-15 11:39:19.077887 | localhost | Region: ca-ymq-1
2026-09-15 11:39:19.077908 | localhost | Label: ubuntu-jammy
2026-09-15 11:39:19.077929 | localhost | Product Name: OpenStack Nova
2026-09-15 11:39:19.077951 | localhost | Interface IP: 162.253.55.55
2026-09-15 11:39:19.100166 | 
2026-09-15 11:39:19.100423 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-09-15 11:39:19.595614 | localhost -> localhost | changed
2026-09-15 11:39:19.601040 | 
2026-09-15 11:39:19.601405 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-09-15 11:39:20.541501 | localhost -> localhost | changed
2026-09-15 11:39:20.552181 | 
2026-09-15 11:39:20.552354 | PLAY [all]
2026-09-15 11:39:20.569060 | 
2026-09-15 11:39:20.569273 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-09-15 11:39:20.848852 | mon1 -> localhost | ok
2026-09-15 11:39:20.856718 | 
2026-09-15 11:39:20.856802 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-09-15 11:39:20.890066 | mon1 | ok
2026-09-15 11:39:20.895947 | osd1 | ok
2026-09-15 11:39:20.919330 | mon1 | included: /var/lib/zuul/builds/a7d76d697da649a8a2d0e2437fd1f75c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-09-15 11:39:20.919429 | osd1 | included: /var/lib/zuul/builds/a7d76d697da649a8a2d0e2437fd1f75c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-09-15 11:39:20.925813 | 
2026-09-15 11:39:20.925871 | TASK [add-build-sshkey : Create Temp SSH key]
2026-09-15 11:39:22.272186 | mon1 -> localhost | Generating public/private rsa key pair.
2026-09-15 11:39:22.272688 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/a7d76d697da649a8a2d0e2437fd1f75c/work/a7d76d697da649a8a2d0e2437fd1f75c_id_rsa
2026-09-15 11:39:22.272793 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/a7d76d697da649a8a2d0e2437fd1f75c/work/a7d76d697da649a8a2d0e2437fd1f75c_id_rsa.pub
2026-09-15 11:39:22.272863 | mon1 -> localhost | The key fingerprint is:
2026-09-15 11:39:22.272911 | mon1 -> localhost | SHA256:xgVb5e5oKqlXwGvXs5pam68eiXzHyyiTpBdxoKZpfYc zuul-build-sshkey
2026-09-15 11:39:22.272953 | mon1 -> localhost | The key's randomart image is:
2026-09-15 11:39:22.272992 | mon1 -> localhost | +---[RSA 3072]----+
2026-09-15 11:39:22.273031 | mon1 -> localhost | |        . ...    |
2026-09-15 11:39:22.273088 | mon1 -> localhost | |      .  + .     |
2026-09-15 11:39:22.273141 | mon1 -> localhost | |     o .. . .    |
2026-09-15 11:39:22.273181 | mon1 -> localhost | |    o +... .     |
2026-09-15 11:39:22.273219 | mon1 -> localhost | |   =   *S.  .    |
2026-09-15 11:39:22.273255 | mon1 -> localhost | |  + ..Eo+ooo     |
2026-09-15 11:39:22.273316 | mon1 -> localhost | | .   =oB= =o.    |
2026-09-15 11:39:22.273358 | mon1 -> localhost | |    . Oo @..     |
2026-09-15 11:39:22.273395 | mon1 -> localhost | |    .+.*X++      |
2026-09-15 11:39:22.273431 | mon1 -> localhost | +----[SHA256]-----+
2026-09-15 11:39:22.273529 | mon1 -> localhost | ok: Runtime: 0:00:00.885543
2026-09-15 11:39:22.283811 | 
2026-09-15 11:39:22.283924 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-09-15 11:39:22.319277 | mon1 | ok
2026-09-15 11:39:22.335120 | osd1 | ok
2026-09-15 11:39:22.362311 | mon1 | included: /var/lib/zuul/builds/a7d76d697da649a8a2d0e2437fd1f75c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-09-15 11:39:22.362440 | osd1 | included: /var/lib/zuul/builds/a7d76d697da649a8a2d0e2437fd1f75c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-09-15 11:39:22.387055 | 
2026-09-15 11:39:22.387330 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-09-15 11:39:22.417433 | mon1 | skipping: Conditional result was False
2026-09-15 11:39:22.429000 | osd1 | skipping: Conditional result was False
2026-09-15 11:39:22.441341 | 
2026-09-15 11:39:22.441568 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-09-15 11:39:23.061739 | osd1 | changed
2026-09-15 11:39:23.071135 | mon1 | changed
2026-09-15 11:39:23.080815 | 
2026-09-15 11:39:23.080937 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-09-15 11:39:23.304611 | mon1 | ok
2026-09-15 11:39:23.309768 | osd1 | ok
2026-09-15 11:39:23.314203 | 
2026-09-15 11:39:23.314262 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-09-15 11:39:23.850489 | mon1 | changed
2026-09-15 11:39:23.860757 | osd1 | changed
2026-09-15 11:39:23.871548 | 
2026-09-15 11:39:23.871724 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-09-15 11:39:24.440971 | mon1 | changed
2026-09-15 11:39:24.444954 | osd1 | changed
2026-09-15 11:39:24.450377 | 
2026-09-15 11:39:24.450436 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-09-15 11:39:24.474041 | mon1 | skipping: Conditional result was False
2026-09-15 11:39:24.484911 | osd1 | skipping: Conditional result was False
2026-09-15 11:39:24.491173 | 
2026-09-15 11:39:24.491240 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-09-15 11:39:24.951090 | mon1 -> localhost | changed
2026-09-15 11:39:24.970826 | 
2026-09-15 11:39:24.971002 | TASK [add-build-sshkey : Add back temp key]
2026-09-15 11:39:25.361819 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/a7d76d697da649a8a2d0e2437fd1f75c/work/a7d76d697da649a8a2d0e2437fd1f75c_id_rsa (zuul-build-sshkey)
2026-09-15 11:39:25.362184 | mon1 -> localhost | ok: Runtime: 0:00:00.012467
2026-09-15 11:39:25.374767 | 
2026-09-15 11:39:25.374943 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-09-15 11:39:25.688199 | osd1 | ok
2026-09-15 11:39:25.701798 | mon1 | ok
2026-09-15 11:39:25.709806 | 
2026-09-15 11:39:25.709944 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-09-15 11:39:25.738760 | mon1 | skipping: Conditional result was False
2026-09-15 11:39:25.761037 | osd1 | skipping: Conditional result was False
2026-09-15 11:39:25.780246 | 
2026-09-15 11:39:25.780415 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-09-15 11:39:26.120703 | osd1 | ok
2026-09-15 11:39:26.161212 | mon1 | ok
2026-09-15 11:39:26.175370 | 
2026-09-15 11:39:26.175907 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-09-15 11:39:26.917475 | osd1 | Output suppressed because no_log was given
2026-09-15 11:39:26.927204 | mon1 | Output suppressed because no_log was given
2026-09-15 11:39:26.950131 | 
2026-09-15 11:39:26.950485 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-09-15 11:39:27.168225 | mon1 | ok: "logs"
2026-09-15 11:39:27.168931 | mon1 | ok: All items complete
2026-09-15 11:39:27.169018 | 
2026-09-15 11:39:27.203789 | osd1 | ok: "logs"
2026-09-15 11:39:27.321837 | mon1 | ok: "artifacts"
2026-09-15 11:39:27.391492 | osd1 | ok: "artifacts"
2026-09-15 11:39:27.478661 | mon1 | ok: "docs"
2026-09-15 11:39:27.595236 | osd1 | ok: "docs"
2026-09-15 11:39:27.609537 | 
2026-09-15 11:39:27.609711 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-09-15 11:39:27.820382 | mon1 | changed: "logs"
2026-09-15 11:39:27.820797 | mon1 | ok: All items complete
2026-09-15 11:39:27.820853 | 
2026-09-15 11:39:27.845335 | osd1 | changed: "logs"
2026-09-15 11:39:27.997138 | mon1 | changed: "artifacts"
2026-09-15 11:39:28.084115 | osd1 | changed: "artifacts"
2026-09-15 11:39:28.188594 | mon1 | changed: "docs"
2026-09-15 11:39:28.219721 | osd1 | changed: "docs"
2026-09-15 11:39:28.237885 | 
2026-09-15 11:39:28.238056 | PLAY RECAP
2026-09-15 11:39:28.238144 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-15 11:39:28.238204 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-09-15 11:39:28.238257 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-09-15 11:39:28.238323 | 
2026-09-15 11:39:28.436336 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-09-15 11:39:28.438899 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-09-15 11:39:29.044906 | 
2026-09-15 11:39:29.045045 | PLAY [all]
2026-09-15 11:39:29.055563 | 
2026-09-15 11:39:29.055637 | TASK [setup-uv : Extract archive]
2026-09-15 11:39:31.439825 | mon1 | changed
2026-09-15 11:39:31.516189 | osd1 | changed
2026-09-15 11:39:31.525119 | 
2026-09-15 11:39:31.525306 | TASK [setup-uv : Print version]
2026-09-15 11:39:31.941678 | mon1 | uv 0.8.13
2026-09-15 11:39:31.945051 | osd1 | uv 0.8.13
2026-09-15 11:39:32.100456 | mon1 | ok: Runtime: 0:00:00.011445
2026-09-15 11:39:32.118440 | osd1 | ok: Runtime: 0:00:00.012730
2026-09-15 11:39:32.142659 | 
2026-09-15 11:39:32.142817 | TASK [Install Ansible collection siblings]
2026-09-15 11:39:32.558476 | mon1 | ok:
2026-09-15 11:39:32.558736 | mon1 | Skipping community.general: no checked-out sibling
2026-09-15 11:39:32.558792 | mon1 | Skipping ansible.utils: no checked-out sibling
2026-09-15 11:39:32.558835 | mon1 | Skipping vexxhost.containers: no checked-out sibling
2026-09-15 11:39:32.561699 | 
2026-09-15 11:39:32.561791 | PLAY RECAP
2026-09-15 11:39:32.561871 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-15 11:39:32.561946 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-15 11:39:32.561986 | 
2026-09-15 11:39:32.713947 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-09-15 11:39:32.720352 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-09-15 11:39:33.292830 | 
2026-09-15 11:39:33.292994 | PLAY [all]
2026-09-15 11:39:33.304238 | 
2026-09-15 11:39:33.304360 | LOOP [Check inventory directories]
2026-09-15 11:39:33.703984 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph"
2026-09-15 11:39:33.868921 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory"
2026-09-15 11:39:34.019087 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory"
2026-09-15 11:39:34.034279 | 
2026-09-15 11:39:34.034551 | LOOP [Copy inventory file for Zuul]
2026-09-15 11:39:34.915091 | mon1 | changed:
2026-09-15 11:39:34.915318 | mon1 | {
2026-09-15 11:39:34.915354 | mon1 |   "ansible_loop_var": "item",
2026-09-15 11:39:34.915382 | mon1 |   "changed": false,
2026-09-15 11:39:34.915402 | mon1 |   "failed": false,
2026-09-15 11:39:34.915424 | mon1 |   "invocation": {
2026-09-15 11:39:34.915442 | mon1 |     "module_args": {
2026-09-15 11:39:34.915459 | mon1 |       "checksum_algorithm": "sha1",
2026-09-15 11:39:34.915476 | mon1 |       "follow": true,
2026-09-15 11:39:34.915493 | mon1 |       "get_attributes": true,
2026-09-15 11:39:34.915511 | mon1 |       "get_checksum": true,
2026-09-15 11:39:34.915527 | mon1 |       "get_mime": true,
2026-09-15 11:39:34.915543 | mon1 |       "path": "src/github.com/vexxhost/ansible-collection-ceph"
2026-09-15 11:39:34.915559 | mon1 |     }
2026-09-15 11:39:34.915579 | mon1 |   },
2026-09-15 11:39:34.915596 | mon1 |   "item": "src/github.com/vexxhost/ansible-collection-ceph",
2026-09-15 11:39:34.915612 | mon1 |   "stat": {
2026-09-15 11:39:34.915628 | mon1 |     "atime": 1789472366.8148115,
2026-09-15 11:39:34.915645 | mon1 |     "attr_flags": "e",
2026-09-15 11:39:34.915662 | mon1 |     "attributes": [
2026-09-15 11:39:34.915677 | mon1 |       "extents"
2026-09-15 11:39:34.915695 | mon1 |     ],
2026-09-15 11:39:34.915711 | mon1 |     "block_size": 4096,
2026-09-15 11:39:34.915726 | mon1 |     "blocks": 8,
2026-09-15 11:39:34.915742 | mon1 |     "charset": "unknown",
2026-09-15 11:39:34.915759 | mon1 |     "ctime": 1789472366.8188117,
2026-09-15 11:39:34.915776 | mon1 |     "dev": 64513,
2026-09-15 11:39:34.915792 | mon1 |     "device_type": 0,
2026-09-15 11:39:34.915808 | mon1 |     "executable": true,
2026-09-15 11:39:34.915823 | mon1 |     "exists": true,
2026-09-15 11:39:34.915838 | mon1 |     "gid": 1000,
2026-09-15 11:39:34.915854 | mon1 |     "gr_name": "zuul",
2026-09-15 11:39:34.915869 | mon1 |     "inode": 1042973,
2026-09-15 11:39:34.915884 | mon1 |     "isblk": false,
2026-09-15 11:39:34.915900 | mon1 |     "ischr": false,
2026-09-15 11:39:34.915915 | mon1 |     "isdir": true,
2026-09-15 11:39:34.915933 | mon1 |     "isfifo": false,
2026-09-15 11:39:34.915949 | mon1 |     "isgid": false,
2026-09-15 11:39:34.915964 | mon1 |     "islnk": false,
2026-09-15 11:39:34.915979 | mon1 |     "isreg": false,
2026-09-15 11:39:34.915994 | mon1 |     "issock": false,
2026-09-15 11:39:34.916009 | mon1 |     "isuid": false,
2026-09-15 11:39:34.916023 | mon1 |     "mimetype": "unknown",
2026-09-15 11:39:34.916038 | mon1 |     "mode": "0755",
2026-09-15 11:39:34.916052 | mon1 |     "mtime": 1789472348.093632,
2026-09-15 11:39:34.916069 | mon1 |     "nlink": 10,
2026-09-15 11:39:34.916085 | mon1 |     "path": "src/github.com/vexxhost/ansible-collection-ceph",
2026-09-15 11:39:34.916100 | mon1 |     "pw_name": "zuul",
2026-09-15 11:39:34.916118 | mon1 |     "readable": true,
2026-09-15 11:39:34.916134 | mon1 |     "rgrp": true,
2026-09-15 11:39:34.916149 | mon1 |     "roth": true,
2026-09-15 11:39:34.916166 | mon1 |     "rusr": true,
2026-09-15 11:39:34.916181 | mon1 |     "size": 4096,
2026-09-15 11:39:34.916211 | mon1 |     "uid": 1000,
2026-09-15 11:39:34.916227 | mon1 |     "version": "984030659",
2026-09-15 11:39:34.916242 | mon1 |     "wgrp": false,
2026-09-15 11:39:34.916263 | mon1 |     "woth": false,
2026-09-15 11:39:34.916302 | mon1 |     "writeable": true,
2026-09-15 11:39:34.916328 | mon1 |     "wusr": true,
2026-09-15 11:39:34.916347 | mon1 |     "xgrp": true,
2026-09-15 11:39:34.916364 | mon1 |     "xoth": true,
2026-09-15 11:39:34.916381 | mon1 |     "xusr": true
2026-09-15 11:39:34.916397 | mon1 |   }
2026-09-15 11:39:34.916413 | mon1 | }
2026-09-15 11:39:34.916448 | mon1 | ok: All items complete
2026-09-15 11:39:34.916469 | 
2026-09-15 11:39:34.918106 | mon1 | skipping: Conditional result was False
2026-09-15 11:39:34.923266 | mon1 | skipping: Conditional result was False
2026-09-15 11:39:34.938951 | 
2026-09-15 11:39:34.939040 | LOOP [Switch "ansible_host" to private IP]
2026-09-15 11:39:35.367308 | mon1 | changed: 2 replacements made
2026-09-15 11:39:35.370341 | mon1 | skipping: Conditional result was False
2026-09-15 11:39:35.371709 | mon1 | skipping: Conditional result was False
2026-09-15 11:39:35.389695 | 
2026-09-15 11:39:35.389864 | TASK [Run Molecule scenario]
2026-09-15 11:39:36.099232 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-09-15 11:39:36.704009 | mon1 |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-09-15 11:39:36.912601 | mon1 | Using CPython 3.13.7
2026-09-15 11:39:36.912680 | mon1 | Creating virtual environment at: .venv
2026-09-15 11:39:36.945600 | mon1 | Downloading pygments (1.2MiB)
2026-09-15 11:39:36.946982 | mon1 | Downloading netaddr (2.2MiB)
2026-09-15 11:39:36.947133 | mon1 | Downloading ansible-core (2.3MiB)
2026-09-15 11:39:36.957832 | mon1 | Downloading cryptography (4.3MiB)
2026-09-15 11:39:37.130051 | mon1 |  Downloading netaddr
2026-09-15 11:39:37.142151 | mon1 |  Downloading cryptography
2026-09-15 11:39:37.186166 | mon1 |  Downloading pygments
2026-09-15 11:39:37.329678 | mon1 |  Downloading ansible-core
2026-09-15 11:39:37.361244 | mon1 | Installed 36 packages in 30ms
2026-09-15 11:39:38.569144 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-09-15 11:39:38.569251 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-09-15 11:39:39.639648 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-09-15 11:39:39.639750 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-09-15 11:47:20.413369 | mon1 | INFO     [default > dependency] Executing
2026-09-15 11:47:20.413745 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-09-15 11:47:20.414116 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-09-15 11:47:20.414335 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-09-15 11:47:20.424350 | mon1 | INFO     [default > cleanup] Executing
2026-09-15 11:47:20.424923 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-09-15 11:47:20.434876 | mon1 | INFO     [default > destroy] Executing
2026-09-15 11:47:20.435003 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-09-15 11:47:20.435153 | mon1 | INFO     [default > destroy] Executed: Successful
2026-09-15 11:47:20.444314 | mon1 | INFO     [default > syntax] Executing
2026-09-15 11:47:21.684281 | mon1 |
2026-09-15 11:47:21.684409 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-09-15 11:47:21.801069 | mon1 | INFO     [default > syntax] Executed: Successful
2026-09-15 11:47:21.812422 | mon1 | INFO     [default > create] Executing
2026-09-15 11:47:21.815438 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-09-15 11:47:21.827151 | mon1 | INFO     [default > prepare] Executing
2026-09-15 11:47:22.674637 | mon1 |
2026-09-15 11:47:22.674790 | mon1 | PLAY [Prepare] *****************************************************************
2026-09-15 11:47:22.675174 | mon1 |
2026-09-15 11:47:22.675455 | mon1 | TASK [Gathering Facts] *********************************************************
2026-09-15 11:47:22.675674 | mon1 | Tuesday 15 September 2026  11:47:22 +0000 (0:00:00.028)       0:00:00.028 *****
2026-09-15 11:47:23.928532 | mon1 | [WARNING]: Host 'osd1' is using the discovered Python interpreter at '/usr/bin/python3.10', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.21/reference_appendices/interpreter_discovery.html for more information.
2026-09-15 11:47:23.938193 | mon1 | [WARNING]: Host 'mon1' is using the discovered Python interpreter at '/usr/bin/python3.10', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.21/reference_appendices/interpreter_discovery.html for more information.
2026-09-15 11:47:23.945998 | mon1 | ok: [osd1]
2026-09-15 11:47:23.946303 | mon1 | ok: [mon1]
2026-09-15 11:47:23.946536 | mon1 |
2026-09-15 11:47:23.946808 | mon1 | TASK [Configure short hostname] ************************************************
2026-09-15 11:47:23.947053 | mon1 | Tuesday 15 September 2026  11:47:23 +0000 (0:00:01.271)       0:00:01.299 *****
2026-09-15 11:47:24.831032 | mon1 | changed: [mon1]
2026-09-15 11:47:24.831129 | mon1 | changed: [osd1]
2026-09-15 11:47:24.831195 | mon1 |
2026-09-15 11:47:24.831317 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-09-15 11:47:24.831434 | mon1 | Tuesday 15 September 2026  11:47:24 +0000 (0:00:00.884)       0:00:02.184 *****
2026-09-15 11:47:25.215311 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually
2026-09-15 11:47:25.229809 | mon1 | changed: [mon1]
2026-09-15 11:47:25.229922 | mon1 | changed: [osd1]
2026-09-15 11:47:25.230056 | mon1 |
2026-09-15 11:47:25.230218 | mon1 | TASK [Update apt cache] ********************************************************
2026-09-15 11:47:25.230342 | mon1 | Tuesday 15 September 2026  11:47:25 +0000 (0:00:00.399)       0:00:02.583 *****
2026-09-15 11:47:33.377878 | mon1 | changed: [osd1]
2026-09-15 11:47:33.377953 | mon1 | changed: [mon1]
2026-09-15 11:47:33.378006 | mon1 |
2026-09-15 11:47:33.378098 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-09-15 11:47:33.378200 | mon1 |
2026-09-15 11:47:33.378307 | mon1 | TASK [Gathering Facts] *********************************************************
2026-09-15 11:47:33.378468 | mon1 | Tuesday 15 September 2026  11:47:33 +0000 (0:00:08.147)       0:00:10.730 *****
2026-09-15 11:47:34.255616 | mon1 | ok: [osd1]
2026-09-15 11:47:34.255912 | mon1 |
2026-09-15 11:47:34.256242 | mon1 | TASK [Install depedencies] *****************************************************
2026-09-15 11:47:34.256451 | mon1 | Tuesday 15 September 2026  11:47:34 +0000 (0:00:00.878)       0:00:11.609 *****
2026-09-15 11:47:58.226891 | mon1 | changed: [osd1]
2026-09-15 11:47:58.226986 | mon1 |
2026-09-15 11:47:58.227191 | mon1 | TASK [Start up service] ********************************************************
2026-09-15 11:47:58.227395 | mon1 | Tuesday 15 September 2026  11:47:58 +0000 (0:00:23.970)       0:00:35.580 *****
2026-09-15 11:47:58.964418 | mon1 | ok: [osd1]
2026-09-15 11:47:58.964510 | mon1 |
2026-09-15 11:47:58.964588 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-09-15 11:47:58.964721 | mon1 | Tuesday 15 September 2026  11:47:58 +0000 (0:00:00.737)       0:00:36.317 *****
2026-09-15 11:47:59.370537 | mon1 | ok: [osd1]
2026-09-15 11:47:59.370615 | mon1 |
2026-09-15 11:47:59.370711 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-09-15 11:47:59.370830 | mon1 | Tuesday 15 September 2026  11:47:59 +0000 (0:00:00.406)       0:00:36.723 *****
2026-09-15 11:48:00.226252 | mon1 | changed: [osd1]
2026-09-15 11:48:00.226365 | mon1 |
2026-09-15 11:48:00.226535 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-09-15 11:48:00.226651 | mon1 | Tuesday 15 September 2026  11:48:00 +0000 (0:00:00.856)       0:00:37.579 *****
2026-09-15 11:48:00.497012 | mon1 | ok: [osd1]
2026-09-15 11:48:00.497161 | mon1 |
2026-09-15 11:48:00.497239 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-09-15 11:48:00.497356 | mon1 | Tuesday 15 September 2026  11:48:00 +0000 (0:00:00.271)       0:00:37.850 *****
2026-09-15 11:48:00.528865 | mon1 | skipping: [osd1]
2026-09-15 11:48:00.529041 | mon1 |
2026-09-15 11:48:00.529301 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-09-15 11:48:00.529495 | mon1 | Tuesday 15 September 2026  11:48:00 +0000 (0:00:00.031)       0:00:37.882 *****
2026-09-15 11:48:01.250018 | mon1 | changed: [osd1] => (item=osd0)
2026-09-15 11:48:01.250259 | mon1 | changed: [osd1] => (item=osd1)
2026-09-15 11:48:01.250527 | mon1 | changed: [osd1] => (item=osd2)
2026-09-15 11:48:01.250765 | mon1 |
2026-09-15 11:48:01.251029 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-09-15 11:48:01.251325 | mon1 | Tuesday 15 September 2026  11:48:01 +0000 (0:00:00.721)       0:00:38.603 *****
2026-09-15 11:48:02.148307 | mon1 | changed: [osd1] => (item=osd0)
2026-09-15 11:48:02.148367 | mon1 | changed: [osd1] => (item=osd1)
2026-09-15 11:48:02.148372 | mon1 | changed: [osd1] => (item=osd2)
2026-09-15 11:48:02.148378 | mon1 |
2026-09-15 11:48:02.148397 | mon1 | TASK [Start loop devices] ******************************************************
2026-09-15 11:48:02.148403 | mon1 | Tuesday 15 September 2026  11:48:02 +0000 (0:00:00.897)       0:00:39.500 *****
2026-09-15 11:48:03.188535 | mon1 | changed: [osd1] => (item=osd0)
2026-09-15 11:48:03.188601 | mon1 | changed: [osd1] => (item=osd1)
2026-09-15 11:48:03.188612 | mon1 | changed: [osd1] => (item=osd2)
2026-09-15 11:48:03.188622 | mon1 |
2026-09-15 11:48:03.188633 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-09-15 11:48:03.188643 | mon1 | Tuesday 15 September 2026  11:48:03 +0000 (0:00:01.040)       0:00:40.541 *****
2026-09-15 11:48:06.493442 | mon1 | changed: [osd1] => (item=osd0)
2026-09-15 11:48:06.493524 | mon1 | changed: [osd1] => (item=osd1)
2026-09-15 11:48:06.493562 | mon1 | changed: [osd1] => (item=osd2)
2026-09-15 11:48:06.493902 | mon1 |
2026-09-15 11:48:06.493970 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-09-15 11:48:06.493977 | mon1 | Tuesday 15 September 2026  11:48:06 +0000 (0:00:03.306)       0:00:43.847 *****
2026-09-15 11:48:08.758571 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-09-15 11:48:08.758667 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-09-15 11:48:08.761149 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-09-15 11:48:08.761305 | mon1 |
2026-09-15 11:48:08.761317 | mon1 | PLAY RECAP *********************************************************************
2026-09-15 11:48:08.761325 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-09-15 11:48:08.761333 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-09-15 11:48:08.761341 | mon1 |
2026-09-15 11:48:08.761347 | mon1 |
2026-09-15 11:48:08.761353 | mon1 | TASKS RECAP ********************************************************************
2026-09-15 11:48:08.761359 | mon1 | Tuesday 15 September 2026  11:48:08 +0000 (0:00:02.265)       0:00:46.113 *****
2026-09-15 11:48:08.761365 | mon1 | ===============================================================================
2026-09-15 11:48:08.761371 | mon1 | Install depedencies ---------------------------------------------------- 23.97s
2026-09-15 11:48:08.761377 | mon1 | Update apt cache -------------------------------------------------------- 8.15s
2026-09-15 11:48:08.761383 | mon1 | Create a volume group for each loop device ------------------------------ 3.31s
2026-09-15 11:48:08.761390 | mon1 | Create a logical volume for each loop device ---------------------------- 2.27s
2026-09-15 11:48:08.761405 | mon1 | Gathering Facts --------------------------------------------------------- 1.27s
2026-09-15 11:48:08.761412 | mon1 | Start loop devices ------------------------------------------------------ 1.04s
2026-09-15 11:48:08.761417 | mon1 | Set permissions on loopback devices ------------------------------------- 0.90s
2026-09-15 11:48:08.762522 | mon1 | Configure short hostname ------------------------------------------------ 0.88s
2026-09-15 11:48:08.762589 | mon1 | Gathering Facts --------------------------------------------------------- 0.88s
2026-09-15 11:48:08.762596 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.86s
2026-09-15 11:48:08.762603 | mon1 | Start up service -------------------------------------------------------- 0.74s
2026-09-15 11:48:08.762609 | mon1 | Create devices for Ceph ------------------------------------------------- 0.72s
2026-09-15 11:48:08.762615 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.41s
2026-09-15 11:48:08.762621 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.40s
2026-09-15 11:48:08.762627 | mon1 | Get list of all loopback devices ---------------------------------------- 0.27s
2026-09-15 11:48:08.762633 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-09-15 11:48:08.958692 | mon1 | INFO     [default > prepare] Executed: Successful
2026-09-15 11:48:08.969571 | mon1 | INFO     [default > converge] Executing
2026-09-15 11:48:10.252977 | mon1 |
2026-09-15 11:48:10.253480 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-09-15 11:48:10.253774 | mon1 |
2026-09-15 11:48:10.254239 | mon1 | TASK [Gathering Facts] *********************************************************
2026-09-15 11:48:10.254651 | mon1 | Tuesday 15 September 2026  11:48:10 +0000 (0:00:00.063)       0:00:00.063 *****
2026-09-15 11:48:11.286574 | mon1 | [WARNING]: Host 'mon1' is using the discovered Python interpreter at '/usr/bin/python3.10', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.21/reference_appendices/interpreter_discovery.html for more information.
2026-09-15 11:48:11.297756 | mon1 | ok: [mon1]
2026-09-15 11:48:11.297983 | mon1 |
2026-09-15 11:48:11.298170 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-15 11:48:11.298325 | mon1 | Tuesday 15 September 2026  11:48:11 +0000 (0:00:01.044)       0:00:01.108 *****
2026-09-15 11:48:11.769609 | mon1 | ok: [mon1]
2026-09-15 11:48:11.769714 | mon1 |
2026-09-15 11:48:11.769727 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-15 11:48:11.769826 | mon1 | Tuesday 15 September 2026  11:48:11 +0000 (0:00:00.472)       0:00:01.580 *****
2026-09-15 11:48:11.837640 | mon1 | skipping: [mon1]
2026-09-15 11:48:11.837726 | mon1 |
2026-09-15 11:48:11.837844 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-09-15 11:48:11.838078 | mon1 | Tuesday 15 September 2026  11:48:11 +0000 (0:00:00.065)       0:00:01.646 *****
2026-09-15 11:48:12.349612 | mon1 | changed: [mon1]
2026-09-15 11:48:12.349699 | mon1 |
2026-09-15 11:48:12.349764 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-15 11:48:12.349864 | mon1 | Tuesday 15 September 2026  11:48:12 +0000 (0:00:00.513)       0:00:02.159 *****
2026-09-15 11:48:12.445736 | mon1 | ok: [mon1] => {
2026-09-15 11:48:12.445952 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-09-15 11:48:12.446072 | mon1 | }
2026-09-15 11:48:12.446216 | mon1 |
2026-09-15 11:48:12.446335 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-15 11:48:12.446454 | mon1 | Tuesday 15 September 2026  11:48:12 +0000 (0:00:00.094)       0:00:02.254 *****
2026-09-15 11:48:13.281699 | mon1 | changed: [mon1]
2026-09-15 11:48:13.281936 | mon1 |
2026-09-15 11:48:13.282100 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-15 11:48:13.282270 | mon1 | Tuesday 15 September 2026  11:48:13 +0000 (0:00:00.836)       0:00:03.091 *****
2026-09-15 11:48:13.321616 | mon1 | skipping: [mon1]
2026-09-15 11:48:13.321709 | mon1 |
2026-09-15 11:48:13.321830 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-15 11:48:13.322052 | mon1 | Tuesday 15 September 2026  11:48:13 +0000 (0:00:00.039)       0:00:03.130 *****
2026-09-15 11:48:13.361635 | mon1 | skipping: [mon1]
2026-09-15 11:48:13.361729 | mon1 |
2026-09-15 11:48:13.361794 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-15 11:48:13.361974 | mon1 | Tuesday 15 September 2026  11:48:13 +0000 (0:00:00.039)       0:00:03.170 *****
2026-09-15 11:48:13.629623 | mon1 | ok: [mon1]
2026-09-15 11:48:13.629795 | mon1 |
2026-09-15 11:48:13.629920 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-15 11:48:13.630041 | mon1 | Tuesday 15 September 2026  11:48:13 +0000 (0:00:00.270)       0:00:03.440 *****
2026-09-15 11:48:15.196712 | mon1 | ok: [mon1]
2026-09-15 11:48:15.196941 | mon1 |
2026-09-15 11:48:15.197114 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-15 11:48:15.197304 | mon1 | Tuesday 15 September 2026  11:48:15 +0000 (0:00:01.566)       0:00:05.007 *****
2026-09-15 11:48:15.299026 | mon1 | ok: [mon1] => {
2026-09-15 11:48:15.299116 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-09-15 11:48:15.299687 | mon1 | }
2026-09-15 11:48:15.299766 | mon1 |
2026-09-15 11:48:15.299775 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-15 11:48:15.299783 | mon1 | Tuesday 15 September 2026  11:48:15 +0000 (0:00:00.102)       0:00:05.109 *****
2026-09-15 11:48:16.421951 | mon1 | changed: [mon1]
2026-09-15 11:48:16.422039 | mon1 |
2026-09-15 11:48:16.422549 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-15 11:48:16.422829 | mon1 | Tuesday 15 September 2026  11:48:16 +0000 (0:00:01.122)       0:00:06.232 *****
2026-09-15 11:48:19.604058 | mon1 | changed: [mon1]
2026-09-15 11:48:19.604329 | mon1 |
2026-09-15 11:48:19.604851 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-09-15 11:48:19.604926 | mon1 | Tuesday 15 September 2026  11:48:19 +0000 (0:00:03.182)       0:00:09.414 *****
2026-09-15 11:48:19.630636 | mon1 | skipping: [mon1]
2026-09-15 11:48:19.630736 | mon1 |
2026-09-15 11:48:19.630750 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-09-15 11:48:19.630816 | mon1 | Tuesday 15 September 2026  11:48:19 +0000 (0:00:00.027)       0:00:09.441 *****
2026-09-15 11:48:19.663741 | mon1 | skipping: [mon1]
2026-09-15 11:48:19.664053 | mon1 |
2026-09-15 11:48:19.664340 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-09-15 11:48:19.664708 | mon1 | Tuesday 15 September 2026  11:48:19 +0000 (0:00:00.032)       0:00:09.474 *****
2026-09-15 11:48:19.699381 | mon1 | skipping: [mon1]
2026-09-15 11:48:19.699458 | mon1 |
2026-09-15 11:48:19.699469 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-09-15 11:48:19.699480 | mon1 | Tuesday 15 September 2026  11:48:19 +0000 (0:00:00.034)       0:00:09.508 *****
2026-09-15 11:48:26.932452 | mon1 | changed: [mon1]
2026-09-15 11:48:26.932530 | mon1 |
2026-09-15 11:48:26.932776 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-09-15 11:48:26.932824 | mon1 | Tuesday 15 September 2026  11:48:26 +0000 (0:00:07.234)       0:00:16.743 *****
2026-09-15 11:48:27.667046 | mon1 | changed: [mon1]
2026-09-15 11:48:27.667136 | mon1 |
2026-09-15 11:48:27.667211 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-09-15 11:48:27.667377 | mon1 | Tuesday 15 September 2026  11:48:27 +0000 (0:00:00.734)       0:00:17.477 *****
2026-09-15 11:48:28.925101 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-09-15 11:48:28.925299 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-09-15 11:48:28.925536 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-09-15 11:48:28.925748 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-09-15 11:48:28.925956 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-09-15 11:48:28.926136 | mon1 |
2026-09-15 11:48:28.926352 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-09-15 11:48:28.926546 | mon1 | Tuesday 15 September 2026  11:48:28 +0000 (0:00:01.257)       0:00:18.735 *****
2026-09-15 11:48:29.709401 | mon1 | changed: [mon1]
2026-09-15 11:48:29.709573 | mon1 |
2026-09-15 11:48:29.709871 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-09-15 11:48:29.710087 | mon1 | Tuesday 15 September 2026  11:48:29 +0000 (0:00:00.774)       0:00:19.510 *****
2026-09-15 11:48:29.710295 | mon1 |
2026-09-15 11:48:29.710560 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-09-15 11:48:29.710772 | mon1 | Tuesday 15 September 2026  11:48:29 +0000 (0:00:00.009)       0:00:19.519 *****
2026-09-15 11:48:30.699603 | mon1 | ok: [mon1]
2026-09-15 11:48:30.699687 | mon1 |
2026-09-15 11:48:30.699781 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-09-15 11:48:30.699912 | mon1 | Tuesday 15 September 2026  11:48:30 +0000 (0:00:00.990)       0:00:20.510 *****
2026-09-15 11:48:31.252160 | mon1 | changed: [mon1]
2026-09-15 11:48:31.252302 | mon1 |
2026-09-15 11:48:31.252318 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-09-15 11:48:31.252500 | mon1 | Tuesday 15 September 2026  11:48:31 +0000 (0:00:00.552)       0:00:21.062 *****
2026-09-15 11:48:31.833489 | mon1 | changed: [mon1]
2026-09-15 11:48:31.833590 | mon1 |
2026-09-15 11:48:31.833599 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-15 11:48:31.833607 | mon1 | Tuesday 15 September 2026  11:48:31 +0000 (0:00:00.581)       0:00:21.644 *****
2026-09-15 11:48:32.105641 | mon1 | ok: [mon1]
2026-09-15 11:48:32.105727 | mon1 |
2026-09-15 11:48:32.105999 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-15 11:48:32.106059 | mon1 | Tuesday 15 September 2026  11:48:32 +0000 (0:00:00.272)       0:00:21.916 *****
2026-09-15 11:48:32.184537 | mon1 | ok: [mon1] => {
2026-09-15 11:48:32.184623 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-09-15 11:48:32.184633 | mon1 | }
2026-09-15 11:48:32.184952 | mon1 |
2026-09-15 11:48:32.185016 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-15 11:48:32.185022 | mon1 | Tuesday 15 September 2026  11:48:32 +0000 (0:00:00.079)       0:00:21.995 *****
2026-09-15 11:48:35.184040 | mon1 | changed: [mon1]
2026-09-15 11:48:35.184105 | mon1 |
2026-09-15 11:48:35.184147 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-15 11:48:35.184240 | mon1 | Tuesday 15 September 2026  11:48:35 +0000 (0:00:02.999)       0:00:24.995 *****
2026-09-15 11:48:39.863083 | mon1 | changed: [mon1]
2026-09-15 11:48:39.863908 | mon1 |
2026-09-15 11:48:39.863945 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-09-15 11:48:39.863957 | mon1 | Tuesday 15 September 2026  11:48:39 +0000 (0:00:04.678)       0:00:29.673 *****
2026-09-15 11:48:41.070206 | mon1 | ok: [mon1]
2026-09-15 11:48:41.070260 | mon1 |
2026-09-15 11:48:41.070267 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-09-15 11:48:41.070273 | mon1 | Tuesday 15 September 2026  11:48:41 +0000 (0:00:01.207)       0:00:30.881 *****
2026-09-15 11:48:41.479371 | mon1 | changed: [mon1]
2026-09-15 11:48:41.479453 | mon1 |
2026-09-15 11:48:41.479461 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-09-15 11:48:41.479597 | mon1 | Tuesday 15 September 2026  11:48:41 +0000 (0:00:00.409)       0:00:31.290 *****
2026-09-15 11:48:42.067497 | mon1 | changed: [mon1]
2026-09-15 11:48:42.067569 | mon1 |
2026-09-15 11:48:42.068026 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-09-15 11:48:42.068242 | mon1 | Tuesday 15 September 2026  11:48:42 +0000 (0:00:00.587)       0:00:31.877 *****
2026-09-15 11:48:42.967221 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-09-15 11:48:42.967362 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-09-15 11:48:42.968163 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-09-15 11:48:42.968236 | mon1 |
2026-09-15 11:48:42.968248 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-09-15 11:48:42.968258 | mon1 | Tuesday 15 September 2026  11:48:42 +0000 (0:00:00.899)       0:00:32.777 *****
2026-09-15 11:48:43.552615 | mon1 | changed: [mon1]
2026-09-15 11:48:43.552709 | mon1 |
2026-09-15 11:48:43.552722 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-09-15 11:48:43.552875 | mon1 | Tuesday 15 September 2026  11:48:43 +0000 (0:00:00.585)       0:00:33.363 *****
2026-09-15 11:48:44.206605 | mon1 | changed: [mon1]
2026-09-15 11:48:44.206718 | mon1 |
2026-09-15 11:48:44.206731 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-09-15 11:48:44.206771 | mon1 | Tuesday 15 September 2026  11:48:44 +0000 (0:00:00.643)       0:00:34.007 *****
2026-09-15 11:48:44.207146 | mon1 |
2026-09-15 11:48:44.207209 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-09-15 11:48:44.207215 | mon1 | Tuesday 15 September 2026  11:48:44 +0000 (0:00:00.010)       0:00:34.017 *****
2026-09-15 11:48:45.002481 | mon1 | ok: [mon1]
2026-09-15 11:48:45.002566 | mon1 |
2026-09-15 11:48:45.002835 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-09-15 11:48:45.002911 | mon1 | Tuesday 15 September 2026  11:48:45 +0000 (0:00:00.795)       0:00:34.813 *****
2026-09-15 11:48:46.035159 | mon1 | changed: [mon1]
2026-09-15 11:48:46.035253 | mon1 |
2026-09-15 11:48:46.035262 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-09-15 11:48:46.035269 | mon1 | Tuesday 15 September 2026  11:48:46 +0000 (0:00:01.032)       0:00:35.845 *****
2026-09-15 11:48:46.690831 | mon1 | changed: [mon1]
2026-09-15 11:48:46.690933 | mon1 |
2026-09-15 11:48:46.691182 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-09-15 11:48:46.691235 | mon1 | Tuesday 15 September 2026  11:48:46 +0000 (0:00:00.656)       0:00:36.501 *****
2026-09-15 11:48:46.750201 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-09-15 11:48:46.750294 | mon1 |
2026-09-15 11:48:46.750430 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-09-15 11:48:46.750550 | mon1 | Tuesday 15 September 2026  11:48:46 +0000 (0:00:00.058)       0:00:36.560 *****
2026-09-15 11:49:13.429735 | mon1 | changed: [mon1]
2026-09-15 11:49:13.429922 | mon1 |
2026-09-15 11:49:13.429931 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-09-15 11:49:13.430005 | mon1 | Tuesday 15 September 2026  11:49:13 +0000 (0:00:26.670)       0:01:03.230 *****
2026-09-15 11:49:14.204751 | mon1 | ok: [mon1] => (item=chronyd)
2026-09-15 11:49:14.204842 | mon1 | ok: [mon1] => (item=sshd)
2026-09-15 11:49:14.204928 | mon1 |
2026-09-15 11:49:14.205169 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-09-15 11:49:14.205296 | mon1 | Tuesday 15 September 2026  11:49:14 +0000 (0:00:00.784)       0:01:04.015 *****
2026-09-15 11:49:30.326051 | mon1 | [ERROR]: Task failed: Module failed: failed to create temporary content file: The read operation timed out
2026-09-15 11:49:30.326115 | mon1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/tasks/main.yml:34:3
2026-09-15 11:49:30.326185 | mon1 |
2026-09-15 11:49:30.326318 | mon1 | 32   loop: "{{ cephadm_services }}"
2026-09-15 11:49:30.326424 | mon1 | 33
2026-09-15 11:49:30.326513 | mon1 | 34 - name: Download "cephadm"
2026-09-15 11:49:30.326605 | mon1 |      ^ column 3
2026-09-15 11:49:30.326684 | mon1 |
2026-09-15 11:49:30.326880 | mon1 | fatal: [mon1]: FAILED! => {"changed": false, "elapsed": 1, "msg": "failed to create temporary content file: The read operation timed out"}
2026-09-15 11:49:30.328435 | mon1 |
2026-09-15 11:49:30.328506 | mon1 | PLAY RECAP *********************************************************************
2026-09-15 11:49:30.328599 | mon1 | mon1                       : ok=33   changed=20   unreachable=0    failed=1    skipped=6    rescued=0    ignored=0
2026-09-15 11:49:30.328683 | mon1 |
2026-09-15 11:49:30.328761 | mon1 |
2026-09-15 11:49:30.328898 | mon1 | TASKS RECAP ********************************************************************
2026-09-15 11:49:30.329085 | mon1 | Tuesday 15 September 2026  11:49:30 +0000 (0:00:16.124)       0:01:20.140 *****
2026-09-15 11:49:30.329178 | mon1 | ===============================================================================
2026-09-15 11:49:30.329288 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 26.67s
2026-09-15 11:49:30.329380 | mon1 | vexxhost.ceph.cephadm : Download "cephadm" ----------------------------- 16.12s
2026-09-15 11:49:30.329487 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.23s
2026-09-15 11:49:30.329593 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.68s
2026-09-15 11:49:30.329680 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.18s
2026-09-15 11:49:30.329760 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 3.00s
2026-09-15 11:49:30.329881 | mon1 | vexxhost.containers.containerd : Reload systemd ------------------------- 1.79s
2026-09-15 11:49:30.329967 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 1.57s
2026-09-15 11:49:30.330075 | mon1 | vexxhost.containers.containerd : Create folders for configuration ------- 1.26s
2026-09-15 11:49:30.330223 | mon1 | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.21s
2026-09-15 11:49:30.330354 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 1.12s
2026-09-15 11:49:30.330461 | mon1 | Gathering Facts --------------------------------------------------------- 1.04s
2026-09-15 11:49:30.330568 | mon1 | vexxhost.containers.docker : Restart docker ----------------------------- 1.03s
2026-09-15 11:49:30.330678 | mon1 | vexxhost.containers.docker : Create folders for configuration ----------- 0.90s
2026-09-15 11:49:30.330809 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.84s
2026-09-15 11:49:30.330937 | mon1 | vexxhost.ceph.cephadm : Ensure services are started --------------------- 0.78s
2026-09-15 11:49:30.331081 | mon1 | vexxhost.containers.containerd : Create containerd config file ---------- 0.77s
2026-09-15 11:49:30.331217 | mon1 | vexxhost.containers.containerd : Create systemd service file for containerd --- 0.73s
2026-09-15 11:49:30.331382 | mon1 | vexxhost.containers.docker : Enable and start service ------------------- 0.66s
2026-09-15 11:49:30.331501 | mon1 | vexxhost.containers.docker : Create docker daemon config file ----------- 0.64s
2026-09-15 11:49:30.560228 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-09-15 11:49:30.560381 | mon1 | ERROR    [default > converge] Executed: Failed
2026-09-15 11:49:30.560493 | mon1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-09-15 11:49:30.849576 | mon1 | ERROR
2026-09-15 11:49:30.849758 | mon1 | {
2026-09-15 11:49:30.849802 | mon1 |   "delta": "0:09:54.843884",
2026-09-15 11:49:30.849831 | mon1 |   "end": "2026-09-15 11:49:30.653477",
2026-09-15 11:49:30.849858 | mon1 |   "msg": "non-zero return code",
2026-09-15 11:49:30.849883 | mon1 |   "rc": 2,
2026-09-15 11:49:30.849905 | mon1 |   "start": "2026-09-15 11:39:35.809593"
2026-09-15 11:49:30.849928 | mon1 | }
failure
2026-09-15 11:49:30.856894 | 
2026-09-15 11:49:30.856960 | PLAY RECAP
2026-09-15 11:49:30.857018 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-09-15 11:49:30.857045 | 
2026-09-15 11:49:31.430862 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-09-15 11:49:31.436151 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-09-15 11:49:32.392820 | 
2026-09-15 11:49:32.392967 | PLAY [all]
2026-09-15 11:49:32.404171 | 
2026-09-15 11:49:32.404249 | TASK [fetch-output : Set log path for multiple nodes]
2026-09-15 11:49:32.474687 | osd1 | ok
2026-09-15 11:49:32.479051 | mon1 | ok
2026-09-15 11:49:32.487206 | 
2026-09-15 11:49:32.487328 | TASK [fetch-output : Set log path for single node]
2026-09-15 11:49:32.511000 | mon1 | skipping: Conditional result was False
2026-09-15 11:49:32.532018 | osd1 | skipping: Conditional result was False
2026-09-15 11:49:32.537605 | 
2026-09-15 11:49:32.537682 | LOOP [fetch-output : Ensure local output dirs]
2026-09-15 11:49:33.209788 | osd1 -> localhost | changed: "/var/lib/zuul/builds/a7d76d697da649a8a2d0e2437fd1f75c/work/logs/osd1"
2026-09-15 11:49:33.217779 | mon1 -> localhost | changed: "/var/lib/zuul/builds/a7d76d697da649a8a2d0e2437fd1f75c/work/logs/mon1"
2026-09-15 11:49:33.622605 | mon1 -> localhost | changed: "/var/lib/zuul/builds/a7d76d697da649a8a2d0e2437fd1f75c/work/artifacts"
2026-09-15 11:49:33.623375 | osd1 -> localhost | ok: "/var/lib/zuul/builds/a7d76d697da649a8a2d0e2437fd1f75c/work/artifacts"
2026-09-15 11:49:33.835723 | osd1 -> localhost | changed: "/var/lib/zuul/builds/a7d76d697da649a8a2d0e2437fd1f75c/work/docs"
2026-09-15 11:49:33.843349 | mon1 -> localhost | ok: "/var/lib/zuul/builds/a7d76d697da649a8a2d0e2437fd1f75c/work/docs"
2026-09-15 11:49:33.843601 | mon1 -> localhost | changed: All items complete
2026-09-15 11:49:33.843625 | 
2026-09-15 11:49:33.866744 | 
2026-09-15 11:49:33.866873 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-09-15 11:49:34.797285 | osd1 | changed: .d..t...... ./
2026-09-15 11:49:34.808053 | mon1 | changed: .d..t...... ./
2026-09-15 11:49:35.313814 | mon1 | changed: .d..t...... ./
2026-09-15 11:49:35.323137 | osd1 | changed: .d..t...... ./
2026-09-15 11:49:35.816347 | osd1 | changed: .d..t...... ./
2026-09-15 11:49:35.830343 | mon1 | ok
2026-09-15 11:49:35.830438 | mon1 | changed: All items complete
2026-09-15 11:49:35.830471 | 
2026-09-15 11:49:35.853035 | 
2026-09-15 11:49:35.853238 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-09-15 11:49:36.406618 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008526
2026-09-15 11:49:36.812728 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007910
2026-09-15 11:49:36.845176 | 
2026-09-15 11:49:36.845340 | PLAY [all]
2026-09-15 11:49:36.855027 | 
2026-09-15 11:49:36.855212 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-09-15 11:49:37.301957 | mon1 | changed
2026-09-15 11:49:37.518895 | osd1 | changed
2026-09-15 11:49:37.538058 | 
2026-09-15 11:49:37.538195 | PLAY RECAP
2026-09-15 11:49:37.538259 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-09-15 11:49:37.538296 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-09-15 11:49:37.538348 | 
2026-09-15 11:49:37.796429 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-09-15 11:49:37.801499 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-09-15 11:49:38.425038 | 
2026-09-15 11:49:38.425731 | PLAY [localhost]
2026-09-15 11:49:38.435904 | 
2026-09-15 11:49:38.435992 | TASK [Generate Zuul manifest]
2026-09-15 11:49:38.453329 | localhost | ok
2026-09-15 11:49:38.475597 | 
2026-09-15 11:49:38.480992 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-09-15 11:49:38.944826 | localhost | changed
2026-09-15 11:49:38.969931 | 
2026-09-15 11:49:39.008044 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-09-15 11:49:39.158669 | localhost | ok
2026-09-15 11:49:39.171478 | 
2026-09-15 11:49:39.171775 | TASK [Upload logs]
2026-09-15 11:49:39.190743 | localhost | ok
2026-09-15 11:49:39.330101 | 
2026-09-15 11:49:39.342105 | TASK [Set zuul-log-path fact]
2026-09-15 11:49:39.372693 | localhost | ok
2026-09-15 11:49:39.388379 | 
2026-09-15 11:49:39.388471 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-09-15 11:49:39.430656 | localhost | ok
2026-09-15 11:49:39.441526 | 
2026-09-15 11:49:39.441684 | TASK [upload-logs : Create log directories]
2026-09-15 11:49:40.448982 | localhost | changed
2026-09-15 11:49:40.459843 | 
2026-09-15 11:49:40.459961 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-09-15 11:49:41.007002 | localhost -> localhost | ok: Runtime: 0:00:00.005689
2026-09-15 11:49:41.014523 | 
2026-09-15 11:49:41.014620 | TASK [upload-logs : Upload logs to log server]
2026-09-15 11:49:41.716103 | localhost | Output suppressed because no_log was given
2026-09-15 11:49:41.722048 | 
2026-09-15 11:49:41.722165 | LOOP [upload-logs : Compress console log and json output]
2026-09-15 11:49:41.823245 | localhost | skipping: Conditional result was False
2026-09-15 11:49:41.829770 | localhost | skipping: Conditional result was False
2026-09-15 11:49:41.850920 | 
2026-09-15 11:49:41.851109 | LOOP [upload-logs : Upload compressed console log and json output]
2026-09-15 11:49:41.952304 | localhost | skipping: Conditional result was False
2026-09-15 11:49:41.952762 | 
2026-09-15 11:49:41.956715 | localhost | skipping: Conditional result was False
2026-09-15 11:49:42.020464 | 
2026-09-15 11:49:42.020627 | LOOP [upload-logs : Upload console log and json output]