2026-04-21 19:19:23.912345 | Job console starting
2026-04-21 19:19:23.931933 | Updating git repos
2026-04-21 19:19:23.961583 | Cloning repos into workspace
2026-04-21 19:19:25.002104 | Restoring repo states
2026-04-21 19:19:25.010762 | Merging changes
2026-04-21 19:19:25.500745 | Checking out repos
2026-04-21 19:19:25.786197 | Preparing playbooks
2026-04-21 19:19:27.355321 | Running Ansible setup
2026-04-21 19:19:31.524880 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-21 19:19:32.133248 | 
2026-04-21 19:19:32.133370 | PLAY [localhost]
2026-04-21 19:19:32.141503 | 
2026-04-21 19:19:32.141569 | TASK [Gathering Facts]
2026-04-21 19:19:33.003770 | localhost | ok
2026-04-21 19:19:33.014199 | 
2026-04-21 19:19:33.014277 | TASK [Setup log path fact]
2026-04-21 19:19:33.035603 | localhost | ok
2026-04-21 19:19:33.048432 | 
2026-04-21 19:19:33.048499 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-21 19:19:33.080537 | localhost | ok
2026-04-21 19:19:33.088316 | 
2026-04-21 19:19:33.088384 | TASK [emit-job-header : Print job information]
2026-04-21 19:19:33.131272 | # Job Information
2026-04-21 19:19:33.131546 | Ansible Version: 2.16.16
2026-04-21 19:19:33.131616 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy
2026-04-21 19:19:33.131665 | Pipeline: check
2026-04-21 19:19:33.131709 | Executor: 0a8996d2b663
2026-04-21 19:19:33.131753 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/72
2026-04-21 19:19:33.131802 | Event ID: e792b610-3db6-11f1-9816-181e6ea45e76
2026-04-21 19:19:33.136161 | 
2026-04-21 19:19:33.136231 | LOOP [emit-job-header : Print node information]
2026-04-21 19:19:33.233008 | localhost | ok:
2026-04-21 19:19:33.233238 | localhost | # Node Information
2026-04-21 19:19:33.233267 | localhost | Inventory Hostname: mon1
2026-04-21 19:19:33.233289 | localhost | Hostname: np0000168954
2026-04-21 19:19:33.233308 | localhost | Username: zuul
2026-04-21 19:19:33.233330 | localhost | Distro: Ubuntu 22.04
2026-04-21 19:19:33.233349 | localhost | Provider: yul1
2026-04-21 19:19:33.233369 | localhost | Region: ca-ymq-1
2026-04-21 19:19:33.233388 | localhost | Label: ubuntu-jammy
2026-04-21 19:19:33.233406 | localhost | Product Name: OpenStack Nova
2026-04-21 19:19:33.233424 | localhost | Interface IP: 199.204.45.156
2026-04-21 19:19:33.279374 | localhost | ok:
2026-04-21 19:19:33.279541 | localhost | # Node Information
2026-04-21 19:19:33.279639 | localhost | Inventory Hostname: osd1
2026-04-21 19:19:33.279698 | localhost | Hostname: np0000168955
2026-04-21 19:19:33.279751 | localhost | Username: zuul
2026-04-21 19:19:33.279802 | localhost | Distro: Ubuntu 22.04
2026-04-21 19:19:33.279852 | localhost | Provider: yul1
2026-04-21 19:19:33.279901 | localhost | Region: ca-ymq-1
2026-04-21 19:19:33.279951 | localhost | Label: ubuntu-jammy
2026-04-21 19:19:33.280000 | localhost | Product Name: OpenStack Nova
2026-04-21 19:19:33.280052 | localhost | Interface IP: 199.204.45.116
2026-04-21 19:19:33.293607 | 
2026-04-21 19:19:33.293859 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-21 19:19:33.724663 | localhost -> localhost | changed
2026-04-21 19:19:33.732618 | 
2026-04-21 19:19:33.732714 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-21 19:19:34.599601 | localhost -> localhost | changed
2026-04-21 19:19:34.610839 | 
2026-04-21 19:19:34.610915 | PLAY [all]
2026-04-21 19:19:34.620908 | 
2026-04-21 19:19:34.620989 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-21 19:19:34.849776 | mon1 -> localhost | ok
2026-04-21 19:19:34.860305 | 
2026-04-21 19:19:34.860393 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-21 19:19:34.893467 | mon1 | ok
2026-04-21 19:19:34.898476 | osd1 | ok
2026-04-21 19:19:34.916125 | mon1 | included: /var/lib/zuul/builds/9ea98a9c616644af946885f0bd1aa940/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-21 19:19:34.916173 | osd1 | included: /var/lib/zuul/builds/9ea98a9c616644af946885f0bd1aa940/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-21 19:19:34.922103 | 
2026-04-21 19:19:34.922163 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-21 19:19:36.192822 | mon1 -> localhost | Generating public/private rsa key pair.
2026-04-21 19:19:36.193080 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/9ea98a9c616644af946885f0bd1aa940/work/9ea98a9c616644af946885f0bd1aa940_id_rsa
2026-04-21 19:19:36.193125 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/9ea98a9c616644af946885f0bd1aa940/work/9ea98a9c616644af946885f0bd1aa940_id_rsa.pub
2026-04-21 19:19:36.193158 | mon1 -> localhost | The key fingerprint is:
2026-04-21 19:19:36.193188 | mon1 -> localhost | SHA256:oju0wQnUI9VIwwf2FK2FKlFlYUotRefxeUUP52FDBdE zuul-build-sshkey
2026-04-21 19:19:36.193217 | mon1 -> localhost | The key's randomart image is:
2026-04-21 19:19:36.193244 | mon1 -> localhost | +---[RSA 3072]----+
2026-04-21 19:19:36.193272 | mon1 -> localhost | |   *OOX=o    .BO+|
2026-04-21 19:19:36.193301 | mon1 -> localhost | |  +o*B=ooo . ..=E|
2026-04-21 19:19:36.193329 | mon1 -> localhost | | . o.=.o. o .   o|
2026-04-21 19:19:36.193357 | mon1 -> localhost | |  o . .    .     |
2026-04-21 19:19:36.193384 | mon1 -> localhost | |   + .. S        |
2026-04-21 19:19:36.193411 | mon1 -> localhost | |    =. .         |
2026-04-21 19:19:36.193438 | mon1 -> localhost | |   ..o           |
2026-04-21 19:19:36.193465 | mon1 -> localhost | |    o.           |
2026-04-21 19:19:36.193491 | mon1 -> localhost | |    ..           |
2026-04-21 19:19:36.193517 | mon1 -> localhost | +----[SHA256]-----+
2026-04-21 19:19:36.193578 | mon1 -> localhost | ok: Runtime: 0:00:00.849871
2026-04-21 19:19:36.199589 | 
2026-04-21 19:19:36.199656 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-21 19:19:36.237720 | mon1 | ok
2026-04-21 19:19:36.243693 | osd1 | ok
2026-04-21 19:19:36.259002 | mon1 | included: /var/lib/zuul/builds/9ea98a9c616644af946885f0bd1aa940/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-21 19:19:36.259093 | osd1 | included: /var/lib/zuul/builds/9ea98a9c616644af946885f0bd1aa940/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-21 19:19:36.269711 | 
2026-04-21 19:19:36.269780 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-21 19:19:36.295741 | mon1 | skipping: Conditional result was False
2026-04-21 19:19:36.306961 | osd1 | skipping: Conditional result was False
2026-04-21 19:19:36.317964 | 
2026-04-21 19:19:36.318032 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-21 19:19:36.789216 | mon1 | changed
2026-04-21 19:19:36.795173 | osd1 | changed
2026-04-21 19:19:36.800247 | 
2026-04-21 19:19:36.800316 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-21 19:19:36.993469 | mon1 | ok
2026-04-21 19:19:36.998795 | osd1 | ok
2026-04-21 19:19:37.003921 | 
2026-04-21 19:19:37.003991 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-21 19:19:37.482470 | mon1 | changed
2026-04-21 19:19:37.502389 | osd1 | changed
2026-04-21 19:19:37.508672 | 
2026-04-21 19:19:37.508742 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-21 19:19:37.968758 | mon1 | changed
2026-04-21 19:19:37.976165 | osd1 | changed
2026-04-21 19:19:37.981255 | 
2026-04-21 19:19:37.981326 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-21 19:19:38.007888 | mon1 | skipping: Conditional result was False
2026-04-21 19:19:38.019421 | osd1 | skipping: Conditional result was False
2026-04-21 19:19:38.075564 | 
2026-04-21 19:19:38.075750 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-21 19:19:38.386889 | mon1 -> localhost | changed
2026-04-21 19:19:38.406667 | 
2026-04-21 19:19:38.406761 | TASK [add-build-sshkey : Add back temp key]
2026-04-21 19:19:38.683850 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/9ea98a9c616644af946885f0bd1aa940/work/9ea98a9c616644af946885f0bd1aa940_id_rsa (zuul-build-sshkey)
2026-04-21 19:19:38.684107 | mon1 -> localhost | ok: Runtime: 0:00:00.013301
2026-04-21 19:19:38.690269 | 
2026-04-21 19:19:38.690334 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-21 19:19:38.951609 | mon1 | ok
2026-04-21 19:19:38.956384 | osd1 | ok
2026-04-21 19:19:38.961129 | 
2026-04-21 19:19:38.961201 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-21 19:19:38.987008 | mon1 | skipping: Conditional result was False
2026-04-21 19:19:38.999321 | osd1 | skipping: Conditional result was False
2026-04-21 19:19:39.043002 | 
2026-04-21 19:19:39.043156 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-21 19:19:39.316983 | mon1 | ok
2026-04-21 19:19:39.321415 | osd1 | ok
2026-04-21 19:19:39.327170 | 
2026-04-21 19:19:39.327239 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-21 19:19:39.983391 | mon1 | Output suppressed because no_log was given
2026-04-21 19:19:39.988370 | osd1 | Output suppressed because no_log was given
2026-04-21 19:19:40.000516 | 
2026-04-21 19:19:40.000577 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-21 19:19:40.195664 | mon1 | ok: "logs"
2026-04-21 19:19:40.195990 | mon1 | ok: All items complete
2026-04-21 19:19:40.196029 | 
2026-04-21 19:19:40.201236 | osd1 | ok: "logs"
2026-04-21 19:19:40.354581 | osd1 | ok: "artifacts"
2026-04-21 19:19:40.360303 | mon1 | ok: "artifacts"
2026-04-21 19:19:40.508731 | osd1 | ok: "docs"
2026-04-21 19:19:40.513489 | mon1 | ok: "docs"
2026-04-21 19:19:40.526008 | 
2026-04-21 19:19:40.526073 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-21 19:19:40.717630 | osd1 | changed: "logs"
2026-04-21 19:19:40.717899 | osd1 | ok: All items complete
2026-04-21 19:19:40.717938 | 
2026-04-21 19:19:40.722772 | mon1 | changed: "logs"
2026-04-21 19:19:40.872898 | osd1 | changed: "artifacts"
2026-04-21 19:19:40.889674 | mon1 | changed: "artifacts"
2026-04-21 19:19:41.037833 | osd1 | changed: "docs"
2026-04-21 19:19:41.042649 | mon1 | changed: "docs"
2026-04-21 19:19:41.060471 | 
2026-04-21 19:19:41.060539 | PLAY RECAP
2026-04-21 19:19:41.060585 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-21 19:19:41.060615 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-21 19:19:41.060642 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-21 19:19:41.060661 | 
2026-04-21 19:19:41.223016 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-21 19:19:41.228079 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-21 19:19:41.800655 | 
2026-04-21 19:19:41.801336 | PLAY [all]
2026-04-21 19:19:41.813924 | 
2026-04-21 19:19:41.814002 | TASK [setup-uv : Extract archive]
2026-04-21 19:19:44.083729 | osd1 | changed
2026-04-21 19:19:44.100647 | mon1 | changed
2026-04-21 19:19:44.108184 | 
2026-04-21 19:19:44.108265 | TASK [setup-uv : Print version]
2026-04-21 19:19:44.672009 | osd1 | uv 0.8.13
2026-04-21 19:19:43.341894 | mon1 | uv 0.8.13
2026-04-21 19:19:44.668844 | mon1 | ok: Runtime: 0:00:00.012533
2026-04-21 19:19:44.677447 | osd1 | ok: Runtime: 0:00:00.011657
2026-04-21 19:19:44.687402 | 
2026-04-21 19:19:44.687455 | PLAY RECAP
2026-04-21 19:19:44.687504 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-21 19:19:44.687531 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-21 19:19:44.687550 | 
2026-04-21 19:19:44.811073 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-21 19:19:44.813820 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-21 19:19:45.368240 | 
2026-04-21 19:19:45.368386 | PLAY [all]
2026-04-21 19:19:45.379387 | 
2026-04-21 19:19:45.379461 | TASK [Copy inventory file for Zuul]
2026-04-21 19:19:46.249097 | mon1 | changed
2026-04-21 19:19:46.254144 | 
2026-04-21 19:19:46.254223 | TASK [Switch "ansible_host" to private IP]
2026-04-21 19:19:46.524727 | mon1 | changed: 2 replacements made
2026-04-21 19:19:46.530957 | 
2026-04-21 19:19:46.531028 | TASK [Run Molecule scenario]
2026-04-21 19:19:46.040197 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-04-21 19:19:47.955190 | mon1 |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-04-21 19:19:48.139168 | mon1 | Using CPython 3.13.7
2026-04-21 19:19:48.139269 | mon1 | Creating virtual environment at: .venv
2026-04-21 19:19:48.366546 | mon1 | Downloading netaddr (2.2MiB)
2026-04-21 19:19:48.366685 | mon1 | Downloading cryptography (4.3MiB)
2026-04-21 19:19:48.372608 | mon1 | Downloading pygments (1.2MiB)
2026-04-21 19:19:48.455995 | mon1 | Downloading ansible-core (2.1MiB)
2026-04-21 19:19:48.540471 | mon1 |  Downloading netaddr
2026-04-21 19:19:48.555006 | mon1 |  Downloading cryptography
2026-04-21 19:19:48.597366 | mon1 |  Downloading pygments
2026-04-21 19:19:48.751789 | mon1 |  Downloading ansible-core
2026-04-21 19:19:48.779948 | mon1 | Installed 36 packages in 27ms
2026-04-21 19:19:49.917000 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-04-21 19:19:49.917108 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-04-21 19:19:50.572815 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-21 19:19:50.572885 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-04-21 19:20:08.312133 | mon1 | INFO     [default > dependency] Executing
2026-04-21 19:20:08.312337 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-04-21 19:20:08.312583 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-04-21 19:20:08.312741 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-04-21 19:20:08.318912 | mon1 | INFO     [default > cleanup] Executing
2026-04-21 19:20:08.319193 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-21 19:20:08.324264 | mon1 | INFO     [default > destroy] Executing
2026-04-21 19:20:08.324300 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-04-21 19:20:08.324376 | mon1 | INFO     [default > destroy] Executed: Successful
2026-04-21 19:20:08.329703 | mon1 | INFO     [default > syntax] Executing
2026-04-21 19:20:09.358977 | mon1 |
2026-04-21 19:20:09.359174 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-04-21 19:20:09.445162 | mon1 | INFO     [default > syntax] Executed: Successful
2026-04-21 19:20:09.454560 | mon1 | INFO     [default > create] Executing
2026-04-21 19:20:09.455859 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-21 19:20:09.460820 | mon1 | INFO     [default > prepare] Executing
2026-04-21 19:20:10.190279 | mon1 |
2026-04-21 19:20:10.190378 | mon1 | PLAY [Prepare] *****************************************************************
2026-04-21 19:20:10.190419 | mon1 |
2026-04-21 19:20:10.190559 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-21 19:20:10.190627 | mon1 | Tuesday 21 April 2026  19:20:10 +0000 (0:00:00.044)       0:00:00.044 *********
2026-04-21 19:20:11.330477 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-04-21 19:20:11.330660 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-21 19:20:11.330871 | mon1 | interpreter could change the meaning of that path. See
2026-04-21 19:20:11.331073 | mon1 | https://docs.ansible.com/ansible-
2026-04-21 19:20:11.331285 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-21 19:20:11.335528 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-04-21 19:20:11.335656 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-21 19:20:11.335777 | mon1 | interpreter could change the meaning of that path. See
2026-04-21 19:20:11.335899 | mon1 | https://docs.ansible.com/ansible-
2026-04-21 19:20:11.336026 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-21 19:20:11.343782 | mon1 | ok: [mon1]
2026-04-21 19:20:11.343973 | mon1 | ok: [osd1]
2026-04-21 19:20:11.344154 | mon1 |
2026-04-21 19:20:11.344355 | mon1 | TASK [Configure short hostname] ************************************************
2026-04-21 19:20:11.344554 | mon1 | Tuesday 21 April 2026  19:20:11 +0000 (0:00:01.154)       0:00:01.199 *********
2026-04-21 19:20:12.059041 | mon1 | changed: [osd1]
2026-04-21 19:20:12.059127 | mon1 | changed: [mon1]
2026-04-21 19:20:12.059243 | mon1 |
2026-04-21 19:20:12.059379 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-21 19:20:12.059522 | mon1 | Tuesday 21 April 2026  19:20:12 +0000 (0:00:00.714)       0:00:01.913 *********
2026-04-21 19:20:12.339759 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-21 19:20:12.339947 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-04-21 19:20:12.340197 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-21 19:20:12.355560 | mon1 | changed: [mon1]
2026-04-21 19:20:12.355670 | mon1 | changed: [osd1]
2026-04-21 19:20:12.355782 | mon1 |
2026-04-21 19:20:12.355905 | mon1 | TASK [Update apt cache] ********************************************************
2026-04-21 19:20:12.356029 | mon1 | Tuesday 21 April 2026  19:20:12 +0000 (0:00:00.297)       0:00:02.211 *********
2026-04-21 19:20:19.683939 | mon1 | changed: [mon1]
2026-04-21 19:20:19.684056 | mon1 | changed: [osd1]
2026-04-21 19:20:19.684069 | mon1 |
2026-04-21 19:20:19.684123 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-04-21 19:20:19.684203 | mon1 |
2026-04-21 19:20:19.684298 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-21 19:20:19.684389 | mon1 | Tuesday 21 April 2026  19:20:19 +0000 (0:00:07.325)       0:00:09.536 *********
2026-04-21 19:20:20.389140 | mon1 | ok: [osd1]
2026-04-21 19:20:20.389241 | mon1 |
2026-04-21 19:20:20.389564 | mon1 | TASK [Install depedencies] *****************************************************
2026-04-21 19:20:20.389796 | mon1 | Tuesday 21 April 2026  19:20:20 +0000 (0:00:00.707)       0:00:10.244 *********
2026-04-21 19:20:40.907613 | mon1 | changed: [osd1]
2026-04-21 19:20:40.907773 | mon1 |
2026-04-21 19:20:40.907989 | mon1 | TASK [Start up service] ********************************************************
2026-04-21 19:20:40.908210 | mon1 | Tuesday 21 April 2026  19:20:40 +0000 (0:00:20.518)       0:00:30.762 *********
2026-04-21 19:20:41.469557 | mon1 | ok: [osd1]
2026-04-21 19:20:41.469708 | mon1 |
2026-04-21 19:20:41.469925 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-04-21 19:20:41.470127 | mon1 | Tuesday 21 April 2026  19:20:41 +0000 (0:00:00.561)       0:00:31.324 *********
2026-04-21 19:20:41.784419 | mon1 | ok: [osd1]
2026-04-21 19:20:41.784562 | mon1 |
2026-04-21 19:20:41.784824 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-21 19:20:41.785117 | mon1 | Tuesday 21 April 2026  19:20:41 +0000 (0:00:00.315)       0:00:31.639 *********
2026-04-21 19:20:42.467110 | mon1 | changed: [osd1]
2026-04-21 19:20:42.467245 | mon1 |
2026-04-21 19:20:42.467476 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-04-21 19:20:42.467686 | mon1 | Tuesday 21 April 2026  19:20:42 +0000 (0:00:00.682)       0:00:32.321 *********
2026-04-21 19:20:42.668036 | mon1 | ok: [osd1]
2026-04-21 19:20:42.668124 | mon1 |
2026-04-21 19:20:42.668152 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-04-21 19:20:42.668285 | mon1 | Tuesday 21 April 2026  19:20:42 +0000 (0:00:00.201)       0:00:32.522 *********
2026-04-21 19:20:42.691945 | mon1 | skipping: [osd1]
2026-04-21 19:20:42.692114 | mon1 |
2026-04-21 19:20:42.692336 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-04-21 19:20:42.692544 | mon1 | Tuesday 21 April 2026  19:20:42 +0000 (0:00:00.024)       0:00:32.547 *********
2026-04-21 19:20:43.241065 | mon1 | changed: [osd1] => (item=osd0)
2026-04-21 19:20:43.241220 | mon1 | changed: [osd1] => (item=osd1)
2026-04-21 19:20:43.241410 | mon1 | changed: [osd1] => (item=osd2)
2026-04-21 19:20:43.241680 | mon1 |
2026-04-21 19:20:43.241828 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-04-21 19:20:43.242024 | mon1 | Tuesday 21 April 2026  19:20:43 +0000 (0:00:00.548)       0:00:33.096 *********
2026-04-21 19:20:43.851545 | mon1 | changed: [osd1] => (item=osd0)
2026-04-21 19:20:43.851752 | mon1 | changed: [osd1] => (item=osd1)
2026-04-21 19:20:43.851935 | mon1 | changed: [osd1] => (item=osd2)
2026-04-21 19:20:43.852114 | mon1 |
2026-04-21 19:20:43.852316 | mon1 | TASK [Start loop devices] ******************************************************
2026-04-21 19:20:43.852515 | mon1 | Tuesday 21 April 2026  19:20:43 +0000 (0:00:00.610)       0:00:33.706 *********
2026-04-21 19:20:44.535081 | mon1 | changed: [osd1] => (item=osd0)
2026-04-21 19:20:44.535190 | mon1 | changed: [osd1] => (item=osd1)
2026-04-21 19:20:44.535202 | mon1 | changed: [osd1] => (item=osd2)
2026-04-21 19:20:44.535297 | mon1 |
2026-04-21 19:20:44.535396 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-04-21 19:20:44.535491 | mon1 | Tuesday 21 April 2026  19:20:44 +0000 (0:00:00.683)       0:00:34.389 *********
2026-04-21 19:20:47.440586 | mon1 | changed: [osd1] => (item=osd0)
2026-04-21 19:20:47.440751 | mon1 | changed: [osd1] => (item=osd1)
2026-04-21 19:20:47.440972 | mon1 | changed: [osd1] => (item=osd2)
2026-04-21 19:20:47.441200 | mon1 |
2026-04-21 19:20:47.441417 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-04-21 19:20:47.441633 | mon1 | Tuesday 21 April 2026  19:20:47 +0000 (0:00:02.905)       0:00:37.295 *********
2026-04-21 19:20:49.248990 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-04-21 19:20:49.249142 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-04-21 19:20:49.249469 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-04-21 19:20:49.249554 | mon1 |
2026-04-21 19:20:49.249780 | mon1 | PLAY RECAP *********************************************************************
2026-04-21 19:20:49.249986 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-04-21 19:20:49.250237 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-21 19:20:49.250470 | mon1 |
2026-04-21 19:20:49.250628 | mon1 |
2026-04-21 19:20:49.250856 | mon1 | TASKS RECAP ********************************************************************
2026-04-21 19:20:49.251032 | mon1 | Tuesday 21 April 2026  19:20:49 +0000 (0:00:01.808)       0:00:39.104 *********
2026-04-21 19:20:49.251225 | mon1 | ===============================================================================
2026-04-21 19:20:49.251420 | mon1 | Install depedencies ---------------------------------------------------- 20.52s
2026-04-21 19:20:49.251618 | mon1 | Update apt cache -------------------------------------------------------- 7.33s
2026-04-21 19:20:49.251820 | mon1 | Create a volume group for each loop device ------------------------------ 2.91s
2026-04-21 19:20:49.252020 | mon1 | Create a logical volume for each loop device ---------------------------- 1.81s
2026-04-21 19:20:49.252215 | mon1 | Gathering Facts --------------------------------------------------------- 1.15s
2026-04-21 19:20:49.252477 | mon1 | Configure short hostname ------------------------------------------------ 0.71s
2026-04-21 19:20:49.252937 | mon1 | Gathering Facts --------------------------------------------------------- 0.71s
2026-04-21 19:20:49.253227 | mon1 | Start loop devices ------------------------------------------------------ 0.68s
2026-04-21 19:20:49.253471 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.68s
2026-04-21 19:20:49.253624 | mon1 | Set permissions on loopback devices ------------------------------------- 0.61s
2026-04-21 19:20:49.253746 | mon1 | Start up service -------------------------------------------------------- 0.56s
2026-04-21 19:20:49.253871 | mon1 | Create devices for Ceph ------------------------------------------------- 0.55s
2026-04-21 19:20:49.254000 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.32s
2026-04-21 19:20:49.254121 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.30s
2026-04-21 19:20:49.254306 | mon1 | Get list of all loopback devices ---------------------------------------- 0.20s
2026-04-21 19:20:49.254479 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-04-21 19:20:49.345623 | mon1 | INFO     [default > prepare] Executed: Successful
2026-04-21 19:20:49.355339 | mon1 | INFO     [default > converge] Executing
2026-04-21 19:20:50.160635 | mon1 |
2026-04-21 19:20:50.160721 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-04-21 19:20:50.160956 | mon1 |
2026-04-21 19:20:50.161133 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-21 19:20:50.161440 | mon1 | Tuesday 21 April 2026  19:20:50 +0000 (0:00:00.046)       0:00:00.046 *********
2026-04-21 19:20:51.116168 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-04-21 19:20:51.116348 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-21 19:20:51.116545 | mon1 | interpreter could change the meaning of that path. See
2026-04-21 19:20:51.116766 | mon1 | https://docs.ansible.com/ansible-
2026-04-21 19:20:51.116944 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-21 19:20:51.127371 | mon1 | ok: [mon1]
2026-04-21 19:20:51.127468 | mon1 |
2026-04-21 19:20:51.127590 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-21 19:20:51.127715 | mon1 | Tuesday 21 April 2026  19:20:51 +0000 (0:00:00.967)       0:00:01.013 *********
2026-04-21 19:20:51.410949 | mon1 | ok: [mon1]
2026-04-21 19:20:51.411104 | mon1 |
2026-04-21 19:20:51.411321 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-21 19:20:51.411528 | mon1 | Tuesday 21 April 2026  19:20:51 +0000 (0:00:00.282)       0:00:01.296 *********
2026-04-21 19:20:51.445442 | mon1 | skipping: [mon1]
2026-04-21 19:20:51.445618 | mon1 |
2026-04-21 19:20:51.446020 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-21 19:20:51.446293 | mon1 | Tuesday 21 April 2026  19:20:51 +0000 (0:00:00.035)       0:00:01.331 *********
2026-04-21 19:20:51.760189 | mon1 | changed: [mon1]
2026-04-21 19:20:51.760339 | mon1 |
2026-04-21 19:20:51.760547 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-21 19:20:51.760753 | mon1 | Tuesday 21 April 2026  19:20:51 +0000 (0:00:00.314)       0:00:01.646 *********
2026-04-21 19:20:51.851451 | mon1 | ok: [mon1] => {
2026-04-21 19:20:51.851640 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-21 19:20:51.851912 | mon1 | }
2026-04-21 19:20:51.851992 | mon1 |
2026-04-21 19:20:51.852199 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-21 19:20:51.852388 | mon1 | Tuesday 21 April 2026  19:20:51 +0000 (0:00:00.091)       0:00:01.737 *********
2026-04-21 19:20:52.517678 | mon1 | changed: [mon1]
2026-04-21 19:20:52.517816 | mon1 |
2026-04-21 19:20:52.518019 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-21 19:20:52.518243 | mon1 | Tuesday 21 April 2026  19:20:52 +0000 (0:00:00.666)       0:00:02.403 *********
2026-04-21 19:20:52.557117 | mon1 | skipping: [mon1]
2026-04-21 19:20:52.557275 | mon1 |
2026-04-21 19:20:52.557473 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-21 19:20:52.557772 | mon1 | Tuesday 21 April 2026  19:20:52 +0000 (0:00:00.039)       0:00:02.443 *********
2026-04-21 19:20:52.597984 | mon1 | skipping: [mon1]
2026-04-21 19:20:52.598151 | mon1 |
2026-04-21 19:20:52.598500 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-21 19:20:52.598609 | mon1 | Tuesday 21 April 2026  19:20:52 +0000 (0:00:00.040)       0:00:02.484 *********
2026-04-21 19:20:52.795318 | mon1 | ok: [mon1]
2026-04-21 19:20:52.795476 | mon1 |
2026-04-21 19:20:52.795706 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-21 19:20:52.795919 | mon1 | Tuesday 21 April 2026  19:20:52 +0000 (0:00:00.196)       0:00:02.681 *********
2026-04-21 19:20:53.990835 | mon1 | ok: [mon1]
2026-04-21 19:20:53.990963 | mon1 |
2026-04-21 19:20:53.991201 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-21 19:20:53.991390 | mon1 | Tuesday 21 April 2026  19:20:53 +0000 (0:00:01.195)       0:00:03.876 *********
2026-04-21 19:20:54.068749 | mon1 | ok: [mon1] => {
2026-04-21 19:20:54.068948 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-04-21 19:20:54.069141 | mon1 | }
2026-04-21 19:20:54.069321 | mon1 |
2026-04-21 19:20:54.069532 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-21 19:20:54.069729 | mon1 | Tuesday 21 April 2026  19:20:54 +0000 (0:00:00.077)       0:00:03.954 *********
2026-04-21 19:20:54.811442 | mon1 | changed: [mon1]
2026-04-21 19:20:54.811593 | mon1 |
2026-04-21 19:20:54.811711 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-21 19:20:54.811838 | mon1 | Tuesday 21 April 2026  19:20:54 +0000 (0:00:00.742)       0:00:04.697 *********
2026-04-21 19:20:57.690263 | mon1 | changed: [mon1]
2026-04-21 19:20:57.690332 | mon1 |
2026-04-21 19:20:57.690389 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-21 19:20:57.690484 | mon1 | Tuesday 21 April 2026  19:20:57 +0000 (0:00:02.878)       0:00:07.576 *********
2026-04-21 19:20:57.720279 | mon1 | skipping: [mon1]
2026-04-21 19:20:57.720382 | mon1 |
2026-04-21 19:20:57.720510 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-21 19:20:57.720648 | mon1 | Tuesday 21 April 2026  19:20:57 +0000 (0:00:00.030)       0:00:07.606 *********
2026-04-21 19:20:57.746515 | mon1 | skipping: [mon1]
2026-04-21 19:20:57.746588 | mon1 |
2026-04-21 19:20:57.746746 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-21 19:20:57.746761 | mon1 | Tuesday 21 April 2026  19:20:57 +0000 (0:00:00.026)       0:00:07.632 *********
2026-04-21 19:20:57.772762 | mon1 | skipping: [mon1]
2026-04-21 19:20:57.772869 | mon1 |
2026-04-21 19:20:57.773029 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-21 19:20:57.773171 | mon1 | Tuesday 21 April 2026  19:20:57 +0000 (0:00:00.026)       0:00:07.659 *********
2026-04-21 19:21:03.451017 | mon1 | changed: [mon1]
2026-04-21 19:21:03.451188 | mon1 |
2026-04-21 19:21:03.451201 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-21 19:21:03.451215 | mon1 | Tuesday 21 April 2026  19:21:03 +0000 (0:00:05.677)       0:00:13.336 *********
2026-04-21 19:21:03.961776 | mon1 | changed: [mon1]
2026-04-21 19:21:03.961936 | mon1 |
2026-04-21 19:21:03.962155 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-21 19:21:03.962386 | mon1 | Tuesday 21 April 2026  19:21:03 +0000 (0:00:00.511)       0:00:13.847 *********
2026-04-21 19:21:04.818000 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-04-21 19:21:04.818238 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-21 19:21:04.818478 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-21 19:21:04.818702 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-21 19:21:04.818919 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-21 19:21:04.819110 | mon1 |
2026-04-21 19:21:04.819316 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-21 19:21:04.819521 | mon1 | Tuesday 21 April 2026  19:21:04 +0000 (0:00:00.856)       0:00:14.704 *********
2026-04-21 19:21:05.382962 | mon1 | changed: [mon1]
2026-04-21 19:21:05.383124 | mon1 |
2026-04-21 19:21:05.383333 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-21 19:21:05.383536 | mon1 | Tuesday 21 April 2026  19:21:05 +0000 (0:00:00.558)       0:00:15.262 *********
2026-04-21 19:21:05.383712 | mon1 |
2026-04-21 19:21:05.383915 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-04-21 19:21:05.384112 | mon1 | Tuesday 21 April 2026  19:21:05 +0000 (0:00:00.006)       0:00:15.268 *********
2026-04-21 19:21:06.292783 | mon1 | ok: [mon1]
2026-04-21 19:21:06.292832 | mon1 |
2026-04-21 19:21:06.292838 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-04-21 19:21:06.292843 | mon1 | Tuesday 21 April 2026  19:21:06 +0000 (0:00:00.909)       0:00:16.178 *********
2026-04-21 19:21:06.726689 | mon1 | changed: [mon1]
2026-04-21 19:21:06.726782 | mon1 |
2026-04-21 19:21:06.727088 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-21 19:21:06.727132 | mon1 | Tuesday 21 April 2026  19:21:06 +0000 (0:00:00.434)       0:00:16.612 *********
2026-04-21 19:21:07.227686 | mon1 | changed: [mon1]
2026-04-21 19:21:07.227764 | mon1 |
2026-04-21 19:21:07.227826 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-21 19:21:07.227936 | mon1 | Tuesday 21 April 2026  19:21:07 +0000 (0:00:00.501)       0:00:17.114 *********
2026-04-21 19:21:07.436221 | mon1 | ok: [mon1]
2026-04-21 19:21:07.436301 | mon1 |
2026-04-21 19:21:07.436362 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-21 19:21:07.436481 | mon1 | Tuesday 21 April 2026  19:21:07 +0000 (0:00:00.208)       0:00:17.322 *********
2026-04-21 19:21:07.501565 | mon1 | ok: [mon1] => {
2026-04-21 19:21:07.501646 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-04-21 19:21:07.501704 | mon1 | }
2026-04-21 19:21:07.502036 | mon1 |
2026-04-21 19:21:07.502085 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-21 19:21:07.502092 | mon1 | Tuesday 21 April 2026  19:21:07 +0000 (0:00:00.065)       0:00:17.387 *********
2026-04-21 19:21:08.513696 | mon1 | changed: [mon1]
2026-04-21 19:21:08.513761 | mon1 |
2026-04-21 19:21:08.513842 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-21 19:21:08.513948 | mon1 | Tuesday 21 April 2026  19:21:08 +0000 (0:00:01.012)       0:00:18.400 *********
2026-04-21 19:21:12.807403 | mon1 | changed: [mon1]
2026-04-21 19:21:12.807444 | mon1 |
2026-04-21 19:21:12.807449 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-04-21 19:21:12.807454 | mon1 | Tuesday 21 April 2026  19:21:12 +0000 (0:00:04.293)       0:00:22.693 *********
2026-04-21 19:21:13.772814 | mon1 | ok: [mon1]
2026-04-21 19:21:13.772891 | mon1 |
2026-04-21 19:21:13.773182 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-04-21 19:21:13.773234 | mon1 | Tuesday 21 April 2026  19:21:13 +0000 (0:00:00.965)       0:00:23.658 *********
2026-04-21 19:21:14.090033 | mon1 | changed: [mon1]
2026-04-21 19:21:14.090081 | mon1 |
2026-04-21 19:21:14.090086 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-04-21 19:21:14.090091 | mon1 | Tuesday 21 April 2026  19:21:14 +0000 (0:00:00.316)       0:00:23.976 *********
2026-04-21 19:21:14.524459 | mon1 | changed: [mon1]
2026-04-21 19:21:14.524528 | mon1 |
2026-04-21 19:21:14.524845 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-04-21 19:21:14.524889 | mon1 | Tuesday 21 April 2026  19:21:14 +0000 (0:00:00.434)       0:00:24.410 *********
2026-04-21 19:21:15.053284 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-04-21 19:21:15.053359 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-04-21 19:21:15.053448 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-04-21 19:21:15.053763 | mon1 |
2026-04-21 19:21:15.053803 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-04-21 19:21:15.053809 | mon1 | Tuesday 21 April 2026  19:21:15 +0000 (0:00:00.528)       0:00:24.939 *********
2026-04-21 19:21:15.486219 | mon1 | changed: [mon1]
2026-04-21 19:21:15.486281 | mon1 |
2026-04-21 19:21:15.486591 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-04-21 19:21:15.486639 | mon1 | Tuesday 21 April 2026  19:21:15 +0000 (0:00:00.432)       0:00:25.372 *********
2026-04-21 19:21:15.926422 | mon1 | changed: [mon1]
2026-04-21 19:21:15.926482 | mon1 |
2026-04-21 19:21:15.926967 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-04-21 19:21:15.927011 | mon1 | Tuesday 21 April 2026  19:21:15 +0000 (0:00:00.433)       0:00:25.805 *********
2026-04-21 19:21:15.927017 | mon1 |
2026-04-21 19:21:15.927022 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-04-21 19:21:15.927061 | mon1 | Tuesday 21 April 2026  19:21:15 +0000 (0:00:00.006)       0:00:25.812 *********
2026-04-21 19:21:16.569808 | mon1 | ok: [mon1]
2026-04-21 19:21:16.570239 | mon1 |
2026-04-21 19:21:16.570298 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-04-21 19:21:16.570456 | mon1 | Tuesday 21 April 2026  19:21:16 +0000 (0:00:00.642)       0:00:26.455 *********
2026-04-21 19:21:17.408480 | mon1 | changed: [mon1]
2026-04-21 19:21:17.408633 | mon1 |
2026-04-21 19:21:17.408841 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-04-21 19:21:17.409046 | mon1 | Tuesday 21 April 2026  19:21:17 +0000 (0:00:00.838)       0:00:27.294 *********
2026-04-21 19:21:17.933350 | mon1 | changed: [mon1]
2026-04-21 19:21:17.933517 | mon1 |
2026-04-21 19:21:17.933741 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-04-21 19:21:17.933949 | mon1 | Tuesday 21 April 2026  19:21:17 +0000 (0:00:00.524)       0:00:27.819 *********
2026-04-21 19:21:17.979765 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-04-21 19:21:17.979824 | mon1 |
2026-04-21 19:21:17.979977 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-04-21 19:21:17.980125 | mon1 | Tuesday 21 April 2026  19:21:17 +0000 (0:00:00.046)       0:00:27.865 *********
2026-04-21 19:21:47.825984 | mon1 | changed: [mon1]
2026-04-21 19:21:47.826056 | mon1 |
2026-04-21 19:21:47.826068 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-04-21 19:21:47.826078 | mon1 | Tuesday 21 April 2026  19:21:47 +0000 (0:00:29.845)       0:00:57.711 *********
2026-04-21 19:21:48.490709 | mon1 | ok: [mon1] => (item=chronyd)
2026-04-21 19:21:48.490816 | mon1 | ok: [mon1] => (item=sshd)
2026-04-21 19:21:48.491221 | mon1 |
2026-04-21 19:21:48.491403 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-04-21 19:21:48.491414 | mon1 | Tuesday 21 April 2026  19:21:48 +0000 (0:00:00.665)       0:00:58.376 *********
2026-04-21 19:21:48.773411 | mon1 | changed: [mon1]
2026-04-21 19:21:48.773475 | mon1 |
2026-04-21 19:21:48.773565 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-04-21 19:21:48.773697 | mon1 | Tuesday 21 April 2026  19:21:48 +0000 (0:00:00.282)       0:00:58.659 *********
2026-04-21 19:21:48.972607 | mon1 | ok: [mon1]
2026-04-21 19:21:48.972710 | mon1 |
2026-04-21 19:21:48.972725 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-04-21 19:21:48.972871 | mon1 | Tuesday 21 April 2026  19:21:48 +0000 (0:00:00.199)       0:00:58.858 *********
2026-04-21 19:21:49.430610 | mon1 | changed: [mon1]
2026-04-21 19:21:49.430692 | mon1 |
2026-04-21 19:21:49.430979 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-04-21 19:21:49.431027 | mon1 | Tuesday 21 April 2026  19:21:49 +0000 (0:00:00.457)       0:00:59.316 *********
2026-04-21 19:21:49.757092 | mon1 | changed: [mon1]
2026-04-21 19:21:49.757166 | mon1 |
2026-04-21 19:21:49.757362 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-04-21 19:21:49.757400 | mon1 | Tuesday 21 April 2026  19:21:49 +0000 (0:00:00.326)       0:00:59.643 *********
2026-04-21 19:21:49.867693 | mon1 | ok: [mon1]
2026-04-21 19:21:49.867784 | mon1 |
2026-04-21 19:21:49.868090 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-04-21 19:21:49.868141 | mon1 | Tuesday 21 April 2026  19:21:49 +0000 (0:00:00.110)       0:00:59.753 *********
2026-04-21 19:21:50.083866 | mon1 | ok: [mon1] => (item=mon1)
2026-04-21 19:21:50.083940 | mon1 |
2026-04-21 19:21:50.084146 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-04-21 19:21:50.084192 | mon1 | Tuesday 21 April 2026  19:21:50 +0000 (0:00:00.216)       0:00:59.970 *********
2026-04-21 19:21:50.124975 | mon1 | ok: [mon1]
2026-04-21 19:21:50.125566 | mon1 |
2026-04-21 19:21:50.125618 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-04-21 19:21:50.125626 | mon1 | Tuesday 21 April 2026  19:21:50 +0000 (0:00:00.040)       0:01:00.011 *********
2026-04-21 19:21:50.222142 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1
2026-04-21 19:21:50.222241 | mon1 |
2026-04-21 19:21:50.222297 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-04-21 19:21:50.222461 | mon1 | Tuesday 21 April 2026  19:21:50 +0000 (0:00:00.097)       0:01:00.108 *********
2026-04-21 19:21:50.495749 | mon1 | changed: [mon1]
2026-04-21 19:21:50.495848 | mon1 |
2026-04-21 19:21:50.496143 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-04-21 19:21:50.496189 | mon1 | Tuesday 21 April 2026  19:21:50 +0000 (0:00:00.273)       0:01:00.381 *********
2026-04-21 19:21:51.133381 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-04-21 19:21:51.133446 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-04-21 19:21:51.133548 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-04-21 19:21:51.133853 | mon1 |
2026-04-21 19:21:51.133893 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-04-21 19:21:51.133899 | mon1 | Tuesday 21 April 2026  19:21:51 +0000 (0:00:00.637)       0:01:01.019 *********
2026-04-21 19:23:18.717817 | mon1 | ok: [mon1]
2026-04-21 19:23:18.717879 | mon1 |
2026-04-21 19:23:18.717974 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-04-21 19:23:18.718071 | mon1 | Tuesday 21 April 2026  19:23:18 +0000 (0:01:27.584)       0:02:28.604 *********
2026-04-21 19:23:18.921116 | mon1 | changed: [mon1]
2026-04-21 19:23:18.921184 | mon1 |
2026-04-21 19:23:18.921264 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-04-21 19:23:18.921393 | mon1 | Tuesday 21 April 2026  19:23:18 +0000 (0:00:00.203)       0:02:28.807 *********
2026-04-21 19:23:18.956400 | mon1 | ok: [mon1]
2026-04-21 19:23:18.956478 | mon1 |
2026-04-21 19:23:18.956578 | mon1 | TASK [Install Ceph host] *******************************************************
2026-04-21 19:23:18.956674 | mon1 | Tuesday 21 April 2026  19:23:18 +0000 (0:00:00.034)       0:02:28.842 *********
2026-04-21 19:23:19.019499 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-04-21 19:23:19.019536 | mon1 |
2026-04-21 19:23:19.019659 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-21 19:23:19.019780 | mon1 | Tuesday 21 April 2026  19:23:19 +0000 (0:00:00.063)       0:02:28.906 *********
2026-04-21 19:23:24.670685 | mon1 | ok: [mon1]
2026-04-21 19:23:24.671085 | mon1 |
2026-04-21 19:23:24.671128 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-21 19:23:24.671134 | mon1 | Tuesday 21 April 2026  19:23:24 +0000 (0:00:05.650)       0:02:34.556 *********
2026-04-21 19:23:24.723605 | mon1 | ok: [mon1] => (item=mon1)
2026-04-21 19:23:24.723640 | mon1 |
2026-04-21 19:23:24.723645 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-21 19:23:24.723650 | mon1 | Tuesday 21 April 2026  19:23:24 +0000 (0:00:00.051)       0:02:34.608 *********
2026-04-21 19:23:25.079112 | mon1 | ok: [mon1]
2026-04-21 19:23:25.079154 | mon1 |
2026-04-21 19:23:25.079160 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-21 19:23:25.079165 | mon1 | Tuesday 21 April 2026  19:23:25 +0000 (0:00:00.356)       0:02:34.965 *********
2026-04-21 19:23:31.433104 | mon1 | ok: [mon1]
2026-04-21 19:23:31.433173 | mon1 |
2026-04-21 19:23:31.433322 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-04-21 19:23:31.433337 | mon1 | Tuesday 21 April 2026  19:23:31 +0000 (0:00:06.354)       0:02:41.319 *********
2026-04-21 19:24:16.352340 | mon1 | changed: [mon1]
2026-04-21 19:24:16.352412 | mon1 |
2026-04-21 19:24:16.352607 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-04-21 19:24:16.352649 | mon1 | Tuesday 21 April 2026  19:24:16 +0000 (0:00:44.919)       0:03:26.238 *********
2026-04-21 19:24:31.116430 | mon1 | ok: [mon1]
2026-04-21 19:24:31.116521 | mon1 |
2026-04-21 19:24:31.116555 | mon1 | TASK [Install Ceph host] *******************************************************
2026-04-21 19:24:31.116569 | mon1 | Tuesday 21 April 2026  19:24:31 +0000 (0:00:14.763)       0:03:41.002 *********
2026-04-21 19:24:31.178125 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-04-21 19:24:31.178235 | mon1 |
2026-04-21 19:24:31.178247 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-21 19:24:31.178410 | mon1 | Tuesday 21 April 2026  19:24:31 +0000 (0:00:00.061)       0:03:41.063 *********
2026-04-21 19:24:31.217190 | mon1 | skipping: [mon1]
2026-04-21 19:24:31.217281 | mon1 |
2026-04-21 19:24:31.217587 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-21 19:24:31.217664 | mon1 | Tuesday 21 April 2026  19:24:31 +0000 (0:00:00.039)       0:03:41.103 *********
2026-04-21 19:24:31.263145 | mon1 | skipping: [mon1] => (item=mon1)
2026-04-21 19:24:31.263196 | mon1 | skipping: [mon1]
2026-04-21 19:24:31.263523 | mon1 |
2026-04-21 19:24:31.263600 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-21 19:24:31.263607 | mon1 | Tuesday 21 April 2026  19:24:31 +0000 (0:00:00.045)       0:03:41.149 *********
2026-04-21 19:24:31.508146 | mon1 | ok: [mon1]
2026-04-21 19:24:31.508204 | mon1 |
2026-04-21 19:24:31.508291 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-21 19:24:31.508423 | mon1 | Tuesday 21 April 2026  19:24:31 +0000 (0:00:00.245)       0:03:41.394 *********
2026-04-21 19:24:37.862405 | mon1 | ok: [mon1]
2026-04-21 19:24:37.862468 | mon1 |
2026-04-21 19:24:37.862562 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-04-21 19:24:37.862656 | mon1 | Tuesday 21 April 2026  19:24:37 +0000 (0:00:06.354)       0:03:47.748 *********
2026-04-21 19:24:49.855835 | mon1 | changed: [mon1]
2026-04-21 19:24:49.855912 | mon1 |
2026-04-21 19:24:49.856227 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-04-21 19:24:49.856269 | mon1 | Tuesday 21 April 2026  19:24:49 +0000 (0:00:11.993)       0:03:59.741 *********
2026-04-21 19:24:55.786056 | mon1 | ok: [mon1]
2026-04-21 19:24:55.786132 | mon1 |
2026-04-21 19:24:55.786229 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-04-21 19:24:55.786344 | mon1 | Tuesday 21 April 2026  19:24:55 +0000 (0:00:05.930)       0:04:05.672 *********
2026-04-21 19:25:02.861522 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'})
2026-04-21 19:25:02.861610 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-04-21 19:25:02.861623 | mon1 | changed: [mon1] => (item={'name': 'prometheus'})
2026-04-21 19:25:02.861727 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-04-21 19:25:02.861814 | mon1 |
2026-04-21 19:25:02.861901 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-04-21 19:25:02.861975 | mon1 |
2026-04-21 19:25:02.862075 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-21 19:25:02.862208 | mon1 | Tuesday 21 April 2026  19:25:02 +0000 (0:00:07.075)       0:04:12.747 *********
2026-04-21 19:25:04.017297 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-04-21 19:25:04.017450 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-21 19:25:04.017598 | mon1 | interpreter could change the meaning of that path. See
2026-04-21 19:25:04.017732 | mon1 | https://docs.ansible.com/ansible-
2026-04-21 19:25:04.017874 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-21 19:25:04.026181 | mon1 | ok: [osd1]
2026-04-21 19:25:04.026278 | mon1 |
2026-04-21 19:25:04.026380 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-21 19:25:04.026478 | mon1 | Tuesday 21 April 2026  19:25:04 +0000 (0:00:01.165)       0:04:13.912 *********
2026-04-21 19:25:04.234858 | mon1 | ok: [osd1]
2026-04-21 19:25:04.235013 | mon1 |
2026-04-21 19:25:04.235035 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-21 19:25:04.235046 | mon1 | Tuesday 21 April 2026  19:25:04 +0000 (0:00:00.208)       0:04:14.121 *********
2026-04-21 19:25:04.267604 | mon1 | skipping: [osd1]
2026-04-21 19:25:04.267675 | mon1 |
2026-04-21 19:25:04.267740 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-21 19:25:04.267833 | mon1 | Tuesday 21 April 2026  19:25:04 +0000 (0:00:00.032)       0:04:14.154 *********
2026-04-21 19:25:04.500270 | mon1 | changed: [osd1]
2026-04-21 19:25:04.500346 | mon1 |
2026-04-21 19:25:04.500399 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-21 19:25:04.500580 | mon1 | Tuesday 21 April 2026  19:25:04 +0000 (0:00:00.232)       0:04:14.386 *********
2026-04-21 19:25:04.552161 | mon1 | ok: [osd1] => {
2026-04-21 19:25:04.552225 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-21 19:25:04.552344 | mon1 | }
2026-04-21 19:25:04.552461 | mon1 |
2026-04-21 19:25:04.552595 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-21 19:25:04.552751 | mon1 | Tuesday 21 April 2026  19:25:04 +0000 (0:00:00.051)       0:04:14.438 *********
2026-04-21 19:25:05.153172 | mon1 | changed: [osd1]
2026-04-21 19:25:05.153244 | mon1 |
2026-04-21 19:25:05.153343 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-21 19:25:05.153471 | mon1 | Tuesday 21 April 2026  19:25:05 +0000 (0:00:00.600)       0:04:15.039 *********
2026-04-21 19:25:05.188600 | mon1 | skipping: [osd1]
2026-04-21 19:25:05.188651 | mon1 |
2026-04-21 19:25:05.188747 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-21 19:25:05.188848 | mon1 | Tuesday 21 April 2026  19:25:05 +0000 (0:00:00.035)       0:04:15.075 *********
2026-04-21 19:25:05.223507 | mon1 | skipping: [osd1]
2026-04-21 19:25:05.223563 | mon1 |
2026-04-21 19:25:05.223664 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-21 19:25:05.223748 | mon1 | Tuesday 21 April 2026  19:25:05 +0000 (0:00:00.034)       0:04:15.109 *********
2026-04-21 19:25:05.417705 | mon1 | ok: [osd1]
2026-04-21 19:25:05.417766 | mon1 |
2026-04-21 19:25:05.417846 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-21 19:25:05.417935 | mon1 | Tuesday 21 April 2026  19:25:05 +0000 (0:00:00.194)       0:04:15.304 *********
2026-04-21 19:25:06.590913 | mon1 | ok: [osd1]
2026-04-21 19:25:06.590981 | mon1 |
2026-04-21 19:25:06.591059 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-21 19:25:06.591158 | mon1 | Tuesday 21 April 2026  19:25:06 +0000 (0:00:01.173)       0:04:16.477 *********
2026-04-21 19:25:06.647322 | mon1 | ok: [osd1] => {
2026-04-21 19:25:06.647382 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-04-21 19:25:06.647529 | mon1 | }
2026-04-21 19:25:06.647639 | mon1 |
2026-04-21 19:25:06.647770 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-21 19:25:06.647897 | mon1 | Tuesday 21 April 2026  19:25:06 +0000 (0:00:00.056)       0:04:16.533 *********
2026-04-21 19:25:08.067155 | mon1 | changed: [osd1]
2026-04-21 19:25:08.067279 | mon1 |
2026-04-21 19:25:08.067466 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-21 19:25:08.067635 | mon1 | Tuesday 21 April 2026  19:25:08 +0000 (0:00:01.419)       0:04:17.953 *********
2026-04-21 19:25:10.728267 | mon1 | changed: [osd1]
2026-04-21 19:25:10.728366 | mon1 |
2026-04-21 19:25:10.728703 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-21 19:25:10.728755 | mon1 | Tuesday 21 April 2026  19:25:10 +0000 (0:00:02.660)       0:04:20.614 *********
2026-04-21 19:25:10.751474 | mon1 | skipping: [osd1]
2026-04-21 19:25:10.751531 | mon1 |
2026-04-21 19:25:10.751662 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-21 19:25:10.751735 | mon1 | Tuesday 21 April 2026  19:25:10 +0000 (0:00:00.023)       0:04:20.637 *********
2026-04-21 19:25:10.779653 | mon1 | skipping: [osd1]
2026-04-21 19:25:10.779703 | mon1 |
2026-04-21 19:25:10.779711 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-21 19:25:10.779718 | mon1 | Tuesday 21 April 2026  19:25:10 +0000 (0:00:00.027)       0:04:20.665 *********
2026-04-21 19:25:10.805993 | mon1 | skipping: [osd1]
2026-04-21 19:25:10.806036 | mon1 |
2026-04-21 19:25:10.806041 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-21 19:25:10.806046 | mon1 | Tuesday 21 April 2026  19:25:10 +0000 (0:00:00.026)       0:04:20.692 *********
2026-04-21 19:25:16.622591 | mon1 | changed: [osd1]
2026-04-21 19:25:16.623221 | mon1 |
2026-04-21 19:25:16.623253 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-21 19:25:16.623265 | mon1 | Tuesday 21 April 2026  19:25:16 +0000 (0:00:05.816)       0:04:26.508 *********
2026-04-21 19:25:17.065957 | mon1 | changed: [osd1]
2026-04-21 19:25:17.066020 | mon1 |
2026-04-21 19:25:17.066103 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-21 19:25:17.066244 | mon1 | Tuesday 21 April 2026  19:25:17 +0000 (0:00:00.444)       0:04:26.952 *********
2026-04-21 19:25:17.934058 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'})
2026-04-21 19:25:17.934181 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-21 19:25:17.934188 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-21 19:25:17.934192 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-21 19:25:17.934197 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-21 19:25:17.934201 | mon1 |
2026-04-21 19:25:17.934206 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-21 19:25:17.934210 | mon1 | Tuesday 21 April 2026  19:25:17 +0000 (0:00:00.867)       0:04:27.819 *********
2026-04-21 19:25:18.480553 | mon1 | changed: [osd1]
2026-04-21 19:25:18.480617 | mon1 |
2026-04-21 19:25:18.480682 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-21 19:25:18.481058 | mon1 | Tuesday 21 April 2026  19:25:18 +0000 (0:00:00.540)       0:04:28.360 *********
2026-04-21 19:25:18.481101 | mon1 |
2026-04-21 19:25:18.481107 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-04-21 19:25:18.481111 | mon1 | Tuesday 21 April 2026  19:25:18 +0000 (0:00:00.006)       0:04:28.366 *********
2026-04-21 19:25:19.126785 | mon1 | ok: [osd1]
2026-04-21 19:25:19.126858 | mon1 |
2026-04-21 19:25:19.126870 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-04-21 19:25:19.127009 | mon1 | Tuesday 21 April 2026  19:25:19 +0000 (0:00:00.646)       0:04:29.013 *********
2026-04-21 19:25:19.592688 | mon1 | changed: [osd1]
2026-04-21 19:25:19.592764 | mon1 |
2026-04-21 19:25:19.592776 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-21 19:25:19.592883 | mon1 | Tuesday 21 April 2026  19:25:19 +0000 (0:00:00.465)       0:04:29.479 *********
2026-04-21 19:25:20.134376 | mon1 | changed: [osd1]
2026-04-21 19:25:20.134443 | mon1 |
2026-04-21 19:25:20.134533 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-21 19:25:20.134655 | mon1 | Tuesday 21 April 2026  19:25:20 +0000 (0:00:00.541)       0:04:30.020 *********
2026-04-21 19:25:20.331557 | mon1 | ok: [osd1]
2026-04-21 19:25:20.331616 | mon1 |
2026-04-21 19:25:20.331650 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-21 19:25:20.331780 | mon1 | Tuesday 21 April 2026  19:25:20 +0000 (0:00:00.197)       0:04:30.217 *********
2026-04-21 19:25:20.382245 | mon1 | ok: [osd1] => {
2026-04-21 19:25:20.382383 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-04-21 19:25:20.382872 | mon1 | }
2026-04-21 19:25:20.382896 | mon1 |
2026-04-21 19:25:20.382903 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-21 19:25:20.382909 | mon1 | Tuesday 21 April 2026  19:25:20 +0000 (0:00:00.050)       0:04:30.268 *********
2026-04-21 19:25:21.312170 | mon1 | changed: [osd1]
2026-04-21 19:25:21.312233 | mon1 |
2026-04-21 19:25:21.312247 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-21 19:25:21.312351 | mon1 | Tuesday 21 April 2026  19:25:21 +0000 (0:00:00.930)       0:04:31.198 *********
2026-04-21 19:25:25.705685 | mon1 | changed: [osd1]
2026-04-21 19:25:25.705777 | mon1 |
2026-04-21 19:25:25.705790 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-04-21 19:25:25.705902 | mon1 | Tuesday 21 April 2026  19:25:25 +0000 (0:00:04.393)       0:04:35.591 *********
2026-04-21 19:25:26.824641 | mon1 | ok: [osd1]
2026-04-21 19:25:26.824736 | mon1 |
2026-04-21 19:25:26.824799 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-04-21 19:25:26.824967 | mon1 | Tuesday 21 April 2026  19:25:26 +0000 (0:00:01.118)       0:04:36.710 *********
2026-04-21 19:25:27.043664 | mon1 | changed: [osd1]
2026-04-21 19:25:27.043736 | mon1 |
2026-04-21 19:25:27.043750 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-04-21 19:25:27.043880 | mon1 | Tuesday 21 April 2026  19:25:27 +0000 (0:00:00.219)       0:04:36.930 *********
2026-04-21 19:25:27.522615 | mon1 | changed: [osd1]
2026-04-21 19:25:27.522707 | mon1 |
2026-04-21 19:25:27.522725 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-04-21 19:25:27.522798 | mon1 | Tuesday 21 April 2026  19:25:27 +0000 (0:00:00.478)       0:04:37.409 *********
2026-04-21 19:25:28.072433 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'})
2026-04-21 19:25:28.072508 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-04-21 19:25:28.072584 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-04-21 19:25:28.072879 | mon1 |
2026-04-21 19:25:28.072921 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-04-21 19:25:28.072927 | mon1 | Tuesday 21 April 2026  19:25:28 +0000 (0:00:00.549)       0:04:37.958 *********
2026-04-21 19:25:28.511115 | mon1 | changed: [osd1]
2026-04-21 19:25:28.511196 | mon1 |
2026-04-21 19:25:28.511208 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-04-21 19:25:28.511301 | mon1 | Tuesday 21 April 2026  19:25:28 +0000 (0:00:00.438)       0:04:38.397 *********
2026-04-21 19:25:28.960245 | mon1 | changed: [osd1]
2026-04-21 19:25:28.960300 | mon1 |
2026-04-21 19:25:28.960745 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-04-21 19:25:28.960792 | mon1 | Tuesday 21 April 2026  19:25:28 +0000 (0:00:00.442)       0:04:38.839 *********
2026-04-21 19:25:28.960797 | mon1 |
2026-04-21 19:25:28.960802 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-04-21 19:25:28.960807 | mon1 | Tuesday 21 April 2026  19:25:28 +0000 (0:00:00.006)       0:04:38.846 *********
2026-04-21 19:25:29.657852 | mon1 | ok: [osd1]
2026-04-21 19:25:29.657934 | mon1 |
2026-04-21 19:25:29.658266 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-04-21 19:25:29.658323 | mon1 | Tuesday 21 April 2026  19:25:29 +0000 (0:00:00.697)       0:04:39.544 *********
2026-04-21 19:25:31.112377 | mon1 | changed: [osd1]
2026-04-21 19:25:31.112450 | mon1 |
2026-04-21 19:25:31.112717 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-04-21 19:25:31.112768 | mon1 | Tuesday 21 April 2026  19:25:31 +0000 (0:00:01.454)       0:04:40.998 *********
2026-04-21 19:25:31.671499 | mon1 | changed: [osd1]
2026-04-21 19:25:31.671577 | mon1 |
2026-04-21 19:25:31.671772 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-04-21 19:25:31.671819 | mon1 | Tuesday 21 April 2026  19:25:31 +0000 (0:00:00.559)       0:04:41.557 *********
2026-04-21 19:25:31.709369 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-04-21 19:25:31.709449 | mon1 |
2026-04-21 19:25:31.709464 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-04-21 19:25:31.709604 | mon1 | Tuesday 21 April 2026  19:25:31 +0000 (0:00:00.037)       0:04:41.595 *********
2026-04-21 19:25:36.824133 | mon1 | changed: [osd1]
2026-04-21 19:25:36.824221 | mon1 |
2026-04-21 19:25:36.824250 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-04-21 19:25:36.824359 | mon1 | Tuesday 21 April 2026  19:25:36 +0000 (0:00:05.114)       0:04:46.710 *********
2026-04-21 19:25:37.464992 | mon1 | ok: [osd1] => (item=chronyd)
2026-04-21 19:25:37.465070 | mon1 | ok: [osd1] => (item=sshd)
2026-04-21 19:25:37.465392 | mon1 |
2026-04-21 19:25:37.465436 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-04-21 19:25:37.465442 | mon1 | Tuesday 21 April 2026  19:25:37 +0000 (0:00:00.640)       0:04:47.351 *********
2026-04-21 19:25:37.772333 | mon1 | changed: [osd1]
2026-04-21 19:25:37.772404 | mon1 |
2026-04-21 19:25:37.772759 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-04-21 19:25:37.772810 | mon1 | Tuesday 21 April 2026  19:25:37 +0000 (0:00:00.307)       0:04:47.658 *********
2026-04-21 19:25:37.962830 | mon1 | ok: [osd1]
2026-04-21 19:25:37.962916 | mon1 |
2026-04-21 19:25:37.963899 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-04-21 19:25:37.963986 | mon1 | Tuesday 21 April 2026  19:25:37 +0000 (0:00:00.190)       0:04:47.848 *********
2026-04-21 19:25:38.269708 | mon1 | changed: [osd1]
2026-04-21 19:25:38.269833 | mon1 |
2026-04-21 19:25:38.269846 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-04-21 19:25:38.269916 | mon1 | Tuesday 21 April 2026  19:25:38 +0000 (0:00:00.307)       0:04:48.156 *********
2026-04-21 19:25:38.476984 | mon1 | changed: [osd1]
2026-04-21 19:25:38.477112 | mon1 |
2026-04-21 19:25:38.477127 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-04-21 19:25:38.477201 | mon1 | Tuesday 21 April 2026  19:25:38 +0000 (0:00:00.207)       0:04:48.363 *********
2026-04-21 19:25:38.676730 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-04-21 19:25:38.676801 | mon1 |
2026-04-21 19:25:38.677149 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-04-21 19:25:38.677196 | mon1 | Tuesday 21 April 2026  19:25:38 +0000 (0:00:00.199)       0:04:48.562 *********
2026-04-21 19:25:38.711920 | mon1 | ok: [osd1]
2026-04-21 19:25:38.711976 | mon1 |
2026-04-21 19:25:38.712069 | mon1 | TASK [Install Ceph host] *******************************************************
2026-04-21 19:25:38.712182 | mon1 | Tuesday 21 April 2026  19:25:38 +0000 (0:00:00.035)       0:04:48.598 *********
2026-04-21 19:25:38.764375 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-04-21 19:25:38.764457 | mon1 |
2026-04-21 19:25:38.764472 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-21 19:25:38.764621 | mon1 | Tuesday 21 April 2026  19:25:38 +0000 (0:00:00.052)       0:04:48.651 *********
2026-04-21 19:25:44.676424 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-04-21 19:25:44.676471 | mon1 |
2026-04-21 19:25:44.676476 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-21 19:25:44.676481 | mon1 | Tuesday 21 April 2026  19:25:44 +0000 (0:00:05.911)       0:04:54.562 *********
2026-04-21 19:25:44.722191 | mon1 | ok: [osd1] => (item=osd1)
2026-04-21 19:25:44.722220 | mon1 |
2026-04-21 19:25:44.722227 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-21 19:25:44.722234 | mon1 | Tuesday 21 April 2026  19:25:44 +0000 (0:00:00.045)       0:04:54.608 *********
2026-04-21 19:25:44.956786 | mon1 | changed: [osd1]
2026-04-21 19:25:44.956865 | mon1 |
2026-04-21 19:25:44.956877 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-21 19:25:44.956997 | mon1 | Tuesday 21 April 2026  19:25:44 +0000 (0:00:00.234)       0:04:54.843 *********
2026-04-21 19:25:53.424821 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-04-21 19:25:53.424905 | mon1 |
2026-04-21 19:25:53.425202 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-04-21 19:25:53.425223 | mon1 | Tuesday 21 April 2026  19:25:53 +0000 (0:00:08.468)       0:05:03.311 *********
2026-04-21 19:25:54.971403 | mon1 | ok: [osd1]
2026-04-21 19:25:54.971450 | mon1 |
2026-04-21 19:25:54.971456 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-04-21 19:25:54.971461 | mon1 | Tuesday 21 April 2026  19:25:54 +0000 (0:00:01.546)       0:05:04.857 *********
2026-04-21 19:26:40.757529 | mon1 | ok: [osd1]
2026-04-21 19:26:40.757605 | mon1 |
2026-04-21 19:26:40.757935 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-04-21 19:26:40.757986 | mon1 | Tuesday 21 April 2026  19:26:40 +0000 (0:00:45.786)       0:05:50.643 *********
2026-04-21 19:28:11.928573 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data)
2026-04-21 19:28:11.928653 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data)
2026-04-21 19:28:11.929226 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data)
2026-04-21 19:28:11.929276 | mon1 |
2026-04-21 19:28:11.929285 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-04-21 19:28:11.929292 | mon1 | Tuesday 21 April 2026  19:28:11 +0000 (0:01:31.171)       0:07:21.814 *********
2026-04-21 19:28:18.078291 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-04-21 19:28:18.078371 | mon1 |
2026-04-21 19:28:18.078394 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-04-21 19:28:18.078405 | mon1 | Tuesday 21 April 2026  19:28:18 +0000 (0:00:06.149)       0:07:27.964 *********
2026-04-21 19:28:24.415843 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-04-21 19:28:24.415914 | mon1 |
2026-04-21 19:28:24.416149 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-04-21 19:28:24.416231 | mon1 | Tuesday 21 April 2026  19:28:24 +0000 (0:00:06.337)       0:07:34.301 *********
2026-04-21 19:28:24.477332 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-04-21 19:28:24.477383 | mon1 |
2026-04-21 19:28:24.477635 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-04-21 19:28:24.477695 | mon1 | Tuesday 21 April 2026  19:28:24 +0000 (0:00:00.061)       0:07:34.363 *********
2026-04-21 19:28:24.520748 | mon1 | ok: [osd1]
2026-04-21 19:28:24.520822 | mon1 |
2026-04-21 19:28:24.520895 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-04-21 19:28:24.521016 | mon1 | Tuesday 21 April 2026  19:28:24 +0000 (0:00:00.043)       0:07:34.406 *********
2026-04-21 19:28:30.534954 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-04-21 19:28:30.535006 | mon1 |
2026-04-21 19:28:30.535014 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-04-21 19:28:30.535020 | mon1 | Tuesday 21 April 2026  19:28:30 +0000 (0:00:06.013)       0:07:40.420 *********
2026-04-21 19:28:30.575120 | mon1 | ok: [osd1]
2026-04-21 19:28:30.575155 | mon1 |
2026-04-21 19:28:30.575163 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-04-21 19:28:30.575169 | mon1 | Tuesday 21 April 2026  19:28:30 +0000 (0:00:00.040)       0:07:40.460 *********
2026-04-21 19:28:30.610010 | mon1 | skipping: [osd1] => (item=1)
2026-04-21 19:28:30.610029 | mon1 | skipping: [osd1] => (item=1)
2026-04-21 19:28:30.610034 | mon1 | skipping: [osd1] => (item=1)
2026-04-21 19:28:30.610039 | mon1 | skipping: [osd1]
2026-04-21 19:28:30.610043 | mon1 |
2026-04-21 19:28:30.610048 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-04-21 19:28:30.610052 | mon1 | Tuesday 21 April 2026  19:28:30 +0000 (0:00:00.035)       0:07:40.496 *********
2026-04-21 19:28:30.642370 | mon1 | skipping: [osd1]
2026-04-21 19:28:30.642424 | mon1 |
2026-04-21 19:28:30.642431 | mon1 | PLAY RECAP *********************************************************************
2026-04-21 19:28:30.646327 | mon1 | mon1                       : ok=59   changed=29   unreachable=0    failed=0    skipped=8    rescued=0    ignored=0
2026-04-21 19:28:30.646402 | mon1 | osd1                       : ok=53   changed=24   unreachable=0    failed=0    skipped=8    rescued=0    ignored=0
2026-04-21 19:28:30.646413 | mon1 |
2026-04-21 19:28:30.646422 | mon1 |
2026-04-21 19:28:30.646432 | mon1 | TASKS RECAP ********************************************************************
2026-04-21 19:28:30.646441 | mon1 | Tuesday 21 April 2026  19:28:30 +0000 (0:00:00.032)       0:07:40.528 *********
2026-04-21 19:28:30.646449 | mon1 | ===============================================================================
2026-04-21 19:28:30.646477 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 91.17s
2026-04-21 19:28:30.646486 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 87.58s
2026-04-21 19:28:30.646495 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 45.79s
2026-04-21 19:28:30.646503 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 44.92s
2026-04-21 19:28:30.646512 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 29.85s
2026-04-21 19:28:30.646520 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.76s
2026-04-21 19:28:30.646529 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 11.99s
2026-04-21 19:28:30.646537 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 8.47s
2026-04-21 19:28:30.646545 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.08s
2026-04-21 19:28:30.646554 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.35s
2026-04-21 19:28:30.646562 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.35s
2026-04-21 19:28:30.646571 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.34s
2026-04-21 19:28:30.646579 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.15s
2026-04-21 19:28:30.646587 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.01s
2026-04-21 19:28:30.646596 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 5.93s
2026-04-21 19:28:30.646604 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.91s
2026-04-21 19:28:30.646613 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.82s
2026-04-21 19:28:30.646629 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.68s
2026-04-21 19:28:30.646638 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.65s
2026-04-21 19:28:30.646867 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.11s
2026-04-21 19:28:30.748291 | mon1 | INFO     [default > converge] Executed: Successful
2026-04-21 19:28:30.760287 | mon1 | INFO     [default > idempotence] Executing
2026-04-21 19:28:31.558921 | mon1 |
2026-04-21 19:28:31.559287 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-04-21 19:28:31.559588 | mon1 |
2026-04-21 19:28:31.559876 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-21 19:28:31.560155 | mon1 | Tuesday 21 April 2026  19:28:31 +0000 (0:00:00.044)       0:00:00.044 *********
2026-04-21 19:28:32.733293 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-04-21 19:28:32.733349 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-21 19:28:32.733360 | mon1 | interpreter could change the meaning of that path. See
2026-04-21 19:28:32.733370 | mon1 | https://docs.ansible.com/ansible-
2026-04-21 19:28:32.733379 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-21 19:28:32.746236 | mon1 | ok: [mon1]
2026-04-21 19:28:32.746300 | mon1 |
2026-04-21 19:28:32.746313 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-21 19:28:32.746620 | mon1 | Tuesday 21 April 2026  19:28:32 +0000 (0:00:01.186)       0:00:01.231 *********
2026-04-21 19:28:33.039600 | mon1 | ok: [mon1]
2026-04-21 19:28:33.039649 | mon1 |
2026-04-21 19:28:33.039658 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-21 19:28:33.039743 | mon1 | Tuesday 21 April 2026  19:28:33 +0000 (0:00:00.293)       0:00:01.525 *********
2026-04-21 19:28:33.062538 | mon1 | skipping: [mon1]
2026-04-21 19:28:33.062734 | mon1 |
2026-04-21 19:28:33.062946 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-21 19:28:33.063166 | mon1 | Tuesday 21 April 2026  19:28:33 +0000 (0:00:00.023)       0:00:01.548 *********
2026-04-21 19:28:33.351254 | mon1 | ok: [mon1]
2026-04-21 19:28:33.351457 | mon1 |
2026-04-21 19:28:33.351688 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-21 19:28:33.351919 | mon1 | Tuesday 21 April 2026  19:28:33 +0000 (0:00:00.288)       0:00:01.837 *********
2026-04-21 19:28:33.410415 | mon1 | ok: [mon1] => {
2026-04-21 19:28:33.410610 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-21 19:28:33.410804 | mon1 | }
2026-04-21 19:28:33.411011 | mon1 |
2026-04-21 19:28:33.411229 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-21 19:28:33.411428 | mon1 | Tuesday 21 April 2026  19:28:33 +0000 (0:00:00.059)       0:00:01.896 *********
2026-04-21 19:28:33.806154 | mon1 | ok: [mon1]
2026-04-21 19:28:33.806383 | mon1 |
2026-04-21 19:28:33.806617 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-21 19:28:33.806836 | mon1 | Tuesday 21 April 2026  19:28:33 +0000 (0:00:00.395)       0:00:02.292 *********
2026-04-21 19:28:33.848403 | mon1 | skipping: [mon1]
2026-04-21 19:28:33.848601 | mon1 |
2026-04-21 19:28:33.848858 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-21 19:28:33.849059 | mon1 | Tuesday 21 April 2026  19:28:33 +0000 (0:00:00.042)       0:00:02.334 *********
2026-04-21 19:28:33.889869 | mon1 | skipping: [mon1]
2026-04-21 19:28:33.890048 | mon1 |
2026-04-21 19:28:33.890315 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-21 19:28:33.890509 | mon1 | Tuesday 21 April 2026  19:28:33 +0000 (0:00:00.041)       0:00:02.376 *********
2026-04-21 19:28:34.095325 | mon1 | ok: [mon1]
2026-04-21 19:28:34.095449 | mon1 |
2026-04-21 19:28:34.095668 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-21 19:28:34.095872 | mon1 | Tuesday 21 April 2026  19:28:34 +0000 (0:00:00.205)       0:00:02.581 *********
2026-04-21 19:28:35.221397 | mon1 | ok: [mon1]
2026-04-21 19:28:35.221507 | mon1 |
2026-04-21 19:28:35.221520 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-21 19:28:35.221530 | mon1 | Tuesday 21 April 2026  19:28:35 +0000 (0:00:01.125)       0:00:03.706 *********
2026-04-21 19:28:35.293942 | mon1 | ok: [mon1] => {
2026-04-21 19:28:35.294364 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-04-21 19:28:35.294673 | mon1 | }
2026-04-21 19:28:35.294696 | mon1 |
2026-04-21 19:28:35.294707 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-21 19:28:35.294718 | mon1 | Tuesday 21 April 2026  19:28:35 +0000 (0:00:00.073)       0:00:03.780 *********
2026-04-21 19:28:35.661912 | mon1 | ok: [mon1]
2026-04-21 19:28:35.661965 | mon1 |
2026-04-21 19:28:35.662000 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-21 19:28:35.662011 | mon1 | Tuesday 21 April 2026  19:28:35 +0000 (0:00:00.367)       0:00:04.147 *********
2026-04-21 19:28:37.879200 | mon1 | ok: [mon1]
2026-04-21 19:28:37.879266 | mon1 |
2026-04-21 19:28:37.879316 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-21 19:28:37.879409 | mon1 | Tuesday 21 April 2026  19:28:37 +0000 (0:00:02.217)       0:00:06.365 *********
2026-04-21 19:28:37.905352 | mon1 | skipping: [mon1]
2026-04-21 19:28:37.905521 | mon1 |
2026-04-21 19:28:37.905816 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-21 19:28:37.905837 | mon1 | Tuesday 21 April 2026  19:28:37 +0000 (0:00:00.025)       0:00:06.391 *********
2026-04-21 19:28:37.936485 | mon1 | skipping: [mon1]
2026-04-21 19:28:37.936556 | mon1 |
2026-04-21 19:28:37.936649 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-21 19:28:37.936740 | mon1 | Tuesday 21 April 2026  19:28:37 +0000 (0:00:00.031)       0:00:06.423 *********
2026-04-21 19:28:37.960596 | mon1 | skipping: [mon1]
2026-04-21 19:28:37.961305 | mon1 |
2026-04-21 19:28:37.961322 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-21 19:28:37.961330 | mon1 | Tuesday 21 April 2026  19:28:37 +0000 (0:00:00.023)       0:00:06.446 *********
2026-04-21 19:28:39.086639 | mon1 | ok: [mon1]
2026-04-21 19:28:39.086756 | mon1 |
2026-04-21 19:28:39.087092 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-21 19:28:39.087149 | mon1 | Tuesday 21 April 2026  19:28:39 +0000 (0:00:01.126)       0:00:07.572 *********
2026-04-21 19:28:39.492367 | mon1 | ok: [mon1]
2026-04-21 19:28:39.492467 | mon1 |
2026-04-21 19:28:39.492740 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-21 19:28:39.492761 | mon1 | Tuesday 21 April 2026  19:28:39 +0000 (0:00:00.405)       0:00:07.978 *********
2026-04-21 19:28:40.376709 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-04-21 19:28:40.376823 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-21 19:28:40.377633 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-21 19:28:40.377654 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-21 19:28:40.377661 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-21 19:28:40.377668 | mon1 |
2026-04-21 19:28:40.377674 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-21 19:28:40.377680 | mon1 | Tuesday 21 April 2026  19:28:40 +0000 (0:00:00.884)       0:00:08.862 *********
2026-04-21 19:28:40.874830 | mon1 | ok: [mon1]
2026-04-21 19:28:40.874895 | mon1 |
2026-04-21 19:28:40.874980 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-21 19:28:40.875375 | mon1 | Tuesday 21 April 2026  19:28:40 +0000 (0:00:00.492)       0:00:09.354 *********
2026-04-21 19:28:40.875415 | mon1 |
2026-04-21 19:28:40.875421 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-21 19:28:40.875425 | mon1 | Tuesday 21 April 2026  19:28:40 +0000 (0:00:00.006)       0:00:09.361 *********
2026-04-21 19:28:41.456917 | mon1 | ok: [mon1]
2026-04-21 19:28:41.456985 | mon1 |
2026-04-21 19:28:41.457047 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-21 19:28:41.457207 | mon1 | Tuesday 21 April 2026  19:28:41 +0000 (0:00:00.581)       0:00:09.942 *********
2026-04-21 19:28:41.680430 | mon1 | ok: [mon1]
2026-04-21 19:28:41.680530 | mon1 |
2026-04-21 19:28:41.680811 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-21 19:28:41.680876 | mon1 | Tuesday 21 April 2026  19:28:41 +0000 (0:00:00.224)       0:00:10.166 *********
2026-04-21 19:28:41.756844 | mon1 | ok: [mon1] => {
2026-04-21 19:28:41.756954 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-04-21 19:28:41.757453 | mon1 | }
2026-04-21 19:28:41.757506 | mon1 |
2026-04-21 19:28:41.757513 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-21 19:28:41.757520 | mon1 | Tuesday 21 April 2026  19:28:41 +0000 (0:00:00.076)       0:00:10.242 *********
2026-04-21 19:28:42.131965 | mon1 | ok: [mon1]
2026-04-21 19:28:42.132064 | mon1 |
2026-04-21 19:28:42.132136 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-21 19:28:42.132305 | mon1 | Tuesday 21 April 2026  19:28:42 +0000 (0:00:00.375)       0:00:10.618 *********
2026-04-21 19:28:45.212482 | mon1 | ok: [mon1]
2026-04-21 19:28:45.212529 | mon1 |
2026-04-21 19:28:45.212535 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-04-21 19:28:45.212539 | mon1 | Tuesday 21 April 2026  19:28:45 +0000 (0:00:03.080)       0:00:13.698 *********
2026-04-21 19:28:46.238831 | mon1 | ok: [mon1]
2026-04-21 19:28:46.238873 | mon1 |
2026-04-21 19:28:46.238881 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-04-21 19:28:46.238887 | mon1 | Tuesday 21 April 2026  19:28:46 +0000 (0:00:01.026)       0:00:14.724 *********
2026-04-21 19:28:46.550238 | mon1 | ok: [mon1]
2026-04-21 19:28:46.550300 | mon1 |
2026-04-21 19:28:46.550506 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-04-21 19:28:46.550557 | mon1 | Tuesday 21 April 2026  19:28:46 +0000 (0:00:00.311)       0:00:15.036 *********
2026-04-21 19:28:46.967809 | mon1 | ok: [mon1]
2026-04-21 19:28:46.967900 | mon1 |
2026-04-21 19:28:46.968224 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-04-21 19:28:46.968276 | mon1 | Tuesday 21 April 2026  19:28:46 +0000 (0:00:00.417)       0:00:15.453 *********
2026-04-21 19:28:47.511202 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-04-21 19:28:47.511321 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-04-21 19:28:47.511841 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-04-21 19:28:47.511889 | mon1 |
2026-04-21 19:28:47.511897 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-04-21 19:28:47.511904 | mon1 | Tuesday 21 April 2026  19:28:47 +0000 (0:00:00.543)       0:00:15.997 *********
2026-04-21 19:28:47.932336 | mon1 | ok: [mon1]
2026-04-21 19:28:47.932403 | mon1 |
2026-04-21 19:28:47.932485 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-04-21 19:28:47.932624 | mon1 | Tuesday 21 April 2026  19:28:47 +0000 (0:00:00.421)       0:00:16.418 *********
2026-04-21 19:28:48.364850 | mon1 | ok: [mon1]
2026-04-21 19:28:48.364913 | mon1 |
2026-04-21 19:28:48.364996 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-04-21 19:28:48.365383 | mon1 | Tuesday 21 April 2026  19:28:48 +0000 (0:00:00.426)       0:00:16.845 *********
2026-04-21 19:28:48.365423 | mon1 |
2026-04-21 19:28:48.365428 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-04-21 19:28:48.365433 | mon1 | Tuesday 21 April 2026  19:28:48 +0000 (0:00:00.005)       0:00:16.851 *********
2026-04-21 19:28:48.714809 | mon1 | ok: [mon1]
2026-04-21 19:28:48.714878 | mon1 |
2026-04-21 19:28:48.714968 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-04-21 19:28:48.715098 | mon1 | Tuesday 21 April 2026  19:28:48 +0000 (0:00:00.349)       0:00:17.201 *********
2026-04-21 19:28:48.762033 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-04-21 19:28:48.762098 | mon1 |
2026-04-21 19:28:48.762199 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-04-21 19:28:48.762352 | mon1 | Tuesday 21 April 2026  19:28:48 +0000 (0:00:00.047)       0:00:17.248 *********
2026-04-21 19:28:49.805711 | mon1 | ok: [mon1]
2026-04-21 19:28:49.805777 | mon1 |
2026-04-21 19:28:49.805789 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-04-21 19:28:49.805800 | mon1 | Tuesday 21 April 2026  19:28:49 +0000 (0:00:01.042)       0:00:18.290 *********
2026-04-21 19:28:50.438209 | mon1 | ok: [mon1] => (item=chronyd)
2026-04-21 19:28:50.438251 | mon1 | ok: [mon1] => (item=sshd)
2026-04-21 19:28:50.438259 | mon1 |
2026-04-21 19:28:50.438265 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-04-21 19:28:50.438271 | mon1 | Tuesday 21 April 2026  19:28:50 +0000 (0:00:00.632)       0:00:18.923 *********
2026-04-21 19:28:50.727512 | mon1 | ok: [mon1]
2026-04-21 19:28:50.727578 | mon1 |
2026-04-21 19:28:50.727590 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-04-21 19:28:50.727602 | mon1 | Tuesday 21 April 2026  19:28:50 +0000 (0:00:00.289)       0:00:19.212 *********
2026-04-21 19:28:50.925170 | mon1 | ok: [mon1]
2026-04-21 19:28:50.925209 | mon1 |
2026-04-21 19:28:50.925222 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-04-21 19:28:50.925233 | mon1 | Tuesday 21 April 2026  19:28:50 +0000 (0:00:00.197)       0:00:19.410 *********
2026-04-21 19:28:51.326519 | mon1 | ok: [mon1]
2026-04-21 19:28:51.326597 | mon1 |
2026-04-21 19:28:51.326795 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-04-21 19:28:51.326840 | mon1 | Tuesday 21 April 2026  19:28:51 +0000 (0:00:00.402)       0:00:19.812 *********
2026-04-21 19:28:51.652463 | mon1 | ok: [mon1]
2026-04-21 19:28:51.652523 | mon1 |
2026-04-21 19:28:51.652603 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-04-21 19:28:51.652698 | mon1 | Tuesday 21 April 2026  19:28:51 +0000 (0:00:00.325)       0:00:20.138 *********
2026-04-21 19:28:51.729177 | mon1 | ok: [mon1]
2026-04-21 19:28:51.729304 | mon1 |
2026-04-21 19:28:51.729317 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-04-21 19:28:51.729331 | mon1 | Tuesday 21 April 2026  19:28:51 +0000 (0:00:00.076)       0:00:20.215 *********
2026-04-21 19:28:51.959082 | mon1 | ok: [mon1] => (item=mon1)
2026-04-21 19:28:51.959211 | mon1 |
2026-04-21 19:28:51.959228 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-04-21 19:28:51.959247 | mon1 | Tuesday 21 April 2026  19:28:51 +0000 (0:00:00.229)       0:00:20.445 *********
2026-04-21 19:28:52.003613 | mon1 | ok: [mon1]
2026-04-21 19:28:52.003747 | mon1 |
2026-04-21 19:28:52.003760 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-04-21 19:28:52.003926 | mon1 | Tuesday 21 April 2026  19:28:51 +0000 (0:00:00.044)       0:00:20.489 *********
2026-04-21 19:28:52.048892 | mon1 | skipping: [mon1]
2026-04-21 19:28:52.048960 | mon1 |
2026-04-21 19:28:52.049332 | mon1 | TASK [Install Ceph host] *******************************************************
2026-04-21 19:28:52.049414 | mon1 | Tuesday 21 April 2026  19:28:52 +0000 (0:00:00.044)       0:00:20.534 *********
2026-04-21 19:28:52.109886 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-04-21 19:28:52.109984 | mon1 |
2026-04-21 19:28:52.110002 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-21 19:28:52.110083 | mon1 | Tuesday 21 April 2026  19:28:52 +0000 (0:00:00.061)       0:00:20.595 *********
2026-04-21 19:28:58.375214 | mon1 | ok: [mon1]
2026-04-21 19:28:58.375296 | mon1 |
2026-04-21 19:28:58.375626 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-21 19:28:58.375676 | mon1 | Tuesday 21 April 2026  19:28:58 +0000 (0:00:06.265)       0:00:26.861 *********
2026-04-21 19:28:58.420305 | mon1 | ok: [mon1] => (item=mon1)
2026-04-21 19:28:58.420373 | mon1 |
2026-04-21 19:28:58.420728 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-21 19:28:58.420774 | mon1 | Tuesday 21 April 2026  19:28:58 +0000 (0:00:00.045)       0:00:26.906 *********
2026-04-21 19:28:58.785577 | mon1 | ok: [mon1]
2026-04-21 19:28:58.785648 | mon1 |
2026-04-21 19:28:58.785847 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-21 19:28:58.785892 | mon1 | Tuesday 21 April 2026  19:28:58 +0000 (0:00:00.365)       0:00:27.271 *********
2026-04-21 19:29:05.180280 | mon1 | ok: [mon1]
2026-04-21 19:29:05.180349 | mon1 |
2026-04-21 19:29:05.180566 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-04-21 19:29:05.180613 | mon1 | Tuesday 21 April 2026  19:29:05 +0000 (0:00:06.394)       0:00:33.666 *********
2026-04-21 19:29:11.394236 | mon1 | ok: [mon1]
2026-04-21 19:29:11.394308 | mon1 |
2026-04-21 19:29:11.394327 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-04-21 19:29:11.394413 | mon1 | Tuesday 21 April 2026  19:29:11 +0000 (0:00:06.213)       0:00:39.880 *********
2026-04-21 19:29:25.466945 | mon1 | ok: [mon1]
2026-04-21 19:29:25.467013 | mon1 |
2026-04-21 19:29:25.467230 | mon1 | TASK [Install Ceph host] *******************************************************
2026-04-21 19:29:25.467279 | mon1 | Tuesday 21 April 2026  19:29:25 +0000 (0:00:14.073)       0:00:53.953 *********
2026-04-21 19:29:25.532845 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-04-21 19:29:25.532924 | mon1 |
2026-04-21 19:29:25.533142 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-21 19:29:25.533184 | mon1 | Tuesday 21 April 2026  19:29:25 +0000 (0:00:00.065)       0:00:54.019 *********
2026-04-21 19:29:25.575864 | mon1 | skipping: [mon1]
2026-04-21 19:29:25.575932 | mon1 |
2026-04-21 19:29:25.576219 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-21 19:29:25.576268 | mon1 | Tuesday 21 April 2026  19:29:25 +0000 (0:00:00.042)       0:00:54.061 *********
2026-04-21 19:29:25.619081 | mon1 | skipping: [mon1] => (item=mon1)
2026-04-21 19:29:25.619120 | mon1 | skipping: [mon1]
2026-04-21 19:29:25.619428 | mon1 |
2026-04-21 19:29:25.619486 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-21 19:29:25.619492 | mon1 | Tuesday 21 April 2026  19:29:25 +0000 (0:00:00.043)       0:00:54.105 *********
2026-04-21 19:29:25.870935 | mon1 | ok: [mon1]
2026-04-21 19:29:25.870997 | mon1 |
2026-04-21 19:29:25.871096 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-21 19:29:25.871229 | mon1 | Tuesday 21 April 2026  19:29:25 +0000 (0:00:00.251)       0:00:54.357 *********
2026-04-21 19:29:32.158323 | mon1 | ok: [mon1]
2026-04-21 19:29:32.158396 | mon1 |
2026-04-21 19:29:32.158479 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-04-21 19:29:32.158576 | mon1 | Tuesday 21 April 2026  19:29:32 +0000 (0:00:06.287)       0:01:00.644 *********
2026-04-21 19:29:38.239897 | mon1 | ok: [mon1]
2026-04-21 19:29:38.239973 | mon1 |
2026-04-21 19:29:38.240251 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-04-21 19:29:38.240279 | mon1 | Tuesday 21 April 2026  19:29:38 +0000 (0:00:06.081)       0:01:06.726 *********
2026-04-21 19:29:44.225110 | mon1 | ok: [mon1]
2026-04-21 19:29:44.225164 | mon1 |
2026-04-21 19:29:44.225172 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-04-21 19:29:44.225178 | mon1 | Tuesday 21 April 2026  19:29:44 +0000 (0:00:05.984)       0:01:12.710 *********
2026-04-21 19:29:51.780784 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'})
2026-04-21 19:29:51.780865 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-04-21 19:29:51.781502 | mon1 | ok: [mon1] => (item={'name': 'prometheus'})
2026-04-21 19:29:51.781548 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-04-21 19:29:51.781555 | mon1 |
2026-04-21 19:29:51.781560 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-04-21 19:29:51.781565 | mon1 |
2026-04-21 19:29:51.781569 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-21 19:29:51.781573 | mon1 | Tuesday 21 April 2026  19:29:51 +0000 (0:00:07.556)       0:01:20.267 *********
2026-04-21 19:29:52.856545 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-04-21 19:29:52.857420 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-21 19:29:52.857505 | mon1 | interpreter could change the meaning of that path. See
2026-04-21 19:29:52.857517 | mon1 | https://docs.ansible.com/ansible-
2026-04-21 19:29:52.857527 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-21 19:29:52.872067 | mon1 | ok: [osd1]
2026-04-21 19:29:52.872377 | mon1 |
2026-04-21 19:29:52.872402 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-21 19:29:52.872407 | mon1 | Tuesday 21 April 2026  19:29:52 +0000 (0:00:01.090)       0:01:21.358 *********
2026-04-21 19:29:53.078773 | mon1 | ok: [osd1]
2026-04-21 19:29:53.078848 | mon1 |
2026-04-21 19:29:53.078928 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-21 19:29:53.079055 | mon1 | Tuesday 21 April 2026  19:29:53 +0000 (0:00:00.207)       0:01:21.565 *********
2026-04-21 19:29:53.116095 | mon1 | skipping: [osd1]
2026-04-21 19:29:53.116173 | mon1 |
2026-04-21 19:29:53.116399 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-21 19:29:53.116446 | mon1 | Tuesday 21 April 2026  19:29:53 +0000 (0:00:00.037)       0:01:21.602 *********
2026-04-21 19:29:53.320839 | mon1 | ok: [osd1]
2026-04-21 19:29:53.320904 | mon1 |
2026-04-21 19:29:53.321121 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-21 19:29:53.321170 | mon1 | Tuesday 21 April 2026  19:29:53 +0000 (0:00:00.204)       0:01:21.807 *********
2026-04-21 19:29:53.393805 | mon1 | ok: [osd1] => {
2026-04-21 19:29:53.394353 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-21 19:29:53.394413 | mon1 | }
2026-04-21 19:29:53.394424 | mon1 |
2026-04-21 19:29:53.394434 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-21 19:29:53.394450 | mon1 | Tuesday 21 April 2026  19:29:53 +0000 (0:00:00.072)       0:01:21.879 *********
2026-04-21 19:29:53.696113 | mon1 | ok: [osd1]
2026-04-21 19:29:53.696172 | mon1 |
2026-04-21 19:29:53.696487 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-21 19:29:53.696532 | mon1 | Tuesday 21 April 2026  19:29:53 +0000 (0:00:00.302)       0:01:22.182 *********
2026-04-21 19:29:53.739066 | mon1 | skipping: [osd1]
2026-04-21 19:29:53.739119 | mon1 |
2026-04-21 19:29:53.739221 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-21 19:29:53.739339 | mon1 | Tuesday 21 April 2026  19:29:53 +0000 (0:00:00.043)       0:01:22.225 *********
2026-04-21 19:29:53.776138 | mon1 | skipping: [osd1]
2026-04-21 19:29:53.776221 | mon1 |
2026-04-21 19:29:53.776232 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-21 19:29:53.776329 | mon1 | Tuesday 21 April 2026  19:29:53 +0000 (0:00:00.037)       0:01:22.262 *********
2026-04-21 19:29:53.982394 | mon1 | ok: [osd1]
2026-04-21 19:29:53.982466 | mon1 |
2026-04-21 19:29:53.982533 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-21 19:29:53.982659 | mon1 | Tuesday 21 April 2026  19:29:53 +0000 (0:00:00.206)       0:01:22.468 *********
2026-04-21 19:29:55.190758 | mon1 | ok: [osd1]
2026-04-21 19:29:55.190806 | mon1 |
2026-04-21 19:29:55.190815 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-21 19:29:55.190822 | mon1 | Tuesday 21 April 2026  19:29:55 +0000 (0:00:01.207)       0:01:23.676 *********
2026-04-21 19:29:55.266309 | mon1 | ok: [osd1] => {
2026-04-21 19:29:55.266381 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-04-21 19:29:55.266397 | mon1 | }
2026-04-21 19:29:55.266410 | mon1 |
2026-04-21 19:29:55.266431 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-21 19:29:55.266589 | mon1 | Tuesday 21 April 2026  19:29:55 +0000 (0:00:00.075)       0:01:23.752 *********
2026-04-21 19:29:55.620575 | mon1 | ok: [osd1]
2026-04-21 19:29:55.620653 | mon1 |
2026-04-21 19:29:55.620711 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-21 19:29:55.620816 | mon1 | Tuesday 21 April 2026  19:29:55 +0000 (0:00:00.354)       0:01:24.106 *********
2026-04-21 19:29:57.588244 | mon1 | ok: [osd1]
2026-04-21 19:29:57.588318 | mon1 |
2026-04-21 19:29:57.588508 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-21 19:29:57.588554 | mon1 | Tuesday 21 April 2026  19:29:57 +0000 (0:00:01.967)       0:01:26.074 *********
2026-04-21 19:29:57.616742 | mon1 | skipping: [osd1]
2026-04-21 19:29:57.616800 | mon1 |
2026-04-21 19:29:57.616886 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-21 19:29:57.616996 | mon1 | Tuesday 21 April 2026  19:29:57 +0000 (0:00:00.028)       0:01:26.103 *********
2026-04-21 19:29:57.644535 | mon1 | skipping: [osd1]
2026-04-21 19:29:57.644941 | mon1 |
2026-04-21 19:29:57.644986 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-21 19:29:57.644994 | mon1 | Tuesday 21 April 2026  19:29:57 +0000 (0:00:00.027)       0:01:26.130 *********
2026-04-21 19:29:57.673277 | mon1 | skipping: [osd1]
2026-04-21 19:29:57.673426 | mon1 |
2026-04-21 19:29:57.673821 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-21 19:29:57.673864 | mon1 | Tuesday 21 April 2026  19:29:57 +0000 (0:00:00.028)       0:01:26.159 *********
2026-04-21 19:29:58.826465 | mon1 | ok: [osd1]
2026-04-21 19:29:58.827156 | mon1 |
2026-04-21 19:29:58.827218 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-21 19:29:58.827230 | mon1 | Tuesday 21 April 2026  19:29:58 +0000 (0:00:01.152)       0:01:27.312 *********
2026-04-21 19:29:59.246233 | mon1 | ok: [osd1]
2026-04-21 19:29:59.246305 | mon1 |
2026-04-21 19:29:59.246508 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-21 19:29:59.246554 | mon1 | Tuesday 21 April 2026  19:29:59 +0000 (0:00:00.420)       0:01:27.732 *********
2026-04-21 19:30:00.130306 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'})
2026-04-21 19:30:00.130419 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-21 19:30:00.130433 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-21 19:30:00.130443 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-21 19:30:00.130460 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-21 19:30:00.130475 | mon1 |
2026-04-21 19:30:00.130487 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-21 19:30:00.130605 | mon1 | Tuesday 21 April 2026  19:30:00 +0000 (0:00:00.883)       0:01:28.615 *********
2026-04-21 19:30:00.616569 | mon1 | ok: [osd1]
2026-04-21 19:30:00.616619 | mon1 |
2026-04-21 19:30:00.616716 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-21 19:30:00.617111 | mon1 | Tuesday 21 April 2026  19:30:00 +0000 (0:00:00.481)       0:01:29.097 *********
2026-04-21 19:30:00.617150 | mon1 |
2026-04-21 19:30:00.617155 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-21 19:30:00.617160 | mon1 | Tuesday 21 April 2026  19:30:00 +0000 (0:00:00.005)       0:01:29.102 *********
2026-04-21 19:30:00.948187 | mon1 | ok: [osd1]
2026-04-21 19:30:00.948261 | mon1 |
2026-04-21 19:30:00.948275 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-21 19:30:00.948404 | mon1 | Tuesday 21 April 2026  19:30:00 +0000 (0:00:00.331)       0:01:29.434 *********
2026-04-21 19:30:01.146753 | mon1 | ok: [osd1]
2026-04-21 19:30:01.146827 | mon1 |
2026-04-21 19:30:01.147139 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-21 19:30:01.147190 | mon1 | Tuesday 21 April 2026  19:30:01 +0000 (0:00:00.198)       0:01:29.632 *********
2026-04-21 19:30:01.214547 | mon1 | ok: [osd1] => {
2026-04-21 19:30:01.214615 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-04-21 19:30:01.215151 | mon1 | }
2026-04-21 19:30:01.215182 | mon1 |
2026-04-21 19:30:01.215189 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-21 19:30:01.215196 | mon1 | Tuesday 21 April 2026  19:30:01 +0000 (0:00:00.067)       0:01:29.700 *********
2026-04-21 19:30:01.561625 | mon1 | ok: [osd1]
2026-04-21 19:30:01.561721 | mon1 |
2026-04-21 19:30:01.561804 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-21 19:30:01.561952 | mon1 | Tuesday 21 April 2026  19:30:01 +0000 (0:00:00.346)       0:01:30.047 *********
2026-04-21 19:30:04.603291 | mon1 | ok: [osd1]
2026-04-21 19:30:04.603362 | mon1 |
2026-04-21 19:30:04.603705 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-04-21 19:30:04.603758 | mon1 | Tuesday 21 April 2026  19:30:04 +0000 (0:00:03.041)       0:01:33.089 *********
2026-04-21 19:30:05.740757 | mon1 | ok: [osd1]
2026-04-21 19:30:05.740844 | mon1 |
2026-04-21 19:30:05.741105 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-04-21 19:30:05.741157 | mon1 | Tuesday 21 April 2026  19:30:05 +0000 (0:00:01.137)       0:01:34.226 *********
2026-04-21 19:30:05.929686 | mon1 | ok: [osd1]
2026-04-21 19:30:05.929758 | mon1 |
2026-04-21 19:30:05.930044 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-04-21 19:30:05.930084 | mon1 | Tuesday 21 April 2026  19:30:05 +0000 (0:00:00.189)       0:01:34.415 *********
2026-04-21 19:30:06.336991 | mon1 | ok: [osd1]
2026-04-21 19:30:06.337110 | mon1 |
2026-04-21 19:30:06.337200 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-04-21 19:30:06.337336 | mon1 | Tuesday 21 April 2026  19:30:06 +0000 (0:00:00.406)       0:01:34.822 *********
2026-04-21 19:30:06.903554 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'})
2026-04-21 19:30:06.903728 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-04-21 19:30:06.903943 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-04-21 19:30:06.904127 | mon1 |
2026-04-21 19:30:06.904340 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-04-21 19:30:06.904544 | mon1 | Tuesday 21 April 2026  19:30:06 +0000 (0:00:00.566)       0:01:35.389 *********
2026-04-21 19:30:07.324178 | mon1 | ok: [osd1]
2026-04-21 19:30:07.324366 | mon1 |
2026-04-21 19:30:07.324619 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-04-21 19:30:07.324851 | mon1 | Tuesday 21 April 2026  19:30:07 +0000 (0:00:00.420)       0:01:35.810 *********
2026-04-21 19:30:07.769778 | mon1 | ok: [osd1]
2026-04-21 19:30:07.769872 | mon1 |
2026-04-21 19:30:07.770010 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-04-21 19:30:07.770147 | mon1 | Tuesday 21 April 2026  19:30:07 +0000 (0:00:00.439)       0:01:36.249 *********
2026-04-21 19:30:07.770290 | mon1 |
2026-04-21 19:30:07.770422 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-04-21 19:30:07.770551 | mon1 | Tuesday 21 April 2026  19:30:07 +0000 (0:00:00.006)       0:01:36.256 *********
2026-04-21 19:30:08.129363 | mon1 | ok: [osd1]
2026-04-21 19:30:08.129429 | mon1 |
2026-04-21 19:30:08.129441 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-04-21 19:30:08.129451 | mon1 | Tuesday 21 April 2026  19:30:08 +0000 (0:00:00.358)       0:01:36.614 *********
2026-04-21 19:30:08.174986 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-04-21 19:30:08.175057 | mon1 |
2026-04-21 19:30:08.175286 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-04-21 19:30:08.175336 | mon1 | Tuesday 21 April 2026  19:30:08 +0000 (0:00:00.046)       0:01:36.661 *********
2026-04-21 19:30:09.306295 | mon1 | ok: [osd1]
2026-04-21 19:30:09.306371 | mon1 |
2026-04-21 19:30:09.306585 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-04-21 19:30:09.306633 | mon1 | Tuesday 21 April 2026  19:30:09 +0000 (0:00:01.131)       0:01:37.792 *********
2026-04-21 19:30:09.955175 | mon1 | ok: [osd1] => (item=chronyd)
2026-04-21 19:30:09.955247 | mon1 | ok: [osd1] => (item=sshd)
2026-04-21 19:30:09.955305 | mon1 |
2026-04-21 19:30:09.955520 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-04-21 19:30:09.955566 | mon1 | Tuesday 21 April 2026  19:30:09 +0000 (0:00:00.648)       0:01:38.441 *********
2026-04-21 19:30:10.250880 | mon1 | ok: [osd1]
2026-04-21 19:30:10.250944 | mon1 |
2026-04-21 19:30:10.251035 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-04-21 19:30:10.251163 | mon1 | Tuesday 21 April 2026  19:30:10 +0000 (0:00:00.294)       0:01:38.735 *********
2026-04-21 19:30:10.444769 | mon1 | ok: [osd1]
2026-04-21 19:30:10.444806 | mon1 |
2026-04-21 19:30:10.444811 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-04-21 19:30:10.444816 | mon1 | Tuesday 21 April 2026  19:30:10 +0000 (0:00:00.195)       0:01:38.930 *********
2026-04-21 19:30:10.672678 | mon1 | ok: [osd1]
2026-04-21 19:30:10.672729 | mon1 |
2026-04-21 19:30:10.672737 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-04-21 19:30:10.672743 | mon1 | Tuesday 21 April 2026  19:30:10 +0000 (0:00:00.227)       0:01:39.158 *********
2026-04-21 19:30:10.865335 | mon1 | ok: [osd1]
2026-04-21 19:30:10.865380 | mon1 |
2026-04-21 19:30:10.865389 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-04-21 19:30:10.865394 | mon1 | Tuesday 21 April 2026  19:30:10 +0000 (0:00:00.192)       0:01:39.351 *********
2026-04-21 19:30:11.075102 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-04-21 19:30:11.075203 | mon1 |
2026-04-21 19:30:11.075506 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-04-21 19:30:11.075554 | mon1 | Tuesday 21 April 2026  19:30:11 +0000 (0:00:00.209)       0:01:39.561 *********
2026-04-21 19:30:11.117064 | mon1 | ok: [osd1]
2026-04-21 19:30:11.117139 | mon1 |
2026-04-21 19:30:11.117442 | mon1 | TASK [Install Ceph host] *******************************************************
2026-04-21 19:30:11.117470 | mon1 | Tuesday 21 April 2026  19:30:11 +0000 (0:00:00.041)       0:01:39.603 *********
2026-04-21 19:30:11.172818 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-04-21 19:30:11.172888 | mon1 |
2026-04-21 19:30:11.173122 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-21 19:30:11.173169 | mon1 | Tuesday 21 April 2026  19:30:11 +0000 (0:00:00.055)       0:01:39.659 *********
2026-04-21 19:30:17.103410 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-04-21 19:30:17.103490 | mon1 |
2026-04-21 19:30:17.103580 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-21 19:30:17.103716 | mon1 | Tuesday 21 April 2026  19:30:17 +0000 (0:00:05.930)       0:01:45.589 *********
2026-04-21 19:30:17.146135 | mon1 | ok: [osd1] => (item=osd1)
2026-04-21 19:30:17.146406 | mon1 |
2026-04-21 19:30:17.146471 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-21 19:30:17.146639 | mon1 | Tuesday 21 April 2026  19:30:17 +0000 (0:00:00.042)       0:01:45.632 *********
2026-04-21 19:30:17.387004 | mon1 | ok: [osd1]
2026-04-21 19:30:17.387071 | mon1 |
2026-04-21 19:30:17.387156 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-21 19:30:17.387281 | mon1 | Tuesday 21 April 2026  19:30:17 +0000 (0:00:00.241)       0:01:45.873 *********
2026-04-21 19:30:23.733210 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-04-21 19:30:23.733272 | mon1 |
2026-04-21 19:30:23.733365 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-04-21 19:30:23.733470 | mon1 | Tuesday 21 April 2026  19:30:23 +0000 (0:00:06.346)       0:01:52.219 *********
2026-04-21 19:30:29.086423 | mon1 | ok: [osd1]
2026-04-21 19:30:29.086488 | mon1 |
2026-04-21 19:30:29.086748 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-04-21 19:30:29.086798 | mon1 | Tuesday 21 April 2026  19:30:29 +0000 (0:00:05.352)       0:01:57.572 *********
2026-04-21 19:30:51.098376 | mon1 | ok: [osd1]
2026-04-21 19:30:51.098465 | mon1 |
2026-04-21 19:30:51.098765 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-04-21 19:30:51.098835 | mon1 | Tuesday 21 April 2026  19:30:51 +0000 (0:00:22.011)       0:02:19.583 *********
2026-04-21 19:30:51.167271 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data)
2026-04-21 19:30:51.167335 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data)
2026-04-21 19:30:51.167838 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data)
2026-04-21 19:30:51.167920 | mon1 | skipping: [osd1]
2026-04-21 19:30:51.167926 | mon1 |
2026-04-21 19:30:51.167930 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-04-21 19:30:51.167935 | mon1 | Tuesday 21 April 2026  19:30:51 +0000 (0:00:00.069)       0:02:19.653 *********
2026-04-21 19:30:57.157322 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-04-21 19:30:57.157393 | mon1 |
2026-04-21 19:30:57.157478 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-04-21 19:30:57.157608 | mon1 | Tuesday 21 April 2026  19:30:57 +0000 (0:00:05.990)       0:02:25.643 *********
2026-04-21 19:31:03.082761 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-04-21 19:31:03.082852 | mon1 |
2026-04-21 19:31:03.082915 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-04-21 19:31:03.083023 | mon1 | Tuesday 21 April 2026  19:31:03 +0000 (0:00:05.925)       0:02:31.569 *********
2026-04-21 19:31:03.139142 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-04-21 19:31:03.139223 | mon1 |
2026-04-21 19:31:03.139447 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-04-21 19:31:03.139491 | mon1 | Tuesday 21 April 2026  19:31:03 +0000 (0:00:00.056)       0:02:31.625 *********
2026-04-21 19:31:03.180990 | mon1 | ok: [osd1]
2026-04-21 19:31:03.181116 | mon1 |
2026-04-21 19:31:03.181402 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-04-21 19:31:03.181425 | mon1 | Tuesday 21 April 2026  19:31:03 +0000 (0:00:00.041)       0:02:31.667 *********
2026-04-21 19:31:09.075874 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-04-21 19:31:09.075980 | mon1 |
2026-04-21 19:31:09.076260 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-04-21 19:31:09.076281 | mon1 | Tuesday 21 April 2026  19:31:09 +0000 (0:00:05.894)       0:02:37.562 *********
2026-04-21 19:31:09.113028 | mon1 | ok: [osd1]
2026-04-21 19:31:09.113096 | mon1 |
2026-04-21 19:31:09.113172 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-04-21 19:31:09.113297 | mon1 | Tuesday 21 April 2026  19:31:09 +0000 (0:00:00.037)       0:02:37.599 *********
2026-04-21 19:31:09.160487 | mon1 | skipping: [osd1] => (item=1)
2026-04-21 19:31:09.161260 | mon1 | skipping: [osd1] => (item=1)
2026-04-21 19:31:09.161307 | mon1 | skipping: [osd1] => (item=1)
2026-04-21 19:31:09.161314 | mon1 | skipping: [osd1]
2026-04-21 19:31:09.161321 | mon1 |
2026-04-21 19:31:09.161327 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-04-21 19:31:09.161334 | mon1 | Tuesday 21 April 2026  19:31:09 +0000 (0:00:00.047)       0:02:37.646 *********
2026-04-21 19:31:09.191460 | mon1 | skipping: [osd1]
2026-04-21 19:31:09.191564 | mon1 |
2026-04-21 19:31:09.191700 | mon1 | PLAY RECAP *********************************************************************
2026-04-21 19:31:09.192190 | mon1 | mon1                       : ok=49   changed=0    unreachable=0    failed=0    skipped=9    rescued=0    ignored=0
2026-04-21 19:31:09.192252 | mon1 | osd1                       : ok=48   changed=0    unreachable=0    failed=0    skipped=9    rescued=0    ignored=0
2026-04-21 19:31:09.192263 | mon1 |
2026-04-21 19:31:09.192279 | mon1 |
2026-04-21 19:31:09.192379 | mon1 | TASKS RECAP ********************************************************************
2026-04-21 19:31:09.194216 | mon1 | Tuesday 21 April 2026  19:31:09 +0000 (0:00:00.031)       0:02:37.678 *********
2026-04-21 19:31:09.194247 | mon1 | ===============================================================================
2026-04-21 19:31:09.194257 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.01s
2026-04-21 19:31:09.194267 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.07s
2026-04-21 19:31:09.194275 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.56s
2026-04-21 19:31:09.194284 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.39s
2026-04-21 19:31:09.194292 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.35s
2026-04-21 19:31:09.194301 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.29s
2026-04-21 19:31:09.194310 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.27s
2026-04-21 19:31:09.194318 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.21s
2026-04-21 19:31:09.194327 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.08s
2026-04-21 19:31:09.194335 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 5.99s
2026-04-21 19:31:09.194344 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 5.98s
2026-04-21 19:31:09.194356 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.93s
2026-04-21 19:31:09.194439 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 5.93s
2026-04-21 19:31:09.194569 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 5.89s
2026-04-21 19:31:09.194691 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.35s
2026-04-21 19:31:09.194807 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.08s
2026-04-21 19:31:09.194922 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.04s
2026-04-21 19:31:09.195037 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.22s
2026-04-21 19:31:09.195152 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.97s
2026-04-21 19:31:09.195272 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 1.21s
2026-04-21 19:31:09.290401 | mon1 | INFO     [default > idempotence] Executed: Successful
2026-04-21 19:31:09.300998 | mon1 | INFO     [default > side_effect] Executing
2026-04-21 19:31:09.301470 | mon1 | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-21 19:31:09.308832 | mon1 | INFO     [default > verify] Executing
2026-04-21 19:31:09.894202 | mon1 |
2026-04-21 19:31:09.894558 | mon1 | PLAY [Verify] ******************************************************************
2026-04-21 19:31:09.894808 | mon1 |
2026-04-21 19:31:09.895113 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-21 19:31:09.895390 | mon1 | Tuesday 21 April 2026  19:31:09 +0000 (0:00:00.007)       0:00:00.007 *********
2026-04-21 19:31:11.034024 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-04-21 19:31:11.034129 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-21 19:31:11.034142 | mon1 | interpreter could change the meaning of that path. See
2026-04-21 19:31:11.034153 | mon1 | https://docs.ansible.com/ansible-
2026-04-21 19:31:11.034206 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-21 19:31:11.045313 | mon1 | ok: [mon1]
2026-04-21 19:31:11.045344 | mon1 |
2026-04-21 19:31:11.045354 | mon1 | TASK [Get cluster health status] ***********************************************
2026-04-21 19:31:11.045364 | mon1 | Tuesday 21 April 2026  19:31:11 +0000 (0:00:01.150)       0:00:01.158 *********
2026-04-21 19:31:21.327101 | mon1 | ok: [mon1]
2026-04-21 19:31:21.327213 | mon1 |
2026-04-21 19:31:21.327226 | mon1 | TASK [Print cluster health status] *********************************************
2026-04-21 19:31:21.327238 | mon1 | Tuesday 21 April 2026  19:31:21 +0000 (0:00:10.280)       0:00:11.439 *********
2026-04-21 19:31:21.354289 | mon1 | ok: [mon1] => {
2026-04-21 19:31:21.354360 | mon1 |     "_ceph_health": {
2026-04-21 19:31:21.354381 | mon1 |         "changed": false,
2026-04-21 19:31:21.354586 | mon1 |         "cmd": [
2026-04-21 19:31:21.354775 | mon1 |             "cephadm",
2026-04-21 19:31:21.354984 | mon1 |             "shell",
2026-04-21 19:31:21.355185 | mon1 |             "--",
2026-04-21 19:31:21.355371 | mon1 |             "ceph",
2026-04-21 19:31:21.355550 | mon1 |             "health"
2026-04-21 19:31:21.355786 | mon1 |         ],
2026-04-21 19:31:21.355980 | mon1 |         "delta": "0:00:10.012986",
2026-04-21 19:31:21.356172 | mon1 |         "end": "2026-04-21 19:31:21.290525",
2026-04-21 19:31:21.356359 | mon1 |         "failed": false,
2026-04-21 19:31:21.356590 | mon1 |         "msg": "",
2026-04-21 19:31:21.356843 | mon1 |         "rc": 0,
2026-04-21 19:31:21.357059 | mon1 |         "start": "2026-04-21 19:31:11.277539",
2026-04-21 19:31:21.357279 | mon1 |         "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config",
2026-04-21 19:31:21.357477 | mon1 |         "stderr_lines": [
2026-04-21 19:31:21.357672 | mon1 |             "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2",
2026-04-21 19:31:21.357881 | mon1 |             "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config"
2026-04-21 19:31:21.358059 | mon1 |         ],
2026-04-21 19:31:21.358304 | mon1 |         "stdout": "HEALTH_OK",
2026-04-21 19:31:21.358483 | mon1 |         "stdout_lines": [
2026-04-21 19:31:21.358670 | mon1 |             "HEALTH_OK"
2026-04-21 19:31:21.358852 | mon1 |         ]
2026-04-21 19:31:21.359039 | mon1 |     }
2026-04-21 19:31:21.359221 | mon1 | }
2026-04-21 19:31:21.359387 | mon1 |
2026-04-21 19:31:21.359621 | mon1 | TASK [Assert that the cluster status is healthy] *******************************
2026-04-21 19:31:21.359821 | mon1 | Tuesday 21 April 2026  19:31:21 +0000 (0:00:00.028)       0:00:11.467 *********
2026-04-21 19:31:21.379857 | mon1 | ok: [mon1] => {
2026-04-21 19:31:21.380050 | mon1 |     "changed": false,
2026-04-21 19:31:21.380246 | mon1 |     "msg": "All assertions passed"
2026-04-21 19:31:21.380428 | mon1 | }
2026-04-21 19:31:21.380632 | mon1 |
2026-04-21 19:31:21.380830 | mon1 | TASK [Create a test Ceph pool] *************************************************
2026-04-21 19:31:21.381030 | mon1 | Tuesday 21 April 2026  19:31:21 +0000 (0:00:00.025)       0:00:11.493 *********
2026-04-21 19:31:27.822929 | mon1 | changed: [mon1]
2026-04-21 19:31:27.823110 | mon1 |
2026-04-21 19:31:27.823462 | mon1 | TASK [Create a test Ceph key] **************************************************
2026-04-21 19:31:27.823566 | mon1 | Tuesday 21 April 2026  19:31:27 +0000 (0:00:06.442)       0:00:17.935 *********
2026-04-21 19:31:30.187117 | mon1 | changed: [mon1]
2026-04-21 19:31:30.187640 | mon1 |
2026-04-21 19:31:30.187688 | mon1 | TASK [Retrieve info for the test Ceph key] *************************************
2026-04-21 19:31:30.187695 | mon1 | Tuesday 21 April 2026  19:31:30 +0000 (0:00:02.364)       0:00:20.300 *********
2026-04-21 19:31:31.354799 | mon1 | ok: [mon1]
2026-04-21 19:31:31.354905 | mon1 |
2026-04-21 19:31:31.354915 | mon1 | TASK [Assert that key_info returns the correct key] ****************************
2026-04-21 19:31:31.354922 | mon1 | Tuesday 21 April 2026  19:31:31 +0000 (0:00:01.166)       0:00:21.467 *********
2026-04-21 19:31:31.389268 | mon1 | ok: [mon1] => {
2026-04-21 19:31:31.390268 | mon1 |     "changed": false,
2026-04-21 19:31:31.390327 | mon1 |     "msg": "All assertions passed"
2026-04-21 19:31:31.390334 | mon1 | }
2026-04-21 19:31:31.390345 | mon1 |
2026-04-21 19:31:31.394051 | mon1 | PLAY RECAP *********************************************************************
2026-04-21 19:31:31.394110 | mon1 | mon1                       : ok=8    changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-04-21 19:31:31.394122 | mon1 |
2026-04-21 19:31:31.394132 | mon1 |
2026-04-21 19:31:31.394141 | mon1 | TASKS RECAP ********************************************************************
2026-04-21 19:31:31.394150 | mon1 | Tuesday 21 April 2026  19:31:31 +0000 (0:00:00.035)       0:00:21.502 *********
2026-04-21 19:31:31.394199 | mon1 | ===============================================================================
2026-04-21 19:31:31.394211 | mon1 | Get cluster health status ---------------------------------------------- 10.28s
2026-04-21 19:31:31.394219 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.44s
2026-04-21 19:31:31.394228 | mon1 | Create a test Ceph key -------------------------------------------------- 2.36s
2026-04-21 19:31:31.394236 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.17s
2026-04-21 19:31:31.394245 | mon1 | Gathering Facts --------------------------------------------------------- 1.15s
2026-04-21 19:31:31.394254 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s
2026-04-21 19:31:31.394262 | mon1 | Print cluster health status --------------------------------------------- 0.03s
2026-04-21 19:31:31.394271 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s
2026-04-21 19:31:31.475914 | mon1 | INFO     [default > verify] Executed: Successful
2026-04-21 19:31:31.486389 | mon1 | INFO     [default > cleanup] Executing
2026-04-21 19:31:31.486828 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-21 19:31:31.493726 | mon1 | INFO     [default > destroy] Executing
2026-04-21 19:31:31.493874 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-04-21 19:31:31.493990 | mon1 | INFO     [default > destroy] Executed: Successful
2026-04-21 19:31:31.494367 | mon1 | WARNING  Molecule executed 1 scenario (1 missing files)
2026-04-21 19:31:41.943781 | mon1 | ok: Runtime: 0:11:45.789704
2026-04-21 19:31:41.957108 | 
2026-04-21 19:31:41.957206 | PLAY RECAP
2026-04-21 19:31:41.957258 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-21 19:31:41.957279 | 
2026-04-21 19:31:42.076164 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-21 19:31:42.081800 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-21 19:31:42.664148 | 
2026-04-21 19:31:42.664294 | PLAY [all]
2026-04-21 19:31:42.676599 | 
2026-04-21 19:31:42.676687 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-21 19:31:42.730311 | mon1 | ok
2026-04-21 19:31:42.736353 | osd1 | ok
2026-04-21 19:31:42.740639 | 
2026-04-21 19:31:42.740717 | TASK [fetch-output : Set log path for single node]
2026-04-21 19:31:42.775590 | mon1 | skipping: Conditional result was False
2026-04-21 19:31:42.776500 | osd1 | skipping: Conditional result was False
2026-04-21 19:31:42.785634 | 
2026-04-21 19:31:42.785707 | LOOP [fetch-output : Ensure local output dirs]
2026-04-21 19:31:43.156543 | mon1 -> localhost | changed: "/var/lib/zuul/builds/9ea98a9c616644af946885f0bd1aa940/work/logs/mon1"
2026-04-21 19:31:43.162168 | osd1 -> localhost | changed: "/var/lib/zuul/builds/9ea98a9c616644af946885f0bd1aa940/work/logs/osd1"
2026-04-21 19:31:43.355220 | mon1 -> localhost | changed: "/var/lib/zuul/builds/9ea98a9c616644af946885f0bd1aa940/work/artifacts"
2026-04-21 19:31:43.368455 | osd1 -> localhost | ok: "/var/lib/zuul/builds/9ea98a9c616644af946885f0bd1aa940/work/artifacts"
2026-04-21 19:31:43.558796 | mon1 -> localhost | changed: "/var/lib/zuul/builds/9ea98a9c616644af946885f0bd1aa940/work/docs"
2026-04-21 19:31:43.578802 | osd1 -> localhost | ok: "/var/lib/zuul/builds/9ea98a9c616644af946885f0bd1aa940/work/docs"
2026-04-21 19:31:43.578921 | osd1 -> localhost | changed: All items complete
2026-04-21 19:31:43.578982 | 
2026-04-21 19:31:43.594086 | 
2026-04-21 19:31:43.594659 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-21 19:31:44.216377 | mon1 | changed: .d..t...... ./
2026-04-21 19:31:44.228710 | osd1 | changed: .d..t...... ./
2026-04-21 19:31:44.671945 | mon1 | changed: .d..t...... ./
2026-04-21 19:31:44.677876 | osd1 | changed: .d..t...... ./
2026-04-21 19:31:45.108026 | osd1 | changed: .d..t...... ./
2026-04-21 19:31:45.125290 | mon1 | changed: .d..t...... ./
2026-04-21 19:31:45.125385 | mon1 | changed: All items complete
2026-04-21 19:31:45.125427 | 
2026-04-21 19:31:45.155993 | 
2026-04-21 19:31:45.156148 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-21 19:31:45.557394 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008032
2026-04-21 19:31:45.797583 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.008016
2026-04-21 19:31:45.821407 | 
2026-04-21 19:31:45.821481 | PLAY [all]
2026-04-21 19:31:45.827855 | 
2026-04-21 19:31:45.827926 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-21 19:31:46.241129 | mon1 | changed
2026-04-21 19:31:46.430704 | osd1 | changed
2026-04-21 19:31:46.445312 | 
2026-04-21 19:31:46.445416 | PLAY RECAP
2026-04-21 19:31:46.445509 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-21 19:31:46.445556 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-21 19:31:46.445585 | 
2026-04-21 19:31:46.568759 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-21 19:31:46.574118 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-21 19:31:47.114951 | 
2026-04-21 19:31:47.115076 | PLAY [localhost]
2026-04-21 19:31:47.124666 | 
2026-04-21 19:31:47.124737 | TASK [Generate Zuul manifest]
2026-04-21 19:31:47.149874 | localhost | ok
2026-04-21 19:31:47.164570 | 
2026-04-21 19:31:47.164684 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-21 19:31:47.479688 | localhost | changed
2026-04-21 19:31:47.493545 | 
2026-04-21 19:31:47.493642 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-21 19:31:47.525733 | localhost | ok
2026-04-21 19:31:47.534680 | 
2026-04-21 19:31:47.534755 | TASK [Upload logs]
2026-04-21 19:31:47.558405 | localhost | ok
2026-04-21 19:31:47.618123 | 
2026-04-21 19:31:47.618284 | TASK [Set zuul-log-path fact]
2026-04-21 19:31:47.639760 | localhost | ok
2026-04-21 19:31:47.654830 | 
2026-04-21 19:31:47.654902 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-21 19:31:47.686733 | localhost | ok
2026-04-21 19:31:47.697140 | 
2026-04-21 19:31:47.697239 | TASK [upload-logs : Create log directories]
2026-04-21 19:31:48.124342 | localhost | changed
2026-04-21 19:31:48.132580 | 
2026-04-21 19:31:48.132652 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-21 19:31:48.529550 | localhost -> localhost | ok: Runtime: 0:00:00.006279
2026-04-21 19:31:48.538926 | 
2026-04-21 19:31:48.539006 | TASK [upload-logs : Upload logs to log server]
2026-04-21 19:31:49.028720 | localhost | Output suppressed because no_log was given
2026-04-21 19:31:49.033655 | 
2026-04-21 19:31:49.033747 | LOOP [upload-logs : Compress console log and json output]
2026-04-21 19:31:49.079130 | localhost | skipping: Conditional result was False
2026-04-21 19:31:49.086395 | localhost | skipping: Conditional result was False
2026-04-21 19:31:49.099411 | 
2026-04-21 19:31:49.099571 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-21 19:31:49.144509 | localhost | skipping: Conditional result was False
2026-04-21 19:31:49.145000 | 
2026-04-21 19:31:49.149701 | localhost | skipping: Conditional result was False
2026-04-21 19:31:49.161900 | 
2026-04-21 19:31:49.161993 | LOOP [upload-logs : Upload console log and json output]