2026-02-11 00:45:03.650547 | Job console starting 2026-02-11 00:45:03.666377 | Updating git repos 2026-02-11 00:45:03.697247 | Cloning repos into workspace 2026-02-11 00:45:03.802747 | Restoring repo states 2026-02-11 00:45:03.817693 | Merging changes 2026-02-11 00:45:04.241966 | Checking out repos 2026-02-11 00:45:04.305656 | Preparing playbooks 2026-02-11 00:45:05.317180 | Running Ansible setup 2026-02-11 00:45:11.687293 | PRE-RUN START: [trusted : vexxhost.dev/zuul-config/playbooks/base/pre.yaml@main] 2026-02-11 00:45:12.266546 | 2026-02-11 00:45:12.266677 | PLAY [localhost] 2026-02-11 00:45:12.275161 | 2026-02-11 00:45:12.275232 | TASK [Gathering Facts] 2026-02-11 00:45:13.158931 | localhost | ok 2026-02-11 00:45:13.167666 | 2026-02-11 00:45:13.167751 | TASK [Setup log path fact] 2026-02-11 00:45:13.189338 | localhost | ok 2026-02-11 00:45:13.200244 | 2026-02-11 00:45:13.200322 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-11 00:45:13.230674 | localhost | ok 2026-02-11 00:45:13.238492 | 2026-02-11 00:45:13.238562 | TASK [emit-job-header : Print job information] 2026-02-11 00:45:13.279801 | # Job Information 2026-02-11 00:45:13.279956 | Ansible Version: 2.16.15 2026-02-11 00:45:13.280000 | Job: ansible-collection-kubernetes-molecule-cluster-upgrade 2026-02-11 00:45:13.280032 | Pipeline: check 2026-02-11 00:45:13.280059 | Executor: 3a2793d2bd32 2026-02-11 00:45:13.280084 | Triggered by: https://github.com/vexxhost/ansible-collection-kubernetes/pull/230 2026-02-11 00:45:13.280116 | Event ID: c1003d70-06e2-11f1-9860-b25bf9d18ce0 2026-02-11 00:45:13.284167 | 2026-02-11 00:45:13.284284 | LOOP [emit-job-header : Print node information] 2026-02-11 00:45:13.379047 | localhost | ok: 2026-02-11 00:45:13.379318 | localhost | # Node Information 2026-02-11 00:45:13.379348 | localhost | Inventory Hostname: controller-1 2026-02-11 00:45:13.379370 | localhost | Hostname: np0000155227 2026-02-11 00:45:13.379390 | localhost | Username: zuul 2026-02-11 00:45:13.379412 | localhost | Distro: Debian 13.3 2026-02-11 00:45:13.379433 | localhost | Provider: yul1 2026-02-11 00:45:13.379451 | localhost | Region: ca-ymq-1 2026-02-11 00:45:13.379471 | localhost | Label: debian-trixie 2026-02-11 00:45:13.379489 | localhost | Product Name: OpenStack Nova 2026-02-11 00:45:13.379507 | localhost | Interface IP: 199.204.45.210 2026-02-11 00:45:13.413952 | localhost | ok: 2026-02-11 00:45:13.414142 | localhost | # Node Information 2026-02-11 00:45:13.414176 | localhost | Inventory Hostname: controller-2 2026-02-11 00:45:13.414198 | localhost | Hostname: np0000155228 2026-02-11 00:45:13.414217 | localhost | Username: zuul 2026-02-11 00:45:13.414236 | localhost | Distro: Debian 13.3 2026-02-11 00:45:13.414254 | localhost | Provider: yul1 2026-02-11 00:45:13.414286 | localhost | Region: ca-ymq-1 2026-02-11 00:45:13.414318 | localhost | Label: debian-trixie 2026-02-11 00:45:13.414338 | localhost | Product Name: OpenStack Nova 2026-02-11 00:45:13.414358 | localhost | Interface IP: 199.204.45.129 2026-02-11 00:45:13.448918 | localhost | ok: 2026-02-11 00:45:13.449103 | localhost | # Node Information 2026-02-11 00:45:13.449146 | localhost | Inventory Hostname: controller-3 2026-02-11 00:45:13.449175 | localhost | Hostname: np0000155229 2026-02-11 00:45:13.449201 | localhost | Username: zuul 2026-02-11 00:45:13.449227 | localhost | Distro: Debian 13.3 2026-02-11 00:45:13.449252 | localhost | Provider: yul1 2026-02-11 00:45:13.449276 | localhost | Region: ca-ymq-1 2026-02-11 00:45:13.449301 | localhost | Label: debian-trixie 2026-02-11 00:45:13.449326 | localhost | Product Name: OpenStack Nova 2026-02-11 00:45:13.449350 | localhost | Interface IP: 199.204.45.49 2026-02-11 00:45:13.460162 | 2026-02-11 00:45:13.460334 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-02-11 00:45:13.852188 | localhost -> localhost | changed 2026-02-11 00:45:13.861426 | 2026-02-11 00:45:13.861513 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-02-11 00:45:14.668910 | localhost -> localhost | changed 2026-02-11 00:45:14.678307 | 2026-02-11 00:45:14.678398 | PLAY [all] 2026-02-11 00:45:14.686894 | 2026-02-11 00:45:14.686958 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-02-11 00:45:14.925340 | controller-1 -> localhost | ok 2026-02-11 00:45:14.934472 | 2026-02-11 00:45:14.934609 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-02-11 00:45:14.969635 | controller-1 | ok 2026-02-11 00:45:14.978052 | controller-2 | ok 2026-02-11 00:45:14.982764 | controller-3 | ok 2026-02-11 00:45:15.003525 | controller-1 | included: /var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-11 00:45:15.003577 | controller-2 | included: /var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-11 00:45:15.003602 | controller-3 | included: /var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-11 00:45:15.008785 | 2026-02-11 00:45:15.008848 | TASK [add-build-sshkey : Create Temp SSH key] 2026-02-11 00:45:16.883042 | controller-1 -> localhost | Generating public/private rsa key pair. 2026-02-11 00:45:16.883419 | controller-1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/work/332cca61e1294ba5b724dfcb0ac6aa76_id_rsa 2026-02-11 00:45:16.883544 | controller-1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/work/332cca61e1294ba5b724dfcb0ac6aa76_id_rsa.pub 2026-02-11 00:45:16.883598 | controller-1 -> localhost | The key fingerprint is: 2026-02-11 00:45:16.883645 | controller-1 -> localhost | SHA256:AF3XPC9Dydy7LbiAqnThDh4AUE5zl25EgJRK8COmZCU zuul-build-sshkey 2026-02-11 00:45:16.883691 | controller-1 -> localhost | The key's randomart image is: 2026-02-11 00:45:16.883736 | controller-1 -> localhost | +---[RSA 3072]----+ 2026-02-11 00:45:16.883780 | controller-1 -> localhost | |+E=+++oo. .= o | 2026-02-11 00:45:16.883827 | controller-1 -> localhost | |.==o o+ . O . | 2026-02-11 00:45:16.883871 | controller-1 -> localhost | |+=+ o. . o . | 2026-02-11 00:45:16.883913 | controller-1 -> localhost | |*o . o. o o | 2026-02-11 00:45:16.883956 | controller-1 -> localhost | |. . .. S. + o | 2026-02-11 00:45:16.883998 | controller-1 -> localhost | | . . .. . . o .| 2026-02-11 00:45:16.884040 | controller-1 -> localhost | | + o. . . . | 2026-02-11 00:45:16.884082 | controller-1 -> localhost | | o =. . | 2026-02-11 00:45:16.884125 | controller-1 -> localhost | | o.. | 2026-02-11 00:45:16.884168 | controller-1 -> localhost | +----[SHA256]-----+ 2026-02-11 00:45:16.884265 | controller-1 -> localhost | ok: Runtime: 0:00:01.440157 2026-02-11 00:45:16.890029 | 2026-02-11 00:45:16.890117 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-02-11 00:45:16.924293 | controller-1 | ok 2026-02-11 00:45:16.928606 | controller-2 | ok 2026-02-11 00:45:16.932862 | controller-3 | ok 2026-02-11 00:45:16.946766 | controller-1 | included: /var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-11 00:45:16.946815 | controller-2 | included: /var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-11 00:45:16.946839 | controller-3 | included: /var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-11 00:45:16.958358 | 2026-02-11 00:45:16.958417 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-02-11 00:45:16.984388 | controller-1 | skipping: Conditional result was False 2026-02-11 00:45:16.995674 | controller-2 | skipping: Conditional result was False 2026-02-11 00:45:16.996026 | controller-3 | skipping: Conditional result was False 2026-02-11 00:45:17.004495 | 2026-02-11 00:45:17.004572 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-02-11 00:45:17.569208 | controller-2 | changed 2026-02-11 00:45:17.575119 | controller-1 | changed 2026-02-11 00:45:17.580743 | controller-3 | changed 2026-02-11 00:45:17.584458 | 2026-02-11 00:45:17.584520 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-02-11 00:45:17.797193 | controller-2 | ok 2026-02-11 00:45:17.814819 | controller-1 | ok 2026-02-11 00:45:17.819280 | controller-3 | ok 2026-02-11 00:45:17.824004 | 2026-02-11 00:45:17.824068 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-02-11 00:45:18.329026 | controller-2 | changed 2026-02-11 00:45:18.356623 | controller-1 | changed 2026-02-11 00:45:18.392614 | controller-3 | changed 2026-02-11 00:45:18.400207 | 2026-02-11 00:45:18.400277 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-02-11 00:45:18.931817 | controller-2 | changed 2026-02-11 00:45:18.936874 | controller-3 | changed 2026-02-11 00:45:18.963771 | controller-1 | changed 2026-02-11 00:45:18.969558 | 2026-02-11 00:45:18.969649 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-02-11 00:45:18.998035 | controller-1 | skipping: Conditional result was False 2026-02-11 00:45:19.000938 | controller-2 | skipping: Conditional result was False 2026-02-11 00:45:19.011441 | controller-3 | skipping: Conditional result was False 2026-02-11 00:45:19.020173 | 2026-02-11 00:45:19.020401 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-02-11 00:45:19.368608 | controller-1 -> localhost | changed 2026-02-11 00:45:19.383338 | 2026-02-11 00:45:19.383414 | TASK [add-build-sshkey : Add back temp key] 2026-02-11 00:45:19.673471 | controller-1 -> localhost | Identity added: /var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/work/332cca61e1294ba5b724dfcb0ac6aa76_id_rsa (zuul-build-sshkey) 2026-02-11 00:45:19.673678 | controller-1 -> localhost | ok: Runtime: 0:00:00.016026 2026-02-11 00:45:19.677648 | 2026-02-11 00:45:19.677714 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-02-11 00:45:20.057652 | controller-2 | ok 2026-02-11 00:45:20.060905 | controller-1 | ok 2026-02-11 00:45:20.063740 | controller-3 | ok 2026-02-11 00:45:20.067263 | 2026-02-11 00:45:20.067382 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-02-11 00:45:20.100332 | controller-1 | skipping: Conditional result was False 2026-02-11 00:45:20.101263 | controller-2 | skipping: Conditional result was False 2026-02-11 00:45:20.111796 | controller-3 | skipping: Conditional result was False 2026-02-11 00:45:20.131214 | 2026-02-11 00:45:20.131284 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-02-11 00:45:20.457801 | controller-3 | ok 2026-02-11 00:45:20.461456 | controller-2 | ok 2026-02-11 00:45:20.464329 | controller-1 | ok 2026-02-11 00:45:20.468898 | 2026-02-11 00:45:20.468987 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-02-11 00:45:21.397445 | controller-2 | Output suppressed because no_log was given 2026-02-11 00:45:21.425725 | controller-1 | Output suppressed because no_log was given 2026-02-11 00:45:21.431855 | controller-3 | Output suppressed because no_log was given 2026-02-11 00:45:21.445251 | 2026-02-11 00:45:21.445316 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-02-11 00:45:21.659471 | controller-2 | ok: "logs" 2026-02-11 00:45:21.660046 | controller-2 | ok: All items complete 2026-02-11 00:45:21.660100 | 2026-02-11 00:45:21.663495 | controller-1 | ok: "logs" 2026-02-11 00:45:21.685612 | controller-3 | ok: "logs" 2026-02-11 00:45:21.832517 | controller-2 | ok: "artifacts" 2026-02-11 00:45:21.878463 | controller-3 | ok: "artifacts" 2026-02-11 00:45:21.890467 | controller-1 | ok: "artifacts" 2026-02-11 00:45:22.006775 | controller-2 | ok: "docs" 2026-02-11 00:45:22.063066 | controller-3 | ok: "docs" 2026-02-11 00:45:22.073169 | controller-1 | ok: "docs" 2026-02-11 00:45:22.086016 | 2026-02-11 00:45:22.086183 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-02-11 00:45:22.299477 | controller-1 | changed: "logs" 2026-02-11 00:45:22.322603 | controller-1 | ok: All items complete 2026-02-11 00:45:22.322793 | 2026-02-11 00:45:22.332030 | controller-2 | changed: "logs" 2026-02-11 00:45:22.336379 | controller-3 | changed: "logs" 2026-02-11 00:45:22.493798 | controller-1 | changed: "artifacts" 2026-02-11 00:45:22.497822 | controller-2 | changed: "artifacts" 2026-02-11 00:45:22.518712 | controller-3 | changed: "artifacts" 2026-02-11 00:45:22.670909 | controller-1 | changed: "docs" 2026-02-11 00:45:22.675887 | controller-2 | changed: "docs" 2026-02-11 00:45:22.715777 | controller-3 | changed: "docs" 2026-02-11 00:45:22.715897 | controller-3 | changed: All items complete 2026-02-11 00:45:22.715952 | 2026-02-11 00:45:22.734108 | 2026-02-11 00:45:22.734219 | PLAY RECAP 2026-02-11 00:45:22.734266 | controller-1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-02-11 00:45:22.734296 | controller-2 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-02-11 00:45:22.734320 | controller-3 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-02-11 00:45:22.734343 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-11 00:45:22.734362 | 2026-02-11 00:45:22.872729 | PRE-RUN END RESULT_NORMAL: [trusted : vexxhost.dev/zuul-config/playbooks/base/pre.yaml@main] 2026-02-11 00:45:22.878705 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-02-11 00:45:23.495056 | 2026-02-11 00:45:23.495223 | PLAY [all] 2026-02-11 00:45:23.506586 | 2026-02-11 00:45:23.506663 | TASK [setup-uv : Extract archive] 2026-02-11 00:45:25.851994 | controller-2 | changed 2026-02-11 00:45:25.961205 | controller-1 | changed 2026-02-11 00:45:26.067189 | controller-3 | changed 2026-02-11 00:45:26.073173 | 2026-02-11 00:45:26.073305 | TASK [setup-uv : Print version] 2026-02-11 00:45:26.395334 | controller-2 | uv 0.8.13 2026-02-11 00:45:26.509858 | controller-1 | uv 0.8.13 2026-02-11 00:45:26.482867 | controller-3 | uv 0.8.13 2026-02-11 00:45:26.667572 | controller-2 | ok: Runtime: 0:00:00.009226 2026-02-11 00:45:26.675722 | controller-1 | ok: Runtime: 0:00:00.013174 2026-02-11 00:45:26.681755 | controller-3 | ok: Runtime: 0:00:00.008188 2026-02-11 00:45:26.694154 | 2026-02-11 00:45:26.694205 | PLAY RECAP 2026-02-11 00:45:26.694253 | controller-1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-11 00:45:26.694281 | controller-2 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-11 00:45:26.694308 | controller-3 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-11 00:45:26.694328 | 2026-02-11 00:45:26.821272 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-02-11 00:45:26.825847 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-02-11 00:45:27.438605 | 2026-02-11 00:45:27.439765 | PLAY [all] 2026-02-11 00:45:27.451549 | 2026-02-11 00:45:27.451622 | TASK [Copy inventory file for Zuul] 2026-02-11 00:45:28.428982 | controller-1 | changed 2026-02-11 00:45:28.434972 | 2026-02-11 00:45:28.435086 | TASK [Switch "ansible_host" to private IP] 2026-02-11 00:45:28.730772 | controller-1 | changed: 3 replacements made 2026-02-11 00:45:28.736585 | 2026-02-11 00:45:28.736648 | TASK [Run Molecule scenario] 2026-02-11 00:45:29.194029 | controller-1 | Using CPython 3.13.5 interpreter at: /usr/bin/python3 2026-02-11 00:45:29.194120 | controller-1 | Creating virtual environment at: .venv 2026-02-11 00:45:29.241324 | controller-1 | Downloading pygments (1.2MiB) 2026-02-11 00:45:29.248985 | controller-1 | Downloading cryptography (4.3MiB) 2026-02-11 00:45:29.249007 | controller-1 | Downloading ansible-core (2.3MiB) 2026-02-11 00:45:29.451721 | controller-1 | Downloading cryptography 2026-02-11 00:45:29.476695 | controller-1 | Downloading pygments 2026-02-11 00:45:29.576436 | controller-1 | Downloading ansible-core 2026-02-11 00:45:29.627996 | controller-1 | Installed 36 packages in 50ms 2026-02-11 00:45:30.335638 | controller-1 | INFO Collection 'vexxhost.kubernetes' detected. 2026-02-11 00:45:30.335740 | controller-1 | INFO Scenarios will be used from 'extensions/molecule' 2026-02-11 00:45:31.155267 | controller-1 | CRITICAL 'extensions/molecule/default/molecule.yml' glob failed. Exiting. 2026-02-11 00:45:31.155338 | controller-1 | INFO default scenario not found, disabling shared state. 2026-02-11 00:45:31.155427 | controller-1 | INFO [cluster-upgrade > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-02-11 00:45:31.155501 | controller-1 | INFO [cluster-upgrade > prerun] Performing prerun with role_name_check=0... 2026-02-11 00:45:53.804823 | controller-1 | INFO [cluster-upgrade > dependency] Executing 2026-02-11 00:45:53.805093 | controller-1 | WARNING [cluster-upgrade > dependency] Missing roles requirements file: requirements.yml 2026-02-11 00:45:53.805556 | controller-1 | WARNING [cluster-upgrade > dependency] Missing collections requirements file: collections.yml 2026-02-11 00:45:53.805656 | controller-1 | WARNING [cluster-upgrade > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-02-11 00:45:53.813042 | controller-1 | INFO [cluster-upgrade > cleanup] Executing 2026-02-11 00:45:53.813436 | controller-1 | WARNING [cluster-upgrade > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-02-11 00:45:53.819138 | controller-1 | INFO [cluster-upgrade > destroy] Executing 2026-02-11 00:45:53.819229 | controller-1 | WARNING [cluster-upgrade > destroy] Skipping, '--destroy=never' requested. 2026-02-11 00:45:53.819296 | controller-1 | INFO [cluster-upgrade > destroy] Executed: Successful 2026-02-11 00:45:53.824613 | controller-1 | INFO [cluster-upgrade > syntax] Executing 2026-02-11 00:45:55.331571 | controller-1 | 2026-02-11 00:45:55.331912 | controller-1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/converge.yml 2026-02-11 00:45:55.440030 | controller-1 | INFO [cluster-upgrade > syntax] Executed: Successful 2026-02-11 00:45:55.451998 | controller-1 | INFO [cluster-upgrade > create] Executing 2026-02-11 00:45:55.454759 | controller-1 | WARNING [cluster-upgrade > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-02-11 00:45:55.461374 | controller-1 | INFO [cluster-upgrade > prepare] Executing 2026-02-11 00:45:56.752198 | controller-1 | 2026-02-11 00:45:56.752219 | controller-1 | PLAY [Prepare] ***************************************************************** 2026-02-11 00:45:56.752223 | controller-1 | 2026-02-11 00:45:56.752227 | controller-1 | TASK [Gathering Facts] ********************************************************* 2026-02-11 00:45:56.753731 | controller-1 | Wednesday 11 February 2026 00:45:56 +0000 (0:00:00.033) 0:00:00.033 **** 2026-02-11 00:45:57.987941 | controller-1 | [WARNING]: Host 'controller-2' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information. 2026-02-11 00:45:58.009979 | controller-1 | [WARNING]: Host 'controller-3' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information. 2026-02-11 00:45:58.027766 | controller-1 | [WARNING]: Host 'controller-1' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information. 2026-02-11 00:45:58.031770 | controller-1 | ok: [controller-2] 2026-02-11 00:45:58.031995 | controller-1 | ok: [controller-3] 2026-02-11 00:45:58.032219 | controller-1 | ok: [controller-1] 2026-02-11 00:45:58.032418 | controller-1 | 2026-02-11 00:45:58.032628 | controller-1 | TASK [Install Debian packages] ************************************************* 2026-02-11 00:45:58.032839 | controller-1 | Wednesday 11 February 2026 00:45:58 +0000 (0:00:01.281) 0:00:01.314 **** 2026-02-11 00:46:03.515135 | controller-1 | ok: [controller-2] 2026-02-11 00:46:03.515178 | controller-1 | ok: [controller-1] 2026-02-11 00:46:03.515254 | controller-1 | ok: [controller-3] 2026-02-11 00:46:03.517328 | controller-1 | 2026-02-11 00:46:03.517350 | controller-1 | PLAY [Configure Kubernetes VIP] ************************************************ 2026-02-11 00:46:03.517355 | controller-1 | 2026-02-11 00:46:03.517359 | controller-1 | TASK [Gathering Facts] ********************************************************* 2026-02-11 00:46:03.517363 | controller-1 | Wednesday 11 February 2026 00:46:03 +0000 (0:00:05.483) 0:00:06.797 **** 2026-02-11 00:46:04.408164 | controller-1 | ok: [controller-2] 2026-02-11 00:46:04.408192 | controller-1 | ok: [controller-3] 2026-02-11 00:46:04.408197 | controller-1 | ok: [controller-1] 2026-02-11 00:46:04.408202 | controller-1 | 2026-02-11 00:46:04.408208 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] *** 2026-02-11 00:46:04.408214 | controller-1 | Wednesday 11 February 2026 00:46:04 +0000 (0:00:00.891) 0:00:07.689 **** 2026-02-11 00:46:04.890144 | controller-1 | changed: [controller-1] 2026-02-11 00:46:04.890620 | controller-1 | changed: [controller-2] 2026-02-11 00:46:04.890972 | controller-1 | changed: [controller-3] 2026-02-11 00:46:04.891413 | controller-1 | 2026-02-11 00:46:04.891783 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] **************** 2026-02-11 00:46:04.892234 | controller-1 | Wednesday 11 February 2026 00:46:04 +0000 (0:00:00.482) 0:00:08.171 **** 2026-02-11 00:46:06.441835 | controller-1 | ok: [controller-1] => (item=/etc/keepalived/keepalived.conf) 2026-02-11 00:46:06.442043 | controller-1 | ok: [controller-2] => (item=/etc/keepalived/keepalived.conf) 2026-02-11 00:46:06.442232 | controller-1 | ok: [controller-3] => (item=/etc/keepalived/keepalived.conf) 2026-02-11 00:46:06.442400 | controller-1 | ok: [controller-1] => (item=/etc/keepalived/check_apiserver.sh) 2026-02-11 00:46:06.442570 | controller-1 | ok: [controller-2] => (item=/etc/keepalived/check_apiserver.sh) 2026-02-11 00:46:06.442733 | controller-1 | ok: [controller-3] => (item=/etc/keepalived/check_apiserver.sh) 2026-02-11 00:46:06.442917 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests/keepalived.yaml) 2026-02-11 00:46:06.443087 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests/keepalived.yaml) 2026-02-11 00:46:06.443254 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests/keepalived.yaml) 2026-02-11 00:46:06.443419 | controller-1 | ok: [controller-2] => (item=/etc/haproxy/haproxy.cfg) 2026-02-11 00:46:06.443600 | controller-1 | ok: [controller-1] => (item=/etc/haproxy/haproxy.cfg) 2026-02-11 00:46:06.443765 | controller-1 | ok: [controller-3] => (item=/etc/haproxy/haproxy.cfg) 2026-02-11 00:46:06.443927 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests/haproxy.yaml) 2026-02-11 00:46:06.444103 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests/haproxy.yaml) 2026-02-11 00:46:06.444274 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests/haproxy.yaml) 2026-02-11 00:46:06.444426 | controller-1 | 2026-02-11 00:46:06.444607 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] **** 2026-02-11 00:46:06.444789 | controller-1 | Wednesday 11 February 2026 00:46:06 +0000 (0:00:01.552) 0:00:09.724 **** 2026-02-11 00:46:06.841318 | controller-1 | [ERROR]: Task failed: Module failed: Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist ! 2026-02-11 00:46:06.841345 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kube_vip/tasks/main.yml:32:3 2026-02-11 00:46:06.841351 | controller-1 | 2026-02-11 00:46:06.841371 | controller-1 | 30 - Restart "kubelet" service 2026-02-11 00:46:06.841377 | controller-1 | 31 2026-02-11 00:46:06.841382 | controller-1 | 32 - name: Switch API server to run on port 6443 2026-02-11 00:46:06.841454 | controller-1 | ^ column 3 2026-02-11 00:46:06.841678 | controller-1 | 2026-02-11 00:46:06.842353 | controller-1 | failed: [controller-1] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257} 2026-02-11 00:46:06.843468 | controller-1 | failed: [controller-2] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257} 2026-02-11 00:46:06.854753 | controller-1 | failed: [controller-3] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257} 2026-02-11 00:46:07.107814 | controller-1 | [ERROR]: Task failed: Module failed: Path /etc/kubernetes/controller-manager.conf does not exist ! 2026-02-11 00:46:07.107851 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kube_vip/tasks/main.yml:32:3 2026-02-11 00:46:07.107861 | controller-1 | 2026-02-11 00:46:07.107870 | controller-1 | 30 - Restart "kubelet" service 2026-02-11 00:46:07.107878 | controller-1 | 31 2026-02-11 00:46:07.107886 | controller-1 | 32 - name: Switch API server to run on port 6443 2026-02-11 00:46:07.107893 | controller-1 | ^ column 3 2026-02-11 00:46:07.107901 | controller-1 | 2026-02-11 00:46:07.107921 | controller-1 | failed: [controller-1] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257} 2026-02-11 00:46:07.107934 | controller-1 | failed: [controller-2] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257} 2026-02-11 00:46:07.113672 | controller-1 | failed: [controller-3] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257} 2026-02-11 00:46:07.378811 | controller-1 | [ERROR]: Task failed: Module failed: Path /etc/kubernetes/scheduler.conf does not exist ! 2026-02-11 00:46:07.378984 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kube_vip/tasks/main.yml:32:3 2026-02-11 00:46:07.380098 | controller-1 | 2026-02-11 00:46:07.380251 | controller-1 | 30 - Restart "kubelet" service 2026-02-11 00:46:07.380373 | controller-1 | 31 2026-02-11 00:46:07.380494 | controller-1 | 32 - name: Switch API server to run on port 6443 2026-02-11 00:46:07.380624 | controller-1 | ^ column 3 2026-02-11 00:46:07.380735 | controller-1 | 2026-02-11 00:46:07.381038 | controller-1 | failed: [controller-3] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257} 2026-02-11 00:46:07.400445 | controller-1 | failed: [controller-1] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257} 2026-02-11 00:46:07.419484 | controller-1 | failed: [controller-2] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257} 2026-02-11 00:46:07.427587 | controller-1 | ...ignoring 2026-02-11 00:46:07.427601 | controller-1 | ...ignoring 2026-02-11 00:46:07.427606 | controller-1 | ...ignoring 2026-02-11 00:46:07.427611 | controller-1 | 2026-02-11 00:46:07.427618 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] ********* 2026-02-11 00:46:07.427624 | controller-1 | Wednesday 11 February 2026 00:46:07 +0000 (0:00:00.985) 0:00:10.709 **** 2026-02-11 00:46:07.856672 | controller-1 | ok: [controller-1] 2026-02-11 00:46:07.856780 | controller-1 | ok: [controller-2] 2026-02-11 00:46:07.856909 | controller-1 | ok: [controller-3] 2026-02-11 00:46:07.857082 | controller-1 | 2026-02-11 00:46:07.857191 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] ********* 2026-02-11 00:46:07.857358 | controller-1 | Wednesday 11 February 2026 00:46:07 +0000 (0:00:00.429) 0:00:11.138 **** 2026-02-11 00:46:08.183307 | controller-1 | ok: [controller-2] 2026-02-11 00:46:08.183404 | controller-1 | ok: [controller-1] 2026-02-11 00:46:08.184056 | controller-1 | ok: [controller-3] 2026-02-11 00:46:08.184083 | controller-1 | 2026-02-11 00:46:08.184089 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************ 2026-02-11 00:46:08.184094 | controller-1 | Wednesday 11 February 2026 00:46:08 +0000 (0:00:00.326) 0:00:11.465 **** 2026-02-11 00:46:08.244373 | controller-1 | ok: [controller-1] 2026-02-11 00:46:08.244396 | controller-1 | ok: [controller-2] 2026-02-11 00:46:08.244400 | controller-1 | ok: [controller-3] 2026-02-11 00:46:08.244404 | controller-1 | 2026-02-11 00:46:08.244408 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] *** 2026-02-11 00:46:08.244411 | controller-1 | Wednesday 11 February 2026 00:46:08 +0000 (0:00:00.059) 0:00:11.525 **** 2026-02-11 00:46:08.302312 | controller-1 | ok: [controller-1] 2026-02-11 00:46:08.302687 | controller-1 | skipping: [controller-2] 2026-02-11 00:46:08.303037 | controller-1 | skipping: [controller-3] 2026-02-11 00:46:08.303251 | controller-1 | 2026-02-11 00:46:08.303388 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] *************** 2026-02-11 00:46:08.303516 | controller-1 | Wednesday 11 February 2026 00:46:08 +0000 (0:00:00.059) 0:00:11.584 **** 2026-02-11 00:46:09.341651 | controller-1 | ok: [controller-2] 2026-02-11 00:46:09.341850 | controller-1 | ok: [controller-1] 2026-02-11 00:46:09.342017 | controller-1 | ok: [controller-3] 2026-02-11 00:46:09.342178 | controller-1 | 2026-02-11 00:46:09.342351 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] ******* 2026-02-11 00:46:09.342515 | controller-1 | Wednesday 11 February 2026 00:46:09 +0000 (0:00:01.039) 0:00:12.623 **** 2026-02-11 00:46:09.765353 | controller-1 | ok: [controller-2] 2026-02-11 00:46:09.769284 | controller-1 | ok: [controller-1] 2026-02-11 00:46:09.769295 | controller-1 | ok: [controller-3] 2026-02-11 00:46:09.769299 | controller-1 | 2026-02-11 00:46:09.769303 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] *************************** 2026-02-11 00:46:09.769307 | controller-1 | Wednesday 11 February 2026 00:46:09 +0000 (0:00:00.358) 0:00:12.982 **** 2026-02-11 00:46:09.769311 | controller-1 | 2026-02-11 00:46:09.769314 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] *************************** 2026-02-11 00:46:09.769317 | controller-1 | Wednesday 11 February 2026 00:46:09 +0000 (0:00:00.004) 0:00:12.986 **** 2026-02-11 00:46:09.769320 | controller-1 | 2026-02-11 00:46:09.769324 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] *************************** 2026-02-11 00:46:09.769327 | controller-1 | Wednesday 11 February 2026 00:46:09 +0000 (0:00:00.003) 0:00:12.989 **** 2026-02-11 00:46:09.769330 | controller-1 | 2026-02-11 00:46:09.769333 | controller-1 | PLAY [Install Kubernetes] ****************************************************** 2026-02-11 00:46:09.769610 | controller-1 | 2026-02-11 00:46:09.769619 | controller-1 | TASK [Gathering Facts] ********************************************************* 2026-02-11 00:46:09.769622 | controller-1 | Wednesday 11 February 2026 00:46:09 +0000 (0:00:00.058) 0:00:13.048 **** 2026-02-11 00:46:10.684196 | controller-1 | ok: [controller-2] 2026-02-11 00:46:10.684411 | controller-1 | ok: [controller-1] 2026-02-11 00:46:10.684590 | controller-1 | ok: [controller-3] 2026-02-11 00:46:10.684757 | controller-1 | 2026-02-11 00:46:10.684944 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-02-11 00:46:10.685127 | controller-1 | Wednesday 11 February 2026 00:46:10 +0000 (0:00:00.917) 0:00:13.965 **** 2026-02-11 00:46:11.157689 | controller-1 | ok: [controller-1] 2026-02-11 00:46:11.157712 | controller-1 | ok: [controller-2] 2026-02-11 00:46:11.157716 | controller-1 | ok: [controller-3] 2026-02-11 00:46:11.157720 | controller-1 | 2026-02-11 00:46:11.157724 | controller-1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-02-11 00:46:11.157727 | controller-1 | Wednesday 11 February 2026 00:46:11 +0000 (0:00:00.470) 0:00:14.436 **** 2026-02-11 00:46:11.231467 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:11.231973 | controller-1 | skipping: [controller-2] 2026-02-11 00:46:11.231982 | controller-1 | skipping: [controller-3] 2026-02-11 00:46:11.231986 | controller-1 | 2026-02-11 00:46:11.231995 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-02-11 00:46:11.231999 | controller-1 | Wednesday 11 February 2026 00:46:11 +0000 (0:00:00.076) 0:00:14.513 **** 2026-02-11 00:46:11.625530 | controller-1 | changed: [controller-3] 2026-02-11 00:46:11.625553 | controller-1 | changed: [controller-2] 2026-02-11 00:46:11.625557 | controller-1 | changed: [controller-1] 2026-02-11 00:46:11.625561 | controller-1 | 2026-02-11 00:46:11.625565 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-02-11 00:46:11.625569 | controller-1 | Wednesday 11 February 2026 00:46:11 +0000 (0:00:00.391) 0:00:14.905 **** 2026-02-11 00:46:11.740227 | controller-1 | ok: [controller-3] => { 2026-02-11 00:46:11.741463 | controller-1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-02-11 00:46:11.741559 | controller-1 | } 2026-02-11 00:46:11.741659 | controller-1 | ok: [controller-1] => { 2026-02-11 00:46:11.741803 | controller-1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-02-11 00:46:11.742175 | controller-1 | } 2026-02-11 00:46:11.742321 | controller-1 | ok: [controller-2] => { 2026-02-11 00:46:11.742487 | controller-1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-02-11 00:46:11.742651 | controller-1 | } 2026-02-11 00:46:11.742807 | controller-1 | 2026-02-11 00:46:11.743120 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-02-11 00:46:11.743280 | controller-1 | Wednesday 11 February 2026 00:46:11 +0000 (0:00:00.117) 0:00:15.022 **** 2026-02-11 00:46:12.635155 | controller-1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2026-02-11 00:46:12.700603 | controller-1 | changed: [controller-2] 2026-02-11 00:46:12.700883 | controller-1 | changed: [controller-1] 2026-02-11 00:46:12.701144 | controller-1 | changed: [controller-3] 2026-02-11 00:46:12.701471 | controller-1 | 2026-02-11 00:46:12.701738 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-02-11 00:46:12.701991 | controller-1 | Wednesday 11 February 2026 00:46:12 +0000 (0:00:00.959) 0:00:15.982 **** 2026-02-11 00:46:12.780090 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:12.782062 | controller-1 | skipping: [controller-2] 2026-02-11 00:46:12.782395 | controller-1 | skipping: [controller-3] 2026-02-11 00:46:12.782687 | controller-1 | 2026-02-11 00:46:12.782998 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-02-11 00:46:12.783231 | controller-1 | Wednesday 11 February 2026 00:46:12 +0000 (0:00:00.080) 0:00:16.062 **** 2026-02-11 00:46:13.181042 | controller-1 | ok: [controller-2] 2026-02-11 00:46:13.181250 | controller-1 | ok: [controller-1] 2026-02-11 00:46:13.181568 | controller-1 | ok: [controller-3] 2026-02-11 00:46:13.181759 | controller-1 | 2026-02-11 00:46:13.182078 | controller-1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-02-11 00:46:13.182392 | controller-1 | Wednesday 11 February 2026 00:46:13 +0000 (0:00:00.400) 0:00:16.463 **** 2026-02-11 00:46:14.105569 | controller-1 | ok: [controller-1] 2026-02-11 00:46:14.105601 | controller-1 | ok: [controller-2] 2026-02-11 00:46:14.105605 | controller-1 | ok: [controller-3] 2026-02-11 00:46:14.105609 | controller-1 | 2026-02-11 00:46:14.105613 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-02-11 00:46:14.105617 | controller-1 | Wednesday 11 February 2026 00:46:14 +0000 (0:00:00.921) 0:00:17.384 **** 2026-02-11 00:46:14.232654 | controller-1 | ok: [controller-1] => { 2026-02-11 00:46:14.232883 | controller-1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-02-11 00:46:14.233070 | controller-1 | } 2026-02-11 00:46:14.233249 | controller-1 | ok: [controller-2] => { 2026-02-11 00:46:14.233490 | controller-1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-02-11 00:46:14.233728 | controller-1 | } 2026-02-11 00:46:14.236901 | controller-1 | ok: [controller-3] => { 2026-02-11 00:46:14.237533 | controller-1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-02-11 00:46:14.237542 | controller-1 | } 2026-02-11 00:46:14.237546 | controller-1 | 2026-02-11 00:46:14.237550 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-02-11 00:46:14.237558 | controller-1 | Wednesday 11 February 2026 00:46:14 +0000 (0:00:00.130) 0:00:17.514 **** 2026-02-11 00:46:15.371400 | controller-1 | changed: [controller-1] 2026-02-11 00:46:15.371579 | controller-1 | changed: [controller-3] 2026-02-11 00:46:15.371699 | controller-1 | changed: [controller-2] 2026-02-11 00:46:15.371847 | controller-1 | 2026-02-11 00:46:15.371970 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-02-11 00:46:15.372126 | controller-1 | Wednesday 11 February 2026 00:46:15 +0000 (0:00:01.139) 0:00:18.653 **** 2026-02-11 00:46:18.684825 | controller-1 | changed: [controller-2] 2026-02-11 00:46:18.685096 | controller-1 | changed: [controller-3] 2026-02-11 00:46:18.685423 | controller-1 | changed: [controller-1] 2026-02-11 00:46:18.685590 | controller-1 | 2026-02-11 00:46:18.685873 | controller-1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-02-11 00:46:18.686077 | controller-1 | Wednesday 11 February 2026 00:46:18 +0000 (0:00:03.312) 0:00:21.966 **** 2026-02-11 00:46:18.748953 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:18.748993 | controller-1 | skipping: [controller-2] 2026-02-11 00:46:18.749008 | controller-1 | skipping: [controller-3] 2026-02-11 00:46:18.749059 | controller-1 | 2026-02-11 00:46:18.749188 | controller-1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-02-11 00:46:18.749262 | controller-1 | Wednesday 11 February 2026 00:46:18 +0000 (0:00:00.061) 0:00:22.028 **** 2026-02-11 00:46:18.804936 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:18.804980 | controller-1 | skipping: [controller-2] 2026-02-11 00:46:18.805586 | controller-1 | skipping: [controller-3] 2026-02-11 00:46:18.805689 | controller-1 | 2026-02-11 00:46:18.805698 | controller-1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-02-11 00:46:18.805704 | controller-1 | Wednesday 11 February 2026 00:46:18 +0000 (0:00:00.058) 0:00:22.087 **** 2026-02-11 00:46:18.866946 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:18.866974 | controller-1 | skipping: [controller-2] 2026-02-11 00:46:18.866980 | controller-1 | skipping: [controller-3] 2026-02-11 00:46:18.866985 | controller-1 | 2026-02-11 00:46:18.866990 | controller-1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-02-11 00:46:18.866995 | controller-1 | Wednesday 11 February 2026 00:46:18 +0000 (0:00:00.061) 0:00:22.148 **** 2026-02-11 00:46:25.128941 | controller-1 | changed: [controller-2] 2026-02-11 00:46:25.128971 | controller-1 | changed: [controller-1] 2026-02-11 00:46:25.128975 | controller-1 | changed: [controller-3] 2026-02-11 00:46:25.128979 | controller-1 | 2026-02-11 00:46:25.128983 | controller-1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-02-11 00:46:25.128986 | controller-1 | Wednesday 11 February 2026 00:46:25 +0000 (0:00:06.260) 0:00:28.408 **** 2026-02-11 00:46:25.910672 | controller-1 | changed: [controller-1] 2026-02-11 00:46:25.910744 | controller-1 | changed: [controller-2] 2026-02-11 00:46:25.910850 | controller-1 | changed: [controller-3] 2026-02-11 00:46:25.911172 | controller-1 | 2026-02-11 00:46:25.911195 | controller-1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-02-11 00:46:25.911200 | controller-1 | Wednesday 11 February 2026 00:46:25 +0000 (0:00:00.784) 0:00:29.193 **** 2026-02-11 00:46:27.408476 | controller-1 | changed: [controller-1] => (item={'path': '/etc/containerd'}) 2026-02-11 00:46:27.408554 | controller-1 | changed: [controller-2] => (item={'path': '/etc/containerd'}) 2026-02-11 00:46:27.409332 | controller-1 | changed: [controller-3] => (item={'path': '/etc/containerd'}) 2026-02-11 00:46:27.409366 | controller-1 | changed: [controller-2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-02-11 00:46:27.409370 | controller-1 | changed: [controller-1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-02-11 00:46:27.409374 | controller-1 | changed: [controller-3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-02-11 00:46:27.409378 | controller-1 | changed: [controller-2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-02-11 00:46:27.409381 | controller-1 | changed: [controller-1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-02-11 00:46:27.409468 | controller-1 | changed: [controller-3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-02-11 00:46:27.409620 | controller-1 | changed: [controller-2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-02-11 00:46:27.409750 | controller-1 | changed: [controller-1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-02-11 00:46:27.409907 | controller-1 | changed: [controller-3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-02-11 00:46:27.410027 | controller-1 | changed: [controller-2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-02-11 00:46:27.410210 | controller-1 | changed: [controller-3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-02-11 00:46:27.410336 | controller-1 | changed: [controller-1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-02-11 00:46:27.410474 | controller-1 | 2026-02-11 00:46:27.410597 | controller-1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-02-11 00:46:27.410709 | controller-1 | Wednesday 11 February 2026 00:46:27 +0000 (0:00:01.496) 0:00:30.690 **** 2026-02-11 00:46:28.387404 | controller-1 | changed: [controller-1] 2026-02-11 00:46:28.387724 | controller-1 | changed: [controller-2] 2026-02-11 00:46:28.388008 | controller-1 | changed: [controller-3] 2026-02-11 00:46:28.388277 | controller-1 | 2026-02-11 00:46:28.388569 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-02-11 00:46:28.388829 | controller-1 | Wednesday 11 February 2026 00:46:28 +0000 (0:00:00.962) 0:00:31.653 **** 2026-02-11 00:46:28.389087 | controller-1 | 2026-02-11 00:46:28.389552 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-02-11 00:46:28.389869 | controller-1 | Wednesday 11 February 2026 00:46:28 +0000 (0:00:00.005) 0:00:31.659 **** 2026-02-11 00:46:28.390108 | controller-1 | 2026-02-11 00:46:28.390376 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-02-11 00:46:28.390668 | controller-1 | Wednesday 11 February 2026 00:46:28 +0000 (0:00:00.004) 0:00:31.663 **** 2026-02-11 00:46:28.390906 | controller-1 | 2026-02-11 00:46:28.391181 | controller-1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-02-11 00:46:28.391440 | controller-1 | Wednesday 11 February 2026 00:46:28 +0000 (0:00:00.006) 0:00:31.669 **** 2026-02-11 00:46:30.263120 | controller-1 | changed: [controller-1] 2026-02-11 00:46:30.263157 | controller-1 | changed: [controller-3] 2026-02-11 00:46:30.263166 | controller-1 | changed: [controller-2] 2026-02-11 00:46:30.263174 | controller-1 | 2026-02-11 00:46:30.263182 | controller-1 | RUNNING HANDLER [vexxhost.kubernetes.kubelet : Reload systemd] ***************** 2026-02-11 00:46:30.263190 | controller-1 | Wednesday 11 February 2026 00:46:30 +0000 (0:00:01.874) 0:00:33.544 **** 2026-02-11 00:46:32.102749 | controller-1 | ok: [controller-2] 2026-02-11 00:46:32.103304 | controller-1 | ok: [controller-1] 2026-02-11 00:46:32.103777 | controller-1 | ok: [controller-3] 2026-02-11 00:46:32.104067 | controller-1 | 2026-02-11 00:46:32.104429 | controller-1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-02-11 00:46:32.104763 | controller-1 | Wednesday 11 February 2026 00:46:32 +0000 (0:00:01.840) 0:00:35.384 **** 2026-02-11 00:46:32.964186 | controller-1 | changed: [controller-2] 2026-02-11 00:46:32.964229 | controller-1 | changed: [controller-1] 2026-02-11 00:46:32.964237 | controller-1 | changed: [controller-3] 2026-02-11 00:46:32.964253 | controller-1 | 2026-02-11 00:46:32.964474 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the "kubeadm-config" ConfigMap] *** 2026-02-11 00:46:32.964512 | controller-1 | Wednesday 11 February 2026 00:46:32 +0000 (0:00:00.861) 0:00:36.246 **** 2026-02-11 00:46:33.640314 | controller-1 | [ERROR]: Task failed: Module failed: Failed to import the required Python library (kubernetes) on np0000155227's Python /usr/bin/python3.13. Please read the module documentation and install it in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter 2026-02-11 00:46:33.645429 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes_upgrade_check/tasks/main.yml:16:3 2026-02-11 00:46:33.645440 | controller-1 | 2026-02-11 00:46:33.645444 | controller-1 | 14 2026-02-11 00:46:33.645448 | controller-1 | 15 --- 2026-02-11 00:46:33.645453 | controller-1 | 16 - name: Retrieve the "kubeadm-config" ConfigMap 2026-02-11 00:46:33.645465 | controller-1 | ^ column 3 2026-02-11 00:46:33.645469 | controller-1 | 2026-02-11 00:46:33.645610 | controller-1 | fatal: [controller-1]: FAILED! => {"changed": false, "msg": "Failed to import the required Python library (kubernetes) on np0000155227's Python /usr/bin/python3.13. Please read the module documentation and install it in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter"} 2026-02-11 00:46:33.652478 | controller-1 | ...ignoring 2026-02-11 00:46:33.652596 | controller-1 | 2026-02-11 00:46:33.652731 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Parse the ClusterConfiguration] *** 2026-02-11 00:46:33.652857 | controller-1 | Wednesday 11 February 2026 00:46:33 +0000 (0:00:00.688) 0:00:36.934 **** 2026-02-11 00:46:33.698863 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:33.698923 | controller-1 | 2026-02-11 00:46:33.698978 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the current Kubernetes version] *** 2026-02-11 00:46:33.699119 | controller-1 | Wednesday 11 February 2026 00:46:33 +0000 (0:00:00.045) 0:00:36.980 **** 2026-02-11 00:46:33.736055 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:33.736091 | controller-1 | 2026-02-11 00:46:33.736096 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Extract major, minor, and patch versions] *** 2026-02-11 00:46:33.736101 | controller-1 | Wednesday 11 February 2026 00:46:33 +0000 (0:00:00.037) 0:00:37.017 **** 2026-02-11 00:46:33.780026 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:33.780160 | controller-1 | 2026-02-11 00:46:33.780289 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Fail if we're jumping more than one minor version] *** 2026-02-11 00:46:33.781999 | controller-1 | Wednesday 11 February 2026 00:46:33 +0000 (0:00:00.044) 0:00:37.062 **** 2026-02-11 00:46:33.853373 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:33.853406 | controller-1 | skipping: [controller-2] 2026-02-11 00:46:33.853410 | controller-1 | skipping: [controller-3] 2026-02-11 00:46:33.853414 | controller-1 | 2026-02-11 00:46:33.853418 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Set fact if we need to upgrade] *** 2026-02-11 00:46:33.853422 | controller-1 | Wednesday 11 February 2026 00:46:33 +0000 (0:00:00.069) 0:00:37.132 **** 2026-02-11 00:46:33.936173 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:33.936199 | controller-1 | skipping: [controller-2] 2026-02-11 00:46:33.936203 | controller-1 | skipping: [controller-3] 2026-02-11 00:46:33.936207 | controller-1 | 2026-02-11 00:46:33.936211 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-02-11 00:46:33.936214 | controller-1 | Wednesday 11 February 2026 00:46:33 +0000 (0:00:00.085) 0:00:37.218 **** 2026-02-11 00:46:34.311702 | controller-1 | ok: [controller-1] 2026-02-11 00:46:34.312063 | controller-1 | ok: [controller-2] 2026-02-11 00:46:34.312383 | controller-1 | ok: [controller-3] 2026-02-11 00:46:34.312691 | controller-1 | 2026-02-11 00:46:34.313018 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-02-11 00:46:34.313392 | controller-1 | Wednesday 11 February 2026 00:46:34 +0000 (0:00:00.375) 0:00:37.594 **** 2026-02-11 00:46:34.384720 | controller-1 | ok: [controller-1] => { 2026-02-11 00:46:34.384921 | controller-1 | "msg": "https://cdn.dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubeadm" 2026-02-11 00:46:34.385128 | controller-1 | } 2026-02-11 00:46:34.385378 | controller-1 | ok: [controller-2] => { 2026-02-11 00:46:34.385551 | controller-1 | "msg": "https://cdn.dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubeadm" 2026-02-11 00:46:34.385795 | controller-1 | } 2026-02-11 00:46:34.386008 | controller-1 | ok: [controller-3] => { 2026-02-11 00:46:34.386171 | controller-1 | "msg": "https://cdn.dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubeadm" 2026-02-11 00:46:34.386368 | controller-1 | } 2026-02-11 00:46:34.386514 | controller-1 | 2026-02-11 00:46:34.386672 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-02-11 00:46:34.386876 | controller-1 | Wednesday 11 February 2026 00:46:34 +0000 (0:00:00.073) 0:00:37.667 **** 2026-02-11 00:46:38.045106 | controller-1 | changed: [controller-2] 2026-02-11 00:46:38.045483 | controller-1 | changed: [controller-1] 2026-02-11 00:46:38.045766 | controller-1 | changed: [controller-3] 2026-02-11 00:46:38.046015 | controller-1 | 2026-02-11 00:46:38.046308 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-02-11 00:46:38.046581 | controller-1 | Wednesday 11 February 2026 00:46:38 +0000 (0:00:03.659) 0:00:41.326 **** 2026-02-11 00:46:38.087616 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:38.146471 | controller-1 | skipping: [controller-2] 2026-02-11 00:46:38.146490 | controller-1 | skipping: [controller-3] 2026-02-11 00:46:38.146494 | controller-1 | 2026-02-11 00:46:38.146498 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-02-11 00:46:38.146502 | controller-1 | Wednesday 11 February 2026 00:46:38 +0000 (0:00:00.102) 0:00:41.428 **** 2026-02-11 00:46:38.529514 | controller-1 | ok: [controller-2] 2026-02-11 00:46:38.530007 | controller-1 | ok: [controller-1] 2026-02-11 00:46:38.530274 | controller-1 | ok: [controller-3] 2026-02-11 00:46:38.530624 | controller-1 | 2026-02-11 00:46:38.531010 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-02-11 00:46:38.531382 | controller-1 | Wednesday 11 February 2026 00:46:38 +0000 (0:00:00.382) 0:00:41.811 **** 2026-02-11 00:46:38.613763 | controller-1 | ok: [controller-1] => { 2026-02-11 00:46:38.613786 | controller-1 | "msg": "https://cdn.dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubectl" 2026-02-11 00:46:38.613791 | controller-1 | } 2026-02-11 00:46:38.613794 | controller-1 | ok: [controller-2] => { 2026-02-11 00:46:38.613798 | controller-1 | "msg": "https://cdn.dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubectl" 2026-02-11 00:46:38.613802 | controller-1 | } 2026-02-11 00:46:38.613805 | controller-1 | ok: [controller-3] => { 2026-02-11 00:46:38.613809 | controller-1 | "msg": "https://cdn.dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubectl" 2026-02-11 00:46:38.613813 | controller-1 | } 2026-02-11 00:46:38.613818 | controller-1 | 2026-02-11 00:46:38.613823 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-02-11 00:46:38.613827 | controller-1 | Wednesday 11 February 2026 00:46:38 +0000 (0:00:00.081) 0:00:41.893 **** 2026-02-11 00:46:40.380340 | controller-1 | changed: [controller-3] 2026-02-11 00:46:40.381836 | controller-1 | changed: [controller-1] 2026-02-11 00:46:40.382056 | controller-1 | changed: [controller-2] 2026-02-11 00:46:40.382235 | controller-1 | 2026-02-11 00:46:40.382438 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-02-11 00:46:40.382634 | controller-1 | Wednesday 11 February 2026 00:46:40 +0000 (0:00:01.769) 0:00:43.662 **** 2026-02-11 00:46:40.483428 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:40.483517 | controller-1 | skipping: [controller-2] 2026-02-11 00:46:40.483628 | controller-1 | skipping: [controller-3] 2026-02-11 00:46:40.483731 | controller-1 | 2026-02-11 00:46:40.483848 | controller-1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-02-11 00:46:40.483962 | controller-1 | Wednesday 11 February 2026 00:46:40 +0000 (0:00:00.102) 0:00:43.765 **** 2026-02-11 00:46:40.538550 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:40.538772 | controller-1 | skipping: [controller-2] 2026-02-11 00:46:40.538960 | controller-1 | skipping: [controller-3] 2026-02-11 00:46:40.539172 | controller-1 | 2026-02-11 00:46:40.539390 | controller-1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-02-11 00:46:40.539606 | controller-1 | Wednesday 11 February 2026 00:46:40 +0000 (0:00:00.055) 0:00:43.820 **** 2026-02-11 00:46:40.569360 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:40.596694 | controller-1 | skipping: [controller-2] 2026-02-11 00:46:40.596730 | controller-1 | skipping: [controller-3] 2026-02-11 00:46:40.596740 | controller-1 | 2026-02-11 00:46:40.596749 | controller-1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-02-11 00:46:40.596757 | controller-1 | Wednesday 11 February 2026 00:46:40 +0000 (0:00:00.057) 0:00:43.878 **** 2026-02-11 00:46:40.655715 | controller-1 | skipping: [controller-1] 2026-02-11 00:46:40.656000 | controller-1 | skipping: [controller-2] 2026-02-11 00:46:40.656245 | controller-1 | skipping: [controller-3] 2026-02-11 00:46:40.656480 | controller-1 | 2026-02-11 00:46:40.656756 | controller-1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-02-11 00:46:40.657003 | controller-1 | Wednesday 11 February 2026 00:46:40 +0000 (0:00:00.059) 0:00:43.937 **** 2026-02-11 00:46:41.728250 | controller-1 | ok: [controller-2] 2026-02-11 00:46:41.728392 | controller-1 | ok: [controller-1] 2026-02-11 00:46:41.728505 | controller-1 | ok: [controller-3] 2026-02-11 00:46:41.728609 | controller-1 | 2026-02-11 00:46:41.728728 | controller-1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-02-11 00:46:41.728860 | controller-1 | Wednesday 11 February 2026 00:46:41 +0000 (0:00:01.072) 0:00:45.010 **** 2026-02-11 00:46:42.452729 | controller-1 | ok: [controller-2] 2026-02-11 00:46:42.452790 | controller-1 | ok: [controller-1] 2026-02-11 00:46:42.452887 | controller-1 | ok: [controller-3] 2026-02-11 00:46:42.453213 | controller-1 | 2026-02-11 00:46:42.453235 | controller-1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-02-11 00:46:42.453239 | controller-1 | Wednesday 11 February 2026 00:46:42 +0000 (0:00:00.724) 0:00:45.735 **** 2026-02-11 00:46:43.966141 | controller-1 | ok: [controller-2] => (item={'path': '/etc/containerd'}) 2026-02-11 00:46:43.966164 | controller-1 | ok: [controller-1] => (item={'path': '/etc/containerd'}) 2026-02-11 00:46:43.966168 | controller-1 | ok: [controller-3] => (item={'path': '/etc/containerd'}) 2026-02-11 00:46:43.966171 | controller-1 | ok: [controller-2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-02-11 00:46:43.966175 | controller-1 | ok: [controller-1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-02-11 00:46:43.966178 | controller-1 | ok: [controller-3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-02-11 00:46:43.966181 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-02-11 00:46:43.966185 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-02-11 00:46:43.966188 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-02-11 00:46:43.966191 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-02-11 00:46:43.966194 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-02-11 00:46:43.966204 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-02-11 00:46:43.966208 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-02-11 00:46:43.966211 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-02-11 00:46:43.966214 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-02-11 00:46:43.966218 | controller-1 | 2026-02-11 00:46:43.966222 | controller-1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-02-11 00:46:43.966225 | controller-1 | Wednesday 11 February 2026 00:46:43 +0000 (0:00:01.511) 0:00:47.247 **** 2026-02-11 00:46:44.832486 | controller-1 | ok: [controller-1] 2026-02-11 00:46:44.832532 | controller-1 | ok: [controller-3] 2026-02-11 00:46:44.832649 | controller-1 | ok: [controller-2] 2026-02-11 00:46:44.833673 | controller-1 | 2026-02-11 00:46:44.833697 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-02-11 00:46:44.833702 | controller-1 | Wednesday 11 February 2026 00:46:44 +0000 (0:00:00.854) 0:00:48.101 **** 2026-02-11 00:46:44.833706 | controller-1 | 2026-02-11 00:46:44.833709 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-02-11 00:46:44.833712 | controller-1 | Wednesday 11 February 2026 00:46:44 +0000 (0:00:00.004) 0:00:48.106 **** 2026-02-11 00:46:44.833716 | controller-1 | 2026-02-11 00:46:44.833719 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-02-11 00:46:44.833722 | controller-1 | Wednesday 11 February 2026 00:46:44 +0000 (0:00:00.004) 0:00:48.110 **** 2026-02-11 00:46:44.833725 | controller-1 | 2026-02-11 00:46:44.833729 | controller-1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-02-11 00:46:44.833732 | controller-1 | Wednesday 11 February 2026 00:46:44 +0000 (0:00:00.004) 0:00:48.115 **** 2026-02-11 00:46:45.403093 | controller-1 | ok: [controller-2] 2026-02-11 00:46:45.403132 | controller-1 | ok: [controller-1] 2026-02-11 00:46:45.403141 | controller-1 | ok: [controller-3] 2026-02-11 00:46:45.403150 | controller-1 | 2026-02-11 00:46:45.403158 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-02-11 00:46:45.403166 | controller-1 | Wednesday 11 February 2026 00:46:45 +0000 (0:00:00.568) 0:00:48.684 **** 2026-02-11 00:46:45.791907 | controller-1 | ok: [controller-1] 2026-02-11 00:46:45.792228 | controller-1 | ok: [controller-2] 2026-02-11 00:46:45.792529 | controller-1 | ok: [controller-3] 2026-02-11 00:46:45.792835 | controller-1 | 2026-02-11 00:46:45.793184 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-02-11 00:46:45.793539 | controller-1 | Wednesday 11 February 2026 00:46:45 +0000 (0:00:00.390) 0:00:49.074 **** 2026-02-11 00:46:45.913834 | controller-1 | ok: [controller-1] => { 2026-02-11 00:46:45.914034 | controller-1 | "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/crictl-v1.34.0-linux-amd64.tar.gz" 2026-02-11 00:46:45.914150 | controller-1 | } 2026-02-11 00:46:45.914266 | controller-1 | ok: [controller-2] => { 2026-02-11 00:46:45.914389 | controller-1 | "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/crictl-v1.34.0-linux-amd64.tar.gz" 2026-02-11 00:46:45.914651 | controller-1 | } 2026-02-11 00:46:45.914786 | controller-1 | ok: [controller-3] => { 2026-02-11 00:46:45.914908 | controller-1 | "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/crictl-v1.34.0-linux-amd64.tar.gz" 2026-02-11 00:46:45.915028 | controller-1 | } 2026-02-11 00:46:45.915133 | controller-1 | 2026-02-11 00:46:45.915249 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-02-11 00:46:45.915362 | controller-1 | Wednesday 11 February 2026 00:46:45 +0000 (0:00:00.121) 0:00:49.196 **** 2026-02-11 00:46:47.452122 | controller-1 | changed: [controller-1] 2026-02-11 00:46:47.452270 | controller-1 | changed: [controller-3] 2026-02-11 00:46:47.452385 | controller-1 | changed: [controller-2] 2026-02-11 00:46:47.452494 | controller-1 | 2026-02-11 00:46:47.452614 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-02-11 00:46:47.452730 | controller-1 | Wednesday 11 February 2026 00:46:47 +0000 (0:00:01.538) 0:00:50.734 **** 2026-02-11 00:46:49.241834 | controller-1 | changed: [controller-2] 2026-02-11 00:46:49.241858 | controller-1 | changed: [controller-1] 2026-02-11 00:46:49.241862 | controller-1 | changed: [controller-3] 2026-02-11 00:46:49.241867 | controller-1 | 2026-02-11 00:46:49.241871 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-02-11 00:46:49.241874 | controller-1 | Wednesday 11 February 2026 00:46:49 +0000 (0:00:01.786) 0:00:52.520 **** 2026-02-11 00:46:49.358721 | controller-1 | ok: [controller-1] => { 2026-02-11 00:46:49.358743 | controller-1 | "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/critest-v1.34.0-linux-amd64.tar.gz" 2026-02-11 00:46:49.358747 | controller-1 | } 2026-02-11 00:46:49.358751 | controller-1 | ok: [controller-2] => { 2026-02-11 00:46:49.358754 | controller-1 | "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/critest-v1.34.0-linux-amd64.tar.gz" 2026-02-11 00:46:49.358757 | controller-1 | } 2026-02-11 00:46:49.358761 | controller-1 | ok: [controller-3] => { 2026-02-11 00:46:49.358771 | controller-1 | "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/critest-v1.34.0-linux-amd64.tar.gz" 2026-02-11 00:46:49.358775 | controller-1 | } 2026-02-11 00:46:49.358778 | controller-1 | 2026-02-11 00:46:49.358782 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-02-11 00:46:49.358786 | controller-1 | Wednesday 11 February 2026 00:46:49 +0000 (0:00:00.118) 0:00:52.639 **** 2026-02-11 00:46:50.513509 | controller-1 | changed: [controller-2] 2026-02-11 00:46:50.517387 | controller-1 | changed: [controller-1] 2026-02-11 00:46:50.517398 | controller-1 | changed: [controller-3] 2026-02-11 00:46:50.517402 | controller-1 | 2026-02-11 00:46:50.517406 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-02-11 00:46:50.517410 | controller-1 | Wednesday 11 February 2026 00:46:50 +0000 (0:00:01.155) 0:00:53.795 **** 2026-02-11 00:46:52.320964 | controller-1 | changed: [controller-2] 2026-02-11 00:46:52.321349 | controller-1 | changed: [controller-1] 2026-02-11 00:46:52.321623 | controller-1 | changed: [controller-3] 2026-02-11 00:46:52.321867 | controller-1 | 2026-02-11 00:46:52.322134 | controller-1 | TASK [vexxhost.containers.cri_tools : Create crictl config] ******************** 2026-02-11 00:46:52.322390 | controller-1 | Wednesday 11 February 2026 00:46:52 +0000 (0:00:01.807) 0:00:55.603 **** 2026-02-11 00:46:53.055134 | controller-1 | changed: [controller-1] 2026-02-11 00:46:53.055525 | controller-1 | changed: [controller-2] 2026-02-11 00:46:53.055810 | controller-1 | changed: [controller-3] 2026-02-11 00:46:53.056136 | controller-1 | 2026-02-11 00:46:53.056421 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/opt/cni/bin)] ********* 2026-02-11 00:46:53.056790 | controller-1 | Wednesday 11 February 2026 00:46:53 +0000 (0:00:00.734) 0:00:56.337 **** 2026-02-11 00:46:53.417092 | controller-1 | changed: [controller-1] 2026-02-11 00:46:53.417457 | controller-1 | changed: [controller-2] 2026-02-11 00:46:53.417792 | controller-1 | changed: [controller-3] 2026-02-11 00:46:53.418105 | controller-1 | 2026-02-11 00:46:53.418368 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-02-11 00:46:53.418718 | controller-1 | Wednesday 11 February 2026 00:46:53 +0000 (0:00:00.361) 0:00:56.699 **** 2026-02-11 00:46:53.787765 | controller-1 | ok: [controller-1] 2026-02-11 00:46:53.788086 | controller-1 | ok: [controller-3] 2026-02-11 00:46:53.788368 | controller-1 | ok: [controller-2] 2026-02-11 00:46:53.788608 | controller-1 | 2026-02-11 00:46:53.788900 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-02-11 00:46:53.789417 | controller-1 | Wednesday 11 February 2026 00:46:53 +0000 (0:00:00.370) 0:00:57.070 **** 2026-02-11 00:46:53.913745 | controller-1 | ok: [controller-2] => { 2026-02-11 00:46:53.913972 | controller-1 | "msg": "https://github.com/containernetworking/plugins/releases/download/v1.8.0/cni-plugins-linux-amd64-v1.8.0.tgz" 2026-02-11 00:46:53.914140 | controller-1 | } 2026-02-11 00:46:53.914306 | controller-1 | ok: [controller-1] => { 2026-02-11 00:46:53.914491 | controller-1 | "msg": "https://github.com/containernetworking/plugins/releases/download/v1.8.0/cni-plugins-linux-amd64-v1.8.0.tgz" 2026-02-11 00:46:53.914643 | controller-1 | } 2026-02-11 00:46:53.914803 | controller-1 | ok: [controller-3] => { 2026-02-11 00:46:53.914979 | controller-1 | "msg": "https://github.com/containernetworking/plugins/releases/download/v1.8.0/cni-plugins-linux-amd64-v1.8.0.tgz" 2026-02-11 00:46:53.915213 | controller-1 | } 2026-02-11 00:46:53.915371 | controller-1 | 2026-02-11 00:46:53.915533 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-02-11 00:46:53.915711 | controller-1 | Wednesday 11 February 2026 00:46:53 +0000 (0:00:00.125) 0:00:57.196 **** 2026-02-11 00:46:55.597777 | controller-1 | changed: [controller-1] 2026-02-11 00:46:55.597800 | controller-1 | changed: [controller-2] 2026-02-11 00:46:55.597804 | controller-1 | changed: [controller-3] 2026-02-11 00:46:55.597808 | controller-1 | 2026-02-11 00:46:55.597812 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-02-11 00:46:55.597815 | controller-1 | Wednesday 11 February 2026 00:46:55 +0000 (0:00:01.680) 0:00:58.876 **** 2026-02-11 00:46:58.757997 | controller-1 | changed: [controller-2] 2026-02-11 00:46:58.758376 | controller-1 | changed: [controller-1] 2026-02-11 00:46:58.758640 | controller-1 | changed: [controller-3] 2026-02-11 00:46:58.758954 | controller-1 | 2026-02-11 00:46:58.759387 | controller-1 | TASK [vexxhost.containers.cni_plugins : Gather variables for each operating system] *** 2026-02-11 00:46:58.759827 | controller-1 | Wednesday 11 February 2026 00:46:58 +0000 (0:00:03.163) 0:01:02.040 **** 2026-02-11 00:46:58.847044 | controller-1 | ok: [controller-1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml) 2026-02-11 00:46:58.847112 | controller-1 | ok: [controller-2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml) 2026-02-11 00:46:58.847210 | controller-1 | ok: [controller-3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml) 2026-02-11 00:46:58.847493 | controller-1 | 2026-02-11 00:46:58.847516 | controller-1 | TASK [vexxhost.containers.cni_plugins : Install additional packages] *********** 2026-02-11 00:46:58.847521 | controller-1 | Wednesday 11 February 2026 00:46:58 +0000 (0:00:00.089) 0:01:02.129 **** 2026-02-11 00:47:01.744911 | controller-1 | changed: [controller-1] 2026-02-11 00:47:01.744933 | controller-1 | changed: [controller-2] 2026-02-11 00:47:01.744937 | controller-1 | changed: [controller-3] 2026-02-11 00:47:01.744941 | controller-1 | 2026-02-11 00:47:01.744945 | controller-1 | TASK [vexxhost.containers.cni_plugins : Ensure IPv6 is enabled] **************** 2026-02-11 00:47:01.744949 | controller-1 | Wednesday 11 February 2026 00:47:01 +0000 (0:00:02.894) 0:01:05.024 **** 2026-02-11 00:47:02.228138 | controller-1 | changed: [controller-1] 2026-02-11 00:47:02.228160 | controller-1 | changed: [controller-2] 2026-02-11 00:47:02.228163 | controller-1 | changed: [controller-3] 2026-02-11 00:47:02.228167 | controller-1 | 2026-02-11 00:47:02.228171 | controller-1 | TASK [vexxhost.containers.cni_plugins : Enable kernel modules on-boot] ********* 2026-02-11 00:47:02.228179 | controller-1 | Wednesday 11 February 2026 00:47:02 +0000 (0:00:00.485) 0:01:05.510 **** 2026-02-11 00:47:02.950522 | controller-1 | changed: [controller-1] 2026-02-11 00:47:02.953773 | controller-1 | changed: [controller-2] 2026-02-11 00:47:02.953785 | controller-1 | changed: [controller-3] 2026-02-11 00:47:02.953790 | controller-1 | 2026-02-11 00:47:02.953803 | controller-1 | TASK [vexxhost.containers.cni_plugins : Enable kernel modules in runtime] ****** 2026-02-11 00:47:02.953808 | controller-1 | Wednesday 11 February 2026 00:47:02 +0000 (0:00:00.722) 0:01:06.233 **** 2026-02-11 00:47:04.481147 | controller-1 | changed: [controller-1] => (item=br_netfilter) 2026-02-11 00:47:04.481333 | controller-1 | changed: [controller-2] => (item=br_netfilter) 2026-02-11 00:47:04.481475 | controller-1 | changed: [controller-3] => (item=br_netfilter) 2026-02-11 00:47:04.481594 | controller-1 | ok: [controller-2] => (item=ip_tables) 2026-02-11 00:47:04.481709 | controller-1 | ok: [controller-1] => (item=ip_tables) 2026-02-11 00:47:04.481823 | controller-1 | ok: [controller-3] => (item=ip_tables) 2026-02-11 00:47:04.481938 | controller-1 | changed: [controller-1] => (item=ip6_tables) 2026-02-11 00:47:04.482052 | controller-1 | changed: [controller-2] => (item=ip6_tables) 2026-02-11 00:47:04.482164 | controller-1 | changed: [controller-3] => (item=ip6_tables) 2026-02-11 00:47:04.482276 | controller-1 | changed: [controller-2] => (item=nf_conntrack) 2026-02-11 00:47:04.482388 | controller-1 | changed: [controller-1] => (item=nf_conntrack) 2026-02-11 00:47:04.482499 | controller-1 | changed: [controller-3] => (item=nf_conntrack) 2026-02-11 00:47:04.482603 | controller-1 | 2026-02-11 00:47:04.482719 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-02-11 00:47:04.482834 | controller-1 | Wednesday 11 February 2026 00:47:04 +0000 (0:00:01.530) 0:01:07.763 **** 2026-02-11 00:47:04.874601 | controller-1 | ok: [controller-1] 2026-02-11 00:47:04.874916 | controller-1 | ok: [controller-2] 2026-02-11 00:47:04.875216 | controller-1 | ok: [controller-3] 2026-02-11 00:47:04.875520 | controller-1 | 2026-02-11 00:47:04.875809 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-02-11 00:47:04.876130 | controller-1 | Wednesday 11 February 2026 00:47:04 +0000 (0:00:00.392) 0:01:08.156 **** 2026-02-11 00:47:04.963758 | controller-1 | ok: [controller-1] => { 2026-02-11 00:47:04.966266 | controller-1 | "msg": "https://cdn.dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubelet" 2026-02-11 00:47:04.966275 | controller-1 | } 2026-02-11 00:47:04.966279 | controller-1 | ok: [controller-2] => { 2026-02-11 00:47:04.966283 | controller-1 | "msg": "https://cdn.dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubelet" 2026-02-11 00:47:04.966286 | controller-1 | } 2026-02-11 00:47:04.966289 | controller-1 | ok: [controller-3] => { 2026-02-11 00:47:04.966293 | controller-1 | "msg": "https://cdn.dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubelet" 2026-02-11 00:47:04.966296 | controller-1 | } 2026-02-11 00:47:04.966299 | controller-1 | 2026-02-11 00:47:04.966303 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-02-11 00:47:04.966306 | controller-1 | Wednesday 11 February 2026 00:47:04 +0000 (0:00:00.089) 0:01:08.246 **** 2026-02-11 00:47:09.888917 | controller-1 | changed: [controller-3] 2026-02-11 00:47:09.889079 | controller-1 | changed: [controller-1] 2026-02-11 00:47:09.889239 | controller-1 | changed: [controller-2] 2026-02-11 00:47:09.889401 | controller-1 | 2026-02-11 00:47:09.889552 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-02-11 00:47:09.889678 | controller-1 | Wednesday 11 February 2026 00:47:09 +0000 (0:00:04.924) 0:01:13.171 **** 2026-02-11 00:47:09.960630 | controller-1 | skipping: [controller-1] 2026-02-11 00:47:09.960967 | controller-1 | skipping: [controller-2] 2026-02-11 00:47:09.962164 | controller-1 | skipping: [controller-3] 2026-02-11 00:47:09.963216 | controller-1 | 2026-02-11 00:47:09.963577 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Gather variables for each operating system] *** 2026-02-11 00:47:09.963890 | controller-1 | Wednesday 11 February 2026 00:47:09 +0000 (0:00:00.071) 0:01:13.242 **** 2026-02-11 00:47:10.009696 | controller-1 | ok: [controller-1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml) 2026-02-11 00:47:10.059585 | controller-1 | ok: [controller-2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml) 2026-02-11 00:47:10.059609 | controller-1 | ok: [controller-3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml) 2026-02-11 00:47:10.059618 | controller-1 | 2026-02-11 00:47:10.059622 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Install coreutils] ************************* 2026-02-11 00:47:10.059625 | controller-1 | Wednesday 11 February 2026 00:47:10 +0000 (0:00:00.098) 0:01:13.341 **** 2026-02-11 00:47:10.122945 | controller-1 | skipping: [controller-1] 2026-02-11 00:47:10.123124 | controller-1 | skipping: [controller-2] 2026-02-11 00:47:10.123275 | controller-1 | skipping: [controller-3] 2026-02-11 00:47:10.123384 | controller-1 | 2026-02-11 00:47:10.123543 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Install additional packages] *************** 2026-02-11 00:47:10.123699 | controller-1 | Wednesday 11 February 2026 00:47:10 +0000 (0:00:00.063) 0:01:13.405 **** 2026-02-11 00:47:13.428556 | controller-1 | changed: [controller-1] 2026-02-11 00:47:13.428725 | controller-1 | changed: [controller-3] 2026-02-11 00:47:13.428910 | controller-1 | changed: [controller-2] 2026-02-11 00:47:13.429039 | controller-1 | 2026-02-11 00:47:13.429180 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Configure sysctl values] ******************* 2026-02-11 00:47:13.429352 | controller-1 | Wednesday 11 February 2026 00:47:13 +0000 (0:00:03.305) 0:01:16.711 **** 2026-02-11 00:47:15.703811 | controller-1 | changed: [controller-1] => (item={'name': 'net.ipv4.ip_forward', 'value': 1}) 2026-02-11 00:47:15.707386 | controller-1 | changed: [controller-2] => (item={'name': 'net.ipv4.ip_forward', 'value': 1}) 2026-02-11 00:47:15.707396 | controller-1 | changed: [controller-3] => (item={'name': 'net.ipv4.ip_forward', 'value': 1}) 2026-02-11 00:47:15.707399 | controller-1 | changed: [controller-2] => (item={'name': 'net.bridge.bridge-nf-call-iptables', 'value': 1}) 2026-02-11 00:47:15.707403 | controller-1 | changed: [controller-1] => (item={'name': 'net.bridge.bridge-nf-call-iptables', 'value': 1}) 2026-02-11 00:47:15.707406 | controller-1 | changed: [controller-3] => (item={'name': 'net.bridge.bridge-nf-call-iptables', 'value': 1}) 2026-02-11 00:47:15.707410 | controller-1 | changed: [controller-2] => (item={'name': 'net.bridge.bridge-nf-call-ip6tables', 'value': 1}) 2026-02-11 00:47:15.707413 | controller-1 | changed: [controller-1] => (item={'name': 'net.bridge.bridge-nf-call-ip6tables', 'value': 1}) 2026-02-11 00:47:15.707416 | controller-1 | changed: [controller-3] => (item={'name': 'net.bridge.bridge-nf-call-ip6tables', 'value': 1}) 2026-02-11 00:47:15.707419 | controller-1 | changed: [controller-2] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 0}) 2026-02-11 00:47:15.707423 | controller-1 | changed: [controller-1] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 0}) 2026-02-11 00:47:15.707433 | controller-1 | changed: [controller-3] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 0}) 2026-02-11 00:47:15.707436 | controller-1 | changed: [controller-2] => (item={'name': 'fs.inotify.max_queued_events', 'value': 1048576}) 2026-02-11 00:47:15.707440 | controller-1 | changed: [controller-1] => (item={'name': 'fs.inotify.max_queued_events', 'value': 1048576}) 2026-02-11 00:47:15.707443 | controller-1 | changed: [controller-3] => (item={'name': 'fs.inotify.max_queued_events', 'value': 1048576}) 2026-02-11 00:47:15.707446 | controller-1 | changed: [controller-2] => (item={'name': 'fs.inotify.max_user_instances', 'value': 8192}) 2026-02-11 00:47:15.707450 | controller-1 | changed: [controller-1] => (item={'name': 'fs.inotify.max_user_instances', 'value': 8192}) 2026-02-11 00:47:15.707453 | controller-1 | changed: [controller-3] => (item={'name': 'fs.inotify.max_user_instances', 'value': 8192}) 2026-02-11 00:47:15.707456 | controller-1 | changed: [controller-2] => (item={'name': 'fs.inotify.max_user_watches', 'value': 1048576}) 2026-02-11 00:47:15.707460 | controller-1 | changed: [controller-1] => (item={'name': 'fs.inotify.max_user_watches', 'value': 1048576}) 2026-02-11 00:47:15.707463 | controller-1 | changed: [controller-3] => (item={'name': 'fs.inotify.max_user_watches', 'value': 1048576}) 2026-02-11 00:47:15.707466 | controller-1 | 2026-02-11 00:47:15.707470 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Create folders for kubernetes configuration] *** 2026-02-11 00:47:15.707473 | controller-1 | Wednesday 11 February 2026 00:47:15 +0000 (0:00:02.275) 0:01:18.986 **** 2026-02-11 00:47:16.665648 | controller-1 | changed: [controller-1] => (item=/etc/systemd/system/kubelet.service.d) 2026-02-11 00:47:16.669293 | controller-1 | changed: [controller-2] => (item=/etc/systemd/system/kubelet.service.d) 2026-02-11 00:47:16.669309 | controller-1 | changed: [controller-3] => (item=/etc/systemd/system/kubelet.service.d) 2026-02-11 00:47:16.669312 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes) 2026-02-11 00:47:16.669316 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes) 2026-02-11 00:47:16.669319 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes) 2026-02-11 00:47:16.669323 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests) 2026-02-11 00:47:16.669326 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests) 2026-02-11 00:47:16.669329 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests) 2026-02-11 00:47:16.669333 | controller-1 | 2026-02-11 00:47:16.669337 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Add kubelet systemd service config] ******** 2026-02-11 00:47:16.669454 | controller-1 | Wednesday 11 February 2026 00:47:16 +0000 (0:00:00.961) 0:01:19.948 **** 2026-02-11 00:47:17.428160 | controller-1 | changed: [controller-2] 2026-02-11 00:47:17.428342 | controller-1 | changed: [controller-1] 2026-02-11 00:47:17.428497 | controller-1 | changed: [controller-3] 2026-02-11 00:47:17.428635 | controller-1 | 2026-02-11 00:47:17.429039 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Add kubeadm dropin for kubelet systemd service config] *** 2026-02-11 00:47:17.429480 | controller-1 | Wednesday 11 February 2026 00:47:17 +0000 (0:00:00.762) 0:01:20.710 **** 2026-02-11 00:47:18.173048 | controller-1 | changed: [controller-2] 2026-02-11 00:47:18.176369 | controller-1 | changed: [controller-1] 2026-02-11 00:47:18.176379 | controller-1 | changed: [controller-3] 2026-02-11 00:47:18.176384 | controller-1 | 2026-02-11 00:47:18.176388 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Check swap status] ************************* 2026-02-11 00:47:18.176391 | controller-1 | Wednesday 11 February 2026 00:47:18 +0000 (0:00:00.744) 0:01:21.455 **** 2026-02-11 00:47:18.659124 | controller-1 | ok: [controller-2] 2026-02-11 00:47:18.661770 | controller-1 | ok: [controller-1] 2026-02-11 00:47:18.661780 | controller-1 | ok: [controller-3] 2026-02-11 00:47:18.661785 | controller-1 | 2026-02-11 00:47:18.661789 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Disable swap] ****************************** 2026-02-11 00:47:18.661792 | controller-1 | Wednesday 11 February 2026 00:47:18 +0000 (0:00:00.486) 0:01:21.941 **** 2026-02-11 00:47:18.699137 | controller-1 | [ERROR]: Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result. 2026-02-11 00:47:18.699202 | controller-1 | 2026-02-11 00:47:18.699305 | controller-1 | Task failed. 2026-02-11 00:47:18.699405 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:78:7 2026-02-11 00:47:18.699498 | controller-1 | 2026-02-11 00:47:18.699614 | controller-1 | 76 register: kubelet_swapon 2026-02-11 00:47:18.699718 | controller-1 | 77 2026-02-11 00:47:18.699806 | controller-1 | 78 - name: Disable swap 2026-02-11 00:47:18.699920 | controller-1 | ^ column 7 2026-02-11 00:47:18.700005 | controller-1 | 2026-02-11 00:47:18.700103 | controller-1 | <<< caused by >>> 2026-02-11 00:47:18.700191 | controller-1 | 2026-02-11 00:47:18.700313 | controller-1 | Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result. 2026-02-11 00:47:18.700413 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11 2026-02-11 00:47:18.700500 | controller-1 | 2026-02-11 00:47:18.700600 | controller-1 | 81 ignore_errors: "{{ ansible_check_mode }}" 2026-02-11 00:47:18.700717 | controller-1 | 82 when: 2026-02-11 00:47:18.700814 | controller-1 | 83 - kubelet_swapon.stdout 2026-02-11 00:47:18.700896 | controller-1 | ^ column 11 2026-02-11 00:47:18.700977 | controller-1 | 2026-02-11 00:47:18.701073 | controller-1 | Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option. 2026-02-11 00:47:18.701158 | controller-1 | 2026-02-11 00:47:18.702521 | controller-1 | fatal: [controller-1]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result."} 2026-02-11 00:47:18.702692 | controller-1 | fatal: [controller-2]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result."} 2026-02-11 00:47:18.712861 | controller-1 | fatal: [controller-3]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result."} 2026-02-11 00:47:18.723568 | controller-1 | ...ignoring 2026-02-11 00:47:18.723702 | controller-1 | ...ignoring 2026-02-11 00:47:18.723819 | controller-1 | ...ignoring 2026-02-11 00:47:18.723935 | controller-1 | 2026-02-11 00:47:18.724081 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Remove swapfile from /etc/fstab] *********** 2026-02-11 00:47:18.724204 | controller-1 | Wednesday 11 February 2026 00:47:18 +0000 (0:00:00.064) 0:01:22.006 **** 2026-02-11 00:47:19.556195 | controller-1 | ok: [controller-1] => (item=swap) 2026-02-11 00:47:19.556315 | controller-1 | ok: [controller-2] => (item=swap) 2026-02-11 00:47:19.557130 | controller-1 | ok: [controller-3] => (item=swap) 2026-02-11 00:47:19.557155 | controller-1 | ok: [controller-1] => (item=none) 2026-02-11 00:47:19.557159 | controller-1 | ok: [controller-2] => (item=none) 2026-02-11 00:47:19.557162 | controller-1 | ok: [controller-3] => (item=none) 2026-02-11 00:47:19.557165 | controller-1 | 2026-02-11 00:47:19.557169 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Create noswap systemd service config file] *** 2026-02-11 00:47:19.557173 | controller-1 | Wednesday 11 February 2026 00:47:19 +0000 (0:00:00.832) 0:01:22.838 **** 2026-02-11 00:47:20.330312 | controller-1 | changed: [controller-1] 2026-02-11 00:47:20.330350 | controller-1 | changed: [controller-3] 2026-02-11 00:47:20.330355 | controller-1 | changed: [controller-2] 2026-02-11 00:47:20.330359 | controller-1 | 2026-02-11 00:47:20.330364 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Enable noswap service] ********************* 2026-02-11 00:47:20.330368 | controller-1 | Wednesday 11 February 2026 00:47:20 +0000 (0:00:00.770) 0:01:23.608 **** 2026-02-11 00:47:22.154937 | controller-1 | changed: [controller-3] 2026-02-11 00:47:22.154970 | controller-1 | changed: [controller-1] 2026-02-11 00:47:22.154976 | controller-1 | changed: [controller-2] 2026-02-11 00:47:22.154981 | controller-1 | 2026-02-11 00:47:22.154986 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Force any restarts if necessary] *********** 2026-02-11 00:47:22.154991 | controller-1 | Wednesday 11 February 2026 00:47:22 +0000 (0:00:01.802) 0:01:25.411 **** 2026-02-11 00:47:22.154996 | controller-1 | 2026-02-11 00:47:22.155001 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Force any restarts if necessary] *********** 2026-02-11 00:47:22.155005 | controller-1 | Wednesday 11 February 2026 00:47:22 +0000 (0:00:00.008) 0:01:25.420 **** 2026-02-11 00:47:22.155010 | controller-1 | 2026-02-11 00:47:22.155014 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Force any restarts if necessary] *********** 2026-02-11 00:47:22.155018 | controller-1 | Wednesday 11 February 2026 00:47:22 +0000 (0:00:00.007) 0:01:25.427 **** 2026-02-11 00:47:22.155022 | controller-1 | 2026-02-11 00:47:22.155027 | controller-1 | RUNNING HANDLER [vexxhost.kubernetes.kubelet : Reload systemd] ***************** 2026-02-11 00:47:22.155031 | controller-1 | Wednesday 11 February 2026 00:47:22 +0000 (0:00:00.007) 0:01:25.435 **** 2026-02-11 00:47:23.758422 | controller-1 | ok: [controller-2] 2026-02-11 00:47:23.758737 | controller-1 | ok: [controller-1] 2026-02-11 00:47:23.758999 | controller-1 | ok: [controller-3] 2026-02-11 00:47:23.759242 | controller-1 | 2026-02-11 00:47:23.759508 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Enable and start kubelet service] ********** 2026-02-11 00:47:23.759764 | controller-1 | Wednesday 11 February 2026 00:47:23 +0000 (0:00:01.604) 0:01:27.039 **** 2026-02-11 00:47:24.697865 | controller-1 | changed: [controller-2] 2026-02-11 00:47:24.697887 | controller-1 | changed: [controller-1] 2026-02-11 00:47:24.697891 | controller-1 | changed: [controller-3] 2026-02-11 00:47:24.697895 | controller-1 | 2026-02-11 00:47:24.697899 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Ensure availability of dbus on Debian] ***** 2026-02-11 00:47:24.697903 | controller-1 | Wednesday 11 February 2026 00:47:24 +0000 (0:00:00.936) 0:01:27.976 **** 2026-02-11 00:47:25.720433 | controller-1 | ok: [controller-2] 2026-02-11 00:47:25.720631 | controller-1 | ok: [controller-1] 2026-02-11 00:47:25.720808 | controller-1 | ok: [controller-3] 2026-02-11 00:47:25.720967 | controller-1 | 2026-02-11 00:47:25.721143 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Configure short hostname] ****************** 2026-02-11 00:47:25.721342 | controller-1 | Wednesday 11 February 2026 00:47:25 +0000 (0:00:01.025) 0:01:29.002 **** 2026-02-11 00:47:26.917140 | controller-1 | changed: [controller-2] 2026-02-11 00:47:26.917373 | controller-1 | changed: [controller-3] 2026-02-11 00:47:26.917653 | controller-1 | changed: [controller-1] 2026-02-11 00:47:26.917832 | controller-1 | 2026-02-11 00:47:26.918008 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Ensure hostname inside hosts file] ********* 2026-02-11 00:47:26.918237 | controller-1 | Wednesday 11 February 2026 00:47:26 +0000 (0:00:01.196) 0:01:30.199 **** 2026-02-11 00:47:27.414050 | controller-1 | changed: [controller-3] 2026-02-11 00:47:27.414073 | controller-1 | changed: [controller-2] 2026-02-11 00:47:27.414077 | controller-1 | changed: [controller-1] 2026-02-11 00:47:27.414081 | controller-1 | 2026-02-11 00:47:27.414085 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Remove kubernetes repository] *********** 2026-02-11 00:47:27.414089 | controller-1 | Wednesday 11 February 2026 00:47:27 +0000 (0:00:00.494) 0:01:30.693 **** 2026-02-11 00:47:27.982623 | controller-1 | ok: [controller-2] 2026-02-11 00:47:27.982853 | controller-1 | ok: [controller-1] 2026-02-11 00:47:27.983035 | controller-1 | ok: [controller-3] 2026-02-11 00:47:27.983210 | controller-1 | 2026-02-11 00:47:27.983399 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Setup control plane] ******************** 2026-02-11 00:47:27.983572 | controller-1 | Wednesday 11 February 2026 00:47:27 +0000 (0:00:00.571) 0:01:31.265 **** 2026-02-11 00:47:28.117578 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/control-plane.yml for controller-1, controller-2, controller-3 2026-02-11 00:47:28.117890 | controller-1 | 2026-02-11 00:47:28.118186 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Bootstrap cluster] ********************** 2026-02-11 00:47:28.118488 | controller-1 | Wednesday 11 February 2026 00:47:28 +0000 (0:00:00.134) 0:01:31.399 **** 2026-02-11 00:47:28.249326 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/bootstrap-cluster.yml for controller-1, controller-2, controller-3 2026-02-11 00:47:28.249637 | controller-1 | 2026-02-11 00:47:28.249915 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Check if any control plane is bootstrapped] *** 2026-02-11 00:47:28.250189 | controller-1 | Wednesday 11 February 2026 00:47:28 +0000 (0:00:00.131) 0:01:31.531 **** 2026-02-11 00:47:29.490601 | controller-1 | ok: [controller-1] => (item=controller-1) 2026-02-11 00:47:29.490624 | controller-1 | ok: [controller-3 -> controller-1(199.204.45.210)] => (item=controller-1) 2026-02-11 00:47:29.490629 | controller-1 | ok: [controller-2 -> controller-1(199.204.45.210)] => (item=controller-1) 2026-02-11 00:47:29.490634 | controller-1 | ok: [controller-1 -> controller-2(199.204.45.129)] => (item=controller-2) 2026-02-11 00:47:29.490638 | controller-1 | ok: [controller-3 -> controller-2(199.204.45.129)] => (item=controller-2) 2026-02-11 00:47:29.490643 | controller-1 | ok: [controller-2] => (item=controller-2) 2026-02-11 00:47:29.490647 | controller-1 | ok: [controller-1 -> controller-3(199.204.45.49)] => (item=controller-3) 2026-02-11 00:47:29.490652 | controller-1 | ok: [controller-3] => (item=controller-3) 2026-02-11 00:47:29.490656 | controller-1 | ok: [controller-2 -> controller-3(199.204.45.49)] => (item=controller-3) 2026-02-11 00:47:29.490660 | controller-1 | 2026-02-11 00:47:29.490665 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Pick node from pre-existing cluster] **** 2026-02-11 00:47:29.490669 | controller-1 | Wednesday 11 February 2026 00:47:29 +0000 (0:00:01.238) 0:01:32.769 **** 2026-02-11 00:47:29.570102 | controller-1 | skipping: [controller-1] 2026-02-11 00:47:29.570125 | controller-1 | skipping: [controller-2] 2026-02-11 00:47:29.570129 | controller-1 | skipping: [controller-3] 2026-02-11 00:47:29.570133 | controller-1 | 2026-02-11 00:47:29.570137 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Select first node to initialize cluster] *** 2026-02-11 00:47:29.570141 | controller-1 | Wednesday 11 February 2026 00:47:29 +0000 (0:00:00.079) 0:01:32.849 **** 2026-02-11 00:47:29.656733 | controller-1 | ok: [controller-1] 2026-02-11 00:47:29.657858 | controller-1 | ok: [controller-2] 2026-02-11 00:47:29.658168 | controller-1 | ok: [controller-3] 2026-02-11 00:47:29.658438 | controller-1 | 2026-02-11 00:47:29.658705 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Print selected bootstrap node] ********** 2026-02-11 00:47:29.658995 | controller-1 | Wednesday 11 February 2026 00:47:29 +0000 (0:00:00.090) 0:01:32.939 **** 2026-02-11 00:47:29.742596 | controller-1 | ok: [controller-1] => { 2026-02-11 00:47:29.742618 | controller-1 | "msg": "controller-1" 2026-02-11 00:47:29.742622 | controller-1 | } 2026-02-11 00:47:29.742626 | controller-1 | ok: [controller-2] => { 2026-02-11 00:47:29.742629 | controller-1 | "msg": "controller-1" 2026-02-11 00:47:29.742632 | controller-1 | } 2026-02-11 00:47:29.742636 | controller-1 | ok: [controller-3] => { 2026-02-11 00:47:29.742639 | controller-1 | "msg": "controller-1" 2026-02-11 00:47:29.742642 | controller-1 | } 2026-02-11 00:47:29.742645 | controller-1 | 2026-02-11 00:47:29.742649 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Upload cluster configuration for bootstrap node] *** 2026-02-11 00:47:29.742653 | controller-1 | Wednesday 11 February 2026 00:47:29 +0000 (0:00:00.081) 0:01:33.020 **** 2026-02-11 00:47:30.434414 | controller-1 | skipping: [controller-2] 2026-02-11 00:47:30.434440 | controller-1 | skipping: [controller-3] 2026-02-11 00:47:30.434446 | controller-1 | changed: [controller-1] 2026-02-11 00:47:30.434452 | controller-1 | 2026-02-11 00:47:30.434464 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create pki folder] ********************** 2026-02-11 00:47:30.434469 | controller-1 | Wednesday 11 February 2026 00:47:30 +0000 (0:00:00.692) 0:01:33.712 **** 2026-02-11 00:47:30.502587 | controller-1 | skipping: [controller-1] 2026-02-11 00:47:30.502975 | controller-1 | skipping: [controller-2] 2026-02-11 00:47:30.503292 | controller-1 | skipping: [controller-3] 2026-02-11 00:47:30.503580 | controller-1 | 2026-02-11 00:47:30.503942 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create kubernetes ca key] *************** 2026-02-11 00:47:30.504296 | controller-1 | Wednesday 11 February 2026 00:47:30 +0000 (0:00:00.070) 0:01:33.783 **** 2026-02-11 00:47:30.572493 | controller-1 | skipping: [controller-1] 2026-02-11 00:47:30.572599 | controller-1 | skipping: [controller-2] 2026-02-11 00:47:30.572690 | controller-1 | skipping: [controller-3] 2026-02-11 00:47:30.572804 | controller-1 | 2026-02-11 00:47:30.572927 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create kubernetes ca cert] ************** 2026-02-11 00:47:30.573021 | controller-1 | Wednesday 11 February 2026 00:47:30 +0000 (0:00:00.068) 0:01:33.852 **** 2026-02-11 00:47:30.606988 | controller-1 | skipping: [controller-1] 2026-02-11 00:47:30.637688 | controller-1 | skipping: [controller-2] 2026-02-11 00:47:30.637790 | controller-1 | skipping: [controller-3] 2026-02-11 00:47:30.638146 | controller-1 | 2026-02-11 00:47:30.638233 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create etcd-ca key] ********************* 2026-02-11 00:47:30.638238 | controller-1 | Wednesday 11 February 2026 00:47:30 +0000 (0:00:00.067) 0:01:33.920 **** 2026-02-11 00:47:30.673609 | controller-1 | skipping: [controller-1] 2026-02-11 00:47:30.698836 | controller-1 | skipping: [controller-2] 2026-02-11 00:47:30.698852 | controller-1 | skipping: [controller-3] 2026-02-11 00:47:30.698856 | controller-1 | 2026-02-11 00:47:30.698860 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create etcd-ca cert] ******************** 2026-02-11 00:47:30.698870 | controller-1 | Wednesday 11 February 2026 00:47:30 +0000 (0:00:00.060) 0:01:33.980 **** 2026-02-11 00:47:30.756578 | controller-1 | skipping: [controller-1] 2026-02-11 00:47:30.756602 | controller-1 | skipping: [controller-2] 2026-02-11 00:47:30.756606 | controller-1 | skipping: [controller-3] 2026-02-11 00:47:30.756609 | controller-1 | 2026-02-11 00:47:30.756613 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create front-proxy-ca key] ************** 2026-02-11 00:47:30.756617 | controller-1 | Wednesday 11 February 2026 00:47:30 +0000 (0:00:00.054) 0:01:34.035 **** 2026-02-11 00:47:30.784889 | controller-1 | skipping: [controller-1] 2026-02-11 00:47:30.814002 | controller-1 | skipping: [controller-2] 2026-02-11 00:47:30.814195 | controller-1 | skipping: [controller-3] 2026-02-11 00:47:30.817521 | controller-1 | 2026-02-11 00:47:30.817532 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create front-proxy-ca cert] ************* 2026-02-11 00:47:30.817536 | controller-1 | Wednesday 11 February 2026 00:47:30 +0000 (0:00:00.060) 0:01:34.096 **** 2026-02-11 00:47:30.876511 | controller-1 | skipping: [controller-1] 2026-02-11 00:47:30.876655 | controller-1 | skipping: [controller-2] 2026-02-11 00:47:30.876773 | controller-1 | skipping: [controller-3] 2026-02-11 00:47:30.876881 | controller-1 | 2026-02-11 00:47:30.877000 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Initialize cluster] ********************* 2026-02-11 00:47:30.877126 | controller-1 | Wednesday 11 February 2026 00:47:30 +0000 (0:00:00.062) 0:01:34.159 **** 2026-02-11 00:48:06.612356 | controller-1 | changed: [controller-1] 2026-02-11 00:48:06.646037 | controller-1 | skipping: [controller-2] 2026-02-11 00:48:06.646286 | controller-1 | skipping: [controller-3] 2026-02-11 00:48:06.646466 | controller-1 | 2026-02-11 00:48:06.646670 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Check if the node is already part of the cluster] *** 2026-02-11 00:48:06.646862 | controller-1 | Wednesday 11 February 2026 00:48:06 +0000 (0:00:35.767) 0:02:09.926 **** 2026-02-11 00:48:07.044304 | controller-1 | ok: [controller-1] 2026-02-11 00:48:07.044502 | controller-1 | ok: [controller-2] 2026-02-11 00:48:07.044701 | controller-1 | ok: [controller-3] 2026-02-11 00:48:07.045019 | controller-1 | 2026-02-11 00:48:07.045361 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Join cluster] *************************** 2026-02-11 00:48:07.045497 | controller-1 | Wednesday 11 February 2026 00:48:07 +0000 (0:00:00.399) 0:02:10.325 **** 2026-02-11 00:48:07.087477 | controller-1 | skipping: [controller-1] 2026-02-11 00:48:07.159657 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/join-cluster.yml for controller-2, controller-3 2026-02-11 00:48:07.160410 | controller-1 | 2026-02-11 00:48:07.161226 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Generate control-plane certificates for joining cluster] *** 2026-02-11 00:48:07.161885 | controller-1 | Wednesday 11 February 2026 00:48:07 +0000 (0:00:00.115) 0:02:10.440 **** 2026-02-11 00:48:07.992763 | controller-1 | ok: [controller-2 -> controller-1(199.204.45.210)] 2026-02-11 00:48:07.992921 | controller-1 | 2026-02-11 00:48:07.993067 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Retrieve SHA256 certificate hash] ******* 2026-02-11 00:48:07.993205 | controller-1 | Wednesday 11 February 2026 00:48:07 +0000 (0:00:00.834) 0:02:11.275 **** 2026-02-11 00:48:08.604831 | controller-1 | ok: [controller-2 -> controller-1(199.204.45.210)] 2026-02-11 00:48:08.604855 | controller-1 | 2026-02-11 00:48:08.604859 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Generate token for joining cluster] ***** 2026-02-11 00:48:08.604863 | controller-1 | Wednesday 11 February 2026 00:48:08 +0000 (0:00:00.609) 0:02:11.884 **** 2026-02-11 00:48:09.021693 | controller-1 | changed: [controller-2 -> controller-1(199.204.45.210)] 2026-02-11 00:48:09.021975 | controller-1 | 2026-02-11 00:48:09.022228 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Upload kubeadm configuration] *********** 2026-02-11 00:48:09.023232 | controller-1 | Wednesday 11 February 2026 00:48:09 +0000 (0:00:00.417) 0:02:12.302 **** 2026-02-11 00:48:09.747842 | controller-1 | changed: [controller-2] 2026-02-11 00:48:09.748085 | controller-1 | changed: [controller-3] 2026-02-11 00:48:09.748284 | controller-1 | 2026-02-11 00:48:09.748493 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Join cluster] *************************** 2026-02-11 00:48:09.748739 | controller-1 | Wednesday 11 February 2026 00:48:09 +0000 (0:00:00.727) 0:02:13.029 **** 2026-02-11 00:49:37.373865 | controller-1 | changed: [controller-2] 2026-02-11 00:49:37.374268 | controller-1 | changed: [controller-3] 2026-02-11 00:49:37.374346 | controller-1 | 2026-02-11 00:49:37.374878 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create folder for admin configuration] *** 2026-02-11 00:49:37.374982 | controller-1 | Wednesday 11 February 2026 00:49:37 +0000 (0:01:27.626) 0:03:40.655 **** 2026-02-11 00:49:37.874491 | controller-1 | changed: [controller-3] 2026-02-11 00:49:37.875332 | controller-1 | changed: [controller-2] 2026-02-11 00:49:37.875624 | controller-1 | changed: [controller-1] 2026-02-11 00:49:37.875934 | controller-1 | 2026-02-11 00:49:37.876272 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Creating a symlink for admin configuration file] *** 2026-02-11 00:49:37.876592 | controller-1 | Wednesday 11 February 2026 00:49:37 +0000 (0:00:00.498) 0:03:41.154 **** 2026-02-11 00:49:38.415767 | controller-1 | changed: [controller-1] 2026-02-11 00:49:38.415804 | controller-1 | changed: [controller-3] 2026-02-11 00:49:38.415813 | controller-1 | changed: [controller-2] 2026-02-11 00:49:38.415821 | controller-1 | 2026-02-11 00:49:38.415830 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Add bash autocomplete for kubectl] ****** 2026-02-11 00:49:38.415838 | controller-1 | Wednesday 11 February 2026 00:49:38 +0000 (0:00:00.542) 0:03:41.697 **** 2026-02-11 00:49:38.827227 | controller-1 | changed: [controller-1] 2026-02-11 00:49:38.828768 | controller-1 | changed: [controller-2] 2026-02-11 00:49:38.828779 | controller-1 | changed: [controller-3] 2026-02-11 00:49:38.828783 | controller-1 | 2026-02-11 00:49:38.828792 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Install PIP] **************************** 2026-02-11 00:49:38.828796 | controller-1 | Wednesday 11 February 2026 00:49:38 +0000 (0:00:00.412) 0:03:42.109 **** 2026-02-11 00:49:38.918091 | controller-1 | skipping: [controller-1] 2026-02-11 00:49:38.918134 | controller-1 | skipping: [controller-2] 2026-02-11 00:49:38.918151 | controller-1 | skipping: [controller-3] 2026-02-11 00:49:38.918574 | controller-1 | 2026-02-11 00:49:38.918596 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Install Kubernetes Python package using pip on supported systems] *** 2026-02-11 00:49:38.918715 | controller-1 | Wednesday 11 February 2026 00:49:38 +0000 (0:00:00.090) 0:03:42.200 **** 2026-02-11 00:49:38.959041 | controller-1 | skipping: [controller-1] 2026-02-11 00:49:38.992502 | controller-1 | skipping: [controller-2] 2026-02-11 00:49:38.992621 | controller-1 | skipping: [controller-3] 2026-02-11 00:49:38.992780 | controller-1 | 2026-02-11 00:49:38.992950 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Enable EPEL repository] ***************** 2026-02-11 00:49:38.993079 | controller-1 | Wednesday 11 February 2026 00:49:38 +0000 (0:00:00.074) 0:03:42.274 **** 2026-02-11 00:49:39.077326 | controller-1 | skipping: [controller-1] 2026-02-11 00:49:39.079874 | controller-1 | skipping: [controller-2] 2026-02-11 00:49:39.079884 | controller-1 | skipping: [controller-3] 2026-02-11 00:49:39.079888 | controller-1 | 2026-02-11 00:49:39.079892 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Install Kubernetes Python package using package manager on supported systems] *** 2026-02-11 00:49:39.079896 | controller-1 | Wednesday 11 February 2026 00:49:39 +0000 (0:00:00.084) 0:03:42.359 **** 2026-02-11 00:49:50.578614 | controller-1 | changed: [controller-2] 2026-02-11 00:49:50.578645 | controller-1 | changed: [controller-3] 2026-02-11 00:49:50.581440 | controller-1 | changed: [controller-1] 2026-02-11 00:49:50.581603 | controller-1 | 2026-02-11 00:49:50.581738 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Allow workload on control plane node] *** 2026-02-11 00:49:50.581861 | controller-1 | Wednesday 11 February 2026 00:49:50 +0000 (0:00:11.500) 0:03:53.859 **** 2026-02-11 00:49:51.705783 | controller-1 | changed: [controller-3] 2026-02-11 00:49:51.706153 | controller-1 | changed: [controller-2] 2026-02-11 00:49:51.706424 | controller-1 | changed: [controller-1] 2026-02-11 00:49:51.706690 | controller-1 | 2026-02-11 00:49:51.706965 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Remove kube-proxy resources] ************ 2026-02-11 00:49:51.707280 | controller-1 | Wednesday 11 February 2026 00:49:51 +0000 (0:00:01.126) 0:03:54.986 **** 2026-02-11 00:49:51.743925 | controller-1 | skipping: [controller-1] => (item=DaemonSet) 2026-02-11 00:49:51.744140 | controller-1 | skipping: [controller-1] => (item=ConfigMap) 2026-02-11 00:49:51.744308 | controller-1 | skipping: [controller-1] 2026-02-11 00:49:51.744596 | controller-1 | 2026-02-11 00:49:51.745299 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Start an upgrade] *********************** 2026-02-11 00:49:51.746431 | controller-1 | Wednesday 11 February 2026 00:49:51 +0000 (0:00:00.039) 0:03:55.026 **** 2026-02-11 00:49:51.782172 | controller-1 | skipping: [controller-1] 2026-02-11 00:49:51.784354 | controller-1 | 2026-02-11 00:49:51.784367 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Check if the Kubernetes API services is up to date] *** 2026-02-11 00:49:51.784373 | controller-1 | Wednesday 11 February 2026 00:49:51 +0000 (0:00:00.037) 0:03:55.063 **** 2026-02-11 00:49:51.869236 | controller-1 | skipping: [controller-1] 2026-02-11 00:49:51.869459 | controller-1 | skipping: [controller-2] 2026-02-11 00:49:51.871850 | controller-1 | skipping: [controller-3] 2026-02-11 00:49:51.871860 | controller-1 | 2026-02-11 00:49:51.871864 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Trigger an upgrade of the Kubernetes API services] *** 2026-02-11 00:49:51.871868 | controller-1 | Wednesday 11 February 2026 00:49:51 +0000 (0:00:00.087) 0:03:55.151 **** 2026-02-11 00:49:51.922083 | controller-1 | skipping: [controller-1] 2026-02-11 00:49:51.961443 | controller-1 | skipping: [controller-2] 2026-02-11 00:49:51.965646 | controller-1 | skipping: [controller-3] 2026-02-11 00:49:51.965661 | controller-1 | 2026-02-11 00:49:51.965666 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Setup nodes] **************************** 2026-02-11 00:49:51.965670 | controller-1 | Wednesday 11 February 2026 00:49:51 +0000 (0:00:00.092) 0:03:55.243 **** 2026-02-11 00:49:52.044250 | controller-1 | skipping: [controller-1] 2026-02-11 00:49:52.044668 | controller-1 | skipping: [controller-2] 2026-02-11 00:49:52.044850 | controller-1 | skipping: [controller-3] 2026-02-11 00:49:52.045021 | controller-1 | 2026-02-11 00:49:52.045198 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Upgrade & restart Kubelet node for upgrade (if needed)] *** 2026-02-11 00:49:52.045410 | controller-1 | Wednesday 11 February 2026 00:49:52 +0000 (0:00:00.083) 0:03:55.326 **** 2026-02-11 00:49:53.049439 | controller-1 | ok: [controller-1] 2026-02-11 00:49:53.463584 | controller-1 | ok: [controller-2] 2026-02-11 00:49:53.465445 | controller-1 | ok: [controller-3] 2026-02-11 00:49:53.465499 | controller-1 | 2026-02-11 00:49:53.465517 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Set node selector for CoreDNS components] *** 2026-02-11 00:49:53.468085 | controller-1 | Wednesday 11 February 2026 00:49:53 +0000 (0:00:01.419) 0:03:56.745 **** 2026-02-11 00:49:54.583582 | controller-1 | changed: [controller-1] 2026-02-11 00:49:54.583637 | controller-1 | 2026-02-11 00:49:54.585170 | controller-1 | PLAY [Install control-plane components] **************************************** 2026-02-11 00:49:54.585194 | controller-1 | 2026-02-11 00:49:54.585203 | controller-1 | TASK [Gathering Facts] ********************************************************* 2026-02-11 00:49:54.585211 | controller-1 | Wednesday 11 February 2026 00:49:54 +0000 (0:00:01.120) 0:03:57.866 **** 2026-02-11 00:49:55.501661 | controller-1 | ok: [controller-2] 2026-02-11 00:49:55.504052 | controller-1 | ok: [controller-1] 2026-02-11 00:49:55.504296 | controller-1 | ok: [controller-3] 2026-02-11 00:49:55.505347 | controller-1 | 2026-02-11 00:49:55.505397 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-02-11 00:49:55.505401 | controller-1 | Wednesday 11 February 2026 00:49:55 +0000 (0:00:00.917) 0:03:58.783 **** 2026-02-11 00:49:55.895568 | controller-1 | ok: [controller-2] 2026-02-11 00:49:55.895599 | controller-1 | ok: [controller-1] 2026-02-11 00:49:55.895605 | controller-1 | ok: [controller-3] 2026-02-11 00:49:55.895774 | controller-1 | 2026-02-11 00:49:55.896049 | controller-1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-02-11 00:49:55.896319 | controller-1 | Wednesday 11 February 2026 00:49:55 +0000 (0:00:00.393) 0:03:59.177 **** 2026-02-11 00:49:57.081927 | controller-1 | ok: [controller-2] 2026-02-11 00:49:57.082001 | controller-1 | ok: [controller-3] 2026-02-11 00:49:57.082089 | controller-1 | ok: [controller-1] 2026-02-11 00:49:57.082174 | controller-1 | 2026-02-11 00:49:57.082278 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-02-11 00:49:57.082372 | controller-1 | Wednesday 11 February 2026 00:49:57 +0000 (0:00:01.184) 0:04:00.361 **** 2026-02-11 00:49:57.490447 | controller-1 | ok: [controller-2] 2026-02-11 00:49:57.490646 | controller-1 | ok: [controller-1] 2026-02-11 00:49:57.490854 | controller-1 | ok: [controller-3] 2026-02-11 00:49:57.491042 | controller-1 | 2026-02-11 00:49:57.491326 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-02-11 00:49:57.491541 | controller-1 | Wednesday 11 February 2026 00:49:57 +0000 (0:00:00.410) 0:04:00.772 **** 2026-02-11 00:49:57.585684 | controller-1 | ok: [controller-1] => { 2026-02-11 00:49:57.585835 | controller-1 | "msg": "https://get.helm.sh/helm-v3.11.2-linux-amd64.tar.gz" 2026-02-11 00:49:57.585993 | controller-1 | } 2026-02-11 00:49:57.586148 | controller-1 | ok: [controller-2] => { 2026-02-11 00:49:57.586268 | controller-1 | "msg": "https://get.helm.sh/helm-v3.11.2-linux-amd64.tar.gz" 2026-02-11 00:49:57.586390 | controller-1 | } 2026-02-11 00:49:57.586504 | controller-1 | ok: [controller-3] => { 2026-02-11 00:49:57.586617 | controller-1 | "msg": "https://get.helm.sh/helm-v3.11.2-linux-amd64.tar.gz" 2026-02-11 00:49:57.586722 | controller-1 | } 2026-02-11 00:49:57.586823 | controller-1 | 2026-02-11 00:49:57.586941 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-02-11 00:49:57.587074 | controller-1 | Wednesday 11 February 2026 00:49:57 +0000 (0:00:00.091) 0:04:00.863 **** 2026-02-11 00:49:58.452847 | controller-1 | changed: [controller-2] 2026-02-11 00:49:58.453051 | controller-1 | changed: [controller-3] 2026-02-11 00:49:58.453219 | controller-1 | changed: [controller-1] 2026-02-11 00:49:58.453405 | controller-1 | 2026-02-11 00:49:58.453580 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-02-11 00:49:58.453749 | controller-1 | Wednesday 11 February 2026 00:49:58 +0000 (0:00:00.871) 0:04:01.734 **** 2026-02-11 00:50:01.384342 | controller-1 | changed: [controller-2] 2026-02-11 00:50:01.384502 | controller-1 | changed: [controller-1] 2026-02-11 00:50:01.384629 | controller-1 | changed: [controller-3] 2026-02-11 00:50:01.384747 | controller-1 | 2026-02-11 00:50:01.384886 | controller-1 | TASK [vexxhost.kubernetes.helm : Remove Helm repository] *********************** 2026-02-11 00:50:01.385009 | controller-1 | Wednesday 11 February 2026 00:50:01 +0000 (0:00:02.930) 0:04:04.664 **** 2026-02-11 00:50:01.917815 | controller-1 | ok: [controller-2] 2026-02-11 00:50:01.917906 | controller-1 | ok: [controller-3] 2026-02-11 00:50:01.918075 | controller-1 | ok: [controller-1] 2026-02-11 00:50:01.918183 | controller-1 | 2026-02-11 00:50:01.918299 | controller-1 | TASK [vexxhost.kubernetes.helm : Add bash autocomplete for helm] *************** 2026-02-11 00:50:01.918528 | controller-1 | Wednesday 11 February 2026 00:50:01 +0000 (0:00:00.533) 0:04:05.198 **** 2026-02-11 00:50:02.313040 | controller-1 | changed: [controller-2] 2026-02-11 00:50:02.313865 | controller-1 | changed: [controller-1] 2026-02-11 00:50:02.313896 | controller-1 | changed: [controller-3] 2026-02-11 00:50:02.313903 | controller-1 | 2026-02-11 00:50:02.313908 | controller-1 | TASK [vexxhost.kubernetes.helm : Get Helm plugins dir] ************************* 2026-02-11 00:50:02.313914 | controller-1 | Wednesday 11 February 2026 00:50:02 +0000 (0:00:00.396) 0:04:05.595 **** 2026-02-11 00:50:02.786962 | controller-1 | ok: [controller-3] 2026-02-11 00:50:02.786996 | controller-1 | ok: [controller-2] 2026-02-11 00:50:02.787002 | controller-1 | ok: [controller-1] 2026-02-11 00:50:02.787007 | controller-1 | 2026-02-11 00:50:02.787013 | controller-1 | TASK [vexxhost.kubernetes.helm : Create Helm plugins directory if it does not exist] *** 2026-02-11 00:50:02.787018 | controller-1 | Wednesday 11 February 2026 00:50:02 +0000 (0:00:00.471) 0:04:06.066 **** 2026-02-11 00:50:03.211229 | controller-1 | changed: [controller-1] 2026-02-11 00:50:03.211533 | controller-1 | changed: [controller-2] 2026-02-11 00:50:03.211713 | controller-1 | changed: [controller-3] 2026-02-11 00:50:03.211874 | controller-1 | 2026-02-11 00:50:03.212071 | controller-1 | TASK [vexxhost.kubernetes.helm : Remove Helm diff plugin installed by kubernetes.core.helm_plugin] *** 2026-02-11 00:50:03.212258 | controller-1 | Wednesday 11 February 2026 00:50:03 +0000 (0:00:00.426) 0:04:06.493 **** 2026-02-11 00:50:03.675983 | controller-1 | ok: [controller-1] 2026-02-11 00:50:03.676294 | controller-1 | ok: [controller-2] 2026-02-11 00:50:03.676549 | controller-1 | ok: [controller-3] 2026-02-11 00:50:03.676792 | controller-1 | 2026-02-11 00:50:03.677040 | controller-1 | TASK [Install plugin] ********************************************************** 2026-02-11 00:50:03.677315 | controller-1 | Wednesday 11 February 2026 00:50:03 +0000 (0:00:00.464) 0:04:06.957 **** 2026-02-11 00:50:03.767996 | controller-1 | included: vexxhost.containers.download_artifact for controller-1, controller-2, controller-3 2026-02-11 00:50:03.768312 | controller-1 | 2026-02-11 00:50:03.768637 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-02-11 00:50:03.768923 | controller-1 | Wednesday 11 February 2026 00:50:03 +0000 (0:00:00.092) 0:04:07.050 **** 2026-02-11 00:50:03.841336 | controller-1 | ok: [controller-3] => { 2026-02-11 00:50:03.841370 | controller-1 | "msg": "https://github.com/databus23/helm-diff/releases/download/v3.8.1/helm-diff-linux-amd64.tgz" 2026-02-11 00:50:03.841865 | controller-1 | } 2026-02-11 00:50:03.842095 | controller-1 | ok: [controller-1] => { 2026-02-11 00:50:03.842290 | controller-1 | "msg": "https://github.com/databus23/helm-diff/releases/download/v3.8.1/helm-diff-linux-amd64.tgz" 2026-02-11 00:50:03.842497 | controller-1 | } 2026-02-11 00:50:03.846228 | controller-1 | ok: [controller-2] => { 2026-02-11 00:50:03.846245 | controller-1 | "msg": "https://github.com/databus23/helm-diff/releases/download/v3.8.1/helm-diff-linux-amd64.tgz" 2026-02-11 00:50:03.846251 | controller-1 | } 2026-02-11 00:50:03.846257 | controller-1 | 2026-02-11 00:50:03.846262 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-02-11 00:50:03.846267 | controller-1 | Wednesday 11 February 2026 00:50:03 +0000 (0:00:00.072) 0:04:07.122 **** 2026-02-11 00:50:04.953373 | controller-1 | changed: [controller-1] 2026-02-11 00:50:04.953531 | controller-1 | changed: [controller-2] 2026-02-11 00:50:04.953653 | controller-1 | changed: [controller-3] 2026-02-11 00:50:04.953796 | controller-1 | 2026-02-11 00:50:04.953957 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-02-11 00:50:04.954108 | controller-1 | Wednesday 11 February 2026 00:50:04 +0000 (0:00:01.113) 0:04:08.235 **** 2026-02-11 00:50:08.308348 | controller-1 | changed: [controller-2] 2026-02-11 00:50:08.308559 | controller-1 | changed: [controller-3] 2026-02-11 00:50:08.308779 | controller-1 | changed: [controller-1] 2026-02-11 00:50:08.308940 | controller-1 | 2026-02-11 00:50:08.309173 | controller-1 | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] *** 2026-02-11 00:50:08.309396 | controller-1 | Wednesday 11 February 2026 00:50:08 +0000 (0:00:03.355) 0:04:11.590 **** 2026-02-11 00:50:08.460589 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for controller-1, controller-2, controller-3 2026-02-11 00:50:08.460614 | controller-1 | 2026-02-11 00:50:08.460619 | controller-1 | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] *************** 2026-02-11 00:50:08.460623 | controller-1 | Wednesday 11 February 2026 00:50:08 +0000 (0:00:00.148) 0:04:11.739 **** 2026-02-11 00:50:09.314069 | controller-1 | changed: [controller-1] 2026-02-11 00:50:09.314095 | controller-1 | 2026-02-11 00:50:09.314101 | controller-1 | TASK [vexxhost.kubernetes.cilium : Get current Kubernetes version] ************* 2026-02-11 00:50:09.314107 | controller-1 | Wednesday 11 February 2026 00:50:09 +0000 (0:00:00.856) 0:04:12.595 **** 2026-02-11 00:50:10.379166 | controller-1 | ok: [controller-1] 2026-02-11 00:50:10.379946 | controller-1 | 2026-02-11 00:50:10.380136 | controller-1 | TASK [vexxhost.kubernetes.cilium : Deploy Helm chart] ************************** 2026-02-11 00:50:10.381062 | controller-1 | Wednesday 11 February 2026 00:50:10 +0000 (0:00:01.062) 0:04:13.658 **** 2026-02-11 00:50:12.966339 | controller-1 | changed: [controller-1] 2026-02-11 00:50:12.966540 | controller-1 | 2026-02-11 00:50:12.966758 | controller-1 | PLAY [Wait for all nodes to become Ready] ************************************** 2026-02-11 00:50:12.966919 | controller-1 | 2026-02-11 00:50:12.967106 | controller-1 | TASK [Gathering Facts] ********************************************************* 2026-02-11 00:50:12.967329 | controller-1 | Wednesday 11 February 2026 00:50:12 +0000 (0:00:02.591) 0:04:16.249 **** 2026-02-11 00:50:13.900924 | controller-1 | ok: [controller-2] 2026-02-11 00:50:13.903243 | controller-1 | ok: [controller-1] 2026-02-11 00:50:13.903254 | controller-1 | ok: [controller-3] 2026-02-11 00:50:13.903258 | controller-1 | 2026-02-11 00:50:13.903262 | controller-1 | TASK [Wait for node to be Ready] *********************************************** 2026-02-11 00:50:13.903267 | controller-1 | Wednesday 11 February 2026 00:50:13 +0000 (0:00:00.934) 0:04:17.183 **** 2026-02-11 00:50:52.248682 | controller-1 | [ERROR]: Task failed: Module failed: 500 2026-02-11 00:50:52.250274 | controller-1 | Reason: Internal Server Error 2026-02-11 00:50:52.250466 | controller-1 | HTTP response headers: HTTPHeaderDict({'Audit-Id': '9193efd5-4fc6-43dc-a5fe-a6ed4bfa88a3', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': 'a3882dae-1931-4b1f-bd26-38809069d472', 'X-Kubernetes-Pf-Prioritylevel-Uid': 'c5d1bf9a-1c05-4349-8be4-89499c6f3aa2', 'Date': 'Wed, 11 Feb 2026 00:50:52 GMT', 'Content-Length': '119'}) 2026-02-11 00:50:52.250605 | controller-1 | HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"etcdserver: leader changed","code":500}\n' 2026-02-11 00:50:52.250733 | controller-1 | Original traceback: 2026-02-11 00:50:52.250940 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-11 00:50:52.251062 | controller-1 | resp = func(self, *args, **kwargs) 2026-02-11 00:50:52.251205 | controller-1 | 2026-02-11 00:50:52.251332 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 273, in request 2026-02-11 00:50:52.252230 | controller-1 | api_response = self.client.call_api( 2026-02-11 00:50:52.252384 | controller-1 | path, 2026-02-11 00:50:52.252511 | controller-1 | ...<11 lines>... 2026-02-11 00:50:52.252634 | controller-1 | _request_timeout=params.get('_request_timeout') 2026-02-11 00:50:52.252751 | controller-1 | ) 2026-02-11 00:50:52.252860 | controller-1 | 2026-02-11 00:50:52.252989 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-11 00:50:52.253109 | controller-1 | return self.__call_api(resource_path, method, 2026-02-11 00:50:52.253224 | controller-1 | ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.253524 | controller-1 | path_params, query_params, header_params, 2026-02-11 00:50:52.254489 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.254645 | controller-1 | ...<2 lines>... 2026-02-11 00:50:52.254767 | controller-1 | _return_http_data_only, collection_formats, 2026-02-11 00:50:52.254889 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.255006 | controller-1 | _preload_content, _request_timeout, _host) 2026-02-11 00:50:52.255118 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.255228 | controller-1 | 2026-02-11 00:50:52.255381 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-11 00:50:52.255498 | controller-1 | response_data = self.request( 2026-02-11 00:50:52.255649 | controller-1 | method, url, query_params=query_params, headers=header_params, 2026-02-11 00:50:52.255765 | controller-1 | post_params=post_params, body=body, 2026-02-11 00:50:52.255879 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.255991 | controller-1 | _request_timeout=_request_timeout) 2026-02-11 00:50:52.256097 | controller-1 | 2026-02-11 00:50:52.256220 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-11 00:50:52.256473 | controller-1 | return self.rest_client.GET(url, 2026-02-11 00:50:52.256649 | controller-1 | ~~~~~~~~~~~~~~~~~~~~^^^^^ 2026-02-11 00:50:52.257282 | controller-1 | query_params=query_params, 2026-02-11 00:50:52.257411 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.257528 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.257643 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.257799 | controller-1 | _request_timeout=_request_timeout, 2026-02-11 00:50:52.257957 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.258081 | controller-1 | headers=headers) 2026-02-11 00:50:52.258202 | controller-1 | ^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.258833 | controller-1 | 2026-02-11 00:50:52.258973 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-11 00:50:52.259091 | controller-1 | return self.request("GET", url, 2026-02-11 00:50:52.259202 | controller-1 | ~~~~~~~~~~~~^^^^^^^^^^^^ 2026-02-11 00:50:52.259314 | controller-1 | headers=headers, 2026-02-11 00:50:52.259424 | controller-1 | ^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.259537 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.259646 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.259772 | controller-1 | _request_timeout=_request_timeout, 2026-02-11 00:50:52.260008 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.260977 | controller-1 | query_params=query_params) 2026-02-11 00:50:52.261105 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.261230 | controller-1 | 2026-02-11 00:50:52.261430 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 238, in request 2026-02-11 00:50:52.261555 | controller-1 | raise ApiException(http_resp=r) 2026-02-11 00:50:52.261665 | controller-1 | 2026-02-11 00:50:52.261782 | controller-1 | Task failed: Module failed. 2026-02-11 00:50:52.261951 | controller-1 | Origin: /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/prepare.yml:25:7 2026-02-11 00:50:52.262108 | controller-1 | 2026-02-11 00:50:52.262239 | controller-1 | 23 become: true 2026-02-11 00:50:52.262392 | controller-1 | 24 tasks: 2026-02-11 00:50:52.262579 | controller-1 | 25 - name: Wait for node to be Ready 2026-02-11 00:50:52.263123 | controller-1 | ^ column 7 2026-02-11 00:50:52.263246 | controller-1 | 2026-02-11 00:50:52.263365 | controller-1 | <<< caused by >>> 2026-02-11 00:50:52.263473 | controller-1 | 2026-02-11 00:50:52.263615 | controller-1 | 500 2026-02-11 00:50:52.263733 | controller-1 | Reason: Internal Server Error 2026-02-11 00:50:52.263875 | controller-1 | HTTP response headers: HTTPHeaderDict({'Audit-Id': '9193efd5-4fc6-43dc-a5fe-a6ed4bfa88a3', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': 'a3882dae-1931-4b1f-bd26-38809069d472', 'X-Kubernetes-Pf-Prioritylevel-Uid': 'c5d1bf9a-1c05-4349-8be4-89499c6f3aa2', 'Date': 'Wed, 11 Feb 2026 00:50:52 GMT', 'Content-Length': '119'}) 2026-02-11 00:50:52.264195 | controller-1 | HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"etcdserver: leader changed","code":500}\n' 2026-02-11 00:50:52.264324 | controller-1 | Original traceback: 2026-02-11 00:50:52.264648 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-11 00:50:52.264780 | controller-1 | resp = func(self, *args, **kwargs) 2026-02-11 00:50:52.264893 | controller-1 | 2026-02-11 00:50:52.265170 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 273, in request 2026-02-11 00:50:52.266414 | controller-1 | api_response = self.client.call_api( 2026-02-11 00:50:52.266561 | controller-1 | path, 2026-02-11 00:50:52.266690 | controller-1 | ...<11 lines>... 2026-02-11 00:50:52.266821 | controller-1 | _request_timeout=params.get('_request_timeout') 2026-02-11 00:50:52.266946 | controller-1 | ) 2026-02-11 00:50:52.267067 | controller-1 | 2026-02-11 00:50:52.267204 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-11 00:50:52.267326 | controller-1 | return self.__call_api(resource_path, method, 2026-02-11 00:50:52.267489 | controller-1 | ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.267613 | controller-1 | path_params, query_params, header_params, 2026-02-11 00:50:52.267785 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.267904 | controller-1 | ...<2 lines>... 2026-02-11 00:50:52.268031 | controller-1 | _return_http_data_only, collection_formats, 2026-02-11 00:50:52.268182 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.268311 | controller-1 | _preload_content, _request_timeout, _host) 2026-02-11 00:50:52.268554 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.268678 | controller-1 | 2026-02-11 00:50:52.269627 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-11 00:50:52.269637 | controller-1 | response_data = self.request( 2026-02-11 00:50:52.269641 | controller-1 | method, url, query_params=query_params, headers=header_params, 2026-02-11 00:50:52.269731 | controller-1 | post_params=post_params, body=body, 2026-02-11 00:50:52.269847 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.269975 | controller-1 | _request_timeout=_request_timeout) 2026-02-11 00:50:52.270082 | controller-1 | 2026-02-11 00:50:52.270204 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-11 00:50:52.270593 | controller-1 | return self.rest_client.GET(url, 2026-02-11 00:50:52.270806 | controller-1 | ~~~~~~~~~~~~~~~~~~~~^^^^^ 2026-02-11 00:50:52.270930 | controller-1 | query_params=query_params, 2026-02-11 00:50:52.271043 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.271635 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.271796 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.271910 | controller-1 | _request_timeout=_request_timeout, 2026-02-11 00:50:52.272017 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.272126 | controller-1 | headers=headers) 2026-02-11 00:50:52.272234 | controller-1 | ^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.272339 | controller-1 | 2026-02-11 00:50:52.272464 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-11 00:50:52.272858 | controller-1 | return self.request("GET", url, 2026-02-11 00:50:52.272980 | controller-1 | ~~~~~~~~~~~~^^^^^^^^^^^^ 2026-02-11 00:50:52.273093 | controller-1 | headers=headers, 2026-02-11 00:50:52.273203 | controller-1 | ^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.274005 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.274155 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.274279 | controller-1 | _request_timeout=_request_timeout, 2026-02-11 00:50:52.274386 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.274501 | controller-1 | query_params=query_params) 2026-02-11 00:50:52.274605 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.274704 | controller-1 | 2026-02-11 00:50:52.274819 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 238, in request 2026-02-11 00:50:52.274926 | controller-1 | raise ApiException(http_resp=r) 2026-02-11 00:50:52.276148 | controller-1 | 2026-02-11 00:50:52.276527 | controller-1 | fatal: [controller-2 -> controller-1(199.204.45.210)]: FAILED! => {"changed": false, "msg": "Task failed: Module failed: 500\nReason: Internal Server Error\nHTTP response headers: HTTPHeaderDict({'Audit-Id': '9193efd5-4fc6-43dc-a5fe-a6ed4bfa88a3', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': 'a3882dae-1931-4b1f-bd26-38809069d472', 'X-Kubernetes-Pf-Prioritylevel-Uid': 'c5d1bf9a-1c05-4349-8be4-89499c6f3aa2', 'Date': 'Wed, 11 Feb 2026 00:50:52 GMT', 'Content-Length': '119'})\nHTTP response body: b'{\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"message\":\"etcdserver: leader changed\",\"code\":500}\\n'\nOriginal traceback: \n File \"/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py\", line 55, in inner\n resp = func(self, *args, **kwargs)\n\n File \"/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py\", line 273, in request\n api_response = self.client.call_api(\n path,\n ...<11 lines>...\n _request_timeout=params.get('_request_timeout')\n )\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 348, in call_api\n return self.__call_api(resource_path, method,\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^\n path_params, query_params, header_params,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n ...<2 lines>...\n _return_http_data_only, collection_formats,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n _preload_content, _request_timeout, _host)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 180, in __call_api\n response_data = self.request(\n method, url, query_params=query_params, headers=header_params,\n post_params=post_params, body=body,\n _preload_content=_preload_content,\n _request_timeout=_request_timeout)\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 373, in request\n return self.rest_client.GET(url,\n ~~~~~~~~~~~~~~~~~~~~^^^^^\n query_params=query_params,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n _preload_content=_preload_content,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n _request_timeout=_request_timeout,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n headers=headers)\n ^^^^^^^^^^^^^^^^\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/rest.py\", line 244, in GET\n return self.request(\"GET\", url,\n ~~~~~~~~~~~~^^^^^^^^^^^^\n headers=headers,\n ^^^^^^^^^^^^^^^^\n _preload_content=_preload_content,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n _request_timeout=_request_timeout,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n query_params=query_params)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/rest.py\", line 238, in request\n raise ApiException(http_resp=r)"} 2026-02-11 00:50:52.313440 | controller-1 | [ERROR]: Task failed: Module failed: 500 2026-02-11 00:50:52.313472 | controller-1 | Reason: Internal Server Error 2026-02-11 00:50:52.313480 | controller-1 | HTTP response headers: HTTPHeaderDict({'Audit-Id': '461c6f57-9d9a-4961-a56d-5cdcf1010b26', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': 'a3882dae-1931-4b1f-bd26-38809069d472', 'X-Kubernetes-Pf-Prioritylevel-Uid': 'c5d1bf9a-1c05-4349-8be4-89499c6f3aa2', 'Date': 'Wed, 11 Feb 2026 00:50:52 GMT', 'Content-Length': '119'}) 2026-02-11 00:50:52.313496 | controller-1 | HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"etcdserver: leader changed","code":500}\n' 2026-02-11 00:50:52.313502 | controller-1 | Original traceback: 2026-02-11 00:50:52.313507 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-11 00:50:52.313513 | controller-1 | resp = func(self, *args, **kwargs) 2026-02-11 00:50:52.313518 | controller-1 | 2026-02-11 00:50:52.315789 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 273, in request 2026-02-11 00:50:52.315803 | controller-1 | api_response = self.client.call_api( 2026-02-11 00:50:52.315809 | controller-1 | path, 2026-02-11 00:50:52.315814 | controller-1 | ...<11 lines>... 2026-02-11 00:50:52.315819 | controller-1 | _request_timeout=params.get('_request_timeout') 2026-02-11 00:50:52.315824 | controller-1 | ) 2026-02-11 00:50:52.315829 | controller-1 | 2026-02-11 00:50:52.315835 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-11 00:50:52.317006 | controller-1 | return self.__call_api(resource_path, method, 2026-02-11 00:50:52.317180 | controller-1 | ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.317621 | controller-1 | path_params, query_params, header_params, 2026-02-11 00:50:52.321292 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.321303 | controller-1 | ...<2 lines>... 2026-02-11 00:50:52.321309 | controller-1 | _return_http_data_only, collection_formats, 2026-02-11 00:50:52.321313 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.321333 | controller-1 | _preload_content, _request_timeout, _host) 2026-02-11 00:50:52.321337 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.321340 | controller-1 | 2026-02-11 00:50:52.321344 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-11 00:50:52.321347 | controller-1 | response_data = self.request( 2026-02-11 00:50:52.321351 | controller-1 | method, url, query_params=query_params, headers=header_params, 2026-02-11 00:50:52.321354 | controller-1 | post_params=post_params, body=body, 2026-02-11 00:50:52.321357 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.321360 | controller-1 | _request_timeout=_request_timeout) 2026-02-11 00:50:52.321364 | controller-1 | 2026-02-11 00:50:52.321367 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-11 00:50:52.321370 | controller-1 | return self.rest_client.GET(url, 2026-02-11 00:50:52.321373 | controller-1 | ~~~~~~~~~~~~~~~~~~~~^^^^^ 2026-02-11 00:50:52.321376 | controller-1 | query_params=query_params, 2026-02-11 00:50:52.321380 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.321383 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.321386 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.321389 | controller-1 | _request_timeout=_request_timeout, 2026-02-11 00:50:52.321393 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.321396 | controller-1 | headers=headers) 2026-02-11 00:50:52.321399 | controller-1 | ^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.321402 | controller-1 | 2026-02-11 00:50:52.321405 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-11 00:50:52.321409 | controller-1 | return self.request("GET", url, 2026-02-11 00:50:52.321412 | controller-1 | ~~~~~~~~~~~~^^^^^^^^^^^^ 2026-02-11 00:50:52.321415 | controller-1 | headers=headers, 2026-02-11 00:50:52.321418 | controller-1 | ^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.321426 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.321429 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.325417 | controller-1 | _request_timeout=_request_timeout, 2026-02-11 00:50:52.325538 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.325649 | controller-1 | query_params=query_params) 2026-02-11 00:50:52.325771 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.325876 | controller-1 | 2026-02-11 00:50:52.326035 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 238, in request 2026-02-11 00:50:52.326369 | controller-1 | raise ApiException(http_resp=r) 2026-02-11 00:50:52.326610 | controller-1 | 2026-02-11 00:50:52.326726 | controller-1 | Task failed: Module failed. 2026-02-11 00:50:52.326846 | controller-1 | Origin: /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/prepare.yml:25:7 2026-02-11 00:50:52.326949 | controller-1 | 2026-02-11 00:50:52.327085 | controller-1 | 23 become: true 2026-02-11 00:50:52.327203 | controller-1 | 24 tasks: 2026-02-11 00:50:52.327463 | controller-1 | 25 - name: Wait for node to be Ready 2026-02-11 00:50:52.327853 | controller-1 | ^ column 7 2026-02-11 00:50:52.327962 | controller-1 | 2026-02-11 00:50:52.328073 | controller-1 | <<< caused by >>> 2026-02-11 00:50:52.328178 | controller-1 | 2026-02-11 00:50:52.328286 | controller-1 | 500 2026-02-11 00:50:52.328396 | controller-1 | Reason: Internal Server Error 2026-02-11 00:50:52.328543 | controller-1 | HTTP response headers: HTTPHeaderDict({'Audit-Id': '461c6f57-9d9a-4961-a56d-5cdcf1010b26', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': 'a3882dae-1931-4b1f-bd26-38809069d472', 'X-Kubernetes-Pf-Prioritylevel-Uid': 'c5d1bf9a-1c05-4349-8be4-89499c6f3aa2', 'Date': 'Wed, 11 Feb 2026 00:50:52 GMT', 'Content-Length': '119'}) 2026-02-11 00:50:52.328666 | controller-1 | HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"etcdserver: leader changed","code":500}\n' 2026-02-11 00:50:52.328776 | controller-1 | Original traceback: 2026-02-11 00:50:52.328892 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-11 00:50:52.329002 | controller-1 | resp = func(self, *args, **kwargs) 2026-02-11 00:50:52.329103 | controller-1 | 2026-02-11 00:50:52.329221 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 273, in request 2026-02-11 00:50:52.329350 | controller-1 | api_response = self.client.call_api( 2026-02-11 00:50:52.329500 | controller-1 | path, 2026-02-11 00:50:52.329623 | controller-1 | ...<11 lines>... 2026-02-11 00:50:52.329735 | controller-1 | _request_timeout=params.get('_request_timeout') 2026-02-11 00:50:52.329842 | controller-1 | ) 2026-02-11 00:50:52.330012 | controller-1 | 2026-02-11 00:50:52.330155 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-11 00:50:52.330267 | controller-1 | return self.__call_api(resource_path, method, 2026-02-11 00:50:52.330392 | controller-1 | ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.330514 | controller-1 | path_params, query_params, header_params, 2026-02-11 00:50:52.330628 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.330733 | controller-1 | ...<2 lines>... 2026-02-11 00:50:52.330853 | controller-1 | _return_http_data_only, collection_formats, 2026-02-11 00:50:52.330968 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.331086 | controller-1 | _preload_content, _request_timeout, _host) 2026-02-11 00:50:52.331198 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.331298 | controller-1 | 2026-02-11 00:50:52.331482 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-11 00:50:52.331592 | controller-1 | response_data = self.request( 2026-02-11 00:50:52.331709 | controller-1 | method, url, query_params=query_params, headers=header_params, 2026-02-11 00:50:52.331815 | controller-1 | post_params=post_params, body=body, 2026-02-11 00:50:52.331923 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.332028 | controller-1 | _request_timeout=_request_timeout) 2026-02-11 00:50:52.332132 | controller-1 | 2026-02-11 00:50:52.332245 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-11 00:50:52.332352 | controller-1 | return self.rest_client.GET(url, 2026-02-11 00:50:52.332978 | controller-1 | ~~~~~~~~~~~~~~~~~~~~^^^^^ 2026-02-11 00:50:52.333105 | controller-1 | query_params=query_params, 2026-02-11 00:50:52.335351 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.335486 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.335591 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.335698 | controller-1 | _request_timeout=_request_timeout, 2026-02-11 00:50:52.335801 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.335906 | controller-1 | headers=headers) 2026-02-11 00:50:52.336016 | controller-1 | ^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.336115 | controller-1 | 2026-02-11 00:50:52.336293 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-11 00:50:52.336816 | controller-1 | return self.request("GET", url, 2026-02-11 00:50:52.336927 | controller-1 | ~~~~~~~~~~~~^^^^^^^^^^^^ 2026-02-11 00:50:52.337149 | controller-1 | headers=headers, 2026-02-11 00:50:52.337330 | controller-1 | ^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.337447 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.337554 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.337665 | controller-1 | _request_timeout=_request_timeout, 2026-02-11 00:50:52.337773 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.337883 | controller-1 | query_params=query_params) 2026-02-11 00:50:52.338047 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.338151 | controller-1 | 2026-02-11 00:50:52.338271 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 238, in request 2026-02-11 00:50:52.338393 | controller-1 | raise ApiException(http_resp=r) 2026-02-11 00:50:52.338541 | controller-1 | 2026-02-11 00:50:52.338991 | controller-1 | fatal: [controller-3 -> controller-1(199.204.45.210)]: FAILED! => {"changed": false, "msg": "Task failed: Module failed: 500\nReason: Internal Server Error\nHTTP response headers: HTTPHeaderDict({'Audit-Id': '461c6f57-9d9a-4961-a56d-5cdcf1010b26', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': 'a3882dae-1931-4b1f-bd26-38809069d472', 'X-Kubernetes-Pf-Prioritylevel-Uid': 'c5d1bf9a-1c05-4349-8be4-89499c6f3aa2', 'Date': 'Wed, 11 Feb 2026 00:50:52 GMT', 'Content-Length': '119'})\nHTTP response body: b'{\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"message\":\"etcdserver: leader changed\",\"code\":500}\\n'\nOriginal traceback: \n File \"/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py\", line 55, in inner\n resp = func(self, *args, **kwargs)\n\n File \"/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py\", line 273, in request\n api_response = self.client.call_api(\n path,\n ...<11 lines>...\n _request_timeout=params.get('_request_timeout')\n )\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 348, in call_api\n return self.__call_api(resource_path, method,\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^\n path_params, query_params, header_params,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n ...<2 lines>...\n _return_http_data_only, collection_formats,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n _preload_content, _request_timeout, _host)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 180, in __call_api\n response_data = self.request(\n method, url, query_params=query_params, headers=header_params,\n post_params=post_params, body=body,\n _preload_content=_preload_content,\n _request_timeout=_request_timeout)\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 373, in request\n return self.rest_client.GET(url,\n ~~~~~~~~~~~~~~~~~~~~^^^^^\n query_params=query_params,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n _preload_content=_preload_content,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n _request_timeout=_request_timeout,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n headers=headers)\n ^^^^^^^^^^^^^^^^\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/rest.py\", line 244, in GET\n return self.request(\"GET\", url,\n ~~~~~~~~~~~~^^^^^^^^^^^^\n headers=headers,\n ^^^^^^^^^^^^^^^^\n _preload_content=_preload_content,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n _request_timeout=_request_timeout,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n query_params=query_params)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/rest.py\", line 238, in request\n raise ApiException(http_resp=r)"} 2026-02-11 00:50:52.339273 | controller-1 | [ERROR]: Task failed: Module failed: 500 2026-02-11 00:50:52.339429 | controller-1 | Reason: Internal Server Error 2026-02-11 00:50:52.339611 | controller-1 | HTTP response headers: HTTPHeaderDict({'Audit-Id': '67bd7865-90f1-4acd-8625-883c71c93e3e', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': 'a3882dae-1931-4b1f-bd26-38809069d472', 'X-Kubernetes-Pf-Prioritylevel-Uid': 'c5d1bf9a-1c05-4349-8be4-89499c6f3aa2', 'Date': 'Wed, 11 Feb 2026 00:50:52 GMT', 'Content-Length': '119'}) 2026-02-11 00:50:52.339777 | controller-1 | HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"etcdserver: leader changed","code":500}\n' 2026-02-11 00:50:52.339929 | controller-1 | Original traceback: 2026-02-11 00:50:52.340090 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-11 00:50:52.340243 | controller-1 | resp = func(self, *args, **kwargs) 2026-02-11 00:50:52.340384 | controller-1 | 2026-02-11 00:50:52.340546 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 273, in request 2026-02-11 00:50:52.340698 | controller-1 | api_response = self.client.call_api( 2026-02-11 00:50:52.340847 | controller-1 | path, 2026-02-11 00:50:52.340997 | controller-1 | ...<11 lines>... 2026-02-11 00:50:52.341150 | controller-1 | _request_timeout=params.get('_request_timeout') 2026-02-11 00:50:52.341527 | controller-1 | ) 2026-02-11 00:50:52.341788 | controller-1 | 2026-02-11 00:50:52.342020 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-11 00:50:52.342267 | controller-1 | return self.__call_api(resource_path, method, 2026-02-11 00:50:52.342340 | controller-1 | ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.342510 | controller-1 | path_params, query_params, header_params, 2026-02-11 00:50:52.342620 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.342788 | controller-1 | ...<2 lines>... 2026-02-11 00:50:52.342873 | controller-1 | _return_http_data_only, collection_formats, 2026-02-11 00:50:52.342995 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.343166 | controller-1 | _preload_content, _request_timeout, _host) 2026-02-11 00:50:52.343303 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.345257 | controller-1 | 2026-02-11 00:50:52.345306 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-11 00:50:52.345320 | controller-1 | response_data = self.request( 2026-02-11 00:50:52.345325 | controller-1 | method, url, query_params=query_params, headers=header_params, 2026-02-11 00:50:52.345329 | controller-1 | post_params=post_params, body=body, 2026-02-11 00:50:52.345333 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.345337 | controller-1 | _request_timeout=_request_timeout) 2026-02-11 00:50:52.345342 | controller-1 | 2026-02-11 00:50:52.345346 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-11 00:50:52.345350 | controller-1 | return self.rest_client.GET(url, 2026-02-11 00:50:52.345355 | controller-1 | ~~~~~~~~~~~~~~~~~~~~^^^^^ 2026-02-11 00:50:52.345359 | controller-1 | query_params=query_params, 2026-02-11 00:50:52.345364 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.345373 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.345545 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.345625 | controller-1 | _request_timeout=_request_timeout, 2026-02-11 00:50:52.345743 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.345861 | controller-1 | headers=headers) 2026-02-11 00:50:52.346041 | controller-1 | ^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.346212 | controller-1 | 2026-02-11 00:50:52.346292 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-11 00:50:52.346480 | controller-1 | return self.request("GET", url, 2026-02-11 00:50:52.346597 | controller-1 | ~~~~~~~~~~~~^^^^^^^^^^^^ 2026-02-11 00:50:52.346716 | controller-1 | headers=headers, 2026-02-11 00:50:52.346830 | controller-1 | ^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.346951 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.347070 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.347184 | controller-1 | _request_timeout=_request_timeout, 2026-02-11 00:50:52.347300 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.347419 | controller-1 | query_params=query_params) 2026-02-11 00:50:52.347542 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.347645 | controller-1 | 2026-02-11 00:50:52.347773 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 238, in request 2026-02-11 00:50:52.347896 | controller-1 | raise ApiException(http_resp=r) 2026-02-11 00:50:52.348006 | controller-1 | 2026-02-11 00:50:52.348130 | controller-1 | Task failed: Module failed. 2026-02-11 00:50:52.348262 | controller-1 | Origin: /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/prepare.yml:25:7 2026-02-11 00:50:52.348367 | controller-1 | 2026-02-11 00:50:52.348489 | controller-1 | 23 become: true 2026-02-11 00:50:52.348607 | controller-1 | 24 tasks: 2026-02-11 00:50:52.348731 | controller-1 | 25 - name: Wait for node to be Ready 2026-02-11 00:50:52.348847 | controller-1 | ^ column 7 2026-02-11 00:50:52.348960 | controller-1 | 2026-02-11 00:50:52.349078 | controller-1 | <<< caused by >>> 2026-02-11 00:50:52.349190 | controller-1 | 2026-02-11 00:50:52.349333 | controller-1 | 500 2026-02-11 00:50:52.349505 | controller-1 | Reason: Internal Server Error 2026-02-11 00:50:52.349693 | controller-1 | HTTP response headers: HTTPHeaderDict({'Audit-Id': '67bd7865-90f1-4acd-8625-883c71c93e3e', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': 'a3882dae-1931-4b1f-bd26-38809069d472', 'X-Kubernetes-Pf-Prioritylevel-Uid': 'c5d1bf9a-1c05-4349-8be4-89499c6f3aa2', 'Date': 'Wed, 11 Feb 2026 00:50:52 GMT', 'Content-Length': '119'}) 2026-02-11 00:50:52.349832 | controller-1 | HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"etcdserver: leader changed","code":500}\n' 2026-02-11 00:50:52.349979 | controller-1 | Original traceback: 2026-02-11 00:50:52.350136 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-11 00:50:52.350460 | controller-1 | resp = func(self, *args, **kwargs) 2026-02-11 00:50:52.350703 | controller-1 | 2026-02-11 00:50:52.350846 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 273, in request 2026-02-11 00:50:52.350975 | controller-1 | api_response = self.client.call_api( 2026-02-11 00:50:52.351094 | controller-1 | path, 2026-02-11 00:50:52.351263 | controller-1 | ...<11 lines>... 2026-02-11 00:50:52.351365 | controller-1 | _request_timeout=params.get('_request_timeout') 2026-02-11 00:50:52.351476 | controller-1 | ) 2026-02-11 00:50:52.351589 | controller-1 | 2026-02-11 00:50:52.351735 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-11 00:50:52.351875 | controller-1 | return self.__call_api(resource_path, method, 2026-02-11 00:50:52.352004 | controller-1 | ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.352135 | controller-1 | path_params, query_params, header_params, 2026-02-11 00:50:52.352265 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.352382 | controller-1 | ...<2 lines>... 2026-02-11 00:50:52.352510 | controller-1 | _return_http_data_only, collection_formats, 2026-02-11 00:50:52.352624 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.352748 | controller-1 | _preload_content, _request_timeout, _host) 2026-02-11 00:50:52.352908 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.353002 | controller-1 | 2026-02-11 00:50:52.353137 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-11 00:50:52.353308 | controller-1 | response_data = self.request( 2026-02-11 00:50:52.353435 | controller-1 | method, url, query_params=query_params, headers=header_params, 2026-02-11 00:50:52.353564 | controller-1 | post_params=post_params, body=body, 2026-02-11 00:50:52.353678 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.353813 | controller-1 | _request_timeout=_request_timeout) 2026-02-11 00:50:52.354005 | controller-1 | 2026-02-11 00:50:52.354131 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-11 00:50:52.354286 | controller-1 | return self.rest_client.GET(url, 2026-02-11 00:50:52.354385 | controller-1 | ~~~~~~~~~~~~~~~~~~~~^^^^^ 2026-02-11 00:50:52.354501 | controller-1 | query_params=query_params, 2026-02-11 00:50:52.354548 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.354632 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.354715 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.354803 | controller-1 | _request_timeout=_request_timeout, 2026-02-11 00:50:52.354881 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.354962 | controller-1 | headers=headers) 2026-02-11 00:50:52.355071 | controller-1 | ^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.355148 | controller-1 | 2026-02-11 00:50:52.355256 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-11 00:50:52.355407 | controller-1 | return self.request("GET", url, 2026-02-11 00:50:52.355418 | controller-1 | ~~~~~~~~~~~~^^^^^^^^^^^^ 2026-02-11 00:50:52.355500 | controller-1 | headers=headers, 2026-02-11 00:50:52.355622 | controller-1 | ^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.355713 | controller-1 | _preload_content=_preload_content, 2026-02-11 00:50:52.355819 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.355887 | controller-1 | _request_timeout=_request_timeout, 2026-02-11 00:50:52.355968 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.356048 | controller-1 | query_params=query_params) 2026-02-11 00:50:52.356128 | controller-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-02-11 00:50:52.356212 | controller-1 | 2026-02-11 00:50:52.356306 | controller-1 | File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 238, in request 2026-02-11 00:50:52.356401 | controller-1 | raise ApiException(http_resp=r) 2026-02-11 00:50:52.356466 | controller-1 | 2026-02-11 00:50:52.356806 | controller-1 | fatal: [controller-1]: FAILED! => {"changed": false, "msg": "Task failed: Module failed: 500\nReason: Internal Server Error\nHTTP response headers: HTTPHeaderDict({'Audit-Id': '67bd7865-90f1-4acd-8625-883c71c93e3e', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': 'a3882dae-1931-4b1f-bd26-38809069d472', 'X-Kubernetes-Pf-Prioritylevel-Uid': 'c5d1bf9a-1c05-4349-8be4-89499c6f3aa2', 'Date': 'Wed, 11 Feb 2026 00:50:52 GMT', 'Content-Length': '119'})\nHTTP response body: b'{\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"message\":\"etcdserver: leader changed\",\"code\":500}\\n'\nOriginal traceback: \n File \"/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py\", line 55, in inner\n resp = func(self, *args, **kwargs)\n\n File \"/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py\", line 273, in request\n api_response = self.client.call_api(\n path,\n ...<11 lines>...\n _request_timeout=params.get('_request_timeout')\n )\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 348, in call_api\n return self.__call_api(resource_path, method,\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^\n path_params, query_params, header_params,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n ...<2 lines>...\n _return_http_data_only, collection_formats,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n _preload_content, _request_timeout, _host)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 180, in __call_api\n response_data = self.request(\n method, url, query_params=query_params, headers=header_params,\n post_params=post_params, body=body,\n _preload_content=_preload_content,\n _request_timeout=_request_timeout)\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 373, in request\n return self.rest_client.GET(url,\n ~~~~~~~~~~~~~~~~~~~~^^^^^\n query_params=query_params,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n _preload_content=_preload_content,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n _request_timeout=_request_timeout,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n headers=headers)\n ^^^^^^^^^^^^^^^^\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/rest.py\", line 244, in GET\n return self.request(\"GET\", url,\n ~~~~~~~~~~~~^^^^^^^^^^^^\n headers=headers,\n ^^^^^^^^^^^^^^^^\n _preload_content=_preload_content,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n _request_timeout=_request_timeout,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n query_params=query_params)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n File \"/usr/lib/python3/dist-packages/kubernetes/client/rest.py\", line 238, in request\n raise ApiException(http_resp=r)"} 2026-02-11 00:50:52.356917 | controller-1 | 2026-02-11 00:50:52.357039 | controller-1 | PLAY RECAP ********************************************************************* 2026-02-11 00:50:52.357099 | controller-1 | controller-1 : ok=115 changed=52 unreachable=0 failed=1 skipped=34 rescued=0 ignored=3 2026-02-11 00:50:52.357190 | controller-1 | controller-2 : ok=113 changed=50 unreachable=0 failed=1 skipped=31 rescued=0 ignored=2 2026-02-11 00:50:52.358724 | controller-1 | controller-3 : ok=110 changed=49 unreachable=0 failed=1 skipped=31 rescued=0 ignored=2 2026-02-11 00:50:52.358779 | controller-1 | 2026-02-11 00:50:52.358785 | controller-1 | 2026-02-11 00:50:52.358789 | controller-1 | TASKS RECAP ******************************************************************** 2026-02-11 00:50:52.358808 | controller-1 | Wednesday 11 February 2026 00:50:52 +0000 (0:00:38.425) 0:04:55.608 **** 2026-02-11 00:50:52.358812 | controller-1 | =============================================================================== 2026-02-11 00:50:52.358816 | controller-1 | vexxhost.kubernetes.kubernetes : Join cluster -------------------------- 87.63s 2026-02-11 00:50:52.358820 | controller-1 | Wait for node to be Ready ---------------------------------------------- 38.43s 2026-02-11 00:50:52.358824 | controller-1 | vexxhost.kubernetes.kubernetes : Initialize cluster -------------------- 35.77s 2026-02-11 00:50:52.358829 | controller-1 | vexxhost.kubernetes.kubernetes : Install Kubernetes Python package using package manager on supported systems -- 11.50s 2026-02-11 00:50:52.358833 | controller-1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.26s 2026-02-11 00:50:52.358837 | controller-1 | Install Debian packages ------------------------------------------------- 5.48s 2026-02-11 00:50:52.358841 | controller-1 | vexxhost.containers.download_artifact : Download item ------------------- 4.92s 2026-02-11 00:50:52.358845 | controller-1 | vexxhost.containers.download_artifact : Download item ------------------- 3.66s 2026-02-11 00:50:52.358852 | controller-1 | vexxhost.kubernetes.kubelet : Reload systemd ---------------------------- 3.44s 2026-02-11 00:50:52.358876 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.36s 2026-02-11 00:50:52.358963 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.31s 2026-02-11 00:50:52.359054 | controller-1 | vexxhost.kubernetes.kubelet : Install additional packages --------------- 3.31s 2026-02-11 00:50:52.359136 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.16s 2026-02-11 00:50:52.359233 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.93s 2026-02-11 00:50:52.359323 | controller-1 | vexxhost.containers.cni_plugins : Install additional packages ----------- 2.89s 2026-02-11 00:50:52.359413 | controller-1 | vexxhost.kubernetes.cilium : Deploy Helm chart -------------------------- 2.59s 2026-02-11 00:50:52.359501 | controller-1 | vexxhost.kubernetes.kubelet : Configure sysctl values ------------------- 2.28s 2026-02-11 00:50:52.359579 | controller-1 | vexxhost.containers.containerd : Restart containerd --------------------- 1.87s 2026-02-11 00:50:52.359783 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.81s 2026-02-11 00:50:52.359869 | controller-1 | vexxhost.kubernetes.kubelet : Enable noswap service --------------------- 1.80s 2026-02-11 00:50:52.569015 | controller-1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.Bs5j.cluster-upgrade/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/prepare.yml 2026-02-11 00:50:52.569617 | controller-1 | ERROR [cluster-upgrade > prepare] Executed: Failed 2026-02-11 00:50:52.569869 | controller-1 | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.Bs5j.cluster-upgrade/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/prepare.yml 2026-02-11 00:51:03.071836 | controller-1 | ERROR 2026-02-11 00:51:03.072122 | controller-1 | { 2026-02-11 00:51:03.072163 | controller-1 | "delta": "0:05:23.520167", 2026-02-11 00:51:03.072191 | controller-1 | "end": "2026-02-11 00:50:52.654978", 2026-02-11 00:51:03.072216 | controller-1 | "msg": "non-zero return code", 2026-02-11 00:51:03.072241 | controller-1 | "rc": 2, 2026-02-11 00:51:03.072268 | controller-1 | "start": "2026-02-11 00:45:29.134811" 2026-02-11 00:51:03.072293 | controller-1 | } failure 2026-02-11 00:51:03.087353 | 2026-02-11 00:51:03.087402 | PLAY RECAP 2026-02-11 00:51:03.087450 | controller-1 | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-02-11 00:51:03.087484 | 2026-02-11 00:51:03.220206 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-02-11 00:51:03.226365 | POST-RUN START: [trusted : vexxhost.dev/zuul-config/playbooks/base/post.yaml@main] 2026-02-11 00:51:03.819749 | 2026-02-11 00:51:03.819882 | PLAY [all] 2026-02-11 00:51:03.831155 | 2026-02-11 00:51:03.831245 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-11 00:51:03.890394 | controller-1 | ok 2026-02-11 00:51:03.895410 | controller-2 | ok 2026-02-11 00:51:03.899315 | controller-3 | ok 2026-02-11 00:51:03.903996 | 2026-02-11 00:51:03.904093 | TASK [fetch-output : Set log path for single node] 2026-02-11 00:51:03.935893 | controller-1 | skipping: Conditional result was False 2026-02-11 00:51:03.937228 | controller-2 | skipping: Conditional result was False 2026-02-11 00:51:03.947880 | controller-3 | skipping: Conditional result was False 2026-02-11 00:51:03.958702 | 2026-02-11 00:51:03.958902 | LOOP [fetch-output : Ensure local output dirs] 2026-02-11 00:51:04.356064 | controller-1 -> localhost | changed: "/var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/work/logs/controller-1" 2026-02-11 00:51:04.358892 | controller-2 -> localhost | changed: "/var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/work/logs/controller-2" 2026-02-11 00:51:04.372237 | controller-3 -> localhost | changed: "/var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/work/logs/controller-3" 2026-02-11 00:51:04.548103 | controller-1 -> localhost | changed: "/var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/work/artifacts" 2026-02-11 00:51:04.570400 | controller-2 -> localhost | ok: "/var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/work/artifacts" 2026-02-11 00:51:04.574575 | controller-3 -> localhost | ok: "/var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/work/artifacts" 2026-02-11 00:51:04.771389 | controller-3 -> localhost | ok: "/var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/work/docs" 2026-02-11 00:51:04.775723 | controller-1 -> localhost | changed: "/var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/work/docs" 2026-02-11 00:51:04.776652 | controller-2 -> localhost | ok: "/var/lib/zuul/builds/332cca61e1294ba5b724dfcb0ac6aa76/work/docs" 2026-02-11 00:51:04.797501 | 2026-02-11 00:51:04.797697 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-11 00:51:05.446020 | controller-1 | changed: .d..t...... ./ 2026-02-11 00:51:05.446380 | controller-1 | changed: All items complete 2026-02-11 00:51:05.446432 | 2026-02-11 00:51:05.451329 | controller-2 | changed: .d..t...... ./ 2026-02-11 00:51:05.476893 | controller-3 | changed: .d..t...... ./ 2026-02-11 00:51:05.933176 | controller-2 | changed: .d..t...... ./ 2026-02-11 00:51:05.937799 | controller-1 | ok 2026-02-11 00:51:05.975878 | controller-3 | ok 2026-02-11 00:51:06.392856 | controller-2 | changed: .d..t...... ./ 2026-02-11 00:51:06.398282 | controller-1 | ok 2026-02-11 00:51:06.436560 | controller-3 | ok 2026-02-11 00:51:06.436636 | controller-3 | changed: All items complete 2026-02-11 00:51:06.436670 | 2026-02-11 00:51:06.457509 | 2026-02-11 00:51:06.457678 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-02-11 00:51:06.860708 | controller-1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007480 2026-02-11 00:51:07.117213 | controller-1 -> localhost | ok: Item: docs Runtime: 0:00:00.008119 2026-02-11 00:51:07.144366 | 2026-02-11 00:51:07.144500 | PLAY [all] 2026-02-11 00:51:07.149913 | 2026-02-11 00:51:07.150035 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-02-11 00:51:07.667079 | controller-1 | changed 2026-02-11 00:51:07.847669 | controller-2 | changed 2026-02-11 00:51:07.874887 | controller-3 | changed 2026-02-11 00:51:07.887152 | 2026-02-11 00:51:07.887209 | PLAY RECAP 2026-02-11 00:51:07.887259 | controller-1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-11 00:51:07.887288 | controller-2 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-11 00:51:07.887312 | controller-3 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-11 00:51:07.887331 | 2026-02-11 00:51:08.053552 | POST-RUN END RESULT_NORMAL: [trusted : vexxhost.dev/zuul-config/playbooks/base/post.yaml@main] 2026-02-11 00:51:08.059503 | POST-RUN START: [trusted : vexxhost.dev/zuul-config/playbooks/base/post-logs.yaml@main] 2026-02-11 00:51:08.620837 | 2026-02-11 00:51:08.621014 | PLAY [localhost] 2026-02-11 00:51:08.630804 | 2026-02-11 00:51:08.630876 | TASK [Generate Zuul manifest] 2026-02-11 00:51:08.655597 | localhost | ok 2026-02-11 00:51:08.672276 | 2026-02-11 00:51:08.672358 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-02-11 00:51:09.028614 | localhost | changed 2026-02-11 00:51:09.042445 | 2026-02-11 00:51:09.042526 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-02-11 00:51:09.076307 | localhost | ok 2026-02-11 00:51:09.084594 | 2026-02-11 00:51:09.084672 | TASK [Upload logs] 2026-02-11 00:51:09.117946 | localhost | ok 2026-02-11 00:51:09.179553 | 2026-02-11 00:51:09.179674 | TASK [Set zuul-log-path fact] 2026-02-11 00:51:09.204042 | localhost | ok 2026-02-11 00:51:09.218987 | 2026-02-11 00:51:09.219077 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-11 00:51:09.251657 | localhost | ok 2026-02-11 00:51:09.264597 | 2026-02-11 00:51:09.264822 | TASK [upload-logs : Create log directories] 2026-02-11 00:51:09.683408 | localhost | changed 2026-02-11 00:51:09.688870 | 2026-02-11 00:51:09.688963 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-02-11 00:51:10.116410 | localhost -> localhost | ok: Runtime: 0:00:00.006693 2026-02-11 00:51:10.123809 | 2026-02-11 00:51:10.123905 | TASK [upload-logs : Upload logs to log server] 2026-02-11 00:51:10.583994 | localhost | Output suppressed because no_log was given 2026-02-11 00:51:10.588051 | 2026-02-11 00:51:10.588120 | LOOP [upload-logs : Compress console log and json output] 2026-02-11 00:51:10.637413 | localhost | skipping: Conditional result was False 2026-02-11 00:51:10.643660 | localhost | skipping: Conditional result was False 2026-02-11 00:51:10.653887 | 2026-02-11 00:51:10.654031 | LOOP [upload-logs : Upload compressed console log and json output] 2026-02-11 00:51:10.698973 | localhost | skipping: Conditional result was False 2026-02-11 00:51:10.699377 | 2026-02-11 00:51:10.702569 | localhost | skipping: Conditional result was False 2026-02-11 00:51:10.718327 | 2026-02-11 00:51:10.718462 | LOOP [upload-logs : Upload console log and json output]