I0313 09:55:10.899534 1 options.go:220] external host was not specified, using 199.204.45.57 I0313 09:55:10.900536 1 server.go:148] Version: v1.28.13 I0313 09:55:10.900605 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0313 09:55:11.180251 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0313 09:55:11.190712 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0313 09:55:11.190737 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0313 09:55:11.190935 1 instance.go:298] Using reconciler: lease I0313 09:55:11.671075 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0313 09:55:11.671108 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0313 09:55:11.957520 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0313 09:55:11.957759 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0313 09:55:12.429553 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0313 09:55:12.449110 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0313 09:55:12.449146 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0313 09:55:12.449153 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0313 09:55:12.449650 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0313 09:55:12.449663 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0313 09:55:12.450612 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0313 09:55:12.451283 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0313 09:55:12.451297 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0313 09:55:12.451300 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0313 09:55:12.452993 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0313 09:55:12.453009 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0313 09:55:12.453987 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0313 09:55:12.454003 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0313 09:55:12.454007 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0313 09:55:12.454730 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0313 09:55:12.454748 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0313 09:55:12.454801 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0313 09:55:12.455487 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0313 09:55:12.457232 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0313 09:55:12.457247 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0313 09:55:12.457251 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0313 09:55:12.457763 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0313 09:55:12.457779 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0313 09:55:12.457783 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0313 09:55:12.458646 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0313 09:55:12.458663 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0313 09:55:12.460526 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0313 09:55:12.460541 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0313 09:55:12.460545 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0313 09:55:12.461255 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0313 09:55:12.461270 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0313 09:55:12.461274 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0313 09:55:12.463097 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0313 09:55:12.463112 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0313 09:55:12.463116 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0313 09:55:12.464088 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0313 09:55:12.464980 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0313 09:55:12.464994 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0313 09:55:12.464997 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0313 09:55:12.468138 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0313 09:55:12.468153 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0313 09:55:12.468156 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0313 09:55:12.468844 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0313 09:55:12.468858 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0313 09:55:12.468861 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0313 09:55:12.469273 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0313 09:55:12.469285 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0313 09:55:12.511152 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0313 09:55:12.511201 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0313 09:55:12.957475 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0313 09:55:12.957494 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0313 09:55:12.957573 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0313 09:55:12.957892 1 secure_serving.go:213] Serving securely on [::]:6443 I0313 09:55:12.957946 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0313 09:55:12.958101 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0313 09:55:12.958258 1 controller.go:78] Starting OpenAPI AggregationController I0313 09:55:12.958279 1 controller.go:80] Starting OpenAPI V3 AggregationController I0313 09:55:12.958281 1 available_controller.go:423] Starting AvailableConditionController I0313 09:55:12.958306 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0313 09:55:12.958464 1 aggregator.go:164] waiting for initial CRD sync... I0313 09:55:12.958496 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0313 09:55:12.958664 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0313 09:55:12.958927 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0313 09:55:12.958939 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0313 09:55:12.958955 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0313 09:55:12.959002 1 gc_controller.go:78] Starting apiserver lease garbage collector I0313 09:55:12.959103 1 controller.go:116] Starting legacy_token_tracking_controller I0313 09:55:12.959151 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0313 09:55:12.959226 1 gc_controller.go:78] Starting apiserver lease garbage collector I0313 09:55:12.959285 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0313 09:55:12.959303 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0313 09:55:12.959359 1 system_namespaces_controller.go:67] Starting system namespaces controller I0313 09:55:12.959601 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0313 09:55:12.959623 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0313 09:55:12.959633 1 naming_controller.go:291] Starting NamingConditionController I0313 09:55:12.959681 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0313 09:55:12.959717 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0313 09:55:12.959754 1 controller.go:134] Starting OpenAPI controller I0313 09:55:12.959776 1 crd_finalizer.go:266] Starting CRDFinalizer I0313 09:55:12.959829 1 controller.go:85] Starting OpenAPI V3 controller I0313 09:55:12.959660 1 establishing_controller.go:76] Starting EstablishingController I0313 09:55:12.977541 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0313 09:55:12.977706 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0313 09:55:12.980474 1 shared_informer.go:318] Caches are synced for node_authorizer E0313 09:55:13.032901 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0313 09:55:13.058721 1 apf_controller.go:379] Running API Priority and Fairness config worker I0313 09:55:13.058744 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0313 09:55:13.058830 1 cache.go:39] Caches are synced for AvailableConditionController controller I0313 09:55:13.059125 1 shared_informer.go:318] Caches are synced for crd-autoregister I0313 09:55:13.059161 1 aggregator.go:166] initial CRD sync complete... I0313 09:55:13.059170 1 autoregister_controller.go:141] Starting autoregister controller I0313 09:55:13.059177 1 cache.go:32] Waiting for caches to sync for autoregister controller I0313 09:55:13.059182 1 cache.go:39] Caches are synced for autoregister controller I0313 09:55:13.059421 1 shared_informer.go:318] Caches are synced for configmaps I0313 09:55:13.059512 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0313 09:55:13.059756 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0313 09:55:13.061760 1 controller.go:624] quota admission added evaluator for: namespaces I0313 09:55:13.239741 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0313 09:55:13.967326 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0313 09:55:13.976906 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0313 09:55:13.976930 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0313 09:55:14.787021 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0313 09:55:14.842224 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0313 09:55:14.980205 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0313 09:55:14.993929 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.57] I0313 09:55:14.996178 1 controller.go:624] quota admission added evaluator for: endpoints I0313 09:55:15.002143 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0313 09:55:15.095530 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0313 09:55:16.578708 1 controller.go:624] quota admission added evaluator for: deployments.apps I0313 09:55:16.618157 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0313 09:55:16.803908 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0313 09:55:20.091745 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0313 09:55:20.140963 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0313 09:55:53.555901 1 trace.go:236] Trace[1836323056]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3849bb20-bae7-4582-ab6f-5337a54cdba6,client:199.204.45.57,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/cert-manager/configmaps,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:root-ca-cert-publisher,verb:POST (13-Mar-2026 09:55:51.839) (total time: 1716ms): Trace[1836323056]: ["Create etcd3" audit-id:3849bb20-bae7-4582-ab6f-5337a54cdba6,key:/configmaps/cert-manager/kube-root-ca.crt,type:*core.ConfigMap,resource:configmaps 1715ms (09:55:51.840) Trace[1836323056]: ---"Txn call succeeded" 1715ms (09:55:53.555)] Trace[1836323056]: [1.716472595s] [1.716472595s] END I0313 09:55:54.639445 1 trace.go:236] Trace[1705318289]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9ab641c2-301b-440b-95cb-d228dbf22b16,client:199.204.45.57,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/cert-manager/serviceaccounts,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:service-account-controller,verb:POST (13-Mar-2026 09:55:51.840) (total time: 2798ms): Trace[1705318289]: ["Create etcd3" audit-id:9ab641c2-301b-440b-95cb-d228dbf22b16,key:/serviceaccounts/cert-manager/default,type:*core.ServiceAccount,resource:serviceaccounts 2797ms (09:55:51.841) Trace[1705318289]: ---"Txn call succeeded" 2797ms (09:55:54.639)] Trace[1705318289]: [2.798833602s] [2.798833602s] END I0313 09:55:54.639527 1 trace.go:236] Trace[715919064]: "Get" accept:application/json, */*,audit-id:9f2113f2-64dc-40aa-88d4-bc36b73c789e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (13-Mar-2026 09:55:52.176) (total time: 2463ms): Trace[715919064]: ---"About to write a response" 2462ms (09:55:54.639) Trace[715919064]: [2.463095022s] [2.463095022s] END I0313 09:55:54.639698 1 trace.go:236] Trace[1992971809]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:59a6dd3e-d26c-48b5-adb1-1f2119427066,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (13-Mar-2026 09:55:51.839) (total time: 2800ms): Trace[1992971809]: ["GuaranteedUpdate etcd3" audit-id:59a6dd3e-d26c-48b5-adb1-1f2119427066,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 2800ms (09:55:51.839) Trace[1992971809]: ---"Txn call completed" 2798ms (09:55:54.639)] Trace[1992971809]: [2.80018438s] [2.80018438s] END I0313 09:55:54.641056 1 trace.go:236] Trace[736570548]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f9a196f8-c406-4a5d-a703-5e76745bc4a4,client:199.204.45.57,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-qdwxp/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (13-Mar-2026 09:55:51.841) (total time: 2799ms): Trace[736570548]: ["GuaranteedUpdate etcd3" audit-id:f9a196f8-c406-4a5d-a703-5e76745bc4a4,key:/pods/kube-system/cilium-qdwxp,type:*core.Pod,resource:pods 2798ms (09:55:51.842) Trace[736570548]: ---"Txn call completed" 2788ms (09:55:54.638)] Trace[736570548]: ---"Object stored in database" 2789ms (09:55:54.639) Trace[736570548]: [2.799064099s] [2.799064099s] END I0313 09:55:54.649156 1 trace.go:236] Trace[87601503]: "Create" accept:application/json, */*,audit-id:8aa6f12f-ee4f-46ae-9ae4-c60a2c44844d,client:199.204.45.57,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/cert-manager/secrets,user-agent:Helm/3.11.2,verb:POST (13-Mar-2026 09:55:51.919) (total time: 2729ms): Trace[87601503]: ["Create etcd3" audit-id:8aa6f12f-ee4f-46ae-9ae4-c60a2c44844d,key:/secrets/cert-manager/sh.helm.release.v1.cert-manager.v1,type:*core.Secret,resource:secrets 2719ms (09:55:51.929) Trace[87601503]: ---"Txn call succeeded" 2709ms (09:55:54.639)] Trace[87601503]: [2.729491894s] [2.729491894s] END E0313 09:55:57.201316 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0313 09:55:57.201472 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0313 09:55:57.202709 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0313 09:55:57.202787 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0313 09:55:57.203921 1 trace.go:236] Trace[291024490]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1940985b-c1ba-471e-b505-4d72bac0a035,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (13-Mar-2026 09:55:52.201) (total time: 5001ms): Trace[291024490]: [5.001966396s] [5.001966396s] END E0313 09:55:57.204151 1 timeout.go:142] post-timeout activity - time-elapsed: 2.721806ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: I0313 09:55:57.487765 1 trace.go:236] Trace[877931955]: "Create" accept:application/json,audit-id:f7c363a7-53fc-418f-bc56-454bf0bdea2a,client:199.204.45.57,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/cert-manager/serviceaccounts,user-agent:Helm/3.11.2,verb:POST (13-Mar-2026 09:55:54.656) (total time: 2831ms): Trace[877931955]: ["Create etcd3" audit-id:f7c363a7-53fc-418f-bc56-454bf0bdea2a,key:/serviceaccounts/cert-manager/cert-manager-webhook,type:*core.ServiceAccount,resource:serviceaccounts 2830ms (09:55:54.657) Trace[877931955]: ---"Txn call succeeded" 2830ms (09:55:57.487)] Trace[877931955]: [2.831224645s] [2.831224645s] END I0313 09:55:57.487815 1 trace.go:236] Trace[235806117]: "Create" accept:application/json,audit-id:4d643ed0-aaf8-4814-a543-fe1f89e371a3,client:199.204.45.57,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/cert-manager/serviceaccounts,user-agent:Helm/3.11.2,verb:POST (13-Mar-2026 09:55:54.656) (total time: 2831ms): Trace[235806117]: ["Create etcd3" audit-id:4d643ed0-aaf8-4814-a543-fe1f89e371a3,key:/serviceaccounts/cert-manager/cert-manager-cainjector,type:*core.ServiceAccount,resource:serviceaccounts 2830ms (09:55:54.656) Trace[235806117]: ---"Txn call succeeded" 2830ms (09:55:57.487)] Trace[235806117]: [2.831473883s] [2.831473883s] END I0313 09:55:57.488178 1 trace.go:236] Trace[829309520]: "Get" accept:application/json, */*,audit-id:944b8cab-5703-457c-8b60-1dad0c6564b6,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (13-Mar-2026 09:55:52.231) (total time: 5256ms): Trace[829309520]: ---"About to write a response" 5255ms (09:55:57.487) Trace[829309520]: [5.256128495s] [5.256128495s] END I0313 09:55:57.488217 1 trace.go:236] Trace[168625712]: "Create" accept:application/json,audit-id:2db1a002-2c1c-42ce-b196-1e26517dcd7f,client:199.204.45.57,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/cert-manager/serviceaccounts,user-agent:Helm/3.11.2,verb:POST (13-Mar-2026 09:55:54.656) (total time: 2831ms): Trace[168625712]: ["Create etcd3" audit-id:2db1a002-2c1c-42ce-b196-1e26517dcd7f,key:/serviceaccounts/cert-manager/cert-manager,type:*core.ServiceAccount,resource:serviceaccounts 2831ms (09:55:54.657) Trace[168625712]: ---"Txn call succeeded" 2830ms (09:55:57.487)] Trace[168625712]: [2.831789942s] [2.831789942s] END I0313 09:55:57.488188 1 trace.go:236] Trace[1520263808]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:69e41a65-e7cc-4cbf-b65d-f88a49d5434b,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (13-Mar-2026 09:55:54.409) (total time: 3079ms): Trace[1520263808]: ["GuaranteedUpdate etcd3" audit-id:69e41a65-e7cc-4cbf-b65d-f88a49d5434b,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 3078ms (09:55:54.409) Trace[1520263808]: ---"Txn call completed" 3077ms (09:55:57.487)] Trace[1520263808]: [3.079064828s] [3.079064828s] END I0313 09:55:57.488880 1 trace.go:236] Trace[632603729]: "Update" accept:application/json, */*,audit-id:d1e5271b-fcb7-43d1-aa63-8c63687b483d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (13-Mar-2026 09:55:54.641) (total time: 2847ms): Trace[632603729]: ["GuaranteedUpdate etcd3" audit-id:d1e5271b-fcb7-43d1-aa63-8c63687b483d,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 2847ms (09:55:54.641) Trace[632603729]: ---"Txn call completed" 2845ms (09:55:57.488)] Trace[632603729]: [2.847385395s] [2.847385395s] END I0313 09:55:57.568825 1 trace.go:236] Trace[758288990]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7242e563-d098-4441-959c-e9206a39fab6,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (13-Mar-2026 09:55:56.641) (total time: 926ms): Trace[758288990]: ---"About to write a response" 926ms (09:55:57.568) Trace[758288990]: [926.920471ms] [926.920471ms] END I0313 09:55:57.569624 1 trace.go:236] Trace[842604540]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4cf5bc9d-378c-4062-a04b-415f7c8bdce4,client:199.204.45.57,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (13-Mar-2026 09:55:57.068) (total time: 501ms): Trace[842604540]: ["Create etcd3" audit-id:4cf5bc9d-378c-4062-a04b-415f7c8bdce4,key:/events/kube-system/kube-apiserver-instance.189c5e0b92283f19,type:*core.Event,resource:events 500ms (09:55:57.069) Trace[842604540]: ---"Txn call succeeded" 500ms (09:55:57.569)] Trace[842604540]: [501.077797ms] [501.077797ms] END I0313 09:55:57.717588 1 trace.go:236] Trace[918721488]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.57,type:*v1.Endpoints,resource:apiServerIPInfo (13-Mar-2026 09:55:54.972) (total time: 2745ms): Trace[918721488]: ---"initial value restored" 2598ms (09:55:57.570) Trace[918721488]: ---"Transaction prepared" 136ms (09:55:57.706) Trace[918721488]: [2.745503762s] [2.745503762s] END I0313 09:55:57.769687 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0313 09:55:57.788725 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0313 09:55:57.814118 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0313 09:55:57.841991 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.100.186.125"} I0313 09:55:57.864362 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.102.56.107"} I0313 09:55:57.884801 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0313 09:55:57.983520 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0313 09:55:58.039826 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0313 09:55:58.515907 1 controller.go:624] quota admission added evaluator for: jobs.batch I0313 09:55:59.195212 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0313 09:55:59.206836 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0313 09:55:59.216634 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0313 09:55:59.381227 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0313 09:55:59.589215 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0313 09:56:00.186116 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0313 09:56:00.390170 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0313 09:56:01.599409 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0313 09:56:02.081319 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0313 09:56:02.598650 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0313 09:56:03.113979 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0313 09:56:07.194767 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0313 09:56:17.608345 1 trace.go:236] Trace[1048794341]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b52cd414-65d4-4c8a-aaa1-f5e9beb26ace,client:199.204.45.57,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/cert-manager/deployments/cert-manager/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:deployment-controller,verb:PUT (13-Mar-2026 09:56:16.966) (total time: 641ms): Trace[1048794341]: ["GuaranteedUpdate etcd3" audit-id:b52cd414-65d4-4c8a-aaa1-f5e9beb26ace,key:/deployments/cert-manager/cert-manager,type:*apps.Deployment,resource:deployments.apps 641ms (09:56:16.966) Trace[1048794341]: ---"Txn call completed" 637ms (09:56:17.607)] Trace[1048794341]: [641.983146ms] [641.983146ms] END W0313 09:56:18.313764 1 dispatcher.go:225] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/mutate?timeout=10s": dial tcp 10.100.186.125:443: connect: connection refused I0313 09:56:23.323082 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0313 09:56:27.889073 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0313 09:56:42.228636 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.97.159.179"} I0313 09:56:42.239913 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.105.151.33"} I0313 09:56:42.261244 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.103.139.205"} I0313 09:56:42.273657 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.100.241.76"} I0313 09:56:49.725681 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0313 09:56:49.747096 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0313 09:56:49.772571 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0313 09:56:49.795195 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0313 09:56:49.815930 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0313 09:56:49.839476 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0313 09:56:49.857751 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0313 09:56:49.903683 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0313 09:56:49.924557 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0313 09:56:49.943294 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0313 09:56:49.961627 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0313 09:56:49.983178 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0313 09:56:50.001624 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0313 09:56:51.375548 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0313 09:56:54.381548 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0313 09:56:54.389165 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0313 09:56:54.444024 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.98.116.187"} I0313 09:56:54.470608 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0313 09:56:56.786997 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0313 09:56:56.915171 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0313 09:56:57.579450 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0313 09:56:57.579532 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0313 09:56:57.579614 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0313 09:57:04.197270 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0313 09:57:07.245914 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.99.138.8"} I0313 09:57:07.529076 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0313 09:57:07.682932 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.104.23.68"} I0313 09:57:07.697658 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.109.115.1"} I0313 09:58:07.106704 1 trace.go:236] Trace[88102031]: "Update" accept:application/json, */*,audit-id:5efd60f9-8081-44aa-88b5-9e4774491eaa,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (13-Mar-2026 09:58:06.596) (total time: 510ms): Trace[88102031]: ["GuaranteedUpdate etcd3" audit-id:5efd60f9-8081-44aa-88b5-9e4774491eaa,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 510ms (09:58:06.596) Trace[88102031]: ---"Txn call completed" 509ms (09:58:07.106)] Trace[88102031]: [510.321836ms] [510.321836ms] END I0313 09:58:07.106786 1 trace.go:236] Trace[1200178858]: "Update" accept:application/json, */*,audit-id:281b3ed2-26bd-4c52-9b6f-3ddf3e986e92,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (13-Mar-2026 09:58:06.596) (total time: 510ms): Trace[1200178858]: ["GuaranteedUpdate etcd3" audit-id:281b3ed2-26bd-4c52-9b6f-3ddf3e986e92,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 510ms (09:58:06.596) Trace[1200178858]: ---"Txn call completed" 509ms (09:58:07.106)] Trace[1200178858]: [510.557102ms] [510.557102ms] END I0313 09:58:26.931261 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.105.9.76"} I0313 09:58:29.410363 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.97.198.61"} I0313 09:58:29.419383 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.99.214.73"} I0313 09:58:36.042982 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.103.21.8"} I0313 09:58:36.052578 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.96.138.127"} I0313 10:01:10.062598 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0313 10:01:14.165152 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0313 10:01:14.210643 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0313 10:01:17.997694 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0313 10:01:18.009632 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0313 10:01:18.027580 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0313 10:01:18.038044 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0313 10:01:18.049551 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0313 10:01:18.067859 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0313 10:01:18.077134 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0313 10:01:19.859029 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0313 10:01:31.489852 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0313 10:02:11.250101 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0313 10:02:25.923536 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0313 10:02:26.153625 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0313 10:02:26.175994 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0313 10:02:26.186216 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0313 10:02:26.441115 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0313 10:02:26.813595 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0313 10:02:26.820540 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0313 10:02:26.871238 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0313 10:02:26.883287 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0313 10:02:27.047327 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0313 10:03:06.213544 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.111.230.0"} I0313 10:03:06.227926 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.110.216.210"} I0313 10:03:06.241393 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.100.89.159"} I0313 10:03:06.251005 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.104.235.237"} I0313 10:03:06.259208 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.100.155.174"} I0313 10:03:06.274559 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.106.91.134"} I0313 10:03:06.321905 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0313 10:03:06.337246 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0313 10:03:06.383074 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0313 10:03:06.394329 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0313 10:03:06.412998 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0313 10:03:06.423765 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.423796 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.423818 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.423830 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.423795 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.423849 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.424717 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.424788 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.424924 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.424982 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.425151 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.425212 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.425470 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.425509 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.425524 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.425542 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.425540 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.425547 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.425730 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.425857 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.425996 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.426023 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.426132 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.426247 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.426531 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.426628 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.427312 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.427372 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.428553 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.428593 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused W0313 10:03:06.428679 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused E0313 10:03:06.428726 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.216.210:443: connect: connection refused I0313 10:03:17.171109 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.101.13.145"} I0313 10:03:17.191677 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.105.60.4"} I0313 10:03:20.591243 1 trace.go:236] Trace[1465502672]: "Get" accept:application/json, */*,audit-id:c4e5177b-ca04-49df-82cc-f9daf9d6f492,client:10.0.0.111,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-cc53fcdb-c579-406f-a0b6-7ad30cb1a7dc,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (13-Mar-2026 10:03:20.078) (total time: 512ms): Trace[1465502672]: ---"About to write a response" 511ms (10:03:20.589) Trace[1465502672]: [512.674466ms] [512.674466ms] END I0313 10:03:20.674546 1 trace.go:236] Trace[454174337]: "Update" accept:application/json, */*,audit-id:b6f80428-3097-427d-8339-f920d617a97d,client:10.0.0.151,protocol:HTTP/2.0,resource:nodefeatures,scope:resource,url:/apis/nfd.k8s-sigs.io/v1alpha1/namespaces/monitoring/nodefeatures/instance,user-agent:nfd-worker/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (13-Mar-2026 10:03:19.909) (total time: 765ms): Trace[454174337]: ---"Conversion done" 45ms (10:03:19.957) Trace[454174337]: ["GuaranteedUpdate etcd3" audit-id:b6f80428-3097-427d-8339-f920d617a97d,key:/nfd.k8s-sigs.io/nodefeatures/monitoring/instance,type:*unstructured.Unstructured,resource:nodefeatures.nfd.k8s-sigs.io 713ms (10:03:19.961) Trace[454174337]: ---"About to Encode" 168ms (10:03:20.142) Trace[454174337]: ---"Txn call completed" 432ms (10:03:20.590) Trace[454174337]: ---"decode succeeded" len:413674 62ms (10:03:20.652)] Trace[454174337]: ---"Writing http response done" 21ms (10:03:20.674) Trace[454174337]: [765.033494ms] [765.033494ms] END I0313 10:03:21.607027 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.106.204.179"} I0313 10:03:24.421877 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.105.56.203"} I0313 10:03:29.212585 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.100.25.56"} I0313 10:03:30.163806 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.103.32.219"} I0313 10:03:36.943020 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0313 10:03:37.139591 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.105.186.77"} I0313 10:03:39.700150 1 trace.go:236] Trace[976929576]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7bd167d2-965d-4344-b3f8-38c099093f7a,client:10.0.0.212,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (13-Mar-2026 10:03:39.092) (total time: 607ms): Trace[976929576]: ["GuaranteedUpdate etcd3" audit-id:7bd167d2-965d-4344-b3f8-38c099093f7a,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 607ms (10:03:39.092) Trace[976929576]: ---"Txn call completed" 606ms (10:03:39.699)] Trace[976929576]: [607.661404ms] [607.661404ms] END I0313 10:03:39.701313 1 trace.go:236] Trace[434523519]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:34931cfe-80fc-46da-b17a-e93c01514da6,client:10.0.0.209,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (13-Mar-2026 10:03:39.166) (total time: 534ms): Trace[434523519]: ["GuaranteedUpdate etcd3" audit-id:34931cfe-80fc-46da-b17a-e93c01514da6,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 534ms (10:03:39.166) Trace[434523519]: ---"Txn call completed" 533ms (10:03:39.701)] Trace[434523519]: [534.525593ms] [534.525593ms] END I0313 10:03:39.701449 1 trace.go:236] Trace[1196708809]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6d626742-ce81-41c5-91a6-6663a1b996e5,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (13-Mar-2026 10:03:38.867) (total time: 833ms): Trace[1196708809]: ---"About to write a response" 833ms (10:03:39.701) Trace[1196708809]: [833.621973ms] [833.621973ms] END I0313 10:03:39.701742 1 trace.go:236] Trace[894538237]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:391aa098-95ab-4466-8cc1-86d98b945a24,client:10.0.0.181,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (13-Mar-2026 10:03:38.861) (total time: 840ms): Trace[894538237]: ["GuaranteedUpdate etcd3" audit-id:391aa098-95ab-4466-8cc1-86d98b945a24,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 840ms (10:03:38.861) Trace[894538237]: ---"Txn call completed" 838ms (10:03:39.701)] Trace[894538237]: [840.181999ms] [840.181999ms] END I0313 10:04:28.413051 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.102.213.126"} I0313 10:04:28.432687 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0313 10:07:32.279864 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.107.197.30"} I0313 10:08:00.887929 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.102.250.244"} I0313 10:09:56.297341 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0313 10:09:56.335895 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.366681 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.367486 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.380635 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.389689 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.411031 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.427352 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.440139 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.447650 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0313 10:09:56.458011 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.465024 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.478195 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.504484 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.536842 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.548402 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.587276 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.667079 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:09:56.792170 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0313 10:10:38.333056 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0313 10:10:38.346961 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0313 10:10:43.546450 1 trace.go:236] Trace[1158929077]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:fa073e02-eb8b-4f67-8c89-f5aec8664e14,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (13-Mar-2026 10:10:42.625) (total time: 920ms): Trace[1158929077]: ["GuaranteedUpdate etcd3" audit-id:fa073e02-eb8b-4f67-8c89-f5aec8664e14,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 920ms (10:10:42.625) Trace[1158929077]: ---"Txn call completed" 919ms (10:10:43.546)] Trace[1158929077]: [920.792136ms] [920.792136ms] END I0313 10:10:43.547711 1 trace.go:236] Trace[121920481]: "Get" accept:application/json, */*,audit-id:26c03fcf-57ed-42a4-bf59-23375e7322b0,client:10.0.0.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (13-Mar-2026 10:10:42.743) (total time: 803ms): Trace[121920481]: ---"About to write a response" 803ms (10:10:43.547) Trace[121920481]: [803.738662ms] [803.738662ms] END I0313 10:10:43.548242 1 trace.go:236] Trace[2039378174]: "Get" accept:application/json, */*,audit-id:77af097e-62b2-465a-9144-33fc07fd59dd,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (13-Mar-2026 10:10:42.979) (total time: 568ms): Trace[2039378174]: ---"About to write a response" 568ms (10:10:43.548) Trace[2039378174]: [568.595357ms] [568.595357ms] END I0313 10:10:43.548373 1 trace.go:236] Trace[2123727781]: "Get" accept:application/json, */*,audit-id:6b6a95fc-ecbb-4e18-827a-867fc94d6a10,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (13-Mar-2026 10:10:42.880) (total time: 668ms): Trace[2123727781]: ---"About to write a response" 667ms (10:10:43.548) Trace[2123727781]: [668.101518ms] [668.101518ms] END I0313 10:10:43.548461 1 trace.go:236] Trace[1961114871]: "Get" accept:application/json, */*,audit-id:a15a9a26-893d-4697-afcf-602e723be74e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (13-Mar-2026 10:10:42.891) (total time: 656ms): Trace[1961114871]: ---"About to write a response" 656ms (10:10:43.548) Trace[1961114871]: [656.853766ms] [656.853766ms] END I0313 10:11:12.192130 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.101.105.158"} I0313 10:11:15.231249 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.100.24.23"} I0313 10:11:49.243094 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.97.91.53"} E0313 10:11:56.961518 1 watch.go:287] unable to encode watch object *v1.WatchEvent: http2: stream closed (&streaming.encoderWithAllocator{writer:responsewriter.outerWithCloseNotifyAndFlush{UserProvidedDecorator:(*metrics.ResponseWriterDelegator)(0xc02120e780), InnerCloseNotifierFlusher:struct { httpsnoop.Unwrapper; http.ResponseWriter; http.Flusher; http.CloseNotifier; http.Pusher }{Unwrapper:(*httpsnoop.rw)(0xc02beca550), ResponseWriter:(*httpsnoop.rw)(0xc02beca550), Flusher:(*httpsnoop.rw)(0xc02beca550), CloseNotifier:(*httpsnoop.rw)(0xc02beca550), Pusher:(*httpsnoop.rw)(0xc02beca550)}}, encoder:(*versioning.codec)(0xc01aaff040), memAllocator:(*runtime.Allocator)(0xc00d679530)}) I0313 10:16:22.586979 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.102.87.238"}