I0514 11:15:52.840246 1 options.go:220] external host was not specified, using 199.204.45.22 I0514 11:15:52.840989 1 server.go:148] Version: v1.28.13 I0514 11:15:52.841026 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0514 11:15:53.226687 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0514 11:15:53.233996 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0514 11:15:53.234016 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0514 11:15:53.234229 1 instance.go:298] Using reconciler: lease I0514 11:15:53.288011 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0514 11:15:53.288037 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0514 11:15:53.556162 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0514 11:15:53.556441 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0514 11:15:54.025097 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0514 11:15:54.036511 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0514 11:15:54.036540 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0514 11:15:54.036549 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0514 11:15:54.037126 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0514 11:15:54.037141 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0514 11:15:54.038089 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0514 11:15:54.039166 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0514 11:15:54.039183 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0514 11:15:54.039188 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0514 11:15:54.040661 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0514 11:15:54.040679 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0514 11:15:54.041596 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0514 11:15:54.041631 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0514 11:15:54.041636 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0514 11:15:54.042276 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0514 11:15:54.042294 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0514 11:15:54.042354 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0514 11:15:54.042853 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0514 11:15:54.044295 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0514 11:15:54.044309 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0514 11:15:54.044313 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0514 11:15:54.044702 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0514 11:15:54.044713 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0514 11:15:54.044717 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0514 11:15:54.045353 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0514 11:15:54.045365 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0514 11:15:54.047024 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0514 11:15:54.047038 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0514 11:15:54.047043 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0514 11:15:54.047365 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0514 11:15:54.047378 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0514 11:15:54.047383 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0514 11:15:54.048986 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0514 11:15:54.049000 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0514 11:15:54.049004 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0514 11:15:54.049858 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0514 11:15:54.050658 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0514 11:15:54.050671 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0514 11:15:54.050675 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0514 11:15:54.053407 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0514 11:15:54.053422 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0514 11:15:54.053425 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0514 11:15:54.054069 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0514 11:15:54.054081 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0514 11:15:54.054085 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0514 11:15:54.054684 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0514 11:15:54.054697 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0514 11:15:54.101709 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0514 11:15:54.101741 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0514 11:15:54.502633 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0514 11:15:54.502630 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0514 11:15:54.503012 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0514 11:15:54.503481 1 secure_serving.go:213] Serving securely on [::]:6443 I0514 11:15:54.503597 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0514 11:15:54.503628 1 controller.go:78] Starting OpenAPI AggregationController I0514 11:15:54.503608 1 controller.go:80] Starting OpenAPI V3 AggregationController I0514 11:15:54.503847 1 aggregator.go:164] waiting for initial CRD sync... I0514 11:15:54.503906 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0514 11:15:54.503988 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0514 11:15:54.503930 1 system_namespaces_controller.go:67] Starting system namespaces controller I0514 11:15:54.504113 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0514 11:15:54.504101 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0514 11:15:54.504155 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0514 11:15:54.504173 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0514 11:15:54.504169 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0514 11:15:54.504187 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0514 11:15:54.504207 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0514 11:15:54.504298 1 controller.go:134] Starting OpenAPI controller I0514 11:15:54.504355 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0514 11:15:54.504438 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0514 11:15:54.504578 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0514 11:15:54.504628 1 gc_controller.go:78] Starting apiserver lease garbage collector I0514 11:15:54.504644 1 controller.go:85] Starting OpenAPI V3 controller I0514 11:15:54.504671 1 naming_controller.go:291] Starting NamingConditionController I0514 11:15:54.504705 1 establishing_controller.go:76] Starting EstablishingController I0514 11:15:54.504704 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0514 11:15:54.504726 1 crd_finalizer.go:266] Starting CRDFinalizer I0514 11:15:54.504737 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0514 11:15:54.504354 1 controller.go:116] Starting legacy_token_tracking_controller I0514 11:15:54.504760 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0514 11:15:54.504482 1 available_controller.go:423] Starting AvailableConditionController I0514 11:15:54.504825 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0514 11:15:54.504874 1 gc_controller.go:78] Starting apiserver lease garbage collector I0514 11:15:54.527535 1 shared_informer.go:318] Caches are synced for node_authorizer E0514 11:15:54.574037 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0514 11:15:54.604918 1 shared_informer.go:318] Caches are synced for configmaps I0514 11:15:54.605092 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0514 11:15:54.605154 1 apf_controller.go:379] Running API Priority and Fairness config worker I0514 11:15:54.605206 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0514 11:15:54.605235 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0514 11:15:54.605261 1 shared_informer.go:318] Caches are synced for crd-autoregister I0514 11:15:54.605339 1 aggregator.go:166] initial CRD sync complete... I0514 11:15:54.605366 1 autoregister_controller.go:141] Starting autoregister controller I0514 11:15:54.605378 1 cache.go:32] Waiting for caches to sync for autoregister controller I0514 11:15:54.605382 1 cache.go:39] Caches are synced for AvailableConditionController controller I0514 11:15:54.605388 1 cache.go:39] Caches are synced for autoregister controller I0514 11:15:54.606922 1 controller.go:624] quota admission added evaluator for: namespaces I0514 11:15:54.777279 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0514 11:15:55.511940 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0514 11:15:55.519472 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0514 11:15:55.519486 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0514 11:15:56.098112 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0514 11:15:56.147891 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0514 11:15:56.216815 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0514 11:15:56.225858 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.22] I0514 11:15:56.227230 1 controller.go:624] quota admission added evaluator for: endpoints I0514 11:15:56.232160 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0514 11:15:57.828429 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0514 11:15:57.844521 1 controller.go:624] quota admission added evaluator for: deployments.apps I0514 11:15:57.862082 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0514 11:15:58.066267 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0514 11:16:03.367954 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0514 11:16:03.817909 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0514 11:16:21.503974 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0514 11:16:21.519572 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0514 11:16:21.519616 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0514 11:16:21.540123 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0514 11:16:21.540179 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0514 11:16:21.545689 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0514 11:16:21.565909 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0514 11:16:21.587756 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0514 11:16:21.603144 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0514 11:16:21.614633 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0514 11:16:21.635901 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0514 11:16:21.635969 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0514 11:16:21.684077 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0514 11:16:21.684112 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0514 11:16:21.716020 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0514 11:16:21.810843 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0514 11:16:21.990685 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0514 11:16:21.990740 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0514 11:16:22.054422 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0514 11:16:22.081909 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0514 11:16:22.117482 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0514 11:16:22.122110 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0514 11:16:22.729598 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0514 11:16:22.731809 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0514 11:16:22.816791 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0514 11:16:28.287774 1 controller.go:624] quota admission added evaluator for: jobs.batch I0514 11:16:29.531059 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0514 11:16:29.543379 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0514 11:16:29.550322 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0514 11:16:29.727830 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0514 11:16:29.949247 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0514 11:16:30.328893 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0514 11:16:30.535797 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0514 11:16:31.952483 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0514 11:16:32.553656 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0514 11:16:33.149314 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0514 11:16:34.437225 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0514 11:16:34.790283 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0514 11:16:34.790345 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0514 11:16:37.830397 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0514 11:16:46.182616 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.96.71.220"} W0514 11:16:46.209198 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.96.71.220:9443: connect: connection refused E0514 11:16:46.209247 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.96.71.220:9443: connect: connection refused I0514 11:16:58.839848 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0514 11:16:58.851453 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0514 11:16:58.866645 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0514 11:16:58.919237 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.105.14.100"} I0514 11:16:58.929402 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.106.25.17"} I0514 11:16:58.931750 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0514 11:16:58.984384 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0514 11:16:59.016274 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager W0514 11:17:19.325697 1 dispatcher.go:225] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/mutate?timeout=10s": context deadline exceeded I0514 11:17:19.325959 1 trace.go:236] Trace[1138082360]: "Create" accept:application/json, */*,audit-id:4e3113b2-9879-46eb-803f-9bc20b6a97ed,client:10.0.0.131,protocol:HTTP/2.0,resource:certificates,scope:resource,url:/apis/cert-manager.io/v1/namespaces/cert-manager/certificates,user-agent:Go-http-client/2.0,verb:POST (14-May-2026 11:17:09.323) (total time: 10002ms): Trace[1138082360]: ["Call mutating webhook" configuration:cert-manager-webhook,webhook:webhook.cert-manager.io,resource:cert-manager.io/v1, Resource=certificates,subresource:,operation:CREATE,UID:22b8c216-eadb-43a7-a870-90bf04334be4 10001ms (11:17:09.324)] Trace[1138082360]: [10.002169901s] [10.002169901s] END I0514 11:17:19.343855 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0514 11:17:25.099938 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0514 11:17:39.055122 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.100.55.213"} I0514 11:17:39.063426 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.106.208.51"} I0514 11:17:39.070667 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.102.11.24"} I0514 11:17:39.081845 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.111.200.32"} I0514 11:17:46.017849 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0514 11:17:46.036688 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0514 11:17:46.057001 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0514 11:17:46.079799 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0514 11:17:46.100677 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0514 11:17:46.119041 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0514 11:17:46.146730 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0514 11:17:46.164295 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0514 11:17:46.187179 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0514 11:17:46.204442 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0514 11:17:46.224842 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0514 11:17:46.244755 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0514 11:17:46.264994 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0514 11:17:47.561162 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0514 11:17:51.167858 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0514 11:17:51.174874 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0514 11:17:51.232698 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.110.108.36"} I0514 11:17:51.267424 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0514 11:17:53.422500 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0514 11:17:53.460365 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0514 11:17:54.078058 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0514 11:17:54.078132 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0514 11:17:54.078191 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0514 11:18:00.541428 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0514 11:18:04.581590 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.110.181.155"} I0514 11:18:04.854242 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0514 11:18:04.997116 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.108.26.121"} I0514 11:18:05.012529 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.100.180.135"} I0514 11:19:40.594759 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.110.1.32"} I0514 11:19:43.093957 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.97.201.246"} I0514 11:19:43.100757 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.99.245.74"} I0514 11:19:49.534021 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.102.149.231"} I0514 11:19:49.544937 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.111.226.85"} I0514 11:22:13.414690 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0514 11:22:17.176342 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0514 11:22:17.211700 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0514 11:22:21.080809 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0514 11:22:21.093665 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0514 11:22:21.105202 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0514 11:22:21.115422 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0514 11:22:21.128469 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0514 11:22:21.141017 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0514 11:22:21.149527 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0514 11:22:23.081694 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0514 11:22:33.938357 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0514 11:23:12.439824 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0514 11:23:26.622649 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0514 11:23:26.815435 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0514 11:23:26.829985 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0514 11:23:26.846253 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0514 11:23:27.062120 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0514 11:23:27.381706 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0514 11:23:27.404927 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0514 11:23:27.462319 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0514 11:23:27.502769 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0514 11:23:27.653729 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0514 11:24:05.510540 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.101.97.68"} I0514 11:24:05.522267 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.110.113.79"} I0514 11:24:05.531240 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.111.171.114"} I0514 11:24:05.542853 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.109.29.72"} I0514 11:24:05.550747 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.96.59.189"} I0514 11:24:05.559368 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.107.85.78"} I0514 11:24:05.607620 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0514 11:24:05.621242 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0514 11:24:05.659433 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0514 11:24:05.671689 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0514 11:24:05.690133 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0514 11:24:05.700354 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.700398 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.700621 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.700663 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.701054 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.701166 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.701300 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.701405 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.701455 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.701501 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.701687 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.701729 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.701780 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.701809 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.702002 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.702023 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.702049 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.702068 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.702231 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.702277 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.702280 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.702494 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.702974 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.703025 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.703193 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.703246 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.703398 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.703454 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.703611 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.703644 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused W0514 11:24:05.704643 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused E0514 11:24:05.704751 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.85.78:443: connect: connection refused I0514 11:24:16.647576 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.104.203.52"} I0514 11:24:16.655881 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.102.209.158"} I0514 11:24:21.291166 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.111.229.181"} I0514 11:24:24.039820 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.109.86.41"} I0514 11:24:28.559945 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.107.106.67"} I0514 11:24:29.477692 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.96.64.145"} I0514 11:24:36.131139 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0514 11:24:36.285741 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.104.165.225"} E0514 11:25:21.530081 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:21.530132 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:21.530210 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 54.172µs, panicked: false, err: context deadline exceeded, panic-reason: E0514 11:25:21.531807 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:21.531956 1 trace.go:236] Trace[1774686849]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cd116608-5a71-4d71-8b1c-e6d0fcd1de39,client:10.0.0.118,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (14-May-2026 11:25:16.530) (total time: 5001ms): Trace[1774686849]: ["GuaranteedUpdate etcd3" audit-id:cd116608-5a71-4d71-8b1c-e6d0fcd1de39,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (11:25:16.530) Trace[1774686849]: ---"Txn call failed" err:context deadline exceeded 4998ms (11:25:21.529)] Trace[1774686849]: [5.001602794s] [5.001602794s] END E0514 11:25:21.532139 1 timeout.go:142] post-timeout activity - time-elapsed: 2.021446ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0514 11:25:21.765470 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0514 11:25:21.765573 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:21.767571 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:21.767638 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:21.768767 1 trace.go:236] Trace[53549824]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2753ca71-9856-4817-8320-e635103802d6,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-May-2026 11:25:16.765) (total time: 5002ms): Trace[53549824]: [5.002837708s] [5.002837708s] END E0514 11:25:21.768998 1 timeout.go:142] post-timeout activity - time-elapsed: 3.424074ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0514 11:25:21.946590 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0514 11:25:21.946762 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:21.947786 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:21.947854 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:21.948946 1 trace.go:236] Trace[425651127]: "Get" accept:application/json, */*,audit-id:87ebab1f-4a58-4c47-acea-5c005d131cb7,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-May-2026 11:25:16.946) (total time: 5002ms): Trace[425651127]: [5.002719994s] [5.002719994s] END E0514 11:25:21.949114 1 timeout.go:142] post-timeout activity - time-elapsed: 2.635803ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0514 11:25:22.053827 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:22.053862 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:22.053889 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 25.811µs, panicked: false, err: context deadline exceeded, panic-reason: E0514 11:25:22.054959 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:22.055054 1 trace.go:236] Trace[330149688]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bc4ee6f4-d2db-49b7-8e15-379b236e09bc,client:10.0.0.94,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (14-May-2026 11:25:17.054) (total time: 5000ms): Trace[330149688]: ["GuaranteedUpdate etcd3" audit-id:bc4ee6f4-d2db-49b7-8e15-379b236e09bc,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (11:25:17.054) Trace[330149688]: ---"Txn call failed" err:context deadline exceeded 4998ms (11:25:22.053)] Trace[330149688]: [5.000977127s] [5.000977127s] END E0514 11:25:22.055312 1 timeout.go:142] post-timeout activity - time-elapsed: 1.4942ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0514 11:25:22.118152 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:22.118182 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:22.118219 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 15.46µs, panicked: false, err: context canceled, panic-reason: E0514 11:25:22.119657 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:22.119770 1 trace.go:236] Trace[429409374]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:375823a1-d9a4-49d0-abfd-e9e2a6ab37d7,client:10.0.0.47,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (14-May-2026 11:25:17.118) (total time: 5001ms): Trace[429409374]: ["GuaranteedUpdate etcd3" audit-id:375823a1-d9a4-49d0-abfd-e9e2a6ab37d7,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (11:25:17.118) Trace[429409374]: ---"Txn call failed" err:context canceled 4998ms (11:25:22.118)] Trace[429409374]: [5.00109021s] [5.00109021s] END E0514 11:25:22.119944 1 timeout.go:142] post-timeout activity - time-elapsed: 1.83401ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0514 11:25:22.125042 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:22.125077 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:22.125126 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 19.65µs, panicked: false, err: context canceled, panic-reason: E0514 11:25:22.126201 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:22.126308 1 trace.go:236] Trace[2114398613]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e2ca8c6f-c8a2-4e7c-8b2a-e1395006557e,client:10.0.0.234,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (14-May-2026 11:25:17.125) (total time: 5000ms): Trace[2114398613]: ["GuaranteedUpdate etcd3" audit-id:e2ca8c6f-c8a2-4e7c-8b2a-e1395006557e,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (11:25:17.125) Trace[2114398613]: ---"Txn call failed" err:context canceled 4998ms (11:25:22.124)] Trace[2114398613]: [5.000618417s] [5.000618417s] END E0514 11:25:22.126502 1 timeout.go:142] post-timeout activity - time-elapsed: 1.551563ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0514 11:25:23.367416 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0514 11:25:23.367539 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:23.368562 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:23.368619 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:23.369756 1 trace.go:236] Trace[868653259]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d950c830-b7ef-41b7-8905-8c0dabc73aa1,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-May-2026 11:25:18.367) (total time: 5001ms): Trace[868653259]: [5.001925953s] [5.001925953s] END E0514 11:25:23.369943 1 timeout.go:142] post-timeout activity - time-elapsed: 2.586901ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0514 11:25:23.455221 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0514 11:25:23.455521 1 trace.go:236] Trace[1690426147]: "Update" accept:application/json, */*,audit-id:1178645b-2dae-475d-aa58-16e5f6573d06,client:199.204.45.22,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/openstack/secrets/sh.helm.release.v1.keystone.v1,user-agent:Helm/3.11.2,verb:PUT (14-May-2026 11:25:16.449) (total time: 7006ms): Trace[1690426147]: ["GuaranteedUpdate etcd3" audit-id:1178645b-2dae-475d-aa58-16e5f6573d06,key:/secrets/openstack/sh.helm.release.v1.keystone.v1,type:*core.Secret,resource:secrets 7004ms (11:25:16.451) Trace[1690426147]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (11:25:23.455)] Trace[1690426147]: [7.006403083s] [7.006403083s] END E0514 11:25:24.037447 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0514 11:25:24.037600 1 trace.go:236] Trace[943466159]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9ea603f9-0767-4fae-93c0-c3516cfe0c74,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-May-2026 11:25:17.034) (total time: 7003ms): Trace[943466159]: ["GuaranteedUpdate etcd3" audit-id:9ea603f9-0767-4fae-93c0-c3516cfe0c74,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (11:25:17.034) Trace[943466159]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (11:25:24.037)] Trace[943466159]: [7.003486033s] [7.003486033s] END E0514 11:25:24.038237 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0514 11:25:26.529945 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0514 11:25:26.530068 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:26.531106 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:26.531221 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:26.532250 1 trace.go:236] Trace[1354850023]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8baca306-8995-4b76-b01a-173befe2c540,client:10.0.0.118,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-May-2026 11:25:21.531) (total time: 5000ms): Trace[1354850023]: [5.000673367s] [5.000673367s] END E0514 11:25:26.532429 1 timeout.go:142] post-timeout activity - time-elapsed: 2.462018ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0514 11:25:26.550814 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0514 11:25:26.550931 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:26.552496 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:26.552593 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:26.553742 1 trace.go:236] Trace[1134699854]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d2b46730-e90c-43a0-ada7-ba0249351472,client:10.0.0.118,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-May-2026 11:25:17.048) (total time: 9505ms): Trace[1134699854]: [9.505568285s] [9.505568285s] END E0514 11:25:26.554009 1 timeout.go:142] post-timeout activity - time-elapsed: 3.240799ms, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: E0514 11:25:26.765702 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0514 11:25:26.765823 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:26.766959 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:26.766997 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:26.768240 1 trace.go:236] Trace[2096755174]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:023d22b3-4cce-497a-bdbe-abd32006b167,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-May-2026 11:25:23.767) (total time: 3000ms): Trace[2096755174]: [3.00033042s] [3.00033042s] END E0514 11:25:26.768431 1 timeout.go:142] post-timeout activity - time-elapsed: 2.869519ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0514 11:25:26.937653 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0514 11:25:26.937850 1 trace.go:236] Trace[2012979567]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8ce4a1c5-6e15-4481-857a-d375041b4ac8,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-May-2026 11:25:19.934) (total time: 7003ms): Trace[2012979567]: ["GuaranteedUpdate etcd3" audit-id:8ce4a1c5-6e15-4481-857a-d375041b4ac8,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (11:25:19.934) Trace[2012979567]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (11:25:26.937)] Trace[2012979567]: [7.003328318s] [7.003328318s] END E0514 11:25:26.946345 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0514 11:25:26.946588 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:26.947864 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:26.947927 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:26.949150 1 trace.go:236] Trace[929221571]: "Get" accept:application/json, */*,audit-id:b6b60af2-5a39-4217-9141-540ff8c3eb24,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-May-2026 11:25:23.948) (total time: 3000ms): Trace[929221571]: [3.000697621s] [3.000697621s] END E0514 11:25:26.949282 1 timeout.go:142] post-timeout activity - time-elapsed: 3.166877ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0514 11:25:27.054021 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0514 11:25:27.054176 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:27.055177 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:27.055752 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:27.056349 1 trace.go:236] Trace[1799687661]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:271a753e-6556-4f08-810e-22f9edf0fb06,client:10.0.0.94,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-May-2026 11:25:22.055) (total time: 5000ms): Trace[1799687661]: [5.00041392s] [5.00041392s] END E0514 11:25:27.056517 1 timeout.go:142] post-timeout activity - time-elapsed: 2.458088ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0514 11:25:27.074622 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:27.074652 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:27.074671 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 13.741µs, panicked: false, err: context canceled, panic-reason: E0514 11:25:27.076588 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0514 11:25:27.076767 1 timeout.go:142] post-timeout activity - time-elapsed: 2.214112ms, POST "/api/v1/namespaces/openstack/events" result: E0514 11:25:27.118539 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0514 11:25:27.118625 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:27.119632 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:27.119674 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:27.120877 1 trace.go:236] Trace[1845534503]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:361ea3cc-641e-4137-bcd8-beb53b49fc4f,client:10.0.0.47,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-May-2026 11:25:22.119) (total time: 5001ms): Trace[1845534503]: [5.00146085s] [5.00146085s] END E0514 11:25:27.121092 1 timeout.go:142] post-timeout activity - time-elapsed: 2.55053ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0514 11:25:27.124299 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0514 11:25:27.124410 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:27.125561 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:27.125656 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:27.126727 1 trace.go:236] Trace[482523817]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5ea6c940-e192-44f1-b75f-c3001566e07f,client:10.0.0.234,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-May-2026 11:25:22.125) (total time: 5000ms): Trace[482523817]: [5.000723489s] [5.000723489s] END E0514 11:25:27.126859 1 timeout.go:142] post-timeout activity - time-elapsed: 2.600931ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0514 11:25:27.232337 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0514 11:25:27.232481 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:27.233550 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:27.233603 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:27.234700 1 trace.go:236] Trace[506761274]: "Get" accept:application/json, */*,audit-id:28035447-792f-453d-b4e0-cd6bb98ebcdb,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-May-2026 11:25:17.231) (total time: 10002ms): Trace[506761274]: [10.002868747s] [10.002868747s] END E0514 11:25:27.234881 1 timeout.go:142] post-timeout activity - time-elapsed: 2.635352ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0514 11:25:27.504496 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0514 11:25:27.504629 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:27.505572 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:27.505808 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:27.506796 1 trace.go:236] Trace[2072719514]: "Get" accept:application/json, */*,audit-id:73639ea0-fb25-4e8b-b431-1c7d51a40ab5,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-May-2026 11:25:17.504) (total time: 10002ms): Trace[2072719514]: [10.002002953s] [10.002002953s] END E0514 11:25:27.506909 1 timeout.go:142] post-timeout activity - time-elapsed: 2.415285ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0514 11:25:28.366951 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0514 11:25:28.367099 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:28.368741 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:28.368823 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:28.369883 1 trace.go:236] Trace[1104380270]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:096f94ea-9c34-4309-b01b-5025d42abdff,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-May-2026 11:25:25.368) (total time: 3000ms): Trace[1104380270]: [3.000829445s] [3.000829445s] END E0514 11:25:28.370034 1 timeout.go:142] post-timeout activity - time-elapsed: 3.053954ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0514 11:25:28.372259 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0514 11:25:28.372559 1 trace.go:236] Trace[1268449293]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:88429cdd-53b9-4a40-ba08-a100c7140d36,client:199.204.45.22,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (14-May-2026 11:25:21.369) (total time: 7003ms): Trace[1268449293]: ["Create etcd3" audit-id:88429cdd-53b9-4a40-ba08-a100c7140d36,key:/events/kube-system/kube-apiserver-instance.18af6ae7bc913ddc,type:*core.Event,resource:events 7002ms (11:25:21.370) Trace[1268449293]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (11:25:28.372)] Trace[1268449293]: [7.00303861s] [7.00303861s] END I0514 11:25:29.946052 1 metrics.go:285] "Failed to get storage metrics" storage_cluster_id="etcd-0" err="context deadline exceeded" E0514 11:25:30.084213 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0514 11:25:30.084343 1 trace.go:236] Trace[952249007]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d132beb6-8492-4ea5-b8fd-f617310949c4,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (14-May-2026 11:25:23.081) (total time: 7003ms): Trace[952249007]: ["GuaranteedUpdate etcd3" audit-id:d132beb6-8492-4ea5-b8fd-f617310949c4,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (11:25:23.081) Trace[952249007]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (11:25:30.084)] Trace[952249007]: [7.003006898s] [7.003006898s] END E0514 11:25:30.461346 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0514 11:25:30.461541 1 trace.go:236] Trace[238524636]: "Create" accept:application/json,audit-id:7551cbd7-6127-44d0-9867-8c64eac17a51,client:199.204.45.22,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/openstack/secrets,user-agent:Helm/3.11.2,verb:POST (14-May-2026 11:25:23.457) (total time: 7003ms): Trace[238524636]: ["Create etcd3" audit-id:7551cbd7-6127-44d0-9867-8c64eac17a51,key:/secrets/openstack/keystone-credential-keys,type:*core.Secret,resource:secrets 7002ms (11:25:23.458) Trace[238524636]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (11:25:30.461)] Trace[238524636]: [7.003532053s] [7.003532053s] END E0514 11:25:31.042752 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0514 11:25:31.043025 1 trace.go:236] Trace[33664933]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2cdd39f5-ae5a-4dae-ac84-7ea3da35c69d,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-May-2026 11:25:24.039) (total time: 7003ms): Trace[33664933]: ["GuaranteedUpdate etcd3" audit-id:2cdd39f5-ae5a-4dae-ac84-7ea3da35c69d,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (11:25:24.039) Trace[33664933]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (11:25:31.042)] Trace[33664933]: [7.0033961s] [7.0033961s] END E0514 11:25:31.043697 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0514 11:25:31.766773 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:31.766822 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:31.766847 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 6.38µs, panicked: false, err: context deadline exceeded, panic-reason: E0514 11:25:31.768156 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:31.768270 1 trace.go:236] Trace[1194841655]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:672fbb5e-9c00-4842-ab8e-dff4369b7f01,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (14-May-2026 11:25:26.766) (total time: 5001ms): Trace[1194841655]: ["GuaranteedUpdate etcd3" audit-id:672fbb5e-9c00-4842-ab8e-dff4369b7f01,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (11:25:26.767) Trace[1194841655]: ---"Txn call failed" err:context deadline exceeded 4998ms (11:25:31.766)] Trace[1194841655]: [5.001270676s] [5.001270676s] END E0514 11:25:31.768434 1 timeout.go:142] post-timeout activity - time-elapsed: 1.498622ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0514 11:25:31.948182 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0514 11:25:31.948190 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 10µs, panicked: false, err: context deadline exceeded, panic-reason: E0514 11:25:31.948219 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0514 11:25:31.949334 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0514 11:25:31.949429 1 trace.go:236] Trace[1923160163]: "Update" accept:application/json, */*,audit-id:82a1cbf1-6688-4945-913e-6312053536d4,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (14-May-2026 11:25:26.947) (total time: 5001ms): Trace[1923160163]: ["GuaranteedUpdate etcd3" audit-id:82a1cbf1-6688-4945-913e-6312053536d4,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (11:25:26.948) Trace[1923160163]: ---"Txn call failed" err:context deadline exceeded 4998ms (11:25:31.947)] Trace[1923160163]: [5.001604653s] [5.001604653s] END E0514 11:25:31.949804 1 timeout.go:142] post-timeout activity - time-elapsed: 1.731327ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: I0514 11:25:33.243449 1 trace.go:236] Trace[81684374]: "Update" accept:application/json, */*,audit-id:b0765d7d-aaae-4f5a-b5ea-5259c53c34c3,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (14-May-2026 11:25:27.233) (total time: 6010ms): Trace[81684374]: ["GuaranteedUpdate etcd3" audit-id:b0765d7d-aaae-4f5a-b5ea-5259c53c34c3,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 6010ms (11:25:27.233) Trace[81684374]: ---"Txn call completed" 6008ms (11:25:33.243)] Trace[81684374]: [6.010293246s] [6.010293246s] END I0514 11:25:33.243449 1 trace.go:236] Trace[726700953]: "Update" accept:application/json, */*,audit-id:26b3589f-c533-430c-880d-40499668c562,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (14-May-2026 11:25:27.505) (total time: 5737ms): Trace[726700953]: ["GuaranteedUpdate etcd3" audit-id:26b3589f-c533-430c-880d-40499668c562,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5737ms (11:25:27.505) Trace[726700953]: ---"Txn call completed" 5736ms (11:25:33.243)] Trace[726700953]: [5.737913977s] [5.737913977s] END I0514 11:25:33.244287 1 trace.go:236] Trace[1222122864]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:19def8e6-cbad-450d-b4bc-d1fb9646514a,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-May-2026 11:25:26.939) (total time: 6304ms): Trace[1222122864]: ["GuaranteedUpdate etcd3" audit-id:19def8e6-cbad-450d-b4bc-d1fb9646514a,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 6304ms (11:25:26.939) Trace[1222122864]: ---"Txn call completed" 6302ms (11:25:33.243)] Trace[1222122864]: [6.304550606s] [6.304550606s] END I0514 11:25:33.245126 1 trace.go:236] Trace[1401282349]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e69b151d-7077-41fc-a818-962d6be8d40b,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-May-2026 11:25:31.044) (total time: 2200ms): Trace[1401282349]: ["GuaranteedUpdate etcd3" audit-id:e69b151d-7077-41fc-a818-962d6be8d40b,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 2200ms (11:25:31.044) Trace[1401282349]: ---"Txn call completed" 2198ms (11:25:33.244)] Trace[1401282349]: [2.200341807s] [2.200341807s] END I0514 11:25:33.248005 1 trace.go:236] Trace[1692515576]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fc07dd02-95cc-49e3-8744-0a390edaad74,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (14-May-2026 11:25:30.086) (total time: 3161ms): Trace[1692515576]: ---"About to write a response" 3161ms (11:25:33.247) Trace[1692515576]: [3.161599715s] [3.161599715s] END I0514 11:25:33.248080 1 trace.go:236] Trace[139726145]: "Get" accept:application/json, */*,audit-id:1e814988-aa67-48e0-bb8e-371e729e1c0a,client:10.0.0.125,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-May-2026 11:25:17.931) (total time: 15316ms): Trace[139726145]: ---"About to write a response" 15316ms (11:25:33.247) Trace[139726145]: [15.316327875s] [15.316327875s] END I0514 11:25:33.248098 1 trace.go:236] Trace[1741411713]: "Get" accept:application/json, */*,audit-id:e10c511a-4a12-43b2-8e54-6873838e32f1,client:10.0.0.42,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (14-May-2026 11:25:18.829) (total time: 14418ms): Trace[1741411713]: ---"About to write a response" 14418ms (11:25:33.247) Trace[1741411713]: [14.418692106s] [14.418692106s] END I0514 11:25:33.248927 1 trace.go:236] Trace[1098454141]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ec2f0bb7-9c1e-4732-bd70-08925573d08b,client:199.204.45.22,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (14-May-2026 11:25:29.387) (total time: 3861ms): Trace[1098454141]: ---"About to write a response" 3861ms (11:25:33.248) Trace[1098454141]: [3.861407205s] [3.861407205s] END I0514 11:25:33.249269 1 trace.go:236] Trace[506045144]: "Get" accept:application/json, */*,audit-id:f58297da-16e3-4bf7-bbf6-c16b736601bc,client:199.204.45.22,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-rm6x7,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-May-2026 11:25:16.951) (total time: 16297ms): Trace[506045144]: ---"About to write a response" 16297ms (11:25:33.248) Trace[506045144]: [16.297660946s] [16.297660946s] END E0514 11:25:33.249289 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0514 11:25:33.250839 1 trace.go:236] Trace[833866960]: "Create" accept:application/json, */*,audit-id:799ff5fa-48e3-4b76-84aa-77d3998043de,client:10.0.0.47,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (14-May-2026 11:25:27.120) (total time: 6130ms): Trace[833866960]: ["Create etcd3" audit-id:799ff5fa-48e3-4b76-84aa-77d3998043de,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18af6ae91351ee74,type:*core.Event,resource:events 6129ms (11:25:27.121) Trace[833866960]: ---"TransformToStorage succeeded" 6121ms (11:25:33.243)] Trace[833866960]: [6.130363888s] [6.130363888s] END I0514 11:25:33.251002 1 trace.go:236] Trace[1957532444]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:defd026b-d345-46a4-a00d-160f10fe5b84,client:199.204.45.22,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (14-May-2026 11:25:28.374) (total time: 4876ms): Trace[1957532444]: ["Create etcd3" audit-id:defd026b-d345-46a4-a00d-160f10fe5b84,key:/events/kube-system/kube-apiserver-instance.18af6ae7d44d59ea,type:*core.Event,resource:events 4875ms (11:25:28.375) Trace[1957532444]: ---"TransformToStorage succeeded" 4867ms (11:25:33.243)] Trace[1957532444]: [4.876226787s] [4.876226787s] END I0514 11:25:33.257934 1 trace.go:236] Trace[1508516297]: "Update" accept:application/json, */*,audit-id:4c5e8d8f-9c4d-4f49-b8b1-1f681b4f489a,client:199.204.45.22,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/openstack/secrets/sh.helm.release.v1.keystone.v1,user-agent:Helm/3.11.2,verb:PUT (14-May-2026 11:25:30.483) (total time: 2774ms): Trace[1508516297]: ["GuaranteedUpdate etcd3" audit-id:4c5e8d8f-9c4d-4f49-b8b1-1f681b4f489a,key:/secrets/openstack/sh.helm.release.v1.keystone.v1,type:*core.Secret,resource:secrets 2771ms (11:25:30.486) Trace[1508516297]: ---"Txn call completed" 2756ms (11:25:33.244)] Trace[1508516297]: [2.774490012s] [2.774490012s] END I0514 11:25:33.266247 1 trace.go:236] Trace[1299475302]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.22,type:*v1.Endpoints,resource:apiServerIPInfo (14-May-2026 11:25:26.240) (total time: 7025ms): Trace[1299475302]: ---"initial value restored" 7007ms (11:25:33.247) Trace[1299475302]: [7.025751875s] [7.025751875s] END I0514 11:25:33.330794 1 trace.go:236] Trace[1792249114]: "Get" accept:application/json, */*,audit-id:2327fd8a-8ca5-432c-8166-ec6ac41c1a40,client:10.0.0.169,protocol:HTTP/2.0,resource:nodefeatures,scope:resource,url:/apis/nfd.k8s-sigs.io/v1alpha1/namespaces/monitoring/nodefeatures/instance,user-agent:nfd-worker/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-May-2026 11:25:22.920) (total time: 10409ms): Trace[1792249114]: ---"About to write a response" 10382ms (11:25:33.303) Trace[1792249114]: [10.409851317s] [10.409851317s] END