I0407 09:35:47.887044 1 options.go:220] external host was not specified, using 199.204.45.246 I0407 09:35:47.888339 1 server.go:148] Version: v1.28.13 I0407 09:35:47.888398 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0407 09:35:48.218687 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0407 09:35:48.227917 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0407 09:35:48.227931 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0407 09:35:48.228154 1 instance.go:298] Using reconciler: lease I0407 09:35:48.790518 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0407 09:35:48.790538 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0407 09:35:49.025110 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0407 09:35:49.025266 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0407 09:35:49.489181 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0407 09:35:49.501254 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0407 09:35:49.501322 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0407 09:35:49.501331 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0407 09:35:49.501877 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0407 09:35:49.501896 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0407 09:35:49.502781 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0407 09:35:49.503686 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0407 09:35:49.503703 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0407 09:35:49.503708 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0407 09:35:49.505124 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0407 09:35:49.505139 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0407 09:35:49.505825 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0407 09:35:49.505837 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0407 09:35:49.505841 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0407 09:35:49.506266 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0407 09:35:49.506280 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0407 09:35:49.506309 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0407 09:35:49.506744 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0407 09:35:49.508166 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0407 09:35:49.508180 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0407 09:35:49.508183 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0407 09:35:49.508489 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0407 09:35:49.508502 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0407 09:35:49.508505 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0407 09:35:49.509082 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0407 09:35:49.509096 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0407 09:35:49.510294 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0407 09:35:49.510308 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0407 09:35:49.510312 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0407 09:35:49.510617 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0407 09:35:49.510633 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0407 09:35:49.510636 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0407 09:35:49.512382 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0407 09:35:49.512397 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0407 09:35:49.512401 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0407 09:35:49.513204 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0407 09:35:49.513986 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0407 09:35:49.514000 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0407 09:35:49.514004 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0407 09:35:49.516925 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0407 09:35:49.516940 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0407 09:35:49.516944 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0407 09:35:49.517551 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0407 09:35:49.517564 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0407 09:35:49.517567 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0407 09:35:49.517937 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0407 09:35:49.517950 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0407 09:35:49.551551 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0407 09:35:49.551681 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0407 09:35:49.964225 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0407 09:35:49.964291 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0407 09:35:49.964243 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0407 09:35:49.964487 1 secure_serving.go:213] Serving securely on [::]:6443 I0407 09:35:49.964564 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0407 09:35:49.965001 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0407 09:35:49.965036 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0407 09:35:49.965054 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0407 09:35:49.965101 1 aggregator.go:164] waiting for initial CRD sync... I0407 09:35:49.965132 1 controller.go:78] Starting OpenAPI AggregationController I0407 09:35:49.965317 1 controller.go:80] Starting OpenAPI V3 AggregationController I0407 09:35:49.965394 1 available_controller.go:423] Starting AvailableConditionController I0407 09:35:49.965484 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0407 09:35:49.965656 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0407 09:35:49.965962 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0407 09:35:49.965989 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0407 09:35:49.966171 1 system_namespaces_controller.go:67] Starting system namespaces controller I0407 09:35:49.966417 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0407 09:35:49.966481 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0407 09:35:49.966515 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0407 09:35:49.966530 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0407 09:35:49.966586 1 gc_controller.go:78] Starting apiserver lease garbage collector I0407 09:35:49.965006 1 gc_controller.go:78] Starting apiserver lease garbage collector I0407 09:35:49.966962 1 controller.go:116] Starting legacy_token_tracking_controller I0407 09:35:49.966985 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0407 09:35:49.967075 1 controller.go:134] Starting OpenAPI controller I0407 09:35:49.967174 1 controller.go:85] Starting OpenAPI V3 controller I0407 09:35:49.967267 1 naming_controller.go:291] Starting NamingConditionController I0407 09:35:49.967329 1 establishing_controller.go:76] Starting EstablishingController I0407 09:35:49.967489 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0407 09:35:49.967597 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0407 09:35:49.967757 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0407 09:35:49.967799 1 crd_finalizer.go:266] Starting CRDFinalizer I0407 09:35:49.967864 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0407 09:35:50.018816 1 shared_informer.go:318] Caches are synced for node_authorizer E0407 09:35:50.045588 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0407 09:35:50.065199 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0407 09:35:50.065733 1 cache.go:39] Caches are synced for AvailableConditionController controller I0407 09:35:50.066119 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0407 09:35:50.066554 1 shared_informer.go:318] Caches are synced for crd-autoregister I0407 09:35:50.066592 1 aggregator.go:166] initial CRD sync complete... I0407 09:35:50.066597 1 apf_controller.go:379] Running API Priority and Fairness config worker I0407 09:35:50.066610 1 autoregister_controller.go:141] Starting autoregister controller I0407 09:35:50.066624 1 cache.go:32] Waiting for caches to sync for autoregister controller I0407 09:35:50.066641 1 cache.go:39] Caches are synced for autoregister controller I0407 09:35:50.066632 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0407 09:35:50.067136 1 shared_informer.go:318] Caches are synced for configmaps I0407 09:35:50.067932 1 controller.go:624] quota admission added evaluator for: namespaces I0407 09:35:50.249660 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0407 09:35:50.974312 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0407 09:35:50.980793 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0407 09:35:50.980848 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0407 09:35:51.585358 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0407 09:35:51.642070 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0407 09:35:51.788340 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0407 09:35:51.796663 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.246] I0407 09:35:51.798190 1 controller.go:624] quota admission added evaluator for: endpoints I0407 09:35:51.804124 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0407 09:35:52.509865 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0407 09:35:53.284434 1 controller.go:624] quota admission added evaluator for: deployments.apps I0407 09:35:53.328267 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0407 09:35:53.549801 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0407 09:35:56.806239 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0407 09:35:57.760098 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0407 09:36:18.317858 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:36:18.339121 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 09:36:18.355443 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:36:18.355671 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:36:18.392445 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 09:36:18.409661 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 09:36:18.435675 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:36:18.435720 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0407 09:36:18.478781 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 09:36:18.506983 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 09:36:18.507054 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0407 09:36:18.536135 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:36:18.536424 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:36:18.580579 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:36:18.678917 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:36:18.678957 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:36:18.693268 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 09:36:18.724051 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:36:18.773895 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:36:18.794398 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:36:18.835784 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:36:18.862914 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:36:19.548163 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:36:19.592245 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:36:19.674408 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:36:25.547313 1 trace.go:236] Trace[434330370]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f91d7532-5e54-4183-ac26-774a37f3e9ed,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 09:36:24.961) (total time: 585ms): Trace[434330370]: ["GuaranteedUpdate etcd3" audit-id:f91d7532-5e54-4183-ac26-774a37f3e9ed,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 585ms (09:36:24.961) Trace[434330370]: ---"Txn call completed" 584ms (09:36:25.547)] Trace[434330370]: [585.885743ms] [585.885743ms] END I0407 09:36:27.200321 1 trace.go:236] Trace[1683169204]: "Get" accept:application/json, */*,audit-id:f24c8514-6675-4330-9636-6cf92355470f,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:36:26.220) (total time: 979ms): Trace[1683169204]: ---"About to write a response" 979ms (09:36:27.200) Trace[1683169204]: [979.354075ms] [979.354075ms] END I0407 09:36:27.200589 1 trace.go:236] Trace[2144835984]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f7fe5481-8af8-42a3-80bb-72242d6e7299,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-h6zpm/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (07-Apr-2026 09:36:25.588) (total time: 1612ms): Trace[2144835984]: ["GuaranteedUpdate etcd3" audit-id:f7fe5481-8af8-42a3-80bb-72242d6e7299,key:/pods/kube-system/cilium-h6zpm,type:*core.Pod,resource:pods 1611ms (09:36:25.588) Trace[2144835984]: ---"Txn call completed" 1601ms (09:36:27.199)] Trace[2144835984]: ---"Object stored in database" 1602ms (09:36:27.200) Trace[2144835984]: [1.612193425s] [1.612193425s] END I0407 09:36:27.200651 1 trace.go:236] Trace[977507802]: "Create" accept:application/json,audit-id:3e468159-1bf4-426c-8f18-dfcbf83710ca,client:199.204.45.246,protocol:HTTP/2.0,resource:rolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/namespaces/envoy-gateway-system/rolebindings,user-agent:Helm/3.11.2,verb:POST (07-Apr-2026 09:36:25.634) (total time: 1566ms): Trace[977507802]: ["Create etcd3" audit-id:3e468159-1bf4-426c-8f18-dfcbf83710ca,key:/rolebindings/envoy-gateway-system/envoy-gateway-gateway-helm-certgen,type:*rbac.RoleBinding,resource:rolebindings.rbac.authorization.k8s.io 1565ms (09:36:25.635) Trace[977507802]: ---"Txn call succeeded" 1565ms (09:36:27.200)] Trace[977507802]: [1.56645137s] [1.56645137s] END I0407 09:36:29.169253 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:36:29.191006 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:36:29.199273 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:36:29.208441 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:36:29.532209 1 controller.go:624] quota admission added evaluator for: jobs.batch I0407 09:36:29.751818 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:36:29.963990 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:36:30.765445 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:36:30.987042 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:36:32.332563 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:36:32.684016 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:36:33.029555 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0407 09:36:33.417641 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0407 09:36:33.417699 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0407 09:36:36.931240 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0407 09:36:46.662677 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.99.137.86"} W0407 09:36:46.695462 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.99.137.86:9443: connect: connection refused E0407 09:36:46.695569 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.99.137.86:9443: connect: connection refused I0407 09:37:00.170866 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0407 09:37:00.197524 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0407 09:37:00.215756 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0407 09:37:00.230456 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.98.80.234"} I0407 09:37:00.247126 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.109.252.118"} I0407 09:37:00.250685 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0407 09:37:00.307715 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0407 09:37:00.365355 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0407 09:37:11.528562 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0407 09:37:12.513697 1 trace.go:236] Trace[1336580173]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6f76b0bb-d364-4ba5-bc1f-da3ef0248adf,client:10.0.0.103,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:37:11.768) (total time: 745ms): Trace[1336580173]: ["GuaranteedUpdate etcd3" audit-id:6f76b0bb-d364-4ba5-bc1f-da3ef0248adf,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 745ms (09:37:11.768) Trace[1336580173]: ---"Txn call completed" 744ms (09:37:12.513)] Trace[1336580173]: [745.436655ms] [745.436655ms] END I0407 09:37:12.519995 1 trace.go:236] Trace[1698023398]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.246,type:*v1.Endpoints,resource:apiServerIPInfo (07-Apr-2026 09:37:11.786) (total time: 733ms): Trace[1698023398]: ---"initial value restored" 727ms (09:37:12.513) Trace[1698023398]: [733.491907ms] [733.491907ms] END I0407 09:37:16.662536 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0407 09:37:31.918718 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.106.189.127"} I0407 09:37:31.930358 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.99.150.178"} I0407 09:37:31.939487 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.109.49.189"} I0407 09:37:31.947314 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.102.63.135"} I0407 09:37:39.371226 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:37:39.390082 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:37:39.411592 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:37:39.428619 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:37:39.455396 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:37:39.482539 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:37:39.500036 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:37:39.517262 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:37:39.545426 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:37:39.562647 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0407 09:37:39.583693 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:37:39.606392 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:37:39.624479 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:37:40.857034 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:37:44.728015 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0407 09:37:44.797424 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.100.163.158"} I0407 09:37:44.830760 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0407 09:37:46.925301 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0407 09:37:46.967649 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0407 09:37:47.629894 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0407 09:37:47.630018 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0407 09:37:47.630164 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0407 09:37:54.667384 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0407 09:37:58.007425 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.103.167.185"} I0407 09:37:58.288212 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0407 09:37:58.437420 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.111.140.234"} I0407 09:37:58.463272 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.101.186.130"} I0407 09:37:59.239051 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0407 09:38:01.521762 1 trace.go:236] Trace[1318962133]: "Update" accept:application/json, */*,audit-id:efe60ddf-cb27-4b6d-a92a-9e0bb635b327,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 09:38:00.391) (total time: 1130ms): Trace[1318962133]: ["GuaranteedUpdate etcd3" audit-id:efe60ddf-cb27-4b6d-a92a-9e0bb635b327,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1129ms (09:38:00.391) Trace[1318962133]: ---"Txn call completed" 1129ms (09:38:01.521)] Trace[1318962133]: [1.130179866s] [1.130179866s] END I0407 09:38:01.827305 1 trace.go:236] Trace[1016877199]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:34b0fddb-55ce-4d88-a30d-8dc9328f371e,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 09:38:00.391) (total time: 1435ms): Trace[1016877199]: ["GuaranteedUpdate etcd3" audit-id:34b0fddb-55ce-4d88-a30d-8dc9328f371e,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 1435ms (09:38:00.391) Trace[1016877199]: ---"Txn call completed" 1434ms (09:38:01.826)] Trace[1016877199]: [1.435681552s] [1.435681552s] END I0407 09:38:01.827616 1 trace.go:236] Trace[1803881883]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:86668257-32d4-4695-b053-d24cb3014326,client:10.0.0.103,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:38:00.749) (total time: 1078ms): Trace[1803881883]: ["GuaranteedUpdate etcd3" audit-id:86668257-32d4-4695-b053-d24cb3014326,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1077ms (09:38:00.749) Trace[1803881883]: ---"Txn call completed" 1076ms (09:38:01.827)] Trace[1803881883]: [1.078009941s] [1.078009941s] END I0407 09:38:01.827825 1 trace.go:236] Trace[229564897]: "Update" accept:application/json, */*,audit-id:9e9bee56-5528-4441-81f6-6b0546e204b0,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 09:38:00.391) (total time: 1435ms): Trace[229564897]: ["GuaranteedUpdate etcd3" audit-id:9e9bee56-5528-4441-81f6-6b0546e204b0,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1435ms (09:38:00.391) Trace[229564897]: ---"Txn call completed" 1435ms (09:38:01.827)] Trace[229564897]: [1.435983558s] [1.435983558s] END I0407 09:38:01.827971 1 trace.go:236] Trace[1168339041]: "Update" accept:application/json, */*,audit-id:8ae4c5db-5f90-4fba-a16e-ee548e5cb299,client:10.0.0.16,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:38:00.583) (total time: 1244ms): Trace[1168339041]: ["GuaranteedUpdate etcd3" audit-id:8ae4c5db-5f90-4fba-a16e-ee548e5cb299,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1244ms (09:38:00.583) Trace[1168339041]: ---"Txn call completed" 1242ms (09:38:01.827)] Trace[1168339041]: [1.244475608s] [1.244475608s] END I0407 09:38:01.828117 1 trace.go:236] Trace[1642573742]: "Get" accept:application/json, */*,audit-id:e1041624-12bc-462c-9ade-8fb31f915372,client:10.0.0.70,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-7ab8aad8-517b-40ab-a431-334bf19f1708,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:38:00.407) (total time: 1420ms): Trace[1642573742]: ---"About to write a response" 1419ms (09:38:01.827) Trace[1642573742]: [1.420152246s] [1.420152246s] END I0407 09:38:01.846725 1 trace.go:236] Trace[916566910]: "Get" accept:application/json, */*,audit-id:b54e2672-1008-49f0-b339-6a38287df4c6,client:10.0.0.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:38:00.780) (total time: 1065ms): Trace[916566910]: ---"About to write a response" 1065ms (09:38:01.846) Trace[916566910]: [1.065788316s] [1.065788316s] END I0407 09:38:01.847085 1 trace.go:236] Trace[1273437574]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c86e5d60-b55d-4f31-b9eb-12d31e38bb76,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:38:00.784) (total time: 1062ms): Trace[1273437574]: ---"About to write a response" 1062ms (09:38:01.847) Trace[1273437574]: [1.062163605s] [1.062163605s] END I0407 09:38:01.847617 1 trace.go:236] Trace[1540211372]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2710cb4f-8f50-4cb0-b6e1-7dac616ebdc4,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-7ab8aad8-517b-40ab-a431-334bf19f1708,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (07-Apr-2026 09:38:00.908) (total time: 939ms): Trace[1540211372]: ---"About to write a response" 938ms (09:38:01.847) Trace[1540211372]: [939.151649ms] [939.151649ms] END I0407 09:38:01.847752 1 trace.go:236] Trace[1213985079]: "Get" accept:application/json,audit-id:719fcd5a-937c-481b-8d71-b823f645313e,client:199.204.45.246,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (07-Apr-2026 09:38:00.720) (total time: 1126ms): Trace[1213985079]: ---"About to write a response" 1126ms (09:38:01.847) Trace[1213985079]: [1.126919588s] [1.126919588s] END I0407 09:38:38.310769 1 trace.go:236] Trace[766029815]: "Update" accept:application/json, */*,audit-id:319a34b2-93ab-4a36-aecf-3aa32f29884c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 09:38:37.763) (total time: 547ms): Trace[766029815]: ["GuaranteedUpdate etcd3" audit-id:319a34b2-93ab-4a36-aecf-3aa32f29884c,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 547ms (09:38:37.763) Trace[766029815]: ---"Txn call completed" 546ms (09:38:38.310)] Trace[766029815]: [547.312727ms] [547.312727ms] END I0407 09:38:38.739367 1 trace.go:236] Trace[910306620]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bc165dea-0ed5-44f0-b512-648ff6d7b853,client:10.0.0.51,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:38:38.234) (total time: 504ms): Trace[910306620]: ["GuaranteedUpdate etcd3" audit-id:bc165dea-0ed5-44f0-b512-648ff6d7b853,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 504ms (09:38:38.234) Trace[910306620]: ---"Txn call completed" 503ms (09:38:38.739)] Trace[910306620]: [504.728169ms] [504.728169ms] END I0407 09:38:39.398830 1 trace.go:236] Trace[1023056941]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:745f6f0f-b6ea-46ef-aa2e-5e13d4c766c7,client:199.204.45.246,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/percona-xtradb-haproxy-0.18a4099ad52a32ab,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (07-Apr-2026 09:38:38.696) (total time: 702ms): Trace[1023056941]: ["GuaranteedUpdate etcd3" audit-id:745f6f0f-b6ea-46ef-aa2e-5e13d4c766c7,key:/events/openstack/percona-xtradb-haproxy-0.18a4099ad52a32ab,type:*core.Event,resource:events 701ms (09:38:38.696) Trace[1023056941]: ---"Txn call completed" 655ms (09:38:39.398)] Trace[1023056941]: ---"Object stored in database" 656ms (09:38:39.398) Trace[1023056941]: [702.012918ms] [702.012918ms] END I0407 09:38:39.461197 1 trace.go:236] Trace[1893053918]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9b97608d-2aeb-479f-a169-71451e665ffb,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 09:38:38.744) (total time: 716ms): Trace[1893053918]: ["GuaranteedUpdate etcd3" audit-id:9b97608d-2aeb-479f-a169-71451e665ffb,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 716ms (09:38:38.744) Trace[1893053918]: ---"Txn call completed" 715ms (09:38:39.460)] Trace[1893053918]: [716.833399ms] [716.833399ms] END I0407 09:38:39.461575 1 trace.go:236] Trace[8084795]: "Update" accept:application/json, */*,audit-id:014c41b7-39b8-4a7b-80d7-0dbe0b020aa9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 09:38:38.744) (total time: 716ms): Trace[8084795]: ["GuaranteedUpdate etcd3" audit-id:014c41b7-39b8-4a7b-80d7-0dbe0b020aa9,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 716ms (09:38:38.745) Trace[8084795]: ---"Txn call completed" 715ms (09:38:39.461)] Trace[8084795]: [716.530809ms] [716.530809ms] END I0407 09:38:39.461744 1 trace.go:236] Trace[691060275]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3c831abd-fa89-4ad3-93f6-ab071297f04f,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:38:38.941) (total time: 520ms): Trace[691060275]: ---"About to write a response" 520ms (09:38:39.461) Trace[691060275]: [520.501239ms] [520.501239ms] END I0407 09:39:26.831606 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.100.144.79"} I0407 09:39:28.753201 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.110.188.45"} I0407 09:39:29.617595 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.100.200.248"} I0407 09:39:37.444750 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.100.78.25"} I0407 09:39:37.451831 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.107.97.234"} I0407 09:39:40.235956 1 trace.go:236] Trace[287368329]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fee1d672-c42b-47b8-ab0a-72f2fc9e8a4d,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (07-Apr-2026 09:39:39.572) (total time: 663ms): Trace[287368329]: ["GuaranteedUpdate etcd3" audit-id:fee1d672-c42b-47b8-ab0a-72f2fc9e8a4d,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 663ms (09:39:39.572) Trace[287368329]: ---"Txn call completed" 662ms (09:39:40.235)] Trace[287368329]: [663.581918ms] [663.581918ms] END I0407 09:40:12.675372 1 trace.go:236] Trace[948516401]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.246,type:*v1.Endpoints,resource:apiServerIPInfo (07-Apr-2026 09:40:11.804) (total time: 871ms): Trace[948516401]: ---"Transaction prepared" 104ms (09:40:11.910) Trace[948516401]: ---"Txn call completed" 764ms (09:40:12.675) Trace[948516401]: [871.040617ms] [871.040617ms] END I0407 09:42:07.285949 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0407 09:42:09.143559 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0407 09:42:09.151549 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0407 09:42:09.166180 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0407 09:42:09.176777 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0407 09:42:09.194913 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0407 09:42:09.203646 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0407 09:42:09.213933 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0407 09:42:20.658151 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0407 09:42:46.018104 1 trace.go:236] Trace[1566436270]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6fae7f7b-202c-4bfe-97dd-459cd9c20039,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 09:42:41.539) (total time: 4478ms): Trace[1566436270]: ["GuaranteedUpdate etcd3" audit-id:6fae7f7b-202c-4bfe-97dd-459cd9c20039,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 4478ms (09:42:41.539) Trace[1566436270]: ---"Txn call completed" 4477ms (09:42:46.017)] Trace[1566436270]: [4.478952253s] [4.478952253s] END I0407 09:42:46.400328 1 trace.go:236] Trace[1856199402]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:585d87d9-2db0-4bc3-84ee-efff80b85e55,client:10.0.0.51,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:42:41.947) (total time: 4453ms): Trace[1856199402]: ["GuaranteedUpdate etcd3" audit-id:585d87d9-2db0-4bc3-84ee-efff80b85e55,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 4452ms (09:42:41.947) Trace[1856199402]: ---"Txn call completed" 4451ms (09:42:46.399)] Trace[1856199402]: [4.453123172s] [4.453123172s] END I0407 09:42:46.401232 1 trace.go:236] Trace[1784810114]: "Update" accept:application/json, */*,audit-id:5dac8537-6fcf-4e62-8109-2d0adf27a270,client:10.0.0.16,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:42:41.947) (total time: 4453ms): Trace[1784810114]: ["GuaranteedUpdate etcd3" audit-id:5dac8537-6fcf-4e62-8109-2d0adf27a270,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 4453ms (09:42:41.948) Trace[1784810114]: ---"Txn call completed" 4452ms (09:42:46.400)] Trace[1784810114]: [4.453237795s] [4.453237795s] END I0407 09:42:46.402261 1 trace.go:236] Trace[782891994]: "Get" accept:application/json, */*,audit-id:b91fa87c-6e84-4100-a930-d6af9204cdda,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:42:41.954) (total time: 4446ms): Trace[782891994]: ---"About to write a response" 4446ms (09:42:46.401) Trace[782891994]: [4.446682711s] [4.446682711s] END I0407 09:42:46.403980 1 trace.go:236] Trace[118643787]: "Get" accept:application/json, */*,audit-id:e1f3547c-895b-41b0-bead-fb1001353103,client:10.0.0.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:42:41.948) (total time: 4454ms): Trace[118643787]: ---"About to write a response" 4454ms (09:42:46.403) Trace[118643787]: [4.454959571s] [4.454959571s] END I0407 09:42:46.404304 1 trace.go:236] Trace[785373303]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f0c87422-8fd6-477f-8c05-040e272abe61,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:42:41.952) (total time: 4451ms): Trace[785373303]: ---"About to write a response" 4451ms (09:42:46.404) Trace[785373303]: [4.451696138s] [4.451696138s] END I0407 09:42:46.404672 1 trace.go:236] Trace[724913861]: "Get" accept:application/json, */*,audit-id:43b30413-d772-45c6-9f6a-7d7fe8346b00,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:42:41.962) (total time: 4441ms): Trace[724913861]: ---"About to write a response" 4441ms (09:42:46.404) Trace[724913861]: [4.441915613s] [4.441915613s] END I0407 09:42:46.404695 1 trace.go:236] Trace[880160507]: "Get" accept:application/json, */*,audit-id:af8d6e4e-4ef5-47a4-b8f6-489b3e866dc9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:42:41.876) (total time: 4528ms): Trace[880160507]: ---"About to write a response" 4528ms (09:42:46.404) Trace[880160507]: [4.52850141s] [4.52850141s] END I0407 09:42:46.404792 1 trace.go:236] Trace[1487051240]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6d085952-3893-4bdb-87db-232cc01df7bd,client:10.0.0.51,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:42:45.680) (total time: 724ms): Trace[1487051240]: ---"About to write a response" 723ms (09:42:46.404) Trace[1487051240]: [724.167155ms] [724.167155ms] END I0407 09:42:46.405058 1 trace.go:236] Trace[1434001818]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:714d2c5e-870d-4c53-94f1-072d70ee9fce,client:10.0.0.103,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:42:41.941) (total time: 4462ms): Trace[1434001818]: ["GuaranteedUpdate etcd3" audit-id:714d2c5e-870d-4c53-94f1-072d70ee9fce,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 4462ms (09:42:41.942) Trace[1434001818]: ---"Txn call completed" 4461ms (09:42:46.404)] Trace[1434001818]: [4.462773329s] [4.462773329s] END I0407 09:42:46.415880 1 trace.go:236] Trace[1835763381]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.246,type:*v1.Endpoints,resource:apiServerIPInfo (07-Apr-2026 09:42:41.814) (total time: 4601ms): Trace[1835763381]: ---"initial value restored" 4592ms (09:42:46.407) Trace[1835763381]: [4.60167159s] [4.60167159s] END I0407 09:43:04.348604 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev E0407 09:43:17.136089 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0407 09:43:17.136208 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:17.137471 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:17.137623 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:43:17.138576 1 trace.go:236] Trace[399794128]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4371d5dc-f4e0-4964-8ca8-3208bfba3a8e,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:43:12.136) (total time: 5002ms): Trace[399794128]: [5.002200693s] [5.002200693s] END E0407 09:43:17.138769 1 timeout.go:142] post-timeout activity - time-elapsed: 2.482908ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0407 09:43:17.493958 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:17.494002 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:17.494031 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 8.59µs, panicked: false, err: context deadline exceeded, panic-reason: E0407 09:43:17.495595 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:43:17.495690 1 trace.go:236] Trace[985290502]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:deb94ce9-a3a6-4444-9381-ba0c796b9efe,client:10.0.0.51,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:43:12.493) (total time: 5001ms): Trace[985290502]: ["GuaranteedUpdate etcd3" audit-id:deb94ce9-a3a6-4444-9381-ba0c796b9efe,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:43:12.493) Trace[985290502]: ---"Txn call failed" err:context deadline exceeded 4999ms (09:43:17.493)] Trace[985290502]: [5.001811647s] [5.001811647s] END E0407 09:43:17.495807 1 timeout.go:142] post-timeout activity - time-elapsed: 1.670968ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0407 09:43:17.501535 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:17.501697 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:17.501573 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 7.29µs, panicked: false, err: context canceled, panic-reason: E0407 09:43:17.503251 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:43:17.503348 1 trace.go:236] Trace[358189773]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ee3c1001-4c3d-46ab-8562-74a6d341ad9e,client:10.0.0.103,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:43:12.502) (total time: 5000ms): Trace[358189773]: ["GuaranteedUpdate etcd3" audit-id:ee3c1001-4c3d-46ab-8562-74a6d341ad9e,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (09:43:12.502) Trace[358189773]: ---"Txn call failed" err:context canceled 4997ms (09:43:17.501)] Trace[358189773]: [5.000746357s] [5.000746357s] END E0407 09:43:17.503502 1 timeout.go:142] post-timeout activity - time-elapsed: 2.114039ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0407 09:43:17.563105 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0407 09:43:17.563427 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:17.564279 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:17.564427 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0407 09:43:17.564524 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0407 09:43:17.565738 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:17.565767 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0407 09:43:17.565852 1 trace.go:236] Trace[386633167]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:28f0d23c-ac7e-4a77-a706-46f48fa16e51,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:43:12.562) (total time: 5003ms): Trace[386633167]: [5.003228826s] [5.003228826s] END E0407 09:43:17.565965 1 timeout.go:142] post-timeout activity - time-elapsed: 2.804105ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0407 09:43:17.567129 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:43:17.567173 1 trace.go:236] Trace[1217310947]: "Get" accept:application/json, */*,audit-id:43ff9217-a604-433a-8499-359e188f20ad,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:43:12.563) (total time: 5003ms): Trace[1217310947]: [5.003377931s] [5.003377931s] END E0407 09:43:17.567231 1 timeout.go:142] post-timeout activity - time-elapsed: 2.801155ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: I0407 09:43:18.820545 1 trace.go:236] Trace[916871809]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.246,type:*v1.Endpoints,resource:apiServerIPInfo (07-Apr-2026 09:43:11.816) (total time: 7004ms): Trace[916871809]: [7.004301126s] [7.004301126s] END E0407 09:43:18.820591 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0407 09:43:18.866456 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:43:18.866601 1 trace.go:236] Trace[884450632]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ee186d61-ff46-4e2d-a6fa-324c77040bf9,client:10.0.0.51,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:43:11.864) (total time: 7002ms): Trace[884450632]: [7.00207288s] [7.00207288s] END E0407 09:43:19.504975 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:43:19.505193 1 trace.go:236] Trace[238706764]: "Update" accept:application/json, */*,audit-id:1b048985-02cb-4159-8aac-704027b5fb78,client:10.0.0.16,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:43:12.501) (total time: 7004ms): Trace[238706764]: ["GuaranteedUpdate etcd3" audit-id:1b048985-02cb-4159-8aac-704027b5fb78,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:43:12.501) Trace[238706764]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:43:19.504)] Trace[238706764]: [7.004076894s] [7.004076894s] END E0407 09:43:22.136347 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:43:22.136450 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:22.138356 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:22.138409 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:43:22.139604 1 trace.go:236] Trace[1924791973]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b83a860b-f65a-4504-b480-29ae82b1a093,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:43:19.138) (total time: 3000ms): Trace[1924791973]: [3.000786969s] [3.000786969s] END E0407 09:43:22.139777 1 timeout.go:142] post-timeout activity - time-elapsed: 3.693577ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0407 09:43:22.493081 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:43:22.493190 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:22.494704 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:22.494797 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:43:22.495870 1 trace.go:236] Trace[720952988]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:57961884-6fe7-4802-b390-ea8eaa32d584,client:10.0.0.51,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:43:17.495) (total time: 5000ms): Trace[720952988]: [5.000553897s] [5.000553897s] END E0407 09:43:22.496055 1 timeout.go:142] post-timeout activity - time-elapsed: 2.835627ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0407 09:43:22.500211 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0407 09:43:22.500361 1 trace.go:236] Trace[894675201]: "Get" accept:application/json, */*,audit-id:280b8a0a-1323-49ed-aa01-70f238517b72,client:10.0.0.16,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:43:19.507) (total time: 2992ms): Trace[894675201]: [2.992856291s] [2.992856291s] END E0407 09:43:22.500600 1 timeout.go:142] post-timeout activity - time-elapsed: 3.06µs, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0407 09:43:22.500658 1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" audit-ID="280b8a0a-1323-49ed-aa01-70f238517b72" E0407 09:43:22.501628 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:43:22.501858 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:22.502673 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:22.502942 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:43:22.503717 1 trace.go:236] Trace[1825862719]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6208ef4c-6f69-47ec-ad57-4cad6d0b9866,client:10.0.0.103,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:43:17.502) (total time: 5000ms): Trace[1825862719]: [5.000740935s] [5.000740935s] END E0407 09:43:22.503772 1 timeout.go:142] post-timeout activity - time-elapsed: 1.829193ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0407 09:43:22.513631 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:43:22.513673 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:22.515051 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:22.515564 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:43:22.516873 1 trace.go:236] Trace[140026988]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:752e2804-3b08-4c99-b21f-3a3285b29f44,client:10.0.0.51,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:43:18.879) (total time: 3636ms): Trace[140026988]: [3.636920507s] [3.636920507s] END E0407 09:43:22.517140 1 timeout.go:142] post-timeout activity - time-elapsed: 3.539384ms, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: E0407 09:43:22.519780 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:43:22.519845 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:22.521288 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:22.521348 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:43:22.522523 1 trace.go:236] Trace[798551078]: "Get" accept:application/json, */*,audit-id:aaf21e08-beda-40ee-8499-8cf8a18ac390,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:43:12.519) (total time: 10002ms): Trace[798551078]: [10.002963945s] [10.002963945s] END E0407 09:43:22.522625 1 timeout.go:142] post-timeout activity - time-elapsed: 2.852248ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0407 09:43:22.555072 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:43:22.555203 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:22.556232 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:22.556312 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:43:22.557520 1 trace.go:236] Trace[1004443496]: "Get" accept:application/json, */*,audit-id:04810cd0-7901-40cf-b02f-cc3c7c640883,client:10.0.0.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:43:12.555) (total time: 10002ms): Trace[1004443496]: [10.002264324s] [10.002264324s] END E0407 09:43:22.557666 1 timeout.go:142] post-timeout activity - time-elapsed: 2.660633ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0407 09:43:22.562368 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:43:22.562465 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:22.563451 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:22.563782 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0407 09:43:22.564288 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0407 09:43:22.564563 1 trace.go:236] Trace[10811455]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a2c27081-eb80-4519-91af-5d4a5594cffa,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:43:19.564) (total time: 2999ms): Trace[10811455]: [2.999859273s] [2.999859273s] END E0407 09:43:22.564698 1 timeout.go:142] post-timeout activity - time-elapsed: 2.355406ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0407 09:43:22.565390 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:22.565845 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:22.566574 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:43:22.567197 1 trace.go:236] Trace[1051614568]: "Get" accept:application/json, */*,audit-id:71853471-a0b6-43c6-bd87-4ec15bde99d2,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:43:19.566) (total time: 3000ms): Trace[1051614568]: [3.000651942s] [3.000651942s] END E0407 09:43:22.567272 1 timeout.go:142] post-timeout activity - time-elapsed: 2.887078ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0407 09:43:22.567336 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:43:22.568622 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:22.568645 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:22.570181 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:43:22.570247 1 trace.go:236] Trace[1104734074]: "Get" accept:application/json, */*,audit-id:2e09868c-6b03-41ff-b644-8c25818b2f57,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:43:12.566) (total time: 10003ms): Trace[1104734074]: [10.003628678s] [10.003628678s] END E0407 09:43:22.570366 1 timeout.go:142] post-timeout activity - time-elapsed: 3.040032ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0407 09:43:25.093608 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:43:25.093872 1 trace.go:236] Trace[1517368284]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:86e7c174-8d4f-45c4-a05c-206c5d48f77b,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (07-Apr-2026 09:43:18.091) (total time: 7002ms): Trace[1517368284]: ["GuaranteedUpdate etcd3" audit-id:86e7c174-8d4f-45c4-a05c-206c5d48f77b,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:43:18.091) Trace[1517368284]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:43:25.093)] Trace[1517368284]: [7.00271213s] [7.00271213s] END E0407 09:43:25.828490 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:43:25.828856 1 trace.go:236] Trace[1646371005]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:aa55e46e-acd7-451c-ad01-251843ceed83,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 09:43:18.825) (total time: 7002ms): Trace[1646371005]: ["GuaranteedUpdate etcd3" audit-id:aa55e46e-acd7-451c-ad01-251843ceed83,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:43:18.826) Trace[1646371005]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:43:25.828)] Trace[1646371005]: [7.002894167s] [7.002894167s] END E0407 09:43:25.829589 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0407 09:43:25.867453 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:43:25.867826 1 trace.go:236] Trace[1376805951]: "Get" accept:application/json, */*,audit-id:67b5722c-2c41-4f92-bc96-fa4a2006ff3b,client:10.0.0.143,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (07-Apr-2026 09:43:18.321) (total time: 7545ms): Trace[1376805951]: [7.545629898s] [7.545629898s] END E0407 09:43:25.868156 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0407 09:43:25.868525 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:43:25.868837 1 trace.go:236] Trace[1335341461]: "Get" accept:application/json,audit-id:ea6a8244-bd44-49f3-beff-ea5d089b2211,client:199.204.45.246,protocol:HTTP/1.1,resource:secrettemplates,scope:resource,url:/apis/secretgen.carvel.dev/v1alpha1/namespaces/monitoring/secrettemplates/kube-prometheus-stack-prometheus-oauth2-proxy,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (07-Apr-2026 09:43:15.036) (total time: 10832ms): Trace[1335341461]: [10.83211059s] [10.83211059s] END I0407 09:43:25.869679 1 trace.go:236] Trace[1111625203]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:241fefd7-4dc1-4c50-b3d6-34d919f39332,client:199.204.45.246,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18a409d5ab95be8a,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (07-Apr-2026 09:43:17.234) (total time: 8634ms): Trace[1111625203]: ["GuaranteedUpdate etcd3" audit-id:241fefd7-4dc1-4c50-b3d6-34d919f39332,key:/events/kube-system/kube-apiserver-instance.18a409d5ab95be8a,type:*core.Event,resource:events 8634ms (09:43:17.235)] Trace[1111625203]: [8.634630474s] [8.634630474s] END E0407 09:43:27.563911 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:27.564039 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:27.563985 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 13.55µs, panicked: false, err: context deadline exceeded, panic-reason: E0407 09:43:27.564765 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:27.564823 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 5.33µs, panicked: false, err: context deadline exceeded, panic-reason: E0407 09:43:27.565237 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:27.565279 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0407 09:43:27.565932 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:43:27.567042 1 trace.go:236] Trace[1196878219]: "Update" accept:application/json, */*,audit-id:e370c756-f60a-40c6-8fec-cb8b9b20d2ea,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:43:22.565) (total time: 5001ms): Trace[1196878219]: ["GuaranteedUpdate etcd3" audit-id:e370c756-f60a-40c6-8fec-cb8b9b20d2ea,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:43:22.565) Trace[1196878219]: ---"Txn call failed" err:context deadline exceeded 4998ms (09:43:27.564)] Trace[1196878219]: [5.001704979s] [5.001704979s] END E0407 09:43:27.567236 1 timeout.go:142] post-timeout activity - time-elapsed: 2.439499ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: I0407 09:43:27.567454 1 trace.go:236] Trace[2016132689]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b675f3fd-b11d-4701-b87f-6ef59c158cad,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 09:43:22.563) (total time: 5004ms): Trace[2016132689]: ["GuaranteedUpdate etcd3" audit-id:b675f3fd-b11d-4701-b87f-6ef59c158cad,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5004ms (09:43:22.563) Trace[2016132689]: ---"Txn call failed" err:context deadline exceeded 4999ms (09:43:27.563)] Trace[2016132689]: [5.004113498s] [5.004113498s] END E0407 09:43:27.567604 1 timeout.go:142] post-timeout activity - time-elapsed: 3.644059ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0407 09:43:28.744666 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:43:28.744862 1 trace.go:236] Trace[1726031919]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fb1bc249-7d0e-482e-87c4-6832873ff122,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 09:43:21.741) (total time: 7003ms): Trace[1726031919]: ["GuaranteedUpdate etcd3" audit-id:fb1bc249-7d0e-482e-87c4-6832873ff122,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:43:21.741) Trace[1726031919]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:43:28.744)] Trace[1726031919]: [7.003274332s] [7.003274332s] END E0407 09:43:29.506715 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:43:29.506985 1 trace.go:236] Trace[1118648649]: "Create" accept:application/json, */*,audit-id:f18e3b5f-87ab-4523-9693-0662b04c6bab,client:10.0.0.103,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (07-Apr-2026 09:43:22.504) (total time: 7002ms): Trace[1118648649]: ["Create etcd3" audit-id:f18e3b5f-87ab-4523-9693-0662b04c6bab,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18a409de1346a975,type:*core.Event,resource:events 7002ms (09:43:22.504)] Trace[1118648649]: [7.002830908s] [7.002830908s] END E0407 09:43:29.523436 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:43:29.523552 1 trace.go:236] Trace[258673080]: "Update" accept:application/json, */*,audit-id:6d07b678-8025-4eab-94c3-c5dba4514a26,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 09:43:22.520) (total time: 7003ms): Trace[258673080]: ["GuaranteedUpdate etcd3" audit-id:6d07b678-8025-4eab-94c3-c5dba4514a26,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:43:22.520) Trace[258673080]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:43:29.523)] Trace[258673080]: [7.003026524s] [7.003026524s] END E0407 09:43:29.526861 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:43:29.526897 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:43:29.526927 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 5.251µs, panicked: false, err: context canceled, panic-reason: E0407 09:43:29.528221 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:43:29.528338 1 trace.go:236] Trace[924100000]: "Update" accept:application/json, */*,audit-id:81abba09-578a-4c0b-9ec4-9d3ad5053348,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 09:43:22.567) (total time: 6960ms): Trace[924100000]: ["GuaranteedUpdate etcd3" audit-id:81abba09-578a-4c0b-9ec4-9d3ad5053348,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 6960ms (09:43:22.567) Trace[924100000]: ---"Txn call failed" err:context canceled 6958ms (09:43:29.526)] Trace[924100000]: [6.960541649s] [6.960541649s] END E0407 09:43:29.528470 1 timeout.go:142] post-timeout activity - time-elapsed: 1.678832ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: I0407 09:43:29.859285 1 trace.go:236] Trace[945661036]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f5442a50-26d2-4443-842d-bb9dd4824820,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 09:43:25.830) (total time: 4028ms): Trace[945661036]: ["GuaranteedUpdate etcd3" audit-id:f5442a50-26d2-4443-842d-bb9dd4824820,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 4028ms (09:43:25.830) Trace[945661036]: ---"Txn call completed" 4026ms (09:43:29.858)] Trace[945661036]: [4.028603714s] [4.028603714s] END I0407 09:43:29.859729 1 trace.go:236] Trace[790823902]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e3d2d643-d44d-4c59-8489-beef9daa4de0,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 09:43:28.746) (total time: 1112ms): Trace[790823902]: ["GuaranteedUpdate etcd3" audit-id:e3d2d643-d44d-4c59-8489-beef9daa4de0,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 1112ms (09:43:28.747) Trace[790823902]: ---"Txn call completed" 1111ms (09:43:29.859)] Trace[790823902]: [1.112863171s] [1.112863171s] END E0407 09:43:29.861126 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0407 09:43:29.861454 1 trace.go:236] Trace[1023749383]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:50d417f8-85bb-48ef-b1a1-7c12a51e3c54,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (07-Apr-2026 09:43:25.252) (total time: 4609ms): Trace[1023749383]: ---"About to write a response" 4609ms (09:43:29.861) Trace[1023749383]: [4.609267822s] [4.609267822s] END I0407 09:43:29.861495 1 trace.go:236] Trace[51760632]: "Get" accept:application/json, */*,audit-id:3dc22c25-9ccb-4727-aca0-8dbe557c0163,client:10.0.0.159,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:43:19.406) (total time: 10454ms): Trace[51760632]: ---"About to write a response" 10454ms (09:43:29.861) Trace[51760632]: [10.454851069s] [10.454851069s] END I0407 09:43:29.861625 1 trace.go:236] Trace[1050875849]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e057aed6-e94d-4aef-8965-31d304abc2ce,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (07-Apr-2026 09:43:25.095) (total time: 4765ms): Trace[1050875849]: ---"About to write a response" 4765ms (09:43:29.861) Trace[1050875849]: [4.765793523s] [4.765793523s] END I0407 09:43:30.075542 1 trace.go:236] Trace[1013725702]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ec0131dc-c5b5-4c79-9066-7b7d10966dbb,client:199.204.45.246,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18a409d5ab95be8a,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (07-Apr-2026 09:43:25.871) (total time: 4203ms): Trace[1013725702]: ["GuaranteedUpdate etcd3" audit-id:ec0131dc-c5b5-4c79-9066-7b7d10966dbb,key:/events/kube-system/kube-apiserver-instance.18a409d5ab95be8a,type:*core.Event,resource:events 4203ms (09:43:25.871) Trace[1013725702]: ---"initial value restored" 3988ms (09:43:29.860) Trace[1013725702]: ---"Txn call completed" 184ms (09:43:30.075)] Trace[1013725702]: ---"Object stored in database" 214ms (09:43:30.075) Trace[1013725702]: [4.203729588s] [4.203729588s] END I0407 09:43:30.075825 1 trace.go:236] Trace[1067631376]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.246,type:*v1.Endpoints,resource:apiServerIPInfo (07-Apr-2026 09:43:21.816) (total time: 8259ms): Trace[1067631376]: ---"initial value restored" 8044ms (09:43:29.860) Trace[1067631376]: ---"Transaction prepared" 97ms (09:43:29.957) Trace[1067631376]: ---"Txn call completed" 117ms (09:43:30.075) Trace[1067631376]: [8.259488663s] [8.259488663s] END I0407 09:43:32.350404 1 trace.go:236] Trace[1140416539]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.246,type:*v1.Endpoints,resource:apiServerIPInfo (07-Apr-2026 09:43:31.816) (total time: 533ms): Trace[1140416539]: ---"initial value restored" 224ms (09:43:32.041) Trace[1140416539]: ---"Transaction prepared" 234ms (09:43:32.275) Trace[1140416539]: ---"Txn call completed" 74ms (09:43:32.350) Trace[1140416539]: [533.515501ms] [533.515501ms] END