I0624 09:37:13.809967 1 options.go:220] external host was not specified, using 199.19.213.108 I0624 09:37:13.810738 1 server.go:148] Version: v1.28.13 I0624 09:37:13.810786 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0624 09:37:14.380801 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0624 09:37:14.390714 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0624 09:37:14.390730 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0624 09:37:14.390922 1 instance.go:298] Using reconciler: lease I0624 09:37:14.421637 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0624 09:37:14.421651 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0624 09:37:14.695176 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0624 09:37:14.695368 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0624 09:37:15.182063 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0624 09:37:15.193046 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0624 09:37:15.193081 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0624 09:37:15.193088 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0624 09:37:15.193494 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0624 09:37:15.193508 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0624 09:37:15.194320 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0624 09:37:15.195036 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0624 09:37:15.195051 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0624 09:37:15.195056 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0624 09:37:15.196787 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0624 09:37:15.196804 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0624 09:37:15.197459 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0624 09:37:15.197472 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0624 09:37:15.197476 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0624 09:37:15.197832 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0624 09:37:15.197846 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0624 09:37:15.197871 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0624 09:37:15.198224 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0624 09:37:15.199351 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0624 09:37:15.199365 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0624 09:37:15.199368 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0624 09:37:15.199646 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0624 09:37:15.199657 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0624 09:37:15.199660 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0624 09:37:15.200195 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0624 09:37:15.200208 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0624 09:37:15.201575 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0624 09:37:15.201589 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0624 09:37:15.201593 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0624 09:37:15.201896 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0624 09:37:15.201910 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0624 09:37:15.201913 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0624 09:37:15.203529 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0624 09:37:15.203546 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0624 09:37:15.203550 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0624 09:37:15.204805 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0624 09:37:15.205629 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0624 09:37:15.205644 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0624 09:37:15.205649 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0624 09:37:15.209021 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0624 09:37:15.209037 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0624 09:37:15.209041 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0624 09:37:15.209941 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0624 09:37:15.209956 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0624 09:37:15.209960 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0624 09:37:15.210366 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0624 09:37:15.210377 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0624 09:37:15.250056 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0624 09:37:15.250142 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0624 09:37:15.652487 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0624 09:37:15.652534 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0624 09:37:15.652807 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0624 09:37:15.653087 1 secure_serving.go:213] Serving securely on [::]:6443 I0624 09:37:15.653156 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0624 09:37:15.653212 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0624 09:37:15.653322 1 controller.go:80] Starting OpenAPI V3 AggregationController I0624 09:37:15.653447 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0624 09:37:15.653627 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0624 09:37:15.653649 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0624 09:37:15.653650 1 controller.go:116] Starting legacy_token_tracking_controller I0624 09:37:15.653688 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0624 09:37:15.653695 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0624 09:37:15.653727 1 available_controller.go:423] Starting AvailableConditionController I0624 09:37:15.653735 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0624 09:37:15.653773 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0624 09:37:15.653796 1 system_namespaces_controller.go:67] Starting system namespaces controller I0624 09:37:15.653474 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0624 09:37:15.653860 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0624 09:37:15.653957 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0624 09:37:15.654341 1 gc_controller.go:78] Starting apiserver lease garbage collector I0624 09:37:15.653487 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0624 09:37:15.653502 1 gc_controller.go:78] Starting apiserver lease garbage collector I0624 09:37:15.654698 1 aggregator.go:164] waiting for initial CRD sync... I0624 09:37:15.654725 1 controller.go:78] Starting OpenAPI AggregationController I0624 09:37:15.654947 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0624 09:37:15.654963 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0624 09:37:15.677846 1 controller.go:134] Starting OpenAPI controller I0624 09:37:15.677875 1 controller.go:85] Starting OpenAPI V3 controller I0624 09:37:15.677892 1 naming_controller.go:291] Starting NamingConditionController I0624 09:37:15.677904 1 establishing_controller.go:76] Starting EstablishingController I0624 09:37:15.677918 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0624 09:37:15.677932 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0624 09:37:15.677942 1 crd_finalizer.go:266] Starting CRDFinalizer I0624 09:37:15.683031 1 shared_informer.go:318] Caches are synced for node_authorizer I0624 09:37:15.754104 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0624 09:37:15.754152 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0624 09:37:15.754297 1 cache.go:39] Caches are synced for AvailableConditionController controller I0624 09:37:15.754469 1 shared_informer.go:318] Caches are synced for configmaps I0624 09:37:15.754533 1 apf_controller.go:379] Running API Priority and Fairness config worker I0624 09:37:15.754591 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0624 09:37:15.755076 1 shared_informer.go:318] Caches are synced for crd-autoregister I0624 09:37:15.755161 1 aggregator.go:166] initial CRD sync complete... I0624 09:37:15.755194 1 autoregister_controller.go:141] Starting autoregister controller I0624 09:37:15.755240 1 cache.go:32] Waiting for caches to sync for autoregister controller I0624 09:37:15.755265 1 cache.go:39] Caches are synced for autoregister controller I0624 09:37:15.756345 1 controller.go:624] quota admission added evaluator for: namespaces I0624 09:37:15.822831 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0624 09:37:16.660513 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0624 09:37:16.664577 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0624 09:37:16.664635 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0624 09:37:17.235134 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0624 09:37:17.527752 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0624 09:37:17.665756 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0624 09:37:17.676056 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.19.213.108] I0624 09:37:17.677298 1 controller.go:624] quota admission added evaluator for: endpoints I0624 09:37:17.682255 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0624 09:37:18.178968 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0624 09:37:19.245820 1 controller.go:624] quota admission added evaluator for: deployments.apps I0624 09:37:19.350282 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0624 09:37:19.557190 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0624 09:37:22.824504 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0624 09:37:23.226287 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0624 09:37:50.702574 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0624 09:37:50.744458 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0624 09:37:50.744507 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0624 09:37:50.759806 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0624 09:37:50.800486 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0624 09:37:50.800529 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0624 09:37:50.861253 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0624 09:37:50.881976 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0624 09:37:50.904405 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0624 09:37:50.946014 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0624 09:37:50.946062 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0624 09:37:50.953761 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0624 09:37:50.995605 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0624 09:37:50.995770 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0624 09:37:51.091271 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0624 09:37:51.216298 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0624 09:37:51.216394 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0624 09:37:51.227296 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0624 09:37:51.303094 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0624 09:37:51.349414 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0624 09:37:51.423804 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0624 09:37:51.447323 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0624 09:37:52.069123 1 trace.go:236] Trace[254700955]: "Create" accept:application/json,audit-id:0cd88976-8d25-4878-b19b-2c7919ff7789,client:199.19.213.108,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (24-Jun-2026 09:37:51.324) (total time: 744ms): Trace[254700955]: ---"Conversion done" 44ms (09:37:51.370) Trace[254700955]: ["Create etcd3" audit-id:0cd88976-8d25-4878-b19b-2c7919ff7789,key:/apiextensions.k8s.io/customresourcedefinitions/envoyproxies.gateway.envoyproxy.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 545ms (09:37:51.523) Trace[254700955]: ---"Txn call succeeded" 489ms (09:37:52.021)] Trace[254700955]: ---"Writing http response done" 21ms (09:37:52.069) Trace[254700955]: [744.942376ms] [744.942376ms] END I0624 09:37:52.561158 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0624 09:37:52.636162 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0624 09:37:58.055276 1 controller.go:624] quota admission added evaluator for: jobs.batch I0624 09:37:58.950044 1 trace.go:236] Trace[1839104026]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:adb1079c-ac33-4981-94cc-c95c593b8727,client:199.19.213.108,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-hb8z9/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Jun-2026 09:37:58.436) (total time: 513ms): Trace[1839104026]: ["GuaranteedUpdate etcd3" audit-id:adb1079c-ac33-4981-94cc-c95c593b8727,key:/pods/kube-system/cilium-hb8z9,type:*core.Pod,resource:pods 512ms (09:37:58.437) Trace[1839104026]: ---"Txn call completed" 503ms (09:37:58.949)] Trace[1839104026]: ---"Object stored in database" 505ms (09:37:58.949) Trace[1839104026]: [513.034996ms] [513.034996ms] END I0624 09:37:59.626123 1 trace.go:236] Trace[222752599]: "Update" accept:application/json, */*,audit-id:17612f57-d5fd-4d0f-807f-7dd8736412be,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (24-Jun-2026 09:37:58.951) (total time: 674ms): Trace[222752599]: ["GuaranteedUpdate etcd3" audit-id:17612f57-d5fd-4d0f-807f-7dd8736412be,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 673ms (09:37:58.952) Trace[222752599]: ---"Txn call completed" 672ms (09:37:59.625)] Trace[222752599]: [674.351213ms] [674.351213ms] END I0624 09:38:00.748341 1 trace.go:236] Trace[970776532]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b606ab9b-0db9-41a5-a23b-aeb16637df33,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:38:00.208) (total time: 540ms): Trace[970776532]: ["GuaranteedUpdate etcd3" audit-id:b606ab9b-0db9-41a5-a23b-aeb16637df33,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 539ms (09:38:00.208) Trace[970776532]: ---"Txn call completed" 538ms (09:38:00.748)] Trace[970776532]: [540.015678ms] [540.015678ms] END I0624 09:38:03.170614 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0624 09:38:03.192214 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0624 09:38:03.557990 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0624 09:38:03.778844 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0624 09:38:04.031488 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0624 09:38:04.200976 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0624 09:38:04.359716 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0624 09:38:04.679009 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0624 09:38:05.175772 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0624 09:38:06.765128 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0624 09:38:07.164058 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0624 09:38:07.373208 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0624 09:38:07.373263 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0624 09:38:10.972643 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0624 09:38:18.287216 1 trace.go:236] Trace[1104614204]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:583af1a5-668d-4255-b2f3-53ad52c9e0b7,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:38:17.134) (total time: 1152ms): Trace[1104614204]: ["GuaranteedUpdate etcd3" audit-id:583af1a5-668d-4255-b2f3-53ad52c9e0b7,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1152ms (09:38:17.135) Trace[1104614204]: ---"Txn call completed" 1150ms (09:38:18.286)] Trace[1104614204]: [1.152170565s] [1.152170565s] END I0624 09:38:18.296029 1 trace.go:236] Trace[610241062]: "Get" accept:application/json, */*,audit-id:84d278b9-b3cc-49ac-b4fb-a399681338ec,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:38:17.242) (total time: 1053ms): Trace[610241062]: ---"About to write a response" 1053ms (09:38:18.295) Trace[610241062]: [1.053625222s] [1.053625222s] END I0624 09:38:18.296121 1 trace.go:236] Trace[356398601]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:79140ef2-ca71-4ca3-9c97-696059458a0c,client:199.19.213.108,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/envoy-gateway-system/jobs/envoy-gateway-gateway-helm-certgen/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:PUT (24-Jun-2026 09:38:17.723) (total time: 572ms): Trace[356398601]: ["GuaranteedUpdate etcd3" audit-id:79140ef2-ca71-4ca3-9c97-696059458a0c,key:/jobs/envoy-gateway-system/envoy-gateway-gateway-helm-certgen,type:*batch.Job,resource:jobs.batch 572ms (09:38:17.723) Trace[356398601]: ---"Txn call completed" 569ms (09:38:18.295)] Trace[356398601]: [572.976729ms] [572.976729ms] END I0624 09:38:18.296426 1 trace.go:236] Trace[181339450]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5041adea-d47d-4bec-8cdf-97a9897ab75b,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:38:17.285) (total time: 1010ms): Trace[181339450]: ---"About to write a response" 1010ms (09:38:18.296) Trace[181339450]: [1.010848976s] [1.010848976s] END I0624 09:38:18.296785 1 trace.go:236] Trace[1420788110]: "Get" accept:application/json, */*,audit-id:86ecfc96-0ff1-46c7-b1ab-2109ddd74f0f,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Jun-2026 09:38:17.285) (total time: 1011ms): Trace[1420788110]: ---"About to write a response" 1010ms (09:38:18.296) Trace[1420788110]: [1.011291077s] [1.011291077s] END I0624 09:38:18.297749 1 trace.go:236] Trace[1783305585]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:dbe373a7-c12d-49aa-9bb9-ac505be77ef3,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:38:17.225) (total time: 1072ms): Trace[1783305585]: ---"About to write a response" 1071ms (09:38:18.297) Trace[1783305585]: [1.072166197s] [1.072166197s] END I0624 09:38:18.311670 1 trace.go:236] Trace[511779198]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.108,type:*v1.Endpoints,resource:apiServerIPInfo (24-Jun-2026 09:38:17.664) (total time: 646ms): Trace[511779198]: ---"initial value restored" 631ms (09:38:18.296) Trace[511779198]: [646.65631ms] [646.65631ms] END I0624 09:38:21.742790 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.101.149.154"} W0624 09:38:21.969062 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.101.149.154:9443: connect: connection refused E0624 09:38:21.969097 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.101.149.154:9443: connect: connection refused I0624 09:38:36.600081 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0624 09:38:36.609527 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0624 09:38:36.650936 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.96.74.243"} I0624 09:38:36.652600 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0624 09:38:36.663525 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.106.236.11"} I0624 09:38:36.684754 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0624 09:38:36.737698 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0624 09:38:36.775275 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager W0624 09:38:47.705877 1 dispatcher.go:217] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": dial tcp 10.96.74.243:443: connect: connection refused I0624 09:38:52.705017 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0624 09:38:53.777468 1 trace.go:236] Trace[1725961721]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:cc8cc66f-26fa-4988-ae6b-b564870a70e2,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:38:52.959) (total time: 818ms): Trace[1725961721]: ---"About to write a response" 818ms (09:38:53.777) Trace[1725961721]: [818.318321ms] [818.318321ms] END I0624 09:38:53.777627 1 trace.go:236] Trace[619387854]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:82b2c178-31ca-41d8-bf69-d1816f56f122,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:38:52.941) (total time: 836ms): Trace[619387854]: ---"About to write a response" 836ms (09:38:53.777) Trace[619387854]: [836.313072ms] [836.313072ms] END I0624 09:38:53.777878 1 trace.go:236] Trace[2079745837]: "Get" accept:application/json, */*,audit-id:1a67f033-4ce8-489d-8efc-8a1b28b04050,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Jun-2026 09:38:53.189) (total time: 588ms): Trace[2079745837]: ---"About to write a response" 588ms (09:38:53.777) Trace[2079745837]: [588.317055ms] [588.317055ms] END I0624 09:38:53.778152 1 trace.go:236] Trace[1925225076]: "Get" accept:application/json, */*,audit-id:507e99e8-d216-4f9b-8649-ccaa4ce4854a,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:38:53.183) (total time: 594ms): Trace[1925225076]: ---"About to write a response" 594ms (09:38:53.777) Trace[1925225076]: [594.269691ms] [594.269691ms] END I0624 09:38:53.779184 1 trace.go:236] Trace[1573498572]: "Get" accept:application/json, */*,audit-id:2ba41af6-e8c6-4177-a3b9-f0bc5fea755f,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Jun-2026 09:38:53.188) (total time: 589ms): Trace[1573498572]: ---"About to write a response" 589ms (09:38:53.777) Trace[1573498572]: [589.868516ms] [589.868516ms] END I0624 09:39:00.630551 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0624 09:39:17.967959 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.101.162.218"} I0624 09:39:17.975433 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.111.11.238"} I0624 09:39:17.983580 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.96.64.212"} I0624 09:39:17.993124 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.106.249.138"} I0624 09:39:25.555494 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0624 09:39:25.567814 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0624 09:39:25.592225 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0624 09:39:25.607211 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0624 09:39:25.628931 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0624 09:39:25.641733 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0624 09:39:25.669114 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0624 09:39:25.683530 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0624 09:39:25.706365 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0624 09:39:25.728933 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0624 09:39:25.753034 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0624 09:39:25.782702 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0624 09:39:25.798777 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0624 09:39:27.185842 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0624 09:39:31.222563 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0624 09:39:31.230769 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0624 09:39:31.282683 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.110.80.206"} I0624 09:39:31.307445 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0624 09:39:33.402712 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0624 09:39:33.439627 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0624 09:39:34.045197 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0624 09:39:34.045265 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0624 09:39:34.045343 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0624 09:39:41.155337 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0624 09:39:44.749638 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.96.73.88"} I0624 09:39:45.025022 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0624 09:39:45.168829 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.105.18.127"} I0624 09:39:45.186928 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.97.186.157"} I0624 09:39:48.817984 1 trace.go:236] Trace[830320735]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:01994bab-4846-4ce2-bda9-e2423c11be9e,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (24-Jun-2026 09:39:48.188) (total time: 629ms): Trace[830320735]: ["GuaranteedUpdate etcd3" audit-id:01994bab-4846-4ce2-bda9-e2423c11be9e,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 629ms (09:39:48.188) Trace[830320735]: ---"Txn call completed" 628ms (09:39:48.817)] Trace[830320735]: [629.31428ms] [629.31428ms] END I0624 09:39:48.818049 1 trace.go:236] Trace[1524682965]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c1b7ceee-457f-41f4-a952-be326b7c3c71,client:10.0.0.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:39:48.038) (total time: 779ms): Trace[1524682965]: ["GuaranteedUpdate etcd3" audit-id:c1b7ceee-457f-41f4-a952-be326b7c3c71,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 779ms (09:39:48.038) Trace[1524682965]: ---"Txn call completed" 778ms (09:39:48.817)] Trace[1524682965]: [779.20852ms] [779.20852ms] END I0624 09:39:48.818046 1 trace.go:236] Trace[1216712122]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b2df4b9e-6825-4e7b-825f-a6a3b198cfba,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:39:48.222) (total time: 595ms): Trace[1216712122]: ["GuaranteedUpdate etcd3" audit-id:b2df4b9e-6825-4e7b-825f-a6a3b198cfba,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 594ms (09:39:48.223) Trace[1216712122]: ---"Txn call completed" 593ms (09:39:48.817)] Trace[1216712122]: [595.105785ms] [595.105785ms] END I0624 09:39:48.818139 1 trace.go:236] Trace[1854336031]: "Get" accept:application/json, */*,audit-id:48f660a3-0d56-4a79-bbdc-8c84d9dbacf5,client:10.0.0.103,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-e617dbef-6712-442e-9dd7-92cb17f08d81,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Jun-2026 09:39:48.155) (total time: 662ms): Trace[1854336031]: ---"About to write a response" 661ms (09:39:48.817) Trace[1854336031]: [662.171477ms] [662.171477ms] END I0624 09:39:48.819017 1 trace.go:236] Trace[1826072948]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a91a2b00-0041-4a5f-975a-5f421eed4ef5,client:10.0.0.45,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:39:48.236) (total time: 582ms): Trace[1826072948]: ["GuaranteedUpdate etcd3" audit-id:a91a2b00-0041-4a5f-975a-5f421eed4ef5,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 582ms (09:39:48.236) Trace[1826072948]: ---"Txn call completed" 581ms (09:39:48.818)] Trace[1826072948]: [582.315852ms] [582.315852ms] END I0624 09:39:48.855381 1 trace.go:236] Trace[1314123050]: "Get" accept:application/json,audit-id:fb81480e-a555-4c39-b628-a14e1b16b971,client:199.19.213.108,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (24-Jun-2026 09:39:48.210) (total time: 644ms): Trace[1314123050]: ---"About to write a response" 644ms (09:39:48.854) Trace[1314123050]: [644.927024ms] [644.927024ms] END I0624 09:40:01.379718 1 trace.go:236] Trace[898810217]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4ac4678e-8891-441e-80ff-37bd31fa51e6,client:10.0.0.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:40:00.869) (total time: 510ms): Trace[898810217]: ["GuaranteedUpdate etcd3" audit-id:4ac4678e-8891-441e-80ff-37bd31fa51e6,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 510ms (09:40:00.869) Trace[898810217]: ---"Txn call completed" 509ms (09:40:01.379)] Trace[898810217]: [510.229357ms] [510.229357ms] END I0624 09:40:01.379717 1 trace.go:236] Trace[985724584]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:da6760ca-9c29-46ab-8f5c-db0e9ccd01f3,client:10.0.0.45,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:40:00.870) (total time: 509ms): Trace[985724584]: ["GuaranteedUpdate etcd3" audit-id:da6760ca-9c29-46ab-8f5c-db0e9ccd01f3,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 509ms (09:40:00.870) Trace[985724584]: ---"Txn call completed" 508ms (09:40:01.379)] Trace[985724584]: [509.188243ms] [509.188243ms] END I0624 09:40:01.516035 1 trace.go:236] Trace[2135013918]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3503362d-4fc9-4cc6-97bd-2584514d8505,client:10.0.0.94,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Jun-2026 09:40:00.928) (total time: 587ms): Trace[2135013918]: ---"About to write a response" 587ms (09:40:01.515) Trace[2135013918]: [587.869221ms] [587.869221ms] END I0624 09:40:01.516312 1 trace.go:236] Trace[820889252]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6500baec-abd6-47ab-a6b9-f46a03a89841,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:40:00.986) (total time: 529ms): Trace[820889252]: ["GuaranteedUpdate etcd3" audit-id:6500baec-abd6-47ab-a6b9-f46a03a89841,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 529ms (09:40:00.987) Trace[820889252]: ---"Txn call completed" 528ms (09:40:01.516)] Trace[820889252]: [529.286626ms] [529.286626ms] END I0624 09:40:01.516655 1 trace.go:236] Trace[1705423628]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a2375b20-2e15-4aab-a3bb-69744bc1a5b4,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:40:00.943) (total time: 572ms): Trace[1705423628]: ---"About to write a response" 572ms (09:40:01.516) Trace[1705423628]: [572.852226ms] [572.852226ms] END I0624 09:40:01.517823 1 trace.go:236] Trace[1230462638]: "Get" accept:application/json,audit-id:25a26fc4-a380-4f2e-93dd-3c313640d3a7,client:199.19.213.108,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (24-Jun-2026 09:40:00.931) (total time: 585ms): Trace[1230462638]: ---"About to write a response" 585ms (09:40:01.517) Trace[1230462638]: [585.957787ms] [585.957787ms] END I0624 09:40:01.517880 1 trace.go:236] Trace[880210104]: "Get" accept:application/json, */*,audit-id:8f6ad292-8bca-461a-8fb2-afef5e30649d,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:40:01.010) (total time: 507ms): Trace[880210104]: ---"About to write a response" 506ms (09:40:01.517) Trace[880210104]: [507.056359ms] [507.056359ms] END I0624 09:40:29.992498 1 trace.go:236] Trace[517055303]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4179fa58-06a9-4875-819e-04db55f24a7c,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:40:29.108) (total time: 883ms): Trace[517055303]: ["GuaranteedUpdate etcd3" audit-id:4179fa58-06a9-4875-819e-04db55f24a7c,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 883ms (09:40:29.108) Trace[517055303]: ---"Txn call completed" 882ms (09:40:29.992)] Trace[517055303]: [883.797374ms] [883.797374ms] END I0624 09:40:29.994400 1 trace.go:236] Trace[692214673]: "Get" accept:application/json,audit-id:ee600e65-1929-4a1a-8b05-92825d23d8a4,client:199.19.213.108,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (24-Jun-2026 09:40:28.874) (total time: 1119ms): Trace[692214673]: ---"About to write a response" 1119ms (09:40:29.993) Trace[692214673]: [1.119827356s] [1.119827356s] END I0624 09:40:31.690944 1 trace.go:236] Trace[1974586868]: "Update" accept:application/json, */*,audit-id:80fb4ced-20f0-4bf3-a0c1-924744d7f4aa,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (24-Jun-2026 09:40:31.002) (total time: 688ms): Trace[1974586868]: ["GuaranteedUpdate etcd3" audit-id:80fb4ced-20f0-4bf3-a0c1-924744d7f4aa,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 688ms (09:40:31.002) Trace[1974586868]: ---"Txn call completed" 687ms (09:40:31.690)] Trace[1974586868]: [688.653768ms] [688.653768ms] END I0624 09:40:32.299955 1 trace.go:236] Trace[88917870]: "Update" accept:application/json, */*,audit-id:3f42d239-a684-4ebd-a52f-46ad06ea4078,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (24-Jun-2026 09:40:31.002) (total time: 1297ms): Trace[88917870]: ["GuaranteedUpdate etcd3" audit-id:3f42d239-a684-4ebd-a52f-46ad06ea4078,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1297ms (09:40:31.002) Trace[88917870]: ---"Txn call completed" 1295ms (09:40:32.299)] Trace[88917870]: [1.297711793s] [1.297711793s] END I0624 09:40:32.475216 1 trace.go:236] Trace[1238382993]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a5ba9919-a74b-41dc-9d51-a85a58cc9562,client:10.0.0.94,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Jun-2026 09:40:31.677) (total time: 797ms): Trace[1238382993]: ---"About to write a response" 797ms (09:40:32.474) Trace[1238382993]: [797.856674ms] [797.856674ms] END I0624 09:41:15.524632 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.103.57.135"} E0624 09:41:23.667519 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:23.667566 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:23.667567 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 15.11µs, panicked: false, err: context canceled, panic-reason: E0624 09:41:23.668837 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:23.668917 1 trace.go:236] Trace[56659171]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0780b723-82ce-4e64-a57a-5e1863da90b5,client:10.0.0.94,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:41:18.667) (total time: 5001ms): Trace[56659171]: ["GuaranteedUpdate etcd3" audit-id:0780b723-82ce-4e64-a57a-5e1863da90b5,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:41:18.667) Trace[56659171]: ---"Txn call failed" err:context canceled 4999ms (09:41:23.667)] Trace[56659171]: [5.001717092s] [5.001717092s] END E0624 09:41:23.669079 1 timeout.go:142] post-timeout activity - time-elapsed: 1.888449ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0624 09:41:23.671813 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:23.671838 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 126.272µs, panicked: false, err: context canceled, panic-reason: E0624 09:41:23.671845 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:23.672985 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:23.673076 1 trace.go:236] Trace[2126327014]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1e1e84c7-763a-4910-9870-f120d52a4650,client:10.0.0.45,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:41:18.672) (total time: 5000ms): Trace[2126327014]: ["GuaranteedUpdate etcd3" audit-id:1e1e84c7-763a-4910-9870-f120d52a4650,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (09:41:18.672) Trace[2126327014]: ---"Txn call failed" err:context canceled 4998ms (09:41:23.671)] Trace[2126327014]: [5.000690342s] [5.000690342s] END E0624 09:41:23.673235 1 timeout.go:142] post-timeout activity - time-elapsed: 1.362715ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0624 09:41:23.716277 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:23.716317 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:23.716428 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 77.821µs, panicked: false, err: context canceled, panic-reason: E0624 09:41:23.717649 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:23.717769 1 trace.go:236] Trace[1553741506]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c3c43234-38cb-43b6-a494-cb94d0054827,client:10.0.0.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:41:18.717) (total time: 5000ms): Trace[1553741506]: ["GuaranteedUpdate etcd3" audit-id:c3c43234-38cb-43b6-a494-cb94d0054827,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (09:41:18.717) Trace[1553741506]: ---"Txn call failed" err:context canceled 4998ms (09:41:23.716)] Trace[1553741506]: [5.000460356s] [5.000460356s] END E0624 09:41:23.717945 1 timeout.go:142] post-timeout activity - time-elapsed: 1.681677ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0624 09:41:23.745238 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:23.745298 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:23.745338 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 24.301µs, panicked: false, err: context canceled, panic-reason: E0624 09:41:23.746804 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:23.746870 1 trace.go:236] Trace[296343259]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5b8a3e60-32c5-4fa9-ba10-e9b9ec54a31a,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:41:18.744) (total time: 5002ms): Trace[296343259]: ["GuaranteedUpdate etcd3" audit-id:5b8a3e60-32c5-4fa9-ba10-e9b9ec54a31a,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:41:18.744) Trace[296343259]: ---"Txn call failed" err:context canceled 4999ms (09:41:23.745)] Trace[296343259]: [5.00209322s] [5.00209322s] END E0624 09:41:23.746980 1 timeout.go:142] post-timeout activity - time-elapsed: 1.808248ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0624 09:41:23.787763 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:23.787885 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:23.788937 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:23.789009 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:23.790180 1 trace.go:236] Trace[1528340948]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1c29a431-953c-4f42-92f6-dd02d1b277d8,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:41:18.788) (total time: 5001ms): Trace[1528340948]: [5.001959567s] [5.001959567s] END E0624 09:41:23.790352 1 timeout.go:142] post-timeout activity - time-elapsed: 2.609848ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0624 09:41:23.816384 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:23.816642 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:23.816867 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0624 09:41:23.818115 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:23.818135 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:23.818151 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:23.819340 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0624 09:41:23.819376 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:23.819388 1 trace.go:236] Trace[1192579449]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e7f84ff4-b8b5-4368-b0af-0f1160f053b0,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:41:18.815) (total time: 5003ms): Trace[1192579449]: [5.0034509s] [5.0034509s] END E0624 09:41:23.819490 1 timeout.go:142] post-timeout activity - time-elapsed: 3.286034ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: I0624 09:41:23.820534 1 trace.go:236] Trace[1652087337]: "Get" accept:application/json, */*,audit-id:a1ac51c7-e770-4816-949e-00b8c5e04b73,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:41:18.817) (total time: 5003ms): Trace[1652087337]: [5.003328128s] [5.003328128s] END E0624 09:41:23.820751 1 timeout.go:142] post-timeout activity - time-elapsed: 3.74242ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: I0624 09:41:24.677209 1 trace.go:236] Trace[1590824811]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.108,type:*v1.Endpoints,resource:apiServerIPInfo (24-Jun-2026 09:41:17.673) (total time: 7003ms): Trace[1590824811]: [7.003185548s] [7.003185548s] END E0624 09:41:24.677254 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0624 09:41:25.954437 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:41:25.954565 1 trace.go:236] Trace[13540141]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c1868138-6e54-4b9f-a5d3-4b9c53ef9c57,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (24-Jun-2026 09:41:18.951) (total time: 7003ms): Trace[13540141]: ["GuaranteedUpdate etcd3" audit-id:c1868138-6e54-4b9f-a5d3-4b9c53ef9c57,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:41:18.951) Trace[13540141]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:41:25.954)] Trace[13540141]: [7.003431626s] [7.003431626s] END E0624 09:41:27.944887 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:27.945059 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:27.945988 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:27.946176 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:27.947364 1 trace.go:236] Trace[885557134]: "Get" accept:application/json, */*,audit-id:b0f9178a-ed77-4a51-8830-dc74396b6017,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Jun-2026 09:41:17.943) (total time: 10003ms): Trace[885557134]: [10.003412306s] [10.003412306s] END E0624 09:41:27.947587 1 timeout.go:142] post-timeout activity - time-elapsed: 2.751348ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0624 09:41:28.617155 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:28.617350 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:28.618274 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:28.618511 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:28.619582 1 trace.go:236] Trace[712199308]: "Get" accept:application/json, */*,audit-id:62146e4b-b56d-489e-ac35-3e1bc8a12980,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Jun-2026 09:41:18.616) (total time: 10002ms): Trace[712199308]: [10.00253038s] [10.00253038s] END E0624 09:41:28.619727 1 timeout.go:142] post-timeout activity - time-elapsed: 2.673638ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0624 09:41:28.667524 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:28.667636 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:28.668945 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:28.669041 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:28.670071 1 trace.go:236] Trace[1415648320]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b4a44323-dd0a-44ad-bdce-697013c32d4c,client:10.0.0.94,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:41:23.668) (total time: 5001ms): Trace[1415648320]: [5.001210713s] [5.001210713s] END E0624 09:41:28.670223 1 timeout.go:142] post-timeout activity - time-elapsed: 2.487966ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0624 09:41:28.672374 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:28.672564 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:28.673982 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:28.674054 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:28.675519 1 trace.go:236] Trace[1204952885]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d21b1ed2-576b-4351-bf29-e8d07e2677a5,client:10.0.0.45,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:41:23.672) (total time: 5002ms): Trace[1204952885]: [5.00280879s] [5.00280879s] END E0624 09:41:28.675637 1 timeout.go:142] post-timeout activity - time-elapsed: 3.333705ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0624 09:41:28.681378 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:28.681431 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:28.683210 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:28.683266 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:28.684406 1 trace.go:236] Trace[807729695]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3b2f61d6-562a-440c-ade1-5e9ccbde5bd1,client:10.0.0.94,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Jun-2026 09:41:19.071) (total time: 9612ms): Trace[807729695]: [9.612461517s] [9.612461517s] END E0624 09:41:28.684488 1 timeout.go:142] post-timeout activity - time-elapsed: 3.150852ms, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: E0624 09:41:28.717053 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:28.717209 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:28.718336 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:28.718393 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:28.719521 1 trace.go:236] Trace[344480670]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:77b4a548-922c-4b4d-8b57-72c7481db1ce,client:10.0.0.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:41:23.716) (total time: 5002ms): Trace[344480670]: [5.002505753s] [5.002505753s] END E0624 09:41:28.719720 1 timeout.go:142] post-timeout activity - time-elapsed: 2.801279ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0624 09:41:28.735393 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:28.735424 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:28.737187 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0624 09:41:28.737301 1 timeout.go:142] post-timeout activity - time-elapsed: 1.97818ms, POST "/api/v1/namespaces/openstack/events" result: E0624 09:41:28.745072 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:28.745176 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:28.746233 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:28.746283 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:28.747960 1 trace.go:236] Trace[1025750222]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4b57ee2d-9bc3-4b57-8cad-b951fa4613df,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:41:23.746) (total time: 5001ms): Trace[1025750222]: [5.001294497s] [5.001294497s] END E0624 09:41:28.748095 1 timeout.go:142] post-timeout activity - time-elapsed: 3.012591ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0624 09:41:28.787628 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:28.787791 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:28.789056 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:28.789099 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:28.790170 1 trace.go:236] Trace[203270959]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:147d9ce9-2510-48d3-bdad-7c161fdb71da,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:41:25.789) (total time: 3000ms): Trace[203270959]: [3.000395234s] [3.000395234s] END E0624 09:41:28.790282 1 timeout.go:142] post-timeout activity - time-elapsed: 2.714027ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0624 09:41:28.816348 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:28.816457 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:28.817314 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:28.817870 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:28.817956 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:28.818562 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0624 09:41:28.819101 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0624 09:41:28.819115 1 trace.go:236] Trace[996734246]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:dceae180-2c91-4267-92ff-50c2dc374ee9,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:41:25.817) (total time: 3001ms): Trace[996734246]: [3.001584356s] [3.001584356s] END E0624 09:41:28.819253 1 timeout.go:142] post-timeout activity - time-elapsed: 3.261463ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0624 09:41:28.820238 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:28.820309 1 trace.go:236] Trace[1483447196]: "Get" accept:application/json, */*,audit-id:05778819-e50f-44e1-b175-33cdf3e07664,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:41:25.818) (total time: 3001ms): Trace[1483447196]: [3.001833836s] [3.001833836s] END E0624 09:41:28.820388 1 timeout.go:142] post-timeout activity - time-elapsed: 3.071961ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0624 09:41:29.678109 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:41:29.678462 1 trace.go:236] Trace[1281098513]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:95e5540c-8e12-4e1b-83a2-92ca61088d0f,client:199.19.213.108,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (24-Jun-2026 09:41:22.675) (total time: 7003ms): Trace[1281098513]: ["Create etcd3" audit-id:95e5540c-8e12-4e1b-83a2-92ca61088d0f,key:/events/kube-system/kube-apiserver-instance.18bbfb0672cb3698,type:*core.Event,resource:events 7002ms (09:41:22.675) Trace[1281098513]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:41:29.678)] Trace[1281098513]: [7.00325073s] [7.00325073s] END E0624 09:41:30.631931 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:41:30.632091 1 trace.go:236] Trace[241966135]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:884872f7-1ee1-4073-ba9e-6803894e27bf,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:41:23.629) (total time: 7002ms): Trace[241966135]: ["GuaranteedUpdate etcd3" audit-id:884872f7-1ee1-4073-ba9e-6803894e27bf,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:41:23.629) Trace[241966135]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:41:30.631)] Trace[241966135]: [7.002593048s] [7.002593048s] END E0624 09:41:30.632963 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0624 09:41:32.396476 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:41:32.396669 1 trace.go:236] Trace[243442483]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:525cd37e-174c-4eb7-8694-54a151be5619,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:41:25.392) (total time: 7003ms): Trace[243442483]: ["GuaranteedUpdate etcd3" audit-id:525cd37e-174c-4eb7-8694-54a151be5619,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:41:25.393) Trace[243442483]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:41:32.396)] Trace[243442483]: [7.003679912s] [7.003679912s] END E0624 09:41:33.229491 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:41:33.229691 1 trace.go:236] Trace[1253513914]: "Update" accept:application/json, */*,audit-id:bbae15f3-9307-4368-95b5-3e5a4acabfd6,client:10.0.0.234,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:41:26.226) (total time: 7002ms): Trace[1253513914]: ["GuaranteedUpdate etcd3" audit-id:bbae15f3-9307-4368-95b5-3e5a4acabfd6,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:41:26.227) Trace[1253513914]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:41:33.229)] Trace[1253513914]: [7.002813885s] [7.002813885s] END E0624 09:41:33.788788 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:33.788840 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:33.788872 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 7.57µs, panicked: false, err: context deadline exceeded, panic-reason: E0624 09:41:33.790518 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:33.790605 1 trace.go:236] Trace[602041545]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f917e1ca-9230-4a30-8310-65e4519f8bbb,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (24-Jun-2026 09:41:28.788) (total time: 5001ms): Trace[602041545]: ["GuaranteedUpdate etcd3" audit-id:f917e1ca-9230-4a30-8310-65e4519f8bbb,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:41:28.789) Trace[602041545]: ---"Txn call failed" err:context deadline exceeded 4998ms (09:41:33.788)] Trace[602041545]: [5.001569546s] [5.001569546s] END E0624 09:41:33.790746 1 timeout.go:142] post-timeout activity - time-elapsed: 1.879979ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0624 09:41:33.818656 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 10.621µs, panicked: false, err: context deadline exceeded, panic-reason: E0624 09:41:33.818766 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:33.819943 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:33.819987 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:33.821407 1 trace.go:236] Trace[1760016501]: "Update" accept:application/json, */*,audit-id:ba297908-0676-458c-bc3d-3f14e8a94aba,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:41:28.818) (total time: 5002ms): Trace[1760016501]: ["GuaranteedUpdate etcd3" audit-id:ba297908-0676-458c-bc3d-3f14e8a94aba,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (09:41:28.818) Trace[1760016501]: ---"Txn call failed" err:context deadline exceeded 4998ms (09:41:33.818)] Trace[1760016501]: [5.002666194s] [5.002666194s] END E0624 09:41:33.821532 1 timeout.go:142] post-timeout activity - time-elapsed: 2.974221ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0624 09:41:33.950906 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:33.951093 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:33.952338 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:33.952438 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:33.953914 1 trace.go:236] Trace[422818164]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:18b61a86-95e6-49a0-ae66-c635cf14174d,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (24-Jun-2026 09:41:25.956) (total time: 7997ms): Trace[422818164]: [7.997523787s] [7.997523787s] END E0624 09:41:33.954134 1 timeout.go:142] post-timeout activity - time-elapsed: 3.359244ms, GET "/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader" result: E0624 09:41:34.785759 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:41:34.785930 1 trace.go:236] Trace[1324797890]: "Update" accept:application/json, */*,audit-id:9717d895-95a0-4b0e-8beb-8618d5ccb9d7,client:10.0.0.151,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:PUT (24-Jun-2026 09:41:27.783) (total time: 7002ms): Trace[1324797890]: ["GuaranteedUpdate etcd3" audit-id:9717d895-95a0-4b0e-8beb-8618d5ccb9d7,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:41:27.783) Trace[1324797890]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:41:34.785)] Trace[1324797890]: [7.002781004s] [7.002781004s] END E0624 09:41:34.950214 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:41:34.950501 1 trace.go:236] Trace[2113084982]: "Update" accept:application/json, */*,audit-id:904f2855-a661-47b3-b764-f728bd2d3988,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (24-Jun-2026 09:41:27.946) (total time: 7003ms): Trace[2113084982]: ["GuaranteedUpdate etcd3" audit-id:904f2855-a661-47b3-b764-f728bd2d3988,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:41:27.946) Trace[2113084982]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:41:34.950)] Trace[2113084982]: [7.00386923s] [7.00386923s] END E0624 09:41:34.955944 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:34.955989 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:34.956031 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 12.85µs, panicked: false, err: context canceled, panic-reason: E0624 09:41:34.958855 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:34.958939 1 trace.go:236] Trace[1184515565]: "Update" accept:application/json, */*,audit-id:965f9e23-f0a7-431e-a2a7-d7f71c27ac89,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (24-Jun-2026 09:41:28.618) (total time: 6340ms): Trace[1184515565]: ["GuaranteedUpdate etcd3" audit-id:965f9e23-f0a7-431e-a2a7-d7f71c27ac89,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 6340ms (09:41:28.618) Trace[1184515565]: ---"Txn call failed" err:context canceled 6336ms (09:41:34.955)] Trace[1184515565]: [6.340700583s] [6.340700583s] END E0624 09:41:34.959108 1 timeout.go:142] post-timeout activity - time-elapsed: 3.230484ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0624 09:41:35.678304 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:41:35.678485 1 trace.go:236] Trace[1837009235]: "Create" accept:application/json, */*,audit-id:7a8a4324-e6ce-44b7-904e-dcf35d089a8d,client:10.0.0.45,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (24-Jun-2026 09:41:28.675) (total time: 7003ms): Trace[1837009235]: ["Create etcd3" audit-id:7a8a4324-e6ce-44b7-904e-dcf35d089a8d,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18bbfb07d897920e,type:*core.Event,resource:events 7002ms (09:41:28.676)] Trace[1837009235]: [7.003031147s] [7.003031147s] END E0624 09:41:35.678625 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 6.943214949s, panicked: false, err: context canceled, panic-reason: I0624 09:41:36.888354 1 trace.go:236] Trace[966266938]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7194e31b-7e00-4919-b801-92ec973df1b6,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:41:30.633) (total time: 6253ms): Trace[966266938]: ["GuaranteedUpdate etcd3" audit-id:7194e31b-7e00-4919-b801-92ec973df1b6,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 6253ms (09:41:30.634) Trace[966266938]: ---"Txn call completed" 6251ms (09:41:36.886)] Trace[966266938]: [6.253493411s] [6.253493411s] END I0624 09:41:36.889121 1 trace.go:236] Trace[885688161]: "Get" accept:application/json, */*,audit-id:b218148e-fc46-4a94-9e48-6ad1506dbae9,client:10.0.0.151,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:GET (24-Jun-2026 09:41:34.788) (total time: 2100ms): Trace[885688161]: ---"About to write a response" 2100ms (09:41:36.888) Trace[885688161]: [2.100532802s] [2.100532802s] END E0624 09:41:36.889493 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0624 09:41:36.890206 1 trace.go:236] Trace[1726364033]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:430d1a98-182c-420e-b277-1b0ee07d3733,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:41:32.398) (total time: 4491ms): Trace[1726364033]: ["GuaranteedUpdate etcd3" audit-id:430d1a98-182c-420e-b277-1b0ee07d3733,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 4491ms (09:41:32.398) Trace[1726364033]: ---"Txn call completed" 4488ms (09:41:36.888)] Trace[1726364033]: [4.491764372s] [4.491764372s] END I0624 09:41:36.890456 1 trace.go:236] Trace[1327825039]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a56529a0-cab8-475c-81fc-21a31249a54a,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (24-Jun-2026 09:41:33.952) (total time: 2938ms): Trace[1327825039]: ["GuaranteedUpdate etcd3" audit-id:a56529a0-cab8-475c-81fc-21a31249a54a,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 2938ms (09:41:33.952) Trace[1327825039]: ---"Txn call completed" 2936ms (09:41:36.889)] Trace[1327825039]: [2.938164795s] [2.938164795s] END I0624 09:41:36.890558 1 trace.go:236] Trace[2098002582]: "Get" accept:application/json, */*,audit-id:08d98454-74be-4fd3-891b-8027a0795b4c,client:10.0.0.234,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:41:33.231) (total time: 3658ms): Trace[2098002582]: ---"About to write a response" 3658ms (09:41:36.890) Trace[2098002582]: [3.65898486s] [3.65898486s] END I0624 09:41:36.890903 1 trace.go:236] Trace[983272418]: "Get" accept:application/json,audit-id:32f6faa8-155e-44e0-ac6f-0a57631bb60b,client:199.19.213.108,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/openstack/serviceaccounts/memcached-memcached,user-agent:Helm/3.11.2,verb:GET (24-Jun-2026 09:41:35.991) (total time: 899ms): Trace[983272418]: [899.378955ms] [899.378955ms] END I0624 09:41:36.891814 1 trace.go:236] Trace[203062678]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d48c5104-0b27-494e-b7da-9b613ca95b0e,client:199.19.213.108,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/ingress-nginx/services/ingress-nginx-controller,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (24-Jun-2026 09:41:25.671) (total time: 11220ms): Trace[203062678]: ---"About to write a response" 11220ms (09:41:36.891) Trace[203062678]: [11.220376762s] [11.220376762s] END I0624 09:41:36.892081 1 trace.go:236] Trace[1720079847]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d2019c11-c2fb-4311-b640-dfdb8e3cad6b,client:199.19.213.108,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:41:28.687) (total time: 8204ms): Trace[1720079847]: ---"About to write a response" 8204ms (09:41:36.891) Trace[1720079847]: [8.204854286s] [8.204854286s] END I0624 09:41:37.330933 1 trace.go:236] Trace[1790027278]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.108,type:*v1.Endpoints,resource:apiServerIPInfo (24-Jun-2026 09:41:27.674) (total time: 9656ms): Trace[1790027278]: ---"initial value restored" 9215ms (09:41:36.889) Trace[1790027278]: ---"Txn call completed" 392ms (09:41:37.330) Trace[1790027278]: [9.656263917s] [9.656263917s] END I0624 09:41:37.344111 1 trace.go:236] Trace[1475713204]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f0da920e-1c1f-449c-ab86-ba4494e324ec,client:199.19.213.108,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bbfb0672cb3698,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Jun-2026 09:41:29.680) (total time: 7663ms): Trace[1475713204]: ["GuaranteedUpdate etcd3" audit-id:f0da920e-1c1f-449c-ab86-ba4494e324ec,key:/events/kube-system/kube-apiserver-instance.18bbfb0672cb3698,type:*core.Event,resource:events 7663ms (09:41:29.680) Trace[1475713204]: ---"initial value restored" 7211ms (09:41:36.892) Trace[1475713204]: ---"Transaction prepared" 250ms (09:41:37.144) Trace[1475713204]: ---"Txn call completed" 199ms (09:41:37.343)] Trace[1475713204]: ---"Object stored in database" 450ms (09:41:37.343) Trace[1475713204]: [7.663214395s] [7.663214395s] END I0624 09:41:39.550612 1 trace.go:236] Trace[1430745470]: "GuaranteedUpdate etcd3" audit-id:,key:/ranges/serviceips,type:*core.RangeAllocation,resource:serviceipallocations (24-Jun-2026 09:41:38.797) (total time: 753ms): Trace[1430745470]: ---"Txn call completed" 742ms (09:41:39.550) Trace[1430745470]: [753.348856ms] [753.348856ms] END I0624 09:41:39.550894 1 trace.go:236] Trace[1277607440]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:736db073-fbc7-4192-b19a-58d2bb58cd53,client:199.19.213.108,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-scheduler-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:41:38.810) (total time: 739ms): Trace[1277607440]: ---"About to write a response" 739ms (09:41:39.550) Trace[1277607440]: [739.893708ms] [739.893708ms] END I0624 09:41:39.622796 1 trace.go:236] Trace[1606374574]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a4cea514-4e59-45c7-86cc-f5332ae9c7ca,client:199.19.213.108,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (24-Jun-2026 09:41:39.017) (total time: 605ms): Trace[1606374574]: ["Create etcd3" audit-id:a4cea514-4e59-45c7-86cc-f5332ae9c7ca,key:/events/openstack/rabbitmq-messaging-topology-operator-6f465c979f-cx2jw.18bbfb08be91400a,type:*core.Event,resource:events 604ms (09:41:39.018) Trace[1606374574]: ---"Txn call succeeded" 603ms (09:41:39.622)] Trace[1606374574]: [605.323475ms] [605.323475ms] END I0624 09:41:39.971028 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.97.200.219"} I0624 09:41:39.971322 1 trace.go:236] Trace[1014412446]: "Create" accept:application/json,audit-id:b1fbb941-6e5d-4fd7-b7ae-2d6e7b9013cc,client:199.19.213.108,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/openstack/services,user-agent:Helm/3.11.2,verb:POST (24-Jun-2026 09:41:38.795) (total time: 1175ms): Trace[1014412446]: [1.175509787s] [1.175509787s] END I0624 09:41:40.576190 1 trace.go:236] Trace[1722812358]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b281b9ee-2820-4932-a5a8-408e7869824b,client:199.19.213.108,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-vip-instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Jun-2026 09:41:39.977) (total time: 598ms): Trace[1722812358]: ["GuaranteedUpdate etcd3" audit-id:b281b9ee-2820-4932-a5a8-408e7869824b,key:/pods/kube-system/kube-vip-instance,type:*core.Pod,resource:pods 598ms (09:41:39.977) Trace[1722812358]: ---"Txn call completed" 594ms (09:41:40.575)] Trace[1722812358]: ---"Object stored in database" 595ms (09:41:40.575) Trace[1722812358]: [598.417851ms] [598.417851ms] END I0624 09:41:40.576240 1 trace.go:236] Trace[853322923]: "Create" accept:application/json,audit-id:f801826f-435f-445e-9569-9421515ef665,client:199.19.213.108,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/openstack/deployments,user-agent:Helm/3.11.2,verb:POST (24-Jun-2026 09:41:39.973) (total time: 602ms): Trace[853322923]: ["Create etcd3" audit-id:f801826f-435f-445e-9569-9421515ef665,key:/deployments/openstack/memcached-memcached,type:*apps.Deployment,resource:deployments.apps 599ms (09:41:39.976) Trace[853322923]: ---"Txn call succeeded" 599ms (09:41:40.575)] Trace[853322923]: [602.554163ms] [602.554163ms] END I0624 09:41:40.577536 1 trace.go:236] Trace[1010352672]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:22b5ce10-26b6-4093-b961-b10e98e58480,client:199.19.213.108,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (24-Jun-2026 09:41:40.021) (total time: 556ms): Trace[1010352672]: ["Create etcd3" audit-id:22b5ce10-26b6-4093-b961-b10e98e58480,key:/events/kube-system/cilium-operator-869df985b8-4xll9.18bbfb092d261027,type:*core.Event,resource:events 555ms (09:41:40.021) Trace[1010352672]: ---"Txn call succeeded" 554ms (09:41:40.575)] Trace[1010352672]: [556.16334ms] [556.16334ms] END I0624 09:41:41.125287 1 trace.go:236] Trace[1631836358]: "Update" accept:application/json, */*,audit-id:6c020fd7-4615-419c-9186-ad6413f2d51b,client:199.19.213.108,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/openstack/secrets/sh.helm.release.v1.memcached.v1,user-agent:Helm/3.11.2,verb:PUT (24-Jun-2026 09:41:40.581) (total time: 544ms): Trace[1631836358]: ["GuaranteedUpdate etcd3" audit-id:6c020fd7-4615-419c-9186-ad6413f2d51b,key:/secrets/openstack/sh.helm.release.v1.memcached.v1,type:*core.Secret,resource:secrets 543ms (09:41:40.581) Trace[1631836358]: ---"Txn call completed" 542ms (09:41:41.124)] Trace[1631836358]: [544.196818ms] [544.196818ms] END I0624 09:41:41.127245 1 trace.go:236] Trace[212411858]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:46943b26-47ac-48e2-97c1-0a4cd1e17897,client:199.19.213.108,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/pxc-operator-69cb5bbdb9-mnz24/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Jun-2026 09:41:40.581) (total time: 545ms): Trace[212411858]: ["GuaranteedUpdate etcd3" audit-id:46943b26-47ac-48e2-97c1-0a4cd1e17897,key:/pods/openstack/pxc-operator-69cb5bbdb9-mnz24,type:*core.Pod,resource:pods 545ms (09:41:40.582) Trace[212411858]: ---"Txn call completed" 541ms (09:41:41.126)] Trace[212411858]: ---"Object stored in database" 541ms (09:41:41.126) Trace[212411858]: [545.209287ms] [545.209287ms] END I0624 09:41:41.308717 1 trace.go:236] Trace[949070035]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:03668cef-07cd-4e2e-bc3a-ad978425be66,client:199.19.213.108,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bbfb0672cb3698,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Jun-2026 09:41:40.639) (total time: 669ms): Trace[949070035]: ["GuaranteedUpdate etcd3" audit-id:03668cef-07cd-4e2e-bc3a-ad978425be66,key:/events/kube-system/kube-apiserver-instance.18bbfb0672cb3698,type:*core.Event,resource:events 669ms (09:41:40.639) Trace[949070035]: ---"initial value restored" 485ms (09:41:41.125) Trace[949070035]: ---"Txn call completed" 181ms (09:41:41.308)] Trace[949070035]: ---"Object stored in database" 181ms (09:41:41.308) Trace[949070035]: [669.51223ms] [669.51223ms] END I0624 09:41:42.320581 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.99.228.251"} E0624 09:41:57.489752 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0624 09:41:57.489925 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:57.491106 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:57.491167 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:57.492180 1 trace.go:236] Trace[1029051847]: "Get" accept:application/json, */*,audit-id:bd1c0c82-b3be-405f-9f88-22bf7fa2c4de,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:41:52.489) (total time: 5002ms): Trace[1029051847]: [5.002428416s] [5.002428416s] END E0624 09:41:57.492337 1 timeout.go:142] post-timeout activity - time-elapsed: 2.476485ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0624 09:41:58.301459 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:58.301548 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:58.302645 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:58.302673 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:58.303822 1 trace.go:236] Trace[1010484004]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:fd8b8bc6-2e43-4418-b727-1bde1f99fe6e,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:41:53.301) (total time: 5002ms): Trace[1010484004]: [5.002635732s] [5.002635732s] END E0624 09:41:58.303907 1 timeout.go:142] post-timeout activity - time-elapsed: 2.452064ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: I0624 09:41:58.674680 1 trace.go:236] Trace[431393974]: "Update" accept:application/json, */*,audit-id:7b94c7a7-72c9-4c89-a1e4-a4fa96d7f95a,client:10.0.0.151,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:PUT (24-Jun-2026 09:41:52.148) (total time: 6526ms): Trace[431393974]: ["GuaranteedUpdate etcd3" audit-id:7b94c7a7-72c9-4c89-a1e4-a4fa96d7f95a,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 6526ms (09:41:52.148) Trace[431393974]: ---"Txn call completed" 6525ms (09:41:58.674)] Trace[431393974]: [6.526599903s] [6.526599903s] END E0624 09:41:58.813824 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:41:58.813926 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:41:58.815016 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:41:58.815082 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:41:58.816208 1 trace.go:236] Trace[1875711839]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:50482063-c54c-408e-a2b8-6de485f61871,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:41:53.814) (total time: 5001ms): Trace[1875711839]: [5.001904933s] [5.001904933s] END E0624 09:41:58.816369 1 timeout.go:142] post-timeout activity - time-elapsed: 2.500315ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: I0624 09:41:58.826083 1 trace.go:236] Trace[1080114675]: "Update" accept:application/json, */*,audit-id:ca348384-c68e-44dd-b460-dd198421a7d6,client:10.0.0.234,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:41:52.149) (total time: 6676ms): Trace[1080114675]: ["GuaranteedUpdate etcd3" audit-id:ca348384-c68e-44dd-b460-dd198421a7d6,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 6675ms (09:41:52.150) Trace[1080114675]: ---"Txn call completed" 6674ms (09:41:58.825)] Trace[1080114675]: [6.676082748s] [6.676082748s] END I0624 09:41:58.907870 1 trace.go:236] Trace[1059760660]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:01ffd669-d682-4864-ba06-d71707ce0dff,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (24-Jun-2026 09:41:52.857) (total time: 6049ms): Trace[1059760660]: ["GuaranteedUpdate etcd3" audit-id:01ffd669-d682-4864-ba06-d71707ce0dff,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 6049ms (09:41:52.857) Trace[1059760660]: ---"Txn call completed" 6048ms (09:41:58.907)] Trace[1059760660]: [6.049862767s] [6.049862767s] END I0624 09:41:58.963243 1 trace.go:236] Trace[342159910]: "List" accept:application/json, */*,audit-id:0ac7c645-6769-48a2-8658-362fd1fbd42c,client:199.19.213.108,protocol:HTTP/2.0,resource:secrets,scope:namespace,url:/api/v1/namespaces/auth-system/secrets,user-agent:Helm/3.11.2,verb:LIST (24-Jun-2026 09:41:52.292) (total time: 6670ms): Trace[342159910]: ["List(recursive=true) etcd3" audit-id:0ac7c645-6769-48a2-8658-362fd1fbd42c,key:/secrets/auth-system,resourceVersion:,resourceVersionMatch:,limit:0,continue: 6670ms (09:41:52.292)] Trace[342159910]: [6.670862769s] [6.670862769s] END I0624 09:41:58.965108 1 trace.go:236] Trace[1016444150]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:80f91b90-c945-4207-8668-420b4b74c4ba,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:41:57.558) (total time: 1406ms): Trace[1016444150]: ["GuaranteedUpdate etcd3" audit-id:80f91b90-c945-4207-8668-420b4b74c4ba,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1406ms (09:41:57.558) Trace[1016444150]: ---"Txn call completed" 1404ms (09:41:58.964)] Trace[1016444150]: [1.40634283s] [1.40634283s] END I0624 09:41:58.965369 1 trace.go:236] Trace[1135988256]: "Get" accept:application/json, */*,audit-id:a2a68c1d-fa39-4174-b6d5-32b178306fca,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Jun-2026 09:41:52.328) (total time: 6636ms): Trace[1135988256]: ---"About to write a response" 6636ms (09:41:58.965) Trace[1135988256]: [6.636896918s] [6.636896918s] END I0624 09:41:58.965535 1 trace.go:236] Trace[1867661852]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:608f875f-c1db-45eb-8f9a-8e10132f86bb,client:10.0.0.94,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:41:54.699) (total time: 4265ms): Trace[1867661852]: ---"About to write a response" 4265ms (09:41:58.965) Trace[1867661852]: [4.265921919s] [4.265921919s] END I0624 09:41:58.965826 1 trace.go:236] Trace[565573646]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:baa069d5-09aa-478c-8c54-1a4db243b4f0,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:41:57.877) (total time: 1086ms): Trace[565573646]: ["GuaranteedUpdate etcd3" audit-id:baa069d5-09aa-478c-8c54-1a4db243b4f0,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 1086ms (09:41:57.878) Trace[565573646]: ---"Txn call completed" 1085ms (09:41:58.964)] Trace[565573646]: [1.086778281s] [1.086778281s] END I0624 09:41:58.965539 1 trace.go:236] Trace[578405398]: "Get" accept:application/json, */*,audit-id:07847a9b-1c3a-4cf6-94e6-73162388f7eb,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Jun-2026 09:41:52.318) (total time: 6647ms): Trace[578405398]: ---"About to write a response" 6647ms (09:41:58.965) Trace[578405398]: [6.647474374s] [6.647474374s] END I0624 09:41:58.966008 1 trace.go:236] Trace[339284355]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:83850a91-555d-4933-b159-695fa816f0ad,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:41:54.676) (total time: 4289ms): Trace[339284355]: ---"About to write a response" 4289ms (09:41:58.965) Trace[339284355]: [4.289749987s] [4.289749987s] END I0624 09:41:58.966074 1 trace.go:236] Trace[2004879354]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f3b36853-b732-425a-a6ab-c8ed8437e56b,client:10.0.0.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:41:54.574) (total time: 4391ms): Trace[2004879354]: ---"About to write a response" 4390ms (09:41:58.965) Trace[2004879354]: [4.391046344s] [4.391046344s] END I0624 09:41:58.966318 1 trace.go:236] Trace[804852176]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:24c76bf6-f708-4e49-8da8-83fddeeba8df,client:199.19.213.108,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/pods/envoy-gateway-78446f96c9-l5md8,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:41:52.605) (total time: 6360ms): Trace[804852176]: ---"About to write a response" 6359ms (09:41:58.965) Trace[804852176]: [6.360297405s] [6.360297405s] END I0624 09:41:59.000067 1 trace.go:236] Trace[1773163860]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5e3f7ea2-d84b-436f-a769-2d20ec952154,client:199.19.213.108,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events/envoy-gateway-78446f96c9-l5md8.18bbfb08c2fd0658,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Jun-2026 09:41:52.606) (total time: 6393ms): Trace[1773163860]: ["GuaranteedUpdate etcd3" audit-id:5e3f7ea2-d84b-436f-a769-2d20ec952154,key:/events/envoy-gateway-system/envoy-gateway-78446f96c9-l5md8.18bbfb08c2fd0658,type:*core.Event,resource:events 6393ms (09:41:52.606) Trace[1773163860]: ---"initial value restored" 6357ms (09:41:58.964)] Trace[1773163860]: ---"Object stored in database" 34ms (09:41:58.999) Trace[1773163860]: [6.393163875s] [6.393163875s] END I0624 09:41:59.472210 1 trace.go:236] Trace[1015934721]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.108,type:*v1.Endpoints,resource:apiServerIPInfo (24-Jun-2026 09:41:57.772) (total time: 1699ms): Trace[1015934721]: ---"initial value restored" 1193ms (09:41:58.965) Trace[1015934721]: ---"Transaction prepared" 368ms (09:41:59.333) Trace[1015934721]: ---"Txn call completed" 138ms (09:41:59.472) Trace[1015934721]: [1.699995621s] [1.699995621s] END I0624 09:42:00.301439 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.102.85.146"} I0624 09:42:00.325368 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.99.73.69"} I0624 09:42:09.450996 1 trace.go:236] Trace[363767478]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:17b294c4-fbe2-4444-9980-1ec25982b096,client:199.19.213.108,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (24-Jun-2026 09:42:08.891) (total time: 559ms): Trace[363767478]: ["Create etcd3" audit-id:17b294c4-fbe2-4444-9980-1ec25982b096,key:/events/openstack/memcached-memcached-cf56b6468-t9nrj.18bbfb1135be8a8c,type:*core.Event,resource:events 559ms (09:42:08.891) Trace[363767478]: ---"Txn call succeeded" 558ms (09:42:09.450)] Trace[363767478]: [559.859373ms] [559.859373ms] END I0624 09:42:09.697853 1 trace.go:236] Trace[1688521851]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5f8c7c25-c539-44e2-9994-4b799c58a145,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:42:08.994) (total time: 703ms): Trace[1688521851]: ---"About to write a response" 703ms (09:42:09.697) Trace[1688521851]: [703.168853ms] [703.168853ms] END I0624 09:42:09.698113 1 trace.go:236] Trace[1630187628]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b76ca209-5f79-4730-b686-def7625f8f24,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:42:09.186) (total time: 511ms): Trace[1630187628]: ["GuaranteedUpdate etcd3" audit-id:b76ca209-5f79-4730-b686-def7625f8f24,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 511ms (09:42:09.186) Trace[1630187628]: ---"Txn call completed" 510ms (09:42:09.697)] Trace[1630187628]: [511.429151ms] [511.429151ms] END I0624 09:42:09.698137 1 trace.go:236] Trace[2144129223]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:db262e9a-b9fe-4870-b2c0-78a98f5b116f,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:42:08.914) (total time: 783ms): Trace[2144129223]: ["GuaranteedUpdate etcd3" audit-id:db262e9a-b9fe-4870-b2c0-78a98f5b116f,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 782ms (09:42:08.915) Trace[2144129223]: ---"Txn call completed" 781ms (09:42:09.697)] Trace[2144129223]: [783.103126ms] [783.103126ms] END I0624 09:42:12.383530 1 trace.go:236] Trace[934583862]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2dbb4364-0f40-4208-9a14-de8dfb97839d,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:42:11.701) (total time: 682ms): Trace[934583862]: ["GuaranteedUpdate etcd3" audit-id:2dbb4364-0f40-4208-9a14-de8dfb97839d,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 682ms (09:42:11.701) Trace[934583862]: ---"Txn call completed" 681ms (09:42:12.383)] Trace[934583862]: [682.291115ms] [682.291115ms] END I0624 09:42:14.914810 1 trace.go:236] Trace[172572069]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:08ccd066-0bf6-4d5c-a469-ad22733ac540,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:42:11.726) (total time: 3187ms): Trace[172572069]: ---"About to write a response" 3187ms (09:42:14.914) Trace[172572069]: [3.18785756s] [3.18785756s] END I0624 09:42:14.914969 1 trace.go:236] Trace[148887344]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f534898f-156a-4ceb-a1be-c84989f97da7,client:10.0.0.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:42:12.060) (total time: 2854ms): Trace[148887344]: ["GuaranteedUpdate etcd3" audit-id:f534898f-156a-4ceb-a1be-c84989f97da7,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 2854ms (09:42:12.060) Trace[148887344]: ---"Txn call completed" 2853ms (09:42:14.914)] Trace[148887344]: [2.854114566s] [2.854114566s] END I0624 09:42:15.086339 1 trace.go:236] Trace[761612060]: "Update" accept:application/json, */*,audit-id:0eabec3a-070a-4ab6-8dc0-94ad90df17c4,client:10.0.0.234,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:42:13.829) (total time: 1256ms): Trace[761612060]: ["GuaranteedUpdate etcd3" audit-id:0eabec3a-070a-4ab6-8dc0-94ad90df17c4,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1256ms (09:42:13.830) Trace[761612060]: ---"Txn call completed" 1255ms (09:42:15.086)] Trace[761612060]: [1.25650905s] [1.25650905s] END I0624 09:42:15.086395 1 trace.go:236] Trace[1526066415]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:89d1e1c0-9a7c-402a-bf14-74fbc136967a,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:42:14.387) (total time: 698ms): Trace[1526066415]: ["GuaranteedUpdate etcd3" audit-id:89d1e1c0-9a7c-402a-bf14-74fbc136967a,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 698ms (09:42:14.387) Trace[1526066415]: ---"Txn call completed" 698ms (09:42:15.086)] Trace[1526066415]: [698.981818ms] [698.981818ms] END I0624 09:42:15.086504 1 trace.go:236] Trace[490698604]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:77ff0294-5722-4da5-b4b0-23ac221ac61a,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (24-Jun-2026 09:42:13.918) (total time: 1167ms): Trace[490698604]: ["GuaranteedUpdate etcd3" audit-id:77ff0294-5722-4da5-b4b0-23ac221ac61a,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 1167ms (09:42:13.919) Trace[490698604]: ---"Txn call completed" 1166ms (09:42:15.086)] Trace[490698604]: [1.167442258s] [1.167442258s] END I0624 09:42:15.086990 1 trace.go:236] Trace[655293642]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:de098019-148e-439b-b815-507d27f73c0d,client:10.0.0.94,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:42:12.413) (total time: 2673ms): Trace[655293642]: ["GuaranteedUpdate etcd3" audit-id:de098019-148e-439b-b815-507d27f73c0d,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 2673ms (09:42:12.413) Trace[655293642]: ---"Txn call completed" 2672ms (09:42:15.086)] Trace[655293642]: [2.673476015s] [2.673476015s] END I0624 09:42:15.087034 1 trace.go:236] Trace[389323129]: "Update" accept:application/json, */*,audit-id:8499f041-5e20-4d5d-b587-9e12a2156a3e,client:10.0.0.151,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:PUT (24-Jun-2026 09:42:13.677) (total time: 1409ms): Trace[389323129]: ["GuaranteedUpdate etcd3" audit-id:8499f041-5e20-4d5d-b587-9e12a2156a3e,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 1408ms (09:42:13.678) Trace[389323129]: ---"Txn call completed" 1407ms (09:42:15.086)] Trace[389323129]: [1.409060118s] [1.409060118s] END I0624 09:42:16.684886 1 trace.go:236] Trace[1224185527]: "Get" accept:application/json, */*,audit-id:af9a9089-88ce-4c1b-a7f5-20eab4757759,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:42:12.061) (total time: 4623ms): Trace[1224185527]: ---"About to write a response" 4623ms (09:42:16.684) Trace[1224185527]: [4.623436439s] [4.623436439s] END I0624 09:42:16.685072 1 trace.go:236] Trace[300296288]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d7d02114-6360-4242-bceb-fa24418bf64f,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:42:12.585) (total time: 4099ms): Trace[300296288]: ---"About to write a response" 4099ms (09:42:16.684) Trace[300296288]: [4.099620492s] [4.099620492s] END I0624 09:42:16.685258 1 trace.go:236] Trace[1527701861]: "Get" accept:application/json, */*,audit-id:9148a3b1-ba16-4f30-bc98-1e8b5173a946,client:199.19.213.108,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak-headless,user-agent:Helm/3.11.2,verb:GET (24-Jun-2026 09:42:12.450) (total time: 4234ms): Trace[1527701861]: ---"About to write a response" 4234ms (09:42:16.684) Trace[1527701861]: [4.234987576s] [4.234987576s] END I0624 09:42:16.685461 1 trace.go:236] Trace[1336578483]: "Get" accept:application/json, */*,audit-id:f8ccbef4-1a7d-44ea-ab19-f0bf2dbf6b2b,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Jun-2026 09:42:11.871) (total time: 4813ms): Trace[1336578483]: ---"About to write a response" 4813ms (09:42:16.685) Trace[1336578483]: [4.813892667s] [4.813892667s] END I0624 09:42:16.685528 1 trace.go:236] Trace[1158065558]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:79e1abbf-34ac-4969-acf8-32c1a3f81d6d,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (24-Jun-2026 09:42:14.916) (total time: 1768ms): Trace[1158065558]: ["GuaranteedUpdate etcd3" audit-id:79e1abbf-34ac-4969-acf8-32c1a3f81d6d,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 1768ms (09:42:14.916) Trace[1158065558]: ---"Txn call completed" 1767ms (09:42:16.685)] Trace[1158065558]: [1.768939612s] [1.768939612s] END I0624 09:42:16.685817 1 trace.go:236] Trace[1810645588]: "Get" accept:application/json, */*,audit-id:ab09509d-2956-47a3-af64-5e7ac8ce5770,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Jun-2026 09:42:11.871) (total time: 4814ms): Trace[1810645588]: ---"About to write a response" 4813ms (09:42:16.685) Trace[1810645588]: [4.814249484s] [4.814249484s] END I0624 09:42:16.687639 1 trace.go:236] Trace[967631679]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:eb4b2402-4350-4bdc-9566-f34d98c4fe93,client:10.0.0.94,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Jun-2026 09:42:13.392) (total time: 3295ms): Trace[967631679]: ---"About to write a response" 3295ms (09:42:16.687) Trace[967631679]: [3.295315303s] [3.295315303s] END E0624 09:42:21.688474 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:42:21.688512 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:21.688552 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 16.991µs, panicked: false, err: context canceled, panic-reason: E0624 09:42:21.688750 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 5.75µs, panicked: false, err: context deadline exceeded, panic-reason: E0624 09:42:21.688763 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:42:21.689870 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:21.689971 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0624 09:42:21.690043 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:42:21.691110 1 trace.go:236] Trace[1549692709]: "Update" accept:application/json, */*,audit-id:549ddd72-0682-4525-b46d-9e2edb908ac8,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:42:16.688) (total time: 5002ms): Trace[1549692709]: ["GuaranteedUpdate etcd3" audit-id:549ddd72-0682-4525-b46d-9e2edb908ac8,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (09:42:16.689) Trace[1549692709]: ---"Txn call failed" err:context deadline exceeded 4999ms (09:42:21.688)] Trace[1549692709]: [5.002157389s] [5.002157389s] END I0624 09:42:21.691225 1 trace.go:236] Trace[1573202107]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a5623351-79a4-41a7-8060-f0c430e226e9,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (24-Jun-2026 09:42:16.689) (total time: 5001ms): Trace[1573202107]: ["GuaranteedUpdate etcd3" audit-id:a5623351-79a4-41a7-8060-f0c430e226e9,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:42:16.689) Trace[1573202107]: ---"Txn call failed" err:context canceled 4998ms (09:42:21.688)] Trace[1573202107]: [5.001983871s] [5.001983871s] END E0624 09:42:21.691248 1 timeout.go:142] post-timeout activity - time-elapsed: 2.496545ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0624 09:42:21.691441 1 timeout.go:142] post-timeout activity - time-elapsed: 3.060171ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0624 09:42:21.870814 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:42:21.870841 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.041µs, panicked: false, err: context canceled, panic-reason: E0624 09:42:21.870862 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:21.870896 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 7.331µs, panicked: false, err: context canceled, panic-reason: E0624 09:42:21.870966 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:42:21.871965 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:21.872058 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0624 09:42:21.872070 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:42:21.873241 1 trace.go:236] Trace[1898001932]: "Update" accept:application/json, */*,audit-id:f08a5753-6b18-4f9d-992f-5468450b9a33,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (24-Jun-2026 09:42:16.689) (total time: 5184ms): Trace[1898001932]: ["GuaranteedUpdate etcd3" audit-id:f08a5753-6b18-4f9d-992f-5468450b9a33,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5183ms (09:42:16.689) Trace[1898001932]: ---"Txn call failed" err:context canceled 5180ms (09:42:21.870)] Trace[1898001932]: [5.184117642s] [5.184117642s] END E0624 09:42:21.873359 1 timeout.go:142] post-timeout activity - time-elapsed: 2.486525ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: I0624 09:42:21.873478 1 trace.go:236] Trace[15528255]: "Update" accept:application/json, */*,audit-id:d96c5656-2b8b-4481-a925-5029cfd4ada4,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (24-Jun-2026 09:42:16.689) (total time: 5184ms): Trace[15528255]: ["GuaranteedUpdate etcd3" audit-id:d96c5656-2b8b-4481-a925-5029cfd4ada4,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5183ms (09:42:16.689) Trace[15528255]: ---"Txn call failed" err:context canceled 5180ms (09:42:21.870)] Trace[15528255]: [5.184094931s] [5.184094931s] END E0624 09:42:21.873780 1 timeout.go:142] post-timeout activity - time-elapsed: 2.779648ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0624 09:42:21.917615 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.46µs, panicked: false, err: context canceled, panic-reason: E0624 09:42:21.917764 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:42:21.918860 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:21.918935 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:42:21.920396 1 trace.go:236] Trace[2032823496]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:858477bc-422f-44df-b934-1fe0d06184c6,client:10.0.0.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:42:16.918) (total time: 5001ms): Trace[2032823496]: ["GuaranteedUpdate etcd3" audit-id:858477bc-422f-44df-b934-1fe0d06184c6,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:42:16.918) Trace[2032823496]: ---"Txn call failed" err:context canceled 4998ms (09:42:21.917)] Trace[2032823496]: [5.001999814s] [5.001999814s] END E0624 09:42:21.920541 1 timeout.go:142] post-timeout activity - time-elapsed: 2.699385ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: I0624 09:42:22.089130 1 trace.go:236] Trace[1978659449]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:342eb8b5-c157-48d0-a776-25e31954f0c4,client:10.0.0.94,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:42:17.089) (total time: 4999ms): Trace[1978659449]: ["GuaranteedUpdate etcd3" audit-id:342eb8b5-c157-48d0-a776-25e31954f0c4,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 4998ms (09:42:17.090) Trace[1978659449]: ---"Txn call failed" err:context canceled 4997ms (09:42:22.089)] Trace[1978659449]: [4.999043428s] [4.999043428s] END E0624 09:42:22.089254 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 7.34µs, panicked: false, err: context canceled, panic-reason: E0624 09:42:22.089322 1 wrap.go:54] timeout or abort while handling: method=PUT URI="/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com?timeout=5s" audit-ID="342eb8b5-c157-48d0-a776-25e31954f0c4" E0624 09:42:22.089341 1 timeout.go:142] post-timeout activity - time-elapsed: 2.36µs, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0624 09:42:22.089449 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:42:22.089496 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 15.3µs, panicked: false, err: context canceled, panic-reason: E0624 09:42:22.090681 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:22.090754 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:42:22.091980 1 trace.go:236] Trace[1723364172]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4dc42f54-53cd-4e49-ab77-826fe83087e0,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:42:17.090) (total time: 5001ms): Trace[1723364172]: ["GuaranteedUpdate etcd3" audit-id:4dc42f54-53cd-4e49-ab77-826fe83087e0,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:42:17.090) Trace[1723364172]: ---"Txn call failed" err:context canceled 4998ms (09:42:22.089)] Trace[1723364172]: [5.001295351s] [5.001295351s] END E0624 09:42:22.092096 1 timeout.go:142] post-timeout activity - time-elapsed: 2.722524ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0624 09:42:23.688580 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:42:23.688738 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:42:23.689735 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:23.689826 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0624 09:42:23.689846 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0624 09:42:23.690443 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:23.691514 1 trace.go:236] Trace[1606081735]: "Get" accept:application/json, */*,audit-id:2104a47f-1a6f-4b88-a2b5-c78c52b69440,client:199.19.213.108,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak-metrics,user-agent:Helm/3.11.2,verb:GET (24-Jun-2026 09:42:16.688) (total time: 7003ms): Trace[1606081735]: [7.003033925s] [7.003033925s] END I0624 09:42:23.691514 1 trace.go:236] Trace[584466907]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e78d2f88-b255-4514-bf7f-e1d4e59f6d9f,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:42:18.688) (total time: 5003ms): Trace[584466907]: [5.003064486s] [5.003064486s] END E0624 09:42:23.691764 1 timeout.go:142] post-timeout activity - time-elapsed: 3.253838ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: I0624 09:42:23.691823 1 trace.go:236] Trace[1328095933]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:25671c80-7add-4774-b2d0-20a2e2ae0307,client:199.19.213.108,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events/envoy-gateway-78446f96c9-l5md8.18bbfb08c2fd0658,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Jun-2026 09:42:12.606) (total time: 11084ms): Trace[1328095933]: ["GuaranteedUpdate etcd3" audit-id:25671c80-7add-4774-b2d0-20a2e2ae0307,key:/events/envoy-gateway-system/envoy-gateway-78446f96c9-l5md8.18bbfb08c2fd0658,type:*core.Event,resource:events 11084ms (09:42:12.606) Trace[1328095933]: ---"initial value restored" 4078ms (09:42:16.685) Trace[1328095933]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:42:23.689)] Trace[1328095933]: [11.084791172s] [11.084791172s] END E0624 09:42:26.917644 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:42:26.917857 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:42:26.918576 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0624 09:42:26.918758 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:26.919801 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:42:26.919869 1 trace.go:236] Trace[1669374335]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e989b548-37b5-4dc1-b436-b2cafbb7e069,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:42:19.915) (total time: 7003ms): Trace[1669374335]: ["GuaranteedUpdate etcd3" audit-id:e989b548-37b5-4dc1-b436-b2cafbb7e069,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:42:19.915) Trace[1669374335]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:42:26.918)] Trace[1669374335]: [7.003977283s] [7.003977283s] END I0624 09:42:26.919867 1 trace.go:236] Trace[1506706934]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1c0e0759-b8bc-4cc9-8a8e-21fad3926e75,client:10.0.0.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:42:21.918) (total time: 5001ms): Trace[1506706934]: [5.001193841s] [5.001193841s] END E0624 09:42:26.920089 1 timeout.go:142] post-timeout activity - time-elapsed: 2.439639ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0624 09:42:26.976146 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:26.976279 1 trace.go:236] Trace[4652135]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:da7d4dad-e2ba-4bd6-89e1-dd20daf49411,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:42:19.973) (total time: 7003ms): Trace[4652135]: ["GuaranteedUpdate etcd3" audit-id:da7d4dad-e2ba-4bd6-89e1-dd20daf49411,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:42:19.973) Trace[4652135]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:42:26.976)] Trace[4652135]: [7.003150826s] [7.003150826s] END E0624 09:42:26.977053 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0624 09:42:27.060665 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:42:27.060752 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:27.060810 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.59µs, panicked: false, err: context deadline exceeded, panic-reason: E0624 09:42:27.062307 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:42:27.062417 1 trace.go:236] Trace[984959142]: "Update" accept:application/json, */*,audit-id:306efdde-c5be-4a01-a7c9-425c37e41652,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:42:22.060) (total time: 5001ms): Trace[984959142]: ["GuaranteedUpdate etcd3" audit-id:306efdde-c5be-4a01-a7c9-425c37e41652,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:42:22.060) Trace[984959142]: ---"Txn call failed" err:context deadline exceeded 4998ms (09:42:27.060)] Trace[984959142]: [5.00192061s] [5.00192061s] END E0624 09:42:27.062702 1 timeout.go:142] post-timeout activity - time-elapsed: 1.976448ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0624 09:42:27.089271 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:42:27.089470 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:42:27.090028 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0624 09:42:27.090359 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:27.091307 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0624 09:42:27.091358 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout I0624 09:42:27.091471 1 trace.go:236] Trace[329181795]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9228daf8-c8ab-42ee-b90a-8027c48df1de,client:10.0.0.94,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:42:22.090) (total time: 5001ms): Trace[329181795]: [5.001059922s] [5.001059922s] END E0624 09:42:27.091676 1 timeout.go:142] post-timeout activity - time-elapsed: 2.883758ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0624 09:42:27.092450 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:27.094757 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:42:27.094841 1 trace.go:236] Trace[1069890479]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3b85780f-2efb-4b25-a833-1c261eee1152,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:42:22.090) (total time: 5004ms): Trace[1069890479]: [5.004693385s] [5.004693385s] END E0624 09:42:27.095016 1 timeout.go:142] post-timeout activity - time-elapsed: 4.869387ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0624 09:42:27.113342 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0624 09:42:27.113448 1 trace.go:236] Trace[62027982]: "Get" accept:application/json, */*,audit-id:16e21af5-c232-472e-a6f8-2a66f889c66e,client:10.0.0.94,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0/log,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:CONNECT (24-Jun-2026 09:42:16.689) (total time: 10423ms): Trace[62027982]: [10.423467724s] [10.423467724s] END E0624 09:42:27.585996 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:42:27.586044 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:27.586081 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 10.551µs, panicked: false, err: context canceled, panic-reason: E0624 09:42:27.587298 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:42:27.587395 1 trace.go:236] Trace[433417993]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b4d9beaf-6f73-4abb-ab3f-df2f4bf53c7d,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (24-Jun-2026 09:42:22.586) (total time: 5000ms): Trace[433417993]: ["GuaranteedUpdate etcd3" audit-id:b4d9beaf-6f73-4abb-ab3f-df2f4bf53c7d,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (09:42:22.586) Trace[433417993]: ---"Txn call failed" err:context canceled 4998ms (09:42:27.586)] Trace[433417993]: [5.00080485s] [5.00080485s] END E0624 09:42:27.587588 1 timeout.go:142] post-timeout activity - time-elapsed: 1.600811ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0624 09:42:28.688887 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:42:28.689110 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:42:28.690329 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:28.690422 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:42:28.691685 1 trace.go:236] Trace[2103335222]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e09c3ebd-64bb-4158-a4ed-d6f60ec9ebf6,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:42:25.689) (total time: 3001ms): Trace[2103335222]: [3.001919615s] [3.001919615s] END E0624 09:42:28.691944 1 timeout.go:142] post-timeout activity - time-elapsed: 3.025566ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0624 09:42:28.875024 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:28.875242 1 trace.go:236] Trace[1178441257]: "Update" accept:application/json, */*,audit-id:855537ea-dea9-4d60-a425-17840725798a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (24-Jun-2026 09:42:21.872) (total time: 7002ms): Trace[1178441257]: ["GuaranteedUpdate etcd3" audit-id:855537ea-dea9-4d60-a425-17840725798a,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:42:21.872) Trace[1178441257]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:42:28.874)] Trace[1178441257]: [7.002829054s] [7.002829054s] END E0624 09:42:28.875382 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:28.876466 1 trace.go:236] Trace[1216784649]: "Update" accept:application/json, */*,audit-id:388c13cb-abde-4a6a-b108-57369f0ab22b,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (24-Jun-2026 09:42:21.871) (total time: 7004ms): Trace[1216784649]: ["GuaranteedUpdate etcd3" audit-id:388c13cb-abde-4a6a-b108-57369f0ab22b,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (09:42:21.871) Trace[1216784649]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:42:28.875)] Trace[1216784649]: [7.004767371s] [7.004767371s] END E0624 09:42:29.593618 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:29.593815 1 trace.go:236] Trace[1990604366]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:eb583634-2129-44dd-a244-5de92599085c,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (24-Jun-2026 09:42:22.589) (total time: 7003ms): Trace[1990604366]: ["GuaranteedUpdate etcd3" audit-id:eb583634-2129-44dd-a244-5de92599085c,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:42:22.590) Trace[1990604366]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:42:29.593)] Trace[1990604366]: [7.003881649s] [7.003881649s] END I0624 09:42:30.690624 1 trace.go:236] Trace[1001811853]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.108,type:*v1.Endpoints,resource:apiServerIPInfo (24-Jun-2026 09:42:17.773) (total time: 12916ms): Trace[1001811853]: [12.916919672s] [12.916919672s] END E0624 09:42:30.690659 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0624 09:42:30.691020 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0624 09:42:30.691033 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:30.691973 1 trace.go:236] Trace[1745449811]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a71632ab-202a-4bfe-a05a-ff847a43e2cb,client:199.19.213.108,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:42:22.688) (total time: 8003ms): Trace[1745449811]: [8.00374116s] [8.00374116s] END I0624 09:42:30.692288 1 trace.go:236] Trace[1517038694]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6746009d-9897-41cf-99f5-2fd08f89cc01,client:199.19.213.108,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/datadir-percona-xtradb-pxc-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:42:19.399) (total time: 11292ms): Trace[1517038694]: [11.292828403s] [11.292828403s] END E0624 09:42:30.736809 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:30.736987 1 trace.go:236] Trace[437794540]: "Update" accept:application/json, */*,audit-id:74a459e7-75b5-4045-a0d7-851977d9939d,client:199.19.213.108,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/auth-system/secrets/sh.helm.release.v1.keycloak.v1,user-agent:Helm/3.11.2,verb:PUT (24-Jun-2026 09:42:23.728) (total time: 7008ms): Trace[437794540]: ["GuaranteedUpdate etcd3" audit-id:74a459e7-75b5-4045-a0d7-851977d9939d,key:/secrets/auth-system/sh.helm.release.v1.keycloak.v1,type:*core.Secret,resource:secrets 7004ms (09:42:23.732) Trace[437794540]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:42:30.736)] Trace[437794540]: [7.008157622s] [7.008157622s] END E0624 09:42:32.255535 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:32.255713 1 trace.go:236] Trace[153624754]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3985aaa5-df9c-44b3-b8e9-f64eee5c13da,client:199.19.213.108,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Jun-2026 09:42:25.249) (total time: 7006ms): Trace[153624754]: ["GuaranteedUpdate etcd3" audit-id:3985aaa5-df9c-44b3-b8e9-f64eee5c13da,key:/minions/instance,type:*core.Node,resource:nodes 7005ms (09:42:25.249) Trace[153624754]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:42:32.255)] Trace[153624754]: [7.006230788s] [7.006230788s] END E0624 09:42:33.925374 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:33.925514 1 trace.go:236] Trace[2097712089]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a43201ff-eb40-4355-8298-01d3f582980a,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:42:26.921) (total time: 7003ms): Trace[2097712089]: ["GuaranteedUpdate etcd3" audit-id:a43201ff-eb40-4355-8298-01d3f582980a,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:42:26.922) Trace[2097712089]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:42:33.925)] Trace[2097712089]: [7.003658538s] [7.003658538s] END E0624 09:42:33.981786 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:33.981873 1 trace.go:236] Trace[1044338867]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8426e923-d580-4daf-8fd1-46466f4b22ce,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:42:26.978) (total time: 7003ms): Trace[1044338867]: ["GuaranteedUpdate etcd3" audit-id:8426e923-d580-4daf-8fd1-46466f4b22ce,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:42:26.978) Trace[1044338867]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:42:33.981)] Trace[1044338867]: [7.003588982s] [7.003588982s] END E0624 09:42:33.982394 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0624 09:42:37.093521 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:37.093668 1 trace.go:236] Trace[2003556826]: "Update" accept:application/json, */*,audit-id:17db3f4e-6290-4bf1-972a-e5494f8606bd,client:10.0.0.234,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:42:30.090) (total time: 7002ms): Trace[2003556826]: ["GuaranteedUpdate etcd3" audit-id:17db3f4e-6290-4bf1-972a-e5494f8606bd,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:42:30.091) Trace[2003556826]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:42:37.093)] Trace[2003556826]: [7.002689741s] [7.002689741s] END E0624 09:42:37.094210 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:37.094700 1 trace.go:236] Trace[1228076471]: "Update" accept:application/json, */*,audit-id:7426e3d4-4f40-4ae1-9e01-7c93e7777e57,client:10.0.0.151,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:PUT (24-Jun-2026 09:42:30.090) (total time: 7003ms): Trace[1228076471]: ["GuaranteedUpdate etcd3" audit-id:7426e3d4-4f40-4ae1-9e01-7c93e7777e57,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:42:30.091) Trace[1228076471]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:42:37.094)] Trace[1228076471]: [7.003876011s] [7.003876011s] END E0624 09:42:37.589555 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:42:37.589686 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:42:37.590748 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:37.590810 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:42:37.592080 1 trace.go:236] Trace[1878630243]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6dc575d2-277e-4975-adc9-a3dcb44120d4,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (24-Jun-2026 09:42:29.595) (total time: 7996ms): Trace[1878630243]: [7.996516207s] [7.996516207s] END E0624 09:42:37.592243 1 timeout.go:142] post-timeout activity - time-elapsed: 2.694274ms, GET "/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader" result: E0624 09:42:37.692166 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:37.692324 1 trace.go:236] Trace[2068493238]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:250771a0-3b1e-458b-9652-b2bc0f45adc0,client:199.19.213.108,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bbfb0672cb3698,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Jun-2026 09:42:23.694) (total time: 13997ms): Trace[2068493238]: ["GuaranteedUpdate etcd3" audit-id:250771a0-3b1e-458b-9652-b2bc0f45adc0,key:/events/kube-system/kube-apiserver-instance.18bbfb0672cb3698,type:*core.Event,resource:events 13997ms (09:42:23.694)] Trace[2068493238]: [13.997842957s] [13.997842957s] END E0624 09:42:40.930416 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:40.930734 1 trace.go:236] Trace[627735366]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ea53dffe-6dcf-42ff-9406-8f35555ec5eb,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:42:33.927) (total time: 7003ms): Trace[627735366]: ["GuaranteedUpdate etcd3" audit-id:ea53dffe-6dcf-42ff-9406-8f35555ec5eb,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:42:33.927) Trace[627735366]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:42:40.930)] Trace[627735366]: [7.003419384s] [7.003419384s] END E0624 09:42:40.985974 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:40.986297 1 trace.go:236] Trace[1058282928]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a5459cc5-62d9-4c87-8473-457c5e8c3e60,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:42:33.983) (total time: 7003ms): Trace[1058282928]: ["GuaranteedUpdate etcd3" audit-id:a5459cc5-62d9-4c87-8473-457c5e8c3e60,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:42:33.983) Trace[1058282928]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:42:40.985)] Trace[1058282928]: [7.00300084s] [7.00300084s] END E0624 09:42:40.987116 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0624 09:42:42.257392 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0624 09:42:42.257604 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:42:42.258601 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:42:42.258700 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:42:42.260577 1 trace.go:236] Trace[108502451]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:48d7670e-a7df-4246-976f-5fd3e9c33b2e,client:199.19.213.108,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:42:32.257) (total time: 10002ms): Trace[108502451]: [10.002836258s] [10.002836258s] END E0624 09:42:42.260789 1 timeout.go:142] post-timeout activity - time-elapsed: 3.333517ms, GET "/api/v1/nodes/instance" result: E0624 09:42:44.593840 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:44.594029 1 trace.go:236] Trace[1488177549]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d3e0e2a2-a8d1-4271-a99d-e3aa967bde7d,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (24-Jun-2026 09:42:37.590) (total time: 7003ms): Trace[1488177549]: ["GuaranteedUpdate etcd3" audit-id:d3e0e2a2-a8d1-4271-a99d-e3aa967bde7d,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:42:37.590) Trace[1488177549]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:42:44.593)] Trace[1488177549]: [7.003377281s] [7.003377281s] END I0624 09:42:44.693079 1 trace.go:236] Trace[1861179720]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.108,type:*v1.Endpoints,resource:apiServerIPInfo (24-Jun-2026 09:42:30.690) (total time: 14002ms): Trace[1861179720]: [14.002317738s] [14.002317738s] END E0624 09:42:44.693131 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0624 09:42:44.693292 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0624 09:42:44.693458 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0624 09:42:44.693459 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0624 09:42:44.693799 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:44.695325 1 trace.go:236] Trace[679871081]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:606bbe0d-7bad-4b30-8201-7f1509314d9a,client:199.19.213.108,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:42:30.698) (total time: 13997ms): Trace[679871081]: [13.997166954s] [13.997166954s] END I0624 09:42:44.695471 1 trace.go:236] Trace[1550577416]: "Get" accept:application/json, */*,audit-id:ee153153-5ff1-4527-b814-ef6585077aca,client:10.0.0.151,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:GET (24-Jun-2026 09:42:37.096) (total time: 7599ms): Trace[1550577416]: [7.599260354s] [7.599260354s] END I0624 09:42:44.695555 1 trace.go:236] Trace[1504953805]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2c6893af-d064-4319-ac08-6785bcf0834d,client:199.19.213.108,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/ingress-nginx/services/ingress-nginx-controller,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (24-Jun-2026 09:42:37.350) (total time: 7345ms): Trace[1504953805]: [7.345327727s] [7.345327727s] END I0624 09:42:44.695771 1 trace.go:236] Trace[146562997]: "Get" accept:application/json, */*,audit-id:f580e196-824c-4a0a-ade9-e1067514e7bf,client:10.0.0.234,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:42:37.095) (total time: 7600ms): Trace[146562997]: [7.600511936s] [7.600511936s] END E0624 09:42:47.936256 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:47.936485 1 trace.go:236] Trace[1039352013]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:dc32fc37-7578-49a4-b9ef-e03b404cd858,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:42:40.933) (total time: 7003ms): Trace[1039352013]: ["GuaranteedUpdate etcd3" audit-id:dc32fc37-7578-49a4-b9ef-e03b404cd858,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:42:40.933) Trace[1039352013]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:42:47.936)] Trace[1039352013]: [7.003267117s] [7.003267117s] END E0624 09:42:47.991802 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:47.991998 1 trace.go:236] Trace[2043288645]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9f5e833d-0b5b-432f-8b97-e517c9eb4ceb,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:42:40.988) (total time: 7003ms): Trace[2043288645]: ["GuaranteedUpdate etcd3" audit-id:9f5e833d-0b5b-432f-8b97-e517c9eb4ceb,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:42:40.988) Trace[2043288645]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:42:47.991)] Trace[2043288645]: [7.003723233s] [7.003723233s] END E0624 09:42:47.993564 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0624 09:42:51.693731 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:51.693928 1 trace.go:236] Trace[2025607806]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:21144012-9b50-4e58-8185-6b4d0459ac66,client:199.19.213.108,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:42:42.259) (total time: 9434ms): Trace[2025607806]: [9.434718068s] [9.434718068s] END E0624 09:42:51.694078 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0624 09:42:51.694132 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:51.695041 1 trace.go:236] Trace[85643458]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b7e0a3a8-f3ca-4b87-9ec6-a8df86a087e4,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (24-Jun-2026 09:42:44.595) (total time: 7099ms): Trace[85643458]: [7.099227233s] [7.099227233s] END I0624 09:42:51.695493 1 trace.go:236] Trace[1166550997]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2d59e08a-ab1f-4e53-9a01-febfa5f8c016,client:199.19.213.108,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bbfb07d8451b7c,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Jun-2026 09:42:37.694) (total time: 14000ms): Trace[1166550997]: ["GuaranteedUpdate etcd3" audit-id:2d59e08a-ab1f-4e53-9a01-febfa5f8c016,key:/events/kube-system/kube-apiserver-instance.18bbfb07d8451b7c,type:*core.Event,resource:events 14000ms (09:42:37.694)] Trace[1166550997]: [14.000719591s] [14.000719591s] END E0624 09:42:54.944612 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:54.944817 1 trace.go:236] Trace[1900799369]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:30e2ca8c-1b2f-4338-aab0-3757d08b080a,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:42:47.939) (total time: 7005ms): Trace[1900799369]: ["GuaranteedUpdate etcd3" audit-id:30e2ca8c-1b2f-4338-aab0-3757d08b080a,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (09:42:47.940) Trace[1900799369]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:42:54.944)] Trace[1900799369]: [7.005661102s] [7.005661102s] END E0624 09:42:54.998228 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:42:54.998363 1 trace.go:236] Trace[590141001]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ac2909f2-20e9-4cdd-9f37-c406fc0a5284,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Jun-2026 09:42:47.994) (total time: 7003ms): Trace[590141001]: ["GuaranteedUpdate etcd3" audit-id:ac2909f2-20e9-4cdd-9f37-c406fc0a5284,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:42:47.995) Trace[590141001]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:42:54.998)] Trace[590141001]: [7.003445608s] [7.003445608s] END E0624 09:42:54.998911 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" I0624 09:42:54.998968 1 controller.go:116] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" E0624 09:43:01.695154 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0624 09:43:01.695261 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:43:01.696828 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:43:01.696870 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:43:01.698209 1 trace.go:236] Trace[247683891]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c09941a4-63e7-46e5-a979-e7f3eb280fe5,client:199.19.213.108,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:42:51.695) (total time: 10002ms): Trace[247683891]: [10.002431031s] [10.002431031s] END E0624 09:43:01.698439 1 timeout.go:142] post-timeout activity - time-elapsed: 3.153778ms, GET "/api/v1/nodes/instance" result: E0624 09:43:04.947075 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0624 09:43:04.947189 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:43:04.948395 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:43:04.948484 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:43:04.949532 1 trace.go:236] Trace[2058158688]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:244eca64-e551-4e03-9c0e-b311488cf9ec,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:42:54.946) (total time: 10002ms): Trace[2058158688]: [10.002974339s] [10.002974339s] END E0624 09:43:04.949755 1 timeout.go:142] post-timeout activity - time-elapsed: 2.505922ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance" result: E0624 09:43:07.806811 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:43:07.807001 1 trace.go:236] Trace[1258880199]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b63a84ea-a1fd-4540-8eed-0f9751d6ea93,client:199.19.213.108,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:42:44.698) (total time: 23108ms): Trace[1258880199]: [23.108568098s] [23.108568098s] END I0624 09:43:07.807041 1 trace.go:236] Trace[430768412]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.108,type:*v1.Endpoints,resource:apiServerIPInfo (24-Jun-2026 09:42:44.693) (total time: 23113ms): Trace[430768412]: [23.113786221s] [23.113786221s] END E0624 09:43:07.807083 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0624 09:43:07.807107 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:43:07.808358 1 trace.go:236] Trace[51474302]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a70ed112-fef3-483c-ab7d-3192d09a6f03,client:199.19.213.108,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/ingress-nginx/services/ingress-nginx-controller,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (24-Jun-2026 09:42:44.703) (total time: 23105ms): Trace[51474302]: [23.105022268s] [23.105022268s] END E0624 09:43:07.809035 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0624 09:43:07.809066 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0624 09:43:07.809066 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0624 09:43:07.809138 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0624 09:43:07.809147 1 trace.go:236] Trace[1164877339]: "Update" accept:application/json, */*,audit-id:6f6023a5-ae28-4981-949c-91f4542f2bdb,client:10.0.0.151,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:PUT (24-Jun-2026 09:42:59.700) (total time: 8109ms): Trace[1164877339]: ["GuaranteedUpdate etcd3" audit-id:6f6023a5-ae28-4981-949c-91f4542f2bdb,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 8108ms (09:42:59.700) Trace[1164877339]: ---"Txn call failed" err:etcdserver: request timed out 8107ms (09:43:07.808)] Trace[1164877339]: [8.109054791s] [8.109054791s] END I0624 09:43:07.810776 1 trace.go:236] Trace[1399937018]: "Update" accept:application/json, */*,audit-id:2c23b81c-dfb7-49f6-95c3-62a2a3c0d2c7,client:10.0.0.234,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:42:59.699) (total time: 8111ms): Trace[1399937018]: ["GuaranteedUpdate etcd3" audit-id:2c23b81c-dfb7-49f6-95c3-62a2a3c0d2c7,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 8110ms (09:42:59.699) Trace[1399937018]: ---"Txn call failed" err:etcdserver: request timed out 8108ms (09:43:07.809)] Trace[1399937018]: [8.111031282s] [8.111031282s] END I0624 09:43:07.810903 1 trace.go:236] Trace[653106736]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7ea37596-43a1-43cc-b5b1-242e4009f747,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:42:54.999) (total time: 12811ms): Trace[653106736]: [12.81144644s] [12.81144644s] END I0624 09:43:07.811096 1 trace.go:236] Trace[1698516594]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e0d1a4e1-a9f5-42fb-ab13-831003ba023e,client:199.19.213.108,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bbfb0672cb3698,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Jun-2026 09:42:51.697) (total time: 16113ms): Trace[1698516594]: ["GuaranteedUpdate etcd3" audit-id:e0d1a4e1-a9f5-42fb-ab13-831003ba023e,key:/events/kube-system/kube-apiserver-instance.18bbfb0672cb3698,type:*core.Event,resource:events 16113ms (09:42:51.697)] Trace[1698516594]: [16.113334831s] [16.113334831s] END E0624 09:43:07.811878 1 controller.go:146] "Failed to ensure lease exists, will retry" err="etcdserver: request timed out" interval="200ms" E0624 09:43:10.089498 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:43:10.089589 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:43:10.089725 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:43:10.090789 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:43:10.090863 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:43:10.090871 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0624 09:43:10.091853 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:43:10.092150 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:43:10.092448 1 trace.go:236] Trace[1794522342]: "Get" accept:application/json, */*,audit-id:76f02fed-d45a-4dab-b157-2aada8f3edf6,client:10.0.0.151,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:GET (24-Jun-2026 09:43:07.811) (total time: 2280ms): Trace[1794522342]: [2.28083804s] [2.28083804s] END E0624 09:43:10.092542 1 timeout.go:142] post-timeout activity - time-elapsed: 3.036428ms, GET "/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller" result: I0624 09:43:10.093469 1 trace.go:236] Trace[1620634675]: "Get" accept:application/json, */*,audit-id:52bd1dfe-a561-47b6-9fc7-fcadb11d56ad,client:10.0.0.234,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Jun-2026 09:43:07.812) (total time: 2281ms): Trace[1620634675]: [2.281069667s] [2.281069667s] END E0624 09:43:10.093546 1 timeout.go:142] post-timeout activity - time-elapsed: 3.716312ms, GET "/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election" result: E0624 09:43:11.696585 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0624 09:43:11.696704 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:43:11.697865 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:43:11.697988 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0624 09:43:11.699594 1 trace.go:236] Trace[602470067]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c4ca11e0-fc00-43b1-85a2-83d5cec48b16,client:199.19.213.108,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:43:01.696) (total time: 10002ms): Trace[602470067]: [10.002934355s] [10.002934355s] END E0624 09:43:11.699854 1 timeout.go:142] post-timeout activity - time-elapsed: 3.287527ms, GET "/api/v1/nodes/instance" result: I0624 09:43:12.494704 1 trace.go:236] Trace[1547562242]: "Update" accept:application/json, */*,audit-id:a6052471-1d38-499b-8087-f5d982690ee3,client:10.0.0.234,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:43:10.090) (total time: 2403ms): Trace[1547562242]: ["GuaranteedUpdate etcd3" audit-id:a6052471-1d38-499b-8087-f5d982690ee3,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 2403ms (09:43:10.090) Trace[1547562242]: ---"Txn call completed" 2402ms (09:43:12.493)] Trace[1547562242]: [2.403922341s] [2.403922341s] END I0624 09:43:12.495380 1 trace.go:236] Trace[1860254798]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8222639b-124a-4005-9d0a-2c620c53b09d,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:43:05.149) (total time: 7346ms): Trace[1860254798]: ---"About to write a response" 7346ms (09:43:12.495) Trace[1860254798]: [7.346235965s] [7.346235965s] END I0624 09:43:12.495981 1 trace.go:236] Trace[1094717190]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1be5499a-d052-4e3e-a442-9011b5132756,client:199.19.213.108,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/ingress-nginx/services/ingress-nginx-controller,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (24-Jun-2026 09:43:07.826) (total time: 4669ms): Trace[1094717190]: ---"About to write a response" 4669ms (09:43:12.495) Trace[1094717190]: [4.669837009s] [4.669837009s] END I0624 09:43:12.496147 1 trace.go:236] Trace[900110983]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f7a3b8bc-7eee-480c-b116-7b36b22ed6e5,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (24-Jun-2026 09:43:05.949) (total time: 6546ms): Trace[900110983]: ---"About to write a response" 6546ms (09:43:12.496) Trace[900110983]: [6.546523212s] [6.546523212s] END I0624 09:43:12.496456 1 trace.go:236] Trace[1473814524]: "List" accept:application/json,audit-id:c0efd2b7-c00f-4e06-86d5-b0887d8ee066,client:199.19.213.108,protocol:HTTP/2.0,resource:namespaces,scope:cluster,url:/api/v1/namespaces,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (24-Jun-2026 09:43:11.545) (total time: 950ms): Trace[1473814524]: ["List(recursive=true) etcd3" audit-id:c0efd2b7-c00f-4e06-86d5-b0887d8ee066,key:/namespaces,resourceVersion:,resourceVersionMatch:,limit:500,continue: 950ms (09:43:11.545)] Trace[1473814524]: [950.530061ms] [950.530061ms] END I0624 09:43:12.496551 1 trace.go:236] Trace[1047747540]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c1d0b8b3-a372-4eb8-887f-094678d1e3fa,client:199.19.213.108,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-operator-869df985b8-4xll9,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:43:07.809) (total time: 4687ms): Trace[1047747540]: ---"About to write a response" 4686ms (09:43:12.495) Trace[1047747540]: [4.687063783s] [4.687063783s] END I0624 09:43:12.497218 1 trace.go:236] Trace[2025282589]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:afa019d8-d42c-4613-a003-3783831f5003,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:43:08.013) (total time: 4483ms): Trace[2025282589]: ---"About to write a response" 4483ms (09:43:12.497) Trace[2025282589]: [4.483696467s] [4.483696467s] END I0624 09:43:12.497348 1 trace.go:236] Trace[898394795]: "Update" accept:application/json, */*,audit-id:44129efd-66af-4d75-a155-139a852f33a2,client:10.0.0.151,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:PUT (24-Jun-2026 09:43:10.090) (total time: 2406ms): Trace[898394795]: ["GuaranteedUpdate etcd3" audit-id:44129efd-66af-4d75-a155-139a852f33a2,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 2406ms (09:43:10.090) Trace[898394795]: ---"Txn call completed" 2405ms (09:43:12.496)] Trace[898394795]: [2.406650896s] [2.406650896s] END E0624 09:43:12.509160 1 wrap.go:54] timeout or abort while handling: method=POST URI="/api/v1/namespaces/cert-manager/events" audit-ID="8bf1d280-fe6a-4e40-b96d-732148bdda0b" E0624 09:43:12.509207 1 timeout.go:142] post-timeout activity - time-elapsed: 3.49µs, POST "/api/v1/namespaces/cert-manager/events" result: E0624 09:43:12.510538 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0624 09:43:12.510561 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0624 09:43:12.511925 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0624 09:43:12.512003 1 timeout.go:142] post-timeout activity - time-elapsed: 1.422891ms, POST "/api/v1/namespaces/cert-manager/events" result: E0624 09:43:12.654129 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 143.531964ms, panicked: false, err: context canceled, panic-reason: E0624 09:43:12.654237 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 145.12158ms, panicked: false, err: context canceled, panic-reason: I0624 09:43:12.741459 1 trace.go:236] Trace[2108459112]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3119a76b-8d11-426f-bc2d-6a8f23e7018a,client:199.19.213.108,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events/envoy-gateway-78446f96c9-l5md8.18bbfb0b170c812b,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Jun-2026 09:43:07.815) (total time: 4925ms): Trace[2108459112]: ["GuaranteedUpdate etcd3" audit-id:3119a76b-8d11-426f-bc2d-6a8f23e7018a,key:/events/envoy-gateway-system/envoy-gateway-78446f96c9-l5md8.18bbfb0b170c812b,type:*core.Event,resource:events 4925ms (09:43:07.815) Trace[2108459112]: ---"initial value restored" 4680ms (09:43:12.496) Trace[2108459112]: ---"Transaction prepared" 154ms (09:43:12.653) Trace[2108459112]: ---"Txn call completed" 87ms (09:43:12.741)] Trace[2108459112]: ---"Object stored in database" 242ms (09:43:12.741) Trace[2108459112]: [4.92552714s] [4.92552714s] END I0624 09:43:13.051315 1 trace.go:236] Trace[1541439668]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.108,type:*v1.Endpoints,resource:apiServerIPInfo (24-Jun-2026 09:43:07.807) (total time: 5243ms): Trace[1541439668]: ---"initial value restored" 4687ms (09:43:12.494) Trace[1541439668]: ---"Transaction prepared" 159ms (09:43:12.654) Trace[1541439668]: ---"Txn call completed" 396ms (09:43:13.051) Trace[1541439668]: [5.243291031s] [5.243291031s] END I0624 09:43:18.042250 1 trace.go:236] Trace[904278494]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:23a8d03b-ed24-4c77-a1b8-4378d5e4c9d9,client:199.19.213.108,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/cilium-operator-869df985b8-4xll9.18bbfb092d261027,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Jun-2026 09:43:17.519) (total time: 522ms): Trace[904278494]: ["GuaranteedUpdate etcd3" audit-id:23a8d03b-ed24-4c77-a1b8-4378d5e4c9d9,key:/events/kube-system/cilium-operator-869df985b8-4xll9.18bbfb092d261027,type:*core.Event,resource:events 522ms (09:43:17.519) Trace[904278494]: ---"Txn call completed" 520ms (09:43:18.042)] Trace[904278494]: ---"Object stored in database" 520ms (09:43:18.042) Trace[904278494]: [522.753039ms] [522.753039ms] END I0624 09:43:18.049890 1 trace.go:236] Trace[1462605396]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:05b9ed7b-46ed-47b7-9e1a-1eb8baab34da,client:199.19.213.108,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-scheduler-instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Jun-2026 09:43:17.519) (total time: 530ms): Trace[1462605396]: ["GuaranteedUpdate etcd3" audit-id:05b9ed7b-46ed-47b7-9e1a-1eb8baab34da,key:/pods/kube-system/kube-scheduler-instance,type:*core.Pod,resource:pods 529ms (09:43:17.519) Trace[1462605396]: ---"Txn call completed" 526ms (09:43:18.049)] Trace[1462605396]: ---"Object stored in database" 527ms (09:43:18.049) Trace[1462605396]: [530.07147ms] [530.07147ms] END I0624 09:43:18.055422 1 trace.go:236] Trace[1560922821]: "List" accept:application/json, */*,audit-id:f5e0debd-caf2-45b3-8202-2242f853fbaa,client:199.19.213.108,protocol:HTTP/2.0,resource:secrets,scope:namespace,url:/api/v1/namespaces/openstack/secrets,user-agent:Helm/3.11.2,verb:LIST (24-Jun-2026 09:43:17.540) (total time: 515ms): Trace[1560922821]: ["List(recursive=true) etcd3" audit-id:f5e0debd-caf2-45b3-8202-2242f853fbaa,key:/secrets/openstack,resourceVersion:,resourceVersionMatch:,limit:0,continue: 515ms (09:43:17.540)] Trace[1560922821]: [515.220326ms] [515.220326ms] END I0624 09:43:51.044532 1 trace.go:236] Trace[943450351]: "Get" accept:application/json,audit-id:8d91db2e-65c2-4894-b43e-4f9616c942f6,client:199.19.213.108,protocol:HTTP/2.0,resource:daemonsets,scope:resource,url:/apis/apps/v1/namespaces/kube-system/daemonsets/cilium,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Jun-2026 09:43:50.460) (total time: 583ms): Trace[943450351]: ---"About to write a response" 582ms (09:43:51.043) Trace[943450351]: [583.628757ms] [583.628757ms] END I0624 09:43:51.046345 1 trace.go:236] Trace[1005157638]: "List" accept:application/json, */*,audit-id:1e382090-f987-44bd-8d82-8ee411ecc5a8,client:199.19.213.108,protocol:HTTP/2.0,resource:pods,scope:namespace,url:/api/v1/namespaces/kube-system/pods,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (24-Jun-2026 09:43:50.457) (total time: 588ms): Trace[1005157638]: ["List(recursive=true) etcd3" audit-id:1e382090-f987-44bd-8d82-8ee411ecc5a8,key:/pods/kube-system,resourceVersion:,resourceVersionMatch:,limit:500,continue: 588ms (09:43:50.458)] Trace[1005157638]: [588.316376ms] [588.316376ms] END I0624 09:43:51.351476 1 trace.go:236] Trace[406336806]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:86bb7d11-f7df-47bd-a9ab-d933d91fa6a1,client:10.0.0.94,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:43:50.750) (total time: 600ms): Trace[406336806]: ["GuaranteedUpdate etcd3" audit-id:86bb7d11-f7df-47bd-a9ab-d933d91fa6a1,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 600ms (09:43:50.750) Trace[406336806]: ---"Txn call completed" 599ms (09:43:51.351)] Trace[406336806]: [600.627505ms] [600.627505ms] END I0624 09:43:51.441505 1 trace.go:236] Trace[36270302]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5f9314b8-8ebf-44f1-96b4-0dbea757c05d,client:10.0.0.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Jun-2026 09:43:50.836) (total time: 605ms): Trace[36270302]: ["GuaranteedUpdate etcd3" audit-id:5f9314b8-8ebf-44f1-96b4-0dbea757c05d,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 605ms (09:43:50.836) Trace[36270302]: ---"Txn call completed" 604ms (09:43:51.441)] Trace[36270302]: [605.318612ms] [605.318612ms] END I0624 09:43:51.442147 1 trace.go:236] Trace[497559221]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:877489c4-13f5-41fa-9a70-c80627ab89dd,client:199.19.213.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Jun-2026 09:43:50.763) (total time: 678ms): Trace[497559221]: ---"About to write a response" 678ms (09:43:51.442) Trace[497559221]: [678.956264ms] [678.956264ms] END