I0626 16:59:01.772747       1 options.go:220] external host was not specified, using 199.204.45.156
I0626 16:59:01.774228       1 server.go:148] Version: v1.28.13
I0626 16:59:01.774270       1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0626 16:59:02.487635       1 shared_informer.go:311] Waiting for caches to sync for node_authorizer
I0626 16:59:02.504017       1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
I0626 16:59:02.504061       1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.
I0626 16:59:02.504844       1 instance.go:298] Using reconciler: lease
I0626 16:59:02.551136       1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager
W0626 16:59:02.551153       1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.
I0626 16:59:02.788195       1 handler.go:275] Adding GroupVersion  v1 to ResourceManager
I0626 16:59:02.788390       1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping.
I0626 16:59:03.241948       1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping.
I0626 16:59:03.256179       1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager
W0626 16:59:03.256209       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources.
W0626 16:59:03.256222       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources.
I0626 16:59:03.256869       1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager
W0626 16:59:03.256887       1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources.
I0626 16:59:03.257932       1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager
I0626 16:59:03.258681       1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager
W0626 16:59:03.258695       1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources.
W0626 16:59:03.258699       1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources.
I0626 16:59:03.259951       1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager
W0626 16:59:03.259966       1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources.
I0626 16:59:03.260648       1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager
W0626 16:59:03.260662       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources.
W0626 16:59:03.260666       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources.
I0626 16:59:03.261126       1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager
W0626 16:59:03.261140       1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources.
W0626 16:59:03.261168       1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources.
I0626 16:59:03.261762       1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager
I0626 16:59:03.263012       1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager
W0626 16:59:03.263028       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources.
W0626 16:59:03.263032       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources.
I0626 16:59:03.263364       1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager
W0626 16:59:03.263379       1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources.
W0626 16:59:03.263383       1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources.
I0626 16:59:03.264027       1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager
W0626 16:59:03.264042       1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources.
I0626 16:59:03.269998       1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager
W0626 16:59:03.270097       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.
W0626 16:59:03.270164       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
I0626 16:59:03.271792       1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager
W0626 16:59:03.271883       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.
W0626 16:59:03.271928       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
I0626 16:59:03.277825       1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager
W0626 16:59:03.277871       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources.
W0626 16:59:03.277883       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
I0626 16:59:03.279480       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager
I0626 16:59:03.280759       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager
W0626 16:59:03.280775       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources.
W0626 16:59:03.280779       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.
I0626 16:59:03.284601       1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager
W0626 16:59:03.284618       1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources.
W0626 16:59:03.284622       1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources.
I0626 16:59:03.285628       1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager
W0626 16:59:03.285644       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.
W0626 16:59:03.285648       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources.
I0626 16:59:03.286336       1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager
W0626 16:59:03.286351       1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources.
I0626 16:59:03.343923       1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager
W0626 16:59:03.343956       1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.
I0626 16:59:03.755130       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0626 16:59:03.755183       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0626 16:59:03.755502       1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key"
I0626 16:59:03.755633       1 secure_serving.go:213] Serving securely on [::]:6443
I0626 16:59:03.755687       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0626 16:59:03.755760       1 controller.go:80] Starting OpenAPI V3 AggregationController
I0626 16:59:03.755961       1 system_namespaces_controller.go:67] Starting system namespaces controller
I0626 16:59:03.756004       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0626 16:59:03.756162       1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
I0626 16:59:03.756196       1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller
I0626 16:59:03.756231       1 customresource_discovery_controller.go:289] Starting DiscoveryController
I0626 16:59:03.756352       1 controller.go:134] Starting OpenAPI controller
I0626 16:59:03.756399       1 controller.go:85] Starting OpenAPI V3 controller
I0626 16:59:03.756471       1 handler_discovery.go:412] Starting ResourceDiscoveryManager
I0626 16:59:03.756610       1 establishing_controller.go:76] Starting EstablishingController
I0626 16:59:03.756650       1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0626 16:59:03.756701       1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0626 16:59:03.756732       1 crd_finalizer.go:266] Starting CRDFinalizer
I0626 16:59:03.756236       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0626 16:59:03.756802       1 controller.go:116] Starting legacy_token_tracking_controller
I0626 16:59:03.756827       1 shared_informer.go:311] Waiting for caches to sync for configmaps
I0626 16:59:03.756930       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0626 16:59:03.756238       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0626 16:59:03.757208       1 available_controller.go:423] Starting AvailableConditionController
I0626 16:59:03.757221       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
I0626 16:59:03.757335       1 controller.go:78] Starting OpenAPI AggregationController
I0626 16:59:03.757410       1 aggregator.go:164] waiting for initial CRD sync...
I0626 16:59:03.757461       1 apf_controller.go:374] Starting API Priority and Fairness config controller
I0626 16:59:03.757592       1 apiservice_controller.go:97] Starting APIServiceRegistrationController
I0626 16:59:03.757641       1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
I0626 16:59:03.756355       1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key"
I0626 16:59:03.756469       1 naming_controller.go:291] Starting NamingConditionController
I0626 16:59:03.761974       1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0626 16:59:03.761985       1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister
I0626 16:59:03.788523       1 shared_informer.go:318] Caches are synced for node_authorizer
E0626 16:59:03.836916       1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms"
I0626 16:59:03.856251       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0626 16:59:03.856865       1 shared_informer.go:318] Caches are synced for configmaps
I0626 16:59:03.857272       1 cache.go:39] Caches are synced for AvailableConditionController controller
I0626 16:59:03.857959       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0626 16:59:03.858086       1 apf_controller.go:379] Running API Priority and Fairness config worker
I0626 16:59:03.858101       1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process
I0626 16:59:03.858285       1 controller.go:624] quota admission added evaluator for: namespaces
I0626 16:59:03.862036       1 shared_informer.go:318] Caches are synced for crd-autoregister
I0626 16:59:03.862080       1 aggregator.go:166] initial CRD sync complete...
I0626 16:59:03.862091       1 autoregister_controller.go:141] Starting autoregister controller
I0626 16:59:03.862100       1 cache.go:32] Waiting for caches to sync for autoregister controller
I0626 16:59:03.862108       1 cache.go:39] Caches are synced for autoregister controller
I0626 16:59:04.040877       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0626 16:59:04.763887       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I0626 16:59:04.775235       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I0626 16:59:04.775261       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0626 16:59:06.147060       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0626 16:59:06.191337       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0626 16:59:06.270766       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W0626 16:59:06.278878       1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.156]
I0626 16:59:06.279966       1 controller.go:624] quota admission added evaluator for: endpoints
I0626 16:59:06.285661       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0626 16:59:06.806469       1 controller.go:624] quota admission added evaluator for: serviceaccounts
I0626 16:59:08.104940       1 controller.go:624] quota admission added evaluator for: deployments.apps
I0626 16:59:08.174740       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I0626 16:59:08.375563       1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I0626 16:59:11.548026       1 controller.go:624] quota admission added evaluator for: replicasets.apps
I0626 16:59:11.697195       1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps
I0626 16:59:42.858110       1 trace.go:236] Trace[982539257]: "Create" accept:application/json,audit-id:0a430a81-e477-4b31-a8cf-4b99c0cb9954,client:199.204.45.156,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 16:59:42.350) (total time: 507ms):
Trace[982539257]: ["Create etcd3" audit-id:0a430a81-e477-4b31-a8cf-4b99c0cb9954,key:/apiextensions.k8s.io/customresourcedefinitions/referencegrants.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 501ms (16:59:42.356)
Trace[982539257]:  ---"Txn call succeeded" 499ms (16:59:42.856)]
Trace[982539257]: [507.477654ms] [507.477654ms] END
I0626 16:59:42.858486       1 trace.go:236] Trace[733862866]: "Create" accept:application/json,audit-id:49510ba2-df9c-433c-a04d-042c5b35dac3,client:199.204.45.156,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 16:59:42.353) (total time: 504ms):
Trace[733862866]: [504.724554ms] [504.724554ms] END
I0626 16:59:42.863727       1 trace.go:236] Trace[1765060612]: "Create" accept:application/json,audit-id:6b58d3fc-2577-4f34-93bd-5af04de83713,client:199.204.45.156,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 16:59:42.356) (total time: 507ms):
Trace[1765060612]: [507.273473ms] [507.273473ms] END
I0626 16:59:42.864289       1 trace.go:236] Trace[1860495421]: "Create" accept:application/json,audit-id:4c7b9cef-a5e4-4e6b-ab2a-f11ecb5da0f2,client:199.204.45.156,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 16:59:42.354) (total time: 509ms):
Trace[1860495421]: [509.491349ms] [509.491349ms] END
I0626 16:59:42.865560       1 trace.go:236] Trace[850428330]: "Create" accept:application/json,audit-id:6f30df75-1d92-45ba-8704-834ec7c5433b,client:199.204.45.156,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 16:59:42.354) (total time: 510ms):
Trace[850428330]: [510.545768ms] [510.545768ms] END
I0626 16:59:42.865739       1 trace.go:236] Trace[1643886760]: "Create" accept:application/json,audit-id:87ca2199-f2c4-4ab8-b2e6-ece246d79920,client:199.204.45.156,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 16:59:42.354) (total time: 511ms):
Trace[1643886760]: [511.673315ms] [511.673315ms] END
I0626 16:59:42.866038       1 trace.go:236] Trace[1409866184]: "Create" accept:application/json,audit-id:a11ae7a0-66c9-4afc-aa85-a609beb2d341,client:199.204.45.156,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 16:59:42.350) (total time: 515ms):
Trace[1409866184]: [515.272151ms] [515.272151ms] END
I0626 16:59:42.866747       1 trace.go:236] Trace[1476874320]: "Create" accept:application/json,audit-id:8bf56a73-bc4f-4be2-9a29-4e15e35799a4,client:199.204.45.156,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 16:59:42.354) (total time: 512ms):
Trace[1476874320]: [512.4218ms] [512.4218ms] END
I0626 16:59:42.867220       1 trace.go:236] Trace[1798866207]: "Create" accept:application/json,audit-id:8a5d8923-24a8-43e9-bede-869527d470c5,client:199.204.45.156,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 16:59:42.354) (total time: 512ms):
Trace[1798866207]: [512.645592ms] [512.645592ms] END
I0626 16:59:42.870106       1 trace.go:236] Trace[2093576633]: "Create" accept:application/json,audit-id:69ceca95-e600-495b-b607-f3b2305cbd3e,client:199.204.45.156,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 16:59:42.360) (total time: 509ms):
Trace[2093576633]: [509.823121ms] [509.823121ms] END
I0626 16:59:42.886568       1 trace.go:236] Trace[1665356547]: "Create" accept:application/json,audit-id:66eb33cf-1129-48e9-a723-f209a099baff,client:199.204.45.156,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 16:59:42.360) (total time: 525ms):
Trace[1665356547]: ---"Conversion done" 39ms (16:59:42.412)
Trace[1665356547]: [525.984749ms] [525.984749ms] END
I0626 16:59:42.969076       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0626 16:59:42.978208       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0626 16:59:42.998229       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0626 16:59:43.016618       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0626 16:59:43.041269       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0626 16:59:43.088219       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0626 16:59:43.088268       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0626 16:59:43.108145       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0626 16:59:43.131794       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0626 16:59:43.131854       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0626 16:59:43.190799       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0626 16:59:43.190861       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0626 16:59:43.246811       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0626 16:59:43.388137       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0626 16:59:43.388208       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0626 16:59:43.402049       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0626 16:59:43.402222       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0626 16:59:43.420852       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 16:59:43.463426       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 16:59:43.500814       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 16:59:43.551457       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 16:59:43.563597       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 16:59:44.173240       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 16:59:44.196571       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 16:59:44.276292       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 16:59:50.148950       1 controller.go:624] quota admission added evaluator for: jobs.batch
I0626 16:59:51.005299       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0626 16:59:51.016677       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0626 16:59:51.028048       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0626 16:59:51.035525       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0626 16:59:51.205290       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0626 16:59:51.604179       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0626 16:59:52.625665       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0626 16:59:53.801263       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0626 16:59:54.032751       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0626 16:59:54.660816       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0626 16:59:54.813087       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
W0626 16:59:59.434297       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
E0626 16:59:59.434350       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
I0626 16:59:59.867373       1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io
I0626 17:00:08.527669       1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.100.4.200"}
W0626 17:00:08.561041       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.100.4.200:9443: connect: connection refused
E0626 17:00:08.561155       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.100.4.200:9443: connect: connection refused
I0626 17:00:22.777539       1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager
I0626 17:00:22.794311       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0626 17:00:22.806428       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0626 17:00:22.848612       1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.111.34.7"}
I0626 17:00:22.853985       1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager
I0626 17:00:22.868611       1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.104.116.35"}
I0626 17:00:22.897407       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0626 17:00:22.940861       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0626 17:00:33.899011       1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io
I0626 17:00:38.617290       1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io
I0626 17:00:51.813538       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.96.133.170"}
I0626 17:00:51.827214       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.106.72.252"}
I0626 17:00:51.830236       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.100.137.237"}
I0626 17:00:51.839489       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.111.4.108"}
I0626 17:00:58.224112       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 17:00:58.248633       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 17:00:58.269081       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 17:00:58.284169       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 17:00:58.303048       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 17:00:58.328182       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 17:00:58.344869       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 17:00:58.383876       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 17:00:58.423968       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 17:00:58.444298       1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager
I0626 17:00:58.466993       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 17:00:58.487241       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 17:00:58.508249       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 17:00:59.769630       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 17:01:03.798010       1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io
I0626 17:01:03.896748       1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.110.188.118"}
I0626 17:01:03.933941       1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io
I0626 17:01:06.028988       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0626 17:01:06.060025       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0626 17:01:06.709070       1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager
I0626 17:01:06.709126       1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager
I0626 17:01:06.709184       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0626 17:01:12.659513       1 trace.go:236] Trace[302808165]: "Update" accept:application/json, */*,audit-id:65ab6f0a-00b9-4a0f-97e7-c376dc2d61f7,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:01:12.122) (total time: 537ms):
Trace[302808165]: ["GuaranteedUpdate etcd3" audit-id:65ab6f0a-00b9-4a0f-97e7-c376dc2d61f7,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 536ms (17:01:12.122)
Trace[302808165]:  ---"Txn call completed" 535ms (17:01:12.659)]
Trace[302808165]: [537.036657ms] [537.036657ms] END
I0626 17:01:13.401145       1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com
I0626 17:01:17.359075       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.104.59.69"}
I0626 17:01:17.634690       1 controller.go:624] quota admission added evaluator for: statefulsets.apps
I0626 17:01:17.745980       1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy
I0626 17:01:17.904573       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.107.212.172"}
I0626 17:01:17.925377       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.109.74.168"}
I0626 17:01:20.101063       1 trace.go:236] Trace[425942310]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2653c781-6f9e-412b-8ff6-3b720fb517e2,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:01:19.539) (total time: 561ms):
Trace[425942310]: ---"About to write a response" 561ms (17:01:20.100)
Trace[425942310]: [561.346835ms] [561.346835ms] END
I0626 17:01:20.102436       1 trace.go:236] Trace[1040761830]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:94300704-4d0c-40bc-8994-015aca299dce,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:01:19.535) (total time: 567ms):
Trace[1040761830]: ---"About to write a response" 567ms (17:01:20.102)
Trace[1040761830]: [567.344537ms] [567.344537ms] END
I0626 17:01:20.102555       1 trace.go:236] Trace[1995049782]: "Update" accept:application/json, */*,audit-id:0189169e-fbff-42f8-9746-b675f0e1f209,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:01:19.450) (total time: 652ms):
Trace[1995049782]: ["GuaranteedUpdate etcd3" audit-id:0189169e-fbff-42f8-9746-b675f0e1f209,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 651ms (17:01:19.450)
Trace[1995049782]:  ---"Txn call completed" 650ms (17:01:20.102)]
Trace[1995049782]: [652.231188ms] [652.231188ms] END
I0626 17:01:20.104006       1 trace.go:236] Trace[1922668208]: "Get" accept:application/json,audit-id:448cd955-f9a1-4caa-9529-bc905b54e465,client:199.204.45.156,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (26-Jun-2026 17:01:19.460) (total time: 643ms):
Trace[1922668208]: ---"About to write a response" 643ms (17:01:20.103)
Trace[1922668208]: [643.855805ms] [643.855805ms] END
I0626 17:01:20.623498       1 trace.go:236] Trace[414389583]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:38cfa5d6-77ca-4f1d-a91b-f17bbf8020cc,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 17:01:20.104) (total time: 518ms):
Trace[414389583]: ["GuaranteedUpdate etcd3" audit-id:38cfa5d6-77ca-4f1d-a91b-f17bbf8020cc,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 518ms (17:01:20.104)
Trace[414389583]:  ---"Txn call completed" 517ms (17:01:20.623)]
Trace[414389583]: [518.858379ms] [518.858379ms] END
I0626 17:01:20.623740       1 trace.go:236] Trace[5923929]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2f5bd873-33df-48b3-9cf8-2b0617cd13dc,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 17:01:20.104) (total time: 519ms):
Trace[5923929]: ["GuaranteedUpdate etcd3" audit-id:2f5bd873-33df-48b3-9cf8-2b0617cd13dc,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 519ms (17:01:20.104)
Trace[5923929]:  ---"Txn call completed" 517ms (17:01:20.623)]
Trace[5923929]: [519.28662ms] [519.28662ms] END
I0626 17:01:20.869679       1 trace.go:236] Trace[474316015]: "Update" accept:application/json, */*,audit-id:a716eb8d-508a-4284-8e0a-a6f4ee67ad46,client:10.0.0.79,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:01:20.105) (total time: 764ms):
Trace[474316015]: ["GuaranteedUpdate etcd3" audit-id:a716eb8d-508a-4284-8e0a-a6f4ee67ad46,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 764ms (17:01:20.105)
Trace[474316015]:  ---"Txn call completed" 762ms (17:01:20.869)]
Trace[474316015]: [764.381193ms] [764.381193ms] END
I0626 17:01:20.869734       1 trace.go:236] Trace[1192138100]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0ff1353d-c089-4c81-b68e-7a356008c6a6,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-c4ecb2c7-84ad-4e44-9c2f-b60b58867758/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 17:01:20.105) (total time: 764ms):
Trace[1192138100]: ["GuaranteedUpdate etcd3" audit-id:0ff1353d-c089-4c81-b68e-7a356008c6a6,key:/pods/local-path-storage/helper-pod-create-pvc-c4ecb2c7-84ad-4e44-9c2f-b60b58867758,type:*core.Pod,resource:pods 764ms (17:01:20.105)
Trace[1192138100]:  ---"Txn call completed" 759ms (17:01:20.869)]
Trace[1192138100]: ---"Object stored in database" 760ms (17:01:20.869)
Trace[1192138100]: [764.514205ms] [764.514205ms] END
I0626 17:01:22.094192       1 trace.go:236] Trace[1280802910]: "Update" accept:application/json, */*,audit-id:259fdc4e-cfaf-46dc-ac07-2450d746923d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 17:01:20.886) (total time: 1207ms):
Trace[1280802910]: ["GuaranteedUpdate etcd3" audit-id:259fdc4e-cfaf-46dc-ac07-2450d746923d,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1207ms (17:01:20.887)
Trace[1280802910]:  ---"Txn call completed" 1206ms (17:01:22.093)]
Trace[1280802910]: [1.207229553s] [1.207229553s] END
I0626 17:01:22.094403       1 trace.go:236] Trace[1138583413]: "Update" accept:application/json, */*,audit-id:291eb8ec-a77a-42ec-8fca-0ee030e46e38,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 17:01:20.885) (total time: 1209ms):
Trace[1138583413]: ["GuaranteedUpdate etcd3" audit-id:291eb8ec-a77a-42ec-8fca-0ee030e46e38,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1208ms (17:01:20.885)
Trace[1138583413]:  ---"Txn call completed" 1207ms (17:01:22.093)]
Trace[1138583413]: [1.209087684s] [1.209087684s] END
I0626 17:01:22.095099       1 trace.go:236] Trace[1237303392]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:05b4b63c-1ab0-4d2c-b7c3-8d7e27ce19ed,client:10.0.0.207,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:01:21.156) (total time: 938ms):
Trace[1237303392]: ["GuaranteedUpdate etcd3" audit-id:05b4b63c-1ab0-4d2c-b7c3-8d7e27ce19ed,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 938ms (17:01:21.156)
Trace[1237303392]:  ---"Txn call completed" 937ms (17:01:22.094)]
Trace[1237303392]: [938.815009ms] [938.815009ms] END
I0626 17:01:22.095272       1 trace.go:236] Trace[520055356]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:78701b82-9566-4b52-99e4-9e1a0d27c4ad,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (26-Jun-2026 17:01:21.236) (total time: 858ms):
Trace[520055356]: ["GuaranteedUpdate etcd3" audit-id:78701b82-9566-4b52-99e4-9e1a0d27c4ad,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 858ms (17:01:21.236)
Trace[520055356]:  ---"Txn call completed" 857ms (17:01:22.095)]
Trace[520055356]: [858.634397ms] [858.634397ms] END
I0626 17:01:22.108570       1 trace.go:236] Trace[1875010166]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a3493898-bf3a-45ab-84c0-2281c7e6c882,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:01:21.593) (total time: 514ms):
Trace[1875010166]: ["GuaranteedUpdate etcd3" audit-id:a3493898-bf3a-45ab-84c0-2281c7e6c882,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 514ms (17:01:21.593)
Trace[1875010166]:  ---"Txn call completed" 513ms (17:01:22.107)]
Trace[1875010166]: [514.994255ms] [514.994255ms] END
I0626 17:01:22.110388       1 trace.go:236] Trace[90567062]: "Get" accept:application/json,audit-id:8a56b583-a1bc-453f-ba33-0f1d325bb173,client:199.204.45.156,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (26-Jun-2026 17:01:21.108) (total time: 1001ms):
Trace[90567062]: ---"About to write a response" 1001ms (17:01:22.109)
Trace[90567062]: [1.001663787s] [1.001663787s] END
I0626 17:01:22.112421       1 trace.go:236] Trace[1106645972]: "Get" accept:application/json, */*,audit-id:965ef6de-8a6b-4e1e-8450-52a4615a1ab9,client:10.0.0.199,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-c4ecb2c7-84ad-4e44-9c2f-b60b58867758,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:01:21.108) (total time: 1004ms):
Trace[1106645972]: ---"About to write a response" 1003ms (17:01:22.111)
Trace[1106645972]: [1.004095848s] [1.004095848s] END
I0626 17:01:58.754553       1 trace.go:236] Trace[1424265654]: "Update" accept:application/json, */*,audit-id:3827f33c-1d31-4dd7-9f68-f90341decac5,client:10.0.0.79,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:01:57.143) (total time: 1610ms):
Trace[1424265654]: ["GuaranteedUpdate etcd3" audit-id:3827f33c-1d31-4dd7-9f68-f90341decac5,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1610ms (17:01:57.143)
Trace[1424265654]:  ---"Txn call completed" 1609ms (17:01:58.753)]
Trace[1424265654]: [1.610910475s] [1.610910475s] END
I0626 17:01:58.754549       1 trace.go:236] Trace[1275203802]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0f128619-b138-4ab3-88f0-f4b5a6167997,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:01:57.376) (total time: 1378ms):
Trace[1275203802]: ["GuaranteedUpdate etcd3" audit-id:0f128619-b138-4ab3-88f0-f4b5a6167997,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1377ms (17:01:57.376)
Trace[1275203802]:  ---"Txn call completed" 1376ms (17:01:58.754)]
Trace[1275203802]: [1.378136993s] [1.378136993s] END
I0626 17:01:58.755772       1 trace.go:236] Trace[1263087786]: "Get" accept:application/json,audit-id:feba25e2-a30d-46cc-8af0-7ca5d6d91153,client:199.204.45.156,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (26-Jun-2026 17:01:58.001) (total time: 753ms):
Trace[1263087786]: ---"About to write a response" 753ms (17:01:58.755)
Trace[1263087786]: [753.912226ms] [753.912226ms] END
I0626 17:01:58.755919       1 trace.go:236] Trace[983901461]: "Get" accept:application/json, */*,audit-id:7274b155-9b78-4bda-9373-35e6f060fe8e,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:01:58.143) (total time: 612ms):
Trace[983901461]: ---"About to write a response" 611ms (17:01:58.755)
Trace[983901461]: [612.016944ms] [612.016944ms] END
I0626 17:01:59.948321       1 trace.go:236] Trace[682683712]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8da6d783-181d-44be-ab9b-f9e7cfe19475,client:10.0.0.207,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:01:58.849) (total time: 1098ms):
Trace[682683712]: ["GuaranteedUpdate etcd3" audit-id:8da6d783-181d-44be-ab9b-f9e7cfe19475,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1098ms (17:01:58.849)
Trace[682683712]:  ---"Txn call completed" 1097ms (17:01:59.948)]
Trace[682683712]: [1.098523916s] [1.098523916s] END
I0626 17:01:59.948427       1 trace.go:236] Trace[771232741]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:045aaaf1-f23f-4d27-9a73-47249e2f9309,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/percona-xtradb-haproxy-0.18bcb0383d93c3e2,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 17:01:58.140) (total time: 1807ms):
Trace[771232741]: ["GuaranteedUpdate etcd3" audit-id:045aaaf1-f23f-4d27-9a73-47249e2f9309,key:/events/openstack/percona-xtradb-haproxy-0.18bcb0383d93c3e2,type:*core.Event,resource:events 1807ms (17:01:58.140)
Trace[771232741]:  ---"initial value restored" 613ms (17:01:58.754)
Trace[771232741]:  ---"Txn call completed" 1192ms (17:01:59.948)]
Trace[771232741]: ---"Object stored in database" 1193ms (17:01:59.948)
Trace[771232741]: [1.807550312s] [1.807550312s] END
I0626 17:01:59.948432       1 trace.go:236] Trace[1388577255]: "Update" accept:application/json, */*,audit-id:db0e54aa-a598-4cb9-877b-b77c9d993e54,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:01:58.758) (total time: 1189ms):
Trace[1388577255]: ["GuaranteedUpdate etcd3" audit-id:db0e54aa-a598-4cb9-877b-b77c9d993e54,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1189ms (17:01:58.759)
Trace[1388577255]:  ---"Txn call completed" 1187ms (17:01:59.948)]
Trace[1388577255]: [1.189478026s] [1.189478026s] END
I0626 17:01:59.950213       1 trace.go:236] Trace[1128581977]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:16014c33-7eb7-46e6-9ad8-0a8a84d1ed7a,client:10.0.0.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:01:59.144) (total time: 806ms):
Trace[1128581977]: ["GuaranteedUpdate etcd3" audit-id:16014c33-7eb7-46e6-9ad8-0a8a84d1ed7a,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 805ms (17:01:59.144)
Trace[1128581977]:  ---"Txn call completed" 805ms (17:01:59.950)]
Trace[1128581977]: [806.124017ms] [806.124017ms] END
I0626 17:01:59.950725       1 trace.go:236] Trace[806643072]: "Get" accept:application/json, */*,audit-id:1b5d40a5-793d-40ed-a495-bb1177fc0dbe,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:01:59.143) (total time: 806ms):
Trace[806643072]: ---"About to write a response" 806ms (17:01:59.950)
Trace[806643072]: [806.995542ms] [806.995542ms] END
I0626 17:01:59.951402       1 trace.go:236] Trace[47027261]: "Get" accept:application/json, */*,audit-id:97b14a07-f2d5-4664-9f4d-79e910cda0ad,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:01:59.142) (total time: 808ms):
Trace[47027261]: ---"About to write a response" 808ms (17:01:59.951)
Trace[47027261]: [808.825423ms] [808.825423ms] END
I0626 17:01:59.952212       1 trace.go:236] Trace[1215733881]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:01adfef4-ea34-4016-83bc-bdb6bbebb799,client:10.0.0.207,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:01:58.803) (total time: 1148ms):
Trace[1215733881]: ---"About to write a response" 1148ms (17:01:59.951)
Trace[1215733881]: [1.1489989s] [1.1489989s] END
I0626 17:01:59.952576       1 trace.go:236] Trace[529477456]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5842c099-8262-4681-90ab-c88fcfb7d597,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:01:58.998) (total time: 954ms):
Trace[529477456]: ---"About to write a response" 954ms (17:01:59.952)
Trace[529477456]: [954.265173ms] [954.265173ms] END
I0626 17:01:59.952609       1 trace.go:236] Trace[1377244229]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:dcaae321-1085-426f-bd86-5e88b2d1528d,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:01:59.142) (total time: 810ms):
Trace[1377244229]: ---"About to write a response" 809ms (17:01:59.952)
Trace[1377244229]: [810.125984ms] [810.125984ms] END
I0626 17:01:59.952598       1 trace.go:236] Trace[330874265]: "Get" accept:application/json, */*,audit-id:69308e1a-0ae1-41b5-8139-357856b8a8ca,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:01:59.089) (total time: 862ms):
Trace[330874265]: ---"About to write a response" 862ms (17:01:59.952)
Trace[330874265]: [862.570617ms] [862.570617ms] END
I0626 17:02:07.461377       1 trace.go:236] Trace[2013349921]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1d291423-c208-4ad5-9668-e7caa6727084,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 17:02:06.204) (total time: 1256ms):
Trace[2013349921]: ["GuaranteedUpdate etcd3" audit-id:1d291423-c208-4ad5-9668-e7caa6727084,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1256ms (17:02:06.204)
Trace[2013349921]:  ---"Txn call completed" 1255ms (17:02:07.461)]
Trace[2013349921]: [1.256582216s] [1.256582216s] END
I0626 17:02:07.461523       1 trace.go:236] Trace[1831255151]: "Update" accept:application/json, */*,audit-id:c36ee710-62bf-4f3c-acd2-1a1c703cd721,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 17:02:06.204) (total time: 1257ms):
Trace[1831255151]: ["GuaranteedUpdate etcd3" audit-id:c36ee710-62bf-4f3c-acd2-1a1c703cd721,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1257ms (17:02:06.204)
Trace[1831255151]:  ---"Txn call completed" 1256ms (17:02:07.461)]
Trace[1831255151]: [1.257278327s] [1.257278327s] END
I0626 17:02:07.461554       1 trace.go:236] Trace[920182515]: "Update" accept:application/json, */*,audit-id:20c7afa0-7b49-490c-86a6-4feab24e507f,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:02:06.203) (total time: 1257ms):
Trace[920182515]: ["GuaranteedUpdate etcd3" audit-id:20c7afa0-7b49-490c-86a6-4feab24e507f,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1257ms (17:02:06.204)
Trace[920182515]:  ---"Txn call completed" 1256ms (17:02:07.461)]
Trace[920182515]: [1.257527471s] [1.257527471s] END
I0626 17:02:07.462046       1 trace.go:236] Trace[962815570]: "Update" accept:application/json, */*,audit-id:f9b28d29-0fbf-4bab-90cb-b612c15b798e,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:02:06.203) (total time: 1258ms):
Trace[962815570]: ["GuaranteedUpdate etcd3" audit-id:f9b28d29-0fbf-4bab-90cb-b612c15b798e,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1257ms (17:02:06.204)
Trace[962815570]:  ---"Txn call completed" 1257ms (17:02:07.461)]
Trace[962815570]: [1.258039799s] [1.258039799s] END
I0626 17:02:07.462288       1 trace.go:236] Trace[1135355572]: "Update" accept:application/json, */*,audit-id:5211c374-11e4-4bd0-b658-13b93703fe4a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 17:02:06.204) (total time: 1258ms):
Trace[1135355572]: ["GuaranteedUpdate etcd3" audit-id:5211c374-11e4-4bd0-b658-13b93703fe4a,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1257ms (17:02:06.204)
Trace[1135355572]:  ---"Txn call completed" 1257ms (17:02:07.462)]
Trace[1135355572]: [1.258151271s] [1.258151271s] END
I0626 17:02:07.462385       1 trace.go:236] Trace[1851234924]: "Get" accept:application/json, */*,audit-id:7147827d-d758-48df-bb81-5f2c0d998216,client:10.0.0.79,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:02:06.791) (total time: 670ms):
Trace[1851234924]: ---"About to write a response" 670ms (17:02:07.462)
Trace[1851234924]: [670.998369ms] [670.998369ms] END
I0626 17:02:07.879126       1 trace.go:236] Trace[1561840991]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.156,type:*v1.Endpoints,resource:apiServerIPInfo (26-Jun-2026 17:02:06.274) (total time: 1604ms):
Trace[1561840991]: ---"initial value restored" 1185ms (17:02:07.460)
Trace[1561840991]: ---"Transaction prepared" 413ms (17:02:07.873)
Trace[1561840991]: [1.604709291s] [1.604709291s] END
I0626 17:02:08.976940       1 trace.go:236] Trace[491270998]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ea90be86-dba3-442a-bfc0-ecbb55ab1a03,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/percona-xtradb-haproxy-0.18bcb0383d93c3e2,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 17:02:08.132) (total time: 844ms):
Trace[491270998]: ["GuaranteedUpdate etcd3" audit-id:ea90be86-dba3-442a-bfc0-ecbb55ab1a03,key:/events/openstack/percona-xtradb-haproxy-0.18bcb0383d93c3e2,type:*core.Event,resource:events 844ms (17:02:08.132)
Trace[491270998]:  ---"Txn call completed" 842ms (17:02:08.976)]
Trace[491270998]: ---"Object stored in database" 842ms (17:02:08.976)
Trace[491270998]: [844.485571ms] [844.485571ms] END
I0626 17:02:08.977440       1 trace.go:236] Trace[1708654325]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7a6874c2-9b3f-4435-8f08-64eff734b874,client:10.0.0.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:02:08.205) (total time: 771ms):
Trace[1708654325]: ["GuaranteedUpdate etcd3" audit-id:7a6874c2-9b3f-4435-8f08-64eff734b874,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 771ms (17:02:08.205)
Trace[1708654325]:  ---"Txn call completed" 770ms (17:02:08.977)]
Trace[1708654325]: [771.833574ms] [771.833574ms] END
I0626 17:02:08.977731       1 trace.go:236] Trace[331292445]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d30ac83b-492f-4f2b-b790-14a268877cf9,client:10.0.0.207,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:02:08.200) (total time: 777ms):
Trace[331292445]: ["GuaranteedUpdate etcd3" audit-id:d30ac83b-492f-4f2b-b790-14a268877cf9,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 777ms (17:02:08.200)
Trace[331292445]:  ---"Txn call completed" 776ms (17:02:08.977)]
Trace[331292445]: [777.337212ms] [777.337212ms] END
I0626 17:02:08.978866       1 trace.go:236] Trace[934808420]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:cd125f9f-7f34-4f81-9646-997782bacf12,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:02:08.210) (total time: 768ms):
Trace[934808420]: ---"About to write a response" 768ms (17:02:08.978)
Trace[934808420]: [768.613841ms] [768.613841ms] END
I0626 17:02:08.979359       1 trace.go:236] Trace[708250360]: "Get" accept:application/json,audit-id:733d1ad7-2beb-48fa-b0da-b8ddace144e0,client:199.204.45.156,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (26-Jun-2026 17:02:08.467) (total time: 512ms):
Trace[708250360]: ---"About to write a response" 511ms (17:02:08.979)
Trace[708250360]: [512.072141ms] [512.072141ms] END
I0626 17:02:15.120387       1 trace.go:236] Trace[1718384848]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:60a5ccc8-70cf-450a-aacc-bb02f42fdab6,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/percona-xtradb-haproxy-0.18bcb0383d93c3e2,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 17:02:13.128) (total time: 1991ms):
Trace[1718384848]: ["GuaranteedUpdate etcd3" audit-id:60a5ccc8-70cf-450a-aacc-bb02f42fdab6,key:/events/openstack/percona-xtradb-haproxy-0.18bcb0383d93c3e2,type:*core.Event,resource:events 1991ms (17:02:13.128)
Trace[1718384848]:  ---"initial value restored" 174ms (17:02:13.303)
Trace[1718384848]:  ---"Txn call completed" 1806ms (17:02:15.119)]
Trace[1718384848]: ---"Object stored in database" 1815ms (17:02:15.120)
Trace[1718384848]: [1.991408613s] [1.991408613s] END
I0626 17:02:15.121582       1 trace.go:236] Trace[584373074]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:18dc4ec6-949e-41fd-ae87-218cbae91708,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:02:13.487) (total time: 1634ms):
Trace[584373074]: ---"About to write a response" 1633ms (17:02:15.121)
Trace[584373074]: [1.634044015s] [1.634044015s] END
I0626 17:02:15.121594       1 trace.go:236] Trace[1095882724]: "Get" accept:application/json, */*,audit-id:59809735-d0c8-4e9c-b6cc-89701d32e8a0,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:02:13.483) (total time: 1638ms):
Trace[1095882724]: ---"About to write a response" 1637ms (17:02:15.120)
Trace[1095882724]: [1.638358903s] [1.638358903s] END
I0626 17:02:15.121742       1 trace.go:236] Trace[1133498507]: "Get" accept:application/json, */*,audit-id:2b25c49a-574e-479b-bd6a-cfed081e8768,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:02:13.488) (total time: 1633ms):
Trace[1133498507]: ---"About to write a response" 1632ms (17:02:15.121)
Trace[1133498507]: [1.633023609s] [1.633023609s] END
I0626 17:02:15.122055       1 trace.go:236] Trace[1062339352]: "Get" accept:application/json, */*,audit-id:74590154-c5a0-46f9-8a30-a2244636fc19,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:02:13.489) (total time: 1632ms):
Trace[1062339352]: ---"About to write a response" 1632ms (17:02:15.121)
Trace[1062339352]: [1.632549112s] [1.632549112s] END
I0626 17:02:15.122057       1 trace.go:236] Trace[481800905]: "Get" accept:application/json, */*,audit-id:3ef21ad2-404c-4ea3-bd0f-0ea3967cfd37,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:02:13.488) (total time: 1633ms):
Trace[481800905]: ---"About to write a response" 1633ms (17:02:15.121)
Trace[481800905]: [1.633197482s] [1.633197482s] END
I0626 17:02:15.122423       1 trace.go:236] Trace[260709905]: "Get" accept:application/json, */*,audit-id:d47d80f1-f93b-41f5-986f-78c9bdb2e131,client:10.0.0.79,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:02:13.898) (total time: 1223ms):
Trace[260709905]: ---"About to write a response" 1223ms (17:02:15.122)
Trace[260709905]: [1.223792235s] [1.223792235s] END
I0626 17:02:15.122906       1 trace.go:236] Trace[1143629145]: "Get" accept:application/json,audit-id:681f242e-dcd4-4794-9779-7cb5b6712909,client:199.204.45.156,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (26-Jun-2026 17:02:14.315) (total time: 807ms):
Trace[1143629145]: ---"About to write a response" 806ms (17:02:15.122)
Trace[1143629145]: [807.150015ms] [807.150015ms] END
I0626 17:02:40.042593       1 trace.go:236] Trace[289647915]: "Update" accept:application/json, */*,audit-id:65598bec-75d4-4cd1-b09f-6dbe98e6bd56,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:02:39.290) (total time: 751ms):
Trace[289647915]: ["GuaranteedUpdate etcd3" audit-id:65598bec-75d4-4cd1-b09f-6dbe98e6bd56,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 751ms (17:02:39.291)
Trace[289647915]:  ---"Txn call completed" 749ms (17:02:40.042)]
Trace[289647915]: [751.599419ms] [751.599419ms] END
I0626 17:02:40.051471       1 trace.go:236] Trace[535065707]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2576ca18-50a7-44eb-94ef-9f3598d9b425,client:10.0.0.207,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:02:39.393) (total time: 657ms):
Trace[535065707]: ["GuaranteedUpdate etcd3" audit-id:2576ca18-50a7-44eb-94ef-9f3598d9b425,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 657ms (17:02:39.393)
Trace[535065707]:  ---"Txn call completed" 656ms (17:02:40.051)]
Trace[535065707]: [657.793688ms] [657.793688ms] END
I0626 17:02:40.052094       1 trace.go:236] Trace[1535426560]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2e686938-ed3d-4366-b9ef-f2208622aa22,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:02:39.396) (total time: 655ms):
Trace[1535426560]: ["GuaranteedUpdate etcd3" audit-id:2e686938-ed3d-4366-b9ef-f2208622aa22,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 655ms (17:02:39.396)
Trace[1535426560]:  ---"Txn call completed" 655ms (17:02:40.051)]
Trace[1535426560]: [655.699687ms] [655.699687ms] END
I0626 17:02:40.052327       1 trace.go:236] Trace[539229607]: "Get" accept:application/json, */*,audit-id:7bd811f1-5d81-4bca-9ccb-d8e996035d61,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:02:39.311) (total time: 740ms):
Trace[539229607]: ---"About to write a response" 740ms (17:02:40.052)
Trace[539229607]: [740.880496ms] [740.880496ms] END
I0626 17:02:40.052633       1 trace.go:236] Trace[290586784]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0bb5195e-9e3a-4100-8e29-7d5dd4a8f1dd,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:02:39.455) (total time: 597ms):
Trace[290586784]: ---"About to write a response" 597ms (17:02:40.052)
Trace[290586784]: [597.107986ms] [597.107986ms] END
I0626 17:02:40.052753       1 trace.go:236] Trace[320702295]: "Get" accept:application/json, */*,audit-id:5f05918d-fd56-46aa-be86-2ea3a81bfe80,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:02:39.352) (total time: 699ms):
Trace[320702295]: ---"About to write a response" 699ms (17:02:40.052)
Trace[320702295]: [699.914385ms] [699.914385ms] END
I0626 17:02:40.052836       1 trace.go:236] Trace[753702374]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:348186d4-0050-411e-9d13-4712c2391c7f,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:02:39.322) (total time: 730ms):
Trace[753702374]: ---"About to write a response" 730ms (17:02:40.052)
Trace[753702374]: [730.362038ms] [730.362038ms] END
I0626 17:02:40.052919       1 trace.go:236] Trace[65815287]: "Get" accept:application/json, */*,audit-id:224488ed-df07-4bfd-9b34-7eef7aee4379,client:10.0.0.79,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:02:39.352) (total time: 700ms):
Trace[65815287]: ---"About to write a response" 700ms (17:02:40.052)
Trace[65815287]: [700.217539ms] [700.217539ms] END
I0626 17:02:40.052921       1 trace.go:236] Trace[1347072227]: "Get" accept:application/json, */*,audit-id:364b683c-3220-457f-886c-43f6a2232b56,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:02:39.357) (total time: 695ms):
Trace[1347072227]: ---"About to write a response" 695ms (17:02:40.052)
Trace[1347072227]: [695.696655ms] [695.696655ms] END
I0626 17:02:40.053269       1 trace.go:236] Trace[241280836]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a8f2c03d-14d7-41e7-9d3c-e9c306205ed1,client:10.0.0.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:02:39.395) (total time: 658ms):
Trace[241280836]: ["GuaranteedUpdate etcd3" audit-id:a8f2c03d-14d7-41e7-9d3c-e9c306205ed1,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 657ms (17:02:39.395)
Trace[241280836]:  ---"Txn call completed" 656ms (17:02:40.053)]
Trace[241280836]: [658.035001ms] [658.035001ms] END
I0626 17:02:40.054246       1 trace.go:236] Trace[1854256356]: "Get" accept:application/json,audit-id:f2530385-f795-4542-9fad-ca87f8561424,client:199.204.45.156,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (26-Jun-2026 17:02:39.326) (total time: 727ms):
Trace[1854256356]: ---"About to write a response" 726ms (17:02:40.053)
Trace[1854256356]: [727.356504ms] [727.356504ms] END
I0626 17:02:50.857558       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.104.202.44"}
I0626 17:02:52.939753       1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.108.17.21"}
I0626 17:02:53.800881       1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.108.215.213"}
I0626 17:03:01.579699       1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.109.95.96"}
I0626 17:03:01.599568       1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.109.172.132"}
I0626 17:05:39.409731       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io
I0626 17:05:41.338756       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0626 17:05:41.350447       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0626 17:05:41.380268       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0626 17:05:41.391014       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0626 17:05:41.404477       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0626 17:05:41.416398       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0626 17:05:41.435992       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0626 17:05:53.703793       1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io
I0626 17:06:29.101070       1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev
I0626 17:06:43.310267       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0626 17:06:43.545851       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0626 17:06:43.559847       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0626 17:06:43.571572       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0626 17:06:43.837830       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0626 17:06:44.106592       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0626 17:06:44.110680       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0626 17:06:44.243138       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0626 17:06:44.268357       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0626 17:06:44.394549       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0626 17:07:26.818355       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.106.139.112"}
I0626 17:07:26.829158       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.97.151.16"}
I0626 17:07:26.841544       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.106.144.110"}
I0626 17:07:26.849297       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.109.187.207"}
I0626 17:07:26.870525       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.110.249.85"}
I0626 17:07:26.873108       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.100.252.222"}
I0626 17:07:26.927514       1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com
I0626 17:07:26.940005       1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com
I0626 17:07:26.997651       1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com
I0626 17:07:27.018711       1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com
I0626 17:07:27.041199       1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com
W0626 17:07:27.057240       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.057286       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.058298       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.058347       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.058426       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.058458       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.058623       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.058681       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.059313       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.059338       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.059733       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.059767       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.059923       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.059955       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.060020       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.060040       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.060797       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.060829       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.061047       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.061075       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.061273       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.061317       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.061570       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.061598       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.061617       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.061663       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.061885       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.061917       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.062004       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.062040       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
W0626 17:07:27.062350       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
E0626 17:07:27.062440       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.144.110:443: connect: connection refused
I0626 17:07:40.738174       1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com
I0626 17:07:40.896073       1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.104.241.233"}
I0626 17:07:57.336730       1 trace.go:236] Trace[598917220]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:66f4c1bb-f47d-4d7e-93f5-a2474d06ff38,client:199.204.45.156,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/datadir-percona-xtradb-pxc-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 17:07:56.235) (total time: 1101ms):
Trace[598917220]: ---"About to write a response" 1100ms (17:07:57.336)
Trace[598917220]: [1.101068008s] [1.101068008s] END
I0626 17:07:57.336745       1 trace.go:236] Trace[1978953723]: "Patch" accept:application/json, */*,audit-id:3e1c036f-3623-4895-8efe-b17f5c858fbd,client:10.0.0.79,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/rabbitmq-keystone.18bcb08a6d4610f0,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PATCH (26-Jun-2026 17:07:56.066) (total time: 1269ms):
Trace[1978953723]: ["GuaranteedUpdate etcd3" audit-id:3e1c036f-3623-4895-8efe-b17f5c858fbd,key:/events/openstack/rabbitmq-keystone.18bcb08a6d4610f0,type:*core.Event,resource:events 1269ms (17:07:56.066)
Trace[1978953723]:  ---"Txn call completed" 1267ms (17:07:57.336)]
Trace[1978953723]: ---"Object stored in database" 1268ms (17:07:57.336)
Trace[1978953723]: [1.269967104s] [1.269967104s] END
I0626 17:07:57.337760       1 trace.go:236] Trace[1906960285]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:713a79d3-9054-428f-abc9-2ba20c3ae158,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:07:56.429) (total time: 907ms):
Trace[1906960285]: ---"About to write a response" 907ms (17:07:57.337)
Trace[1906960285]: [907.795166ms] [907.795166ms] END
I0626 17:07:57.338131       1 trace.go:236] Trace[30529100]: "Get" accept:application/json, */*,audit-id:67f080c5-890b-45e0-b983-3add107f3715,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:07:56.464) (total time: 873ms):
Trace[30529100]: ---"About to write a response" 872ms (17:07:57.337)
Trace[30529100]: [873.383891ms] [873.383891ms] END
I0626 17:07:57.338810       1 trace.go:236] Trace[1139891832]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3431f7cc-1fc5-47ad-a05a-13e11ccdd7ff,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:07:56.431) (total time: 907ms):
Trace[1139891832]: ---"About to write a response" 907ms (17:07:57.338)
Trace[1139891832]: [907.626163ms] [907.626163ms] END
I0626 17:07:57.339371       1 trace.go:236] Trace[1402119825]: "Get" accept:application/json, */*,audit-id:0bbe30a2-db64-4af2-bfba-66d8bf518fce,client:10.0.0.158,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (26-Jun-2026 17:07:56.334) (total time: 1005ms):
Trace[1402119825]: ---"About to write a response" 1004ms (17:07:57.339)
Trace[1402119825]: [1.005060485s] [1.005060485s] END
I0626 17:07:57.339498       1 trace.go:236] Trace[1302849692]: "Get" accept:application/json, */*,audit-id:bc57b048-afec-418b-ba4b-5d72ecd979ec,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:07:56.462) (total time: 876ms):
Trace[1302849692]: ---"About to write a response" 875ms (17:07:57.338)
Trace[1302849692]: [876.476472ms] [876.476472ms] END
I0626 17:07:57.339376       1 trace.go:236] Trace[1937815919]: "Get" accept:application/json, */*,audit-id:e8941b9a-fab9-41ff-9ac5-6eb19eba98f9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:07:56.432) (total time: 906ms):
Trace[1937815919]: ---"About to write a response" 906ms (17:07:57.339)
Trace[1937815919]: [906.984291ms] [906.984291ms] END
I0626 17:07:57.339880       1 trace.go:236] Trace[130263918]: "Get" accept:application/json, */*,audit-id:f0e2db52-5332-40a7-95d8-7f1d72feaeb3,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:07:56.460) (total time: 879ms):
Trace[130263918]: ---"About to write a response" 878ms (17:07:57.339)
Trace[130263918]: [879.150696ms] [879.150696ms] END
I0626 17:07:57.340260       1 trace.go:236] Trace[21243921]: "Get" accept:application/json, */*,audit-id:7dc95a85-9493-41e7-93e2-70ae30f22dd6,client:10.0.0.79,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:07:56.346) (total time: 993ms):
Trace[21243921]: ---"About to write a response" 993ms (17:07:57.340)
Trace[21243921]: [993.906973ms] [993.906973ms] END
I0626 17:07:57.571881       1 trace.go:236] Trace[1144196414]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.156,type:*v1.Endpoints,resource:apiServerIPInfo (26-Jun-2026 17:07:56.293) (total time: 1278ms):
Trace[1144196414]: ---"initial value restored" 1045ms (17:07:57.339)
Trace[1144196414]: ---"Txn call completed" 226ms (17:07:57.571)
Trace[1144196414]: [1.278615308s] [1.278615308s] END
I0626 17:08:28.792157       1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.106.79.240"}
I0626 17:08:28.806490       1 controller.go:624] quota admission added evaluator for: cronjobs.batch
I0626 17:08:40.127399       1 trace.go:236] Trace[273068174]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:861608ad-d88b-4bf3-9b96-f54314b00223,client:199.204.45.156,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 17:08:39.378) (total time: 748ms):
Trace[273068174]: ["GuaranteedUpdate etcd3" audit-id:861608ad-d88b-4bf3-9b96-f54314b00223,key:/minions/instance,type:*core.Node,resource:nodes 748ms (17:08:39.378)
Trace[273068174]:  ---"Txn call completed" 737ms (17:08:40.122)]
Trace[273068174]: ---"Object stored in database" 739ms (17:08:40.122)
Trace[273068174]: [748.855187ms] [748.855187ms] END
E0626 17:08:51.159939       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:51.160004       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:51.160054       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 17.71µs, panicked: false, err: context canceled, panic-reason: <nil>
E0626 17:08:51.161155       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:08:51.161243       1 trace.go:236] Trace[208960503]: "Update" accept:application/json, */*,audit-id:4e794bae-e3f7-42de-901b-ef2b0e7f41bf,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:08:46.159) (total time: 5001ms):
Trace[208960503]: ["GuaranteedUpdate etcd3" audit-id:4e794bae-e3f7-42de-901b-ef2b0e7f41bf,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (17:08:46.159)
Trace[208960503]:  ---"Txn call failed" err:context canceled 4999ms (17:08:51.159)]
Trace[208960503]: [5.00196842s] [5.00196842s] END
E0626 17:08:51.161392       1 timeout.go:142] post-timeout activity - time-elapsed: 1.470836ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0626 17:08:51.436243       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:51.436375       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:51.436297       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 20.48µs, panicked: false, err: context deadline exceeded, panic-reason: <nil>
E0626 17:08:51.438021       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:08:51.438137       1 trace.go:236] Trace[394518685]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d7adccfa-2dbb-4d3f-9e18-e53453bf0f8e,client:10.0.0.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:08:46.438) (total time: 4999ms):
Trace[394518685]: ["GuaranteedUpdate etcd3" audit-id:d7adccfa-2dbb-4d3f-9e18-e53453bf0f8e,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 4999ms (17:08:46.438)
Trace[394518685]:  ---"Txn call failed" err:context deadline exceeded 4997ms (17:08:51.436)]
Trace[394518685]: [4.999606572s] [4.999606572s] END
E0626 17:08:51.438276       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:51.438323       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 7.73µs, panicked: false, err: context deadline exceeded, panic-reason: <nil>
E0626 17:08:51.438375       1 timeout.go:142] post-timeout activity - time-elapsed: 2.107897ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: <nil>
E0626 17:08:51.439261       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:51.439479       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:08:51.440923       1 trace.go:236] Trace[43135810]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3bc6f76c-0abd-4c4c-b1c6-0d535fc7ef4b,client:10.0.0.207,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:08:46.437) (total time: 5003ms):
Trace[43135810]: ["GuaranteedUpdate etcd3" audit-id:3bc6f76c-0abd-4c4c-b1c6-0d535fc7ef4b,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5003ms (17:08:46.437)
Trace[43135810]:  ---"Txn call failed" err:context deadline exceeded 4999ms (17:08:51.437)]
Trace[43135810]: [5.00336212s] [5.00336212s] END
E0626 17:08:51.440984       1 timeout.go:142] post-timeout activity - time-elapsed: 2.489795ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: <nil>
E0626 17:08:51.442152       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0626 17:08:51.442216       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:51.443356       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:51.443387       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:08:51.444477       1 trace.go:236] Trace[1847228207]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:de4d48dc-12ab-429b-9f23-194ac4e96574,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:08:46.442) (total time: 5002ms):
Trace[1847228207]: [5.002003864s] [5.002003864s] END
E0626 17:08:51.444665       1 timeout.go:142] post-timeout activity - time-elapsed: 2.437334ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0626 17:08:51.450991       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0626 17:08:51.451035       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:51.452232       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:51.452359       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:08:51.453355       1 trace.go:236] Trace[874949208]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8d95d611-4714-43c3-960f-61e5eabbfe5c,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:08:46.451) (total time: 5001ms):
Trace[874949208]: [5.001928283s] [5.001928283s] END
E0626 17:08:51.453431       1 timeout.go:142] post-timeout activity - time-elapsed: 2.339452ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
I0626 17:08:53.299841       1 trace.go:236] Trace[835385191]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.156,type:*v1.Endpoints,resource:apiServerIPInfo (26-Jun-2026 17:08:46.296) (total time: 7003ms):
Trace[835385191]: [7.003146318s] [7.003146318s] END
E0626 17:08:53.299884       1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out
E0626 17:08:53.907463       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:08:53.908262       1 trace.go:236] Trace[2002033473]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a220188a-d294-4278-aad4-e3d45100ceea,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:08:46.901) (total time: 7006ms):
Trace[2002033473]: ["GuaranteedUpdate etcd3" audit-id:a220188a-d294-4278-aad4-e3d45100ceea,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7006ms (17:08:46.901)
Trace[2002033473]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:08:53.904)]
Trace[2002033473]: [7.006284374s] [7.006284374s] END
E0626 17:08:53.909216       1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
E0626 17:08:55.362024       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:08:55.362347       1 trace.go:236] Trace[531673119]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:545577a9-59a1-41d6-b625-83f8ff5bb8f7,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (26-Jun-2026 17:08:48.358) (total time: 7003ms):
Trace[531673119]: ["Create etcd3" audit-id:545577a9-59a1-41d6-b625-83f8ff5bb8f7,key:/events/kube-system/kube-apiserver-instance.18bcb09a1518a279,type:*core.Event,resource:events 7003ms (17:08:48.359)
Trace[531673119]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:08:55.361)]
Trace[531673119]: [7.003759275s] [7.003759275s] END
E0626 17:08:56.156419       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:08:56.156559       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:56.157627       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:56.157690       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:08:56.159631       1 trace.go:236] Trace[1145260195]: "Get" accept:application/json, */*,audit-id:5f6dc233-cf77-4af2-ab11-764520c67a9a,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:08:53.162) (total time: 2997ms):
Trace[1145260195]: [2.997358742s] [2.997358742s] END
E0626 17:08:56.159836       1 timeout.go:142] post-timeout activity - time-elapsed: 3.400982ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0626 17:08:56.436796       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:08:56.436920       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:56.437791       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:08:56.437844       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:56.438256       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:56.439187       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:56.439260       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0626 17:08:56.439504       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:08:56.440267       1 trace.go:236] Trace[222807715]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bbbaf030-fe04-48cb-b46a-3e43a526bbe7,client:10.0.0.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:08:51.439) (total time: 5001ms):
Trace[222807715]: [5.001196768s] [5.001196768s] END
I0626 17:08:56.440444       1 trace.go:236] Trace[689957259]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a403a5ca-8143-4e5d-b6c3-07e1bb56b7d2,client:10.0.0.207,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:08:51.439) (total time: 5001ms):
Trace[689957259]: [5.00132906s] [5.00132906s] END
E0626 17:08:56.440699       1 timeout.go:142] post-timeout activity - time-elapsed: 3.969331ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: <nil>
E0626 17:08:56.440814       1 timeout.go:142] post-timeout activity - time-elapsed: 3.025284ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: <nil>
E0626 17:08:56.451089       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:08:56.451169       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:56.452120       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:08:56.452248       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:56.452263       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:56.453608       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:56.453684       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0626 17:08:56.453815       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0626 17:08:56.454742       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
I0626 17:08:56.454806       1 trace.go:236] Trace[1919034081]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9ff9a1f3-b129-4442-9add-87d72e10c02b,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:08:53.454) (total time: 3000ms):
Trace[1919034081]: [3.000547408s] [3.000547408s] END
I0626 17:08:56.454874       1 trace.go:236] Trace[369436636]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e728d986-8edc-4e96-9441-5d06be6dd266,client:10.0.0.207,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:08:46.780) (total time: 9673ms):
Trace[369436636]: [9.673852755s] [9.673852755s] END
E0626 17:08:56.454933       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:56.454957       1 timeout.go:142] post-timeout activity - time-elapsed: 3.810219ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0626 17:08:56.455091       1 timeout.go:142] post-timeout activity - time-elapsed: 2.965704ms, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: <nil>
E0626 17:08:56.455858       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:56.456434       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:08:56.457801       1 trace.go:236] Trace[2139615707]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7452cf40-7363-4a85-acb0-23529a218703,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:08:53.445) (total time: 3012ms):
Trace[2139615707]: [3.012558705s] [3.012558705s] END
E0626 17:08:56.457891       1 timeout.go:142] post-timeout activity - time-elapsed: 3.214208ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0626 17:08:56.480743       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:08:56.480853       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:56.482135       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:56.482209       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:08:56.483396       1 trace.go:236] Trace[1487094068]: "Get" accept:application/json, */*,audit-id:d889c1ce-6362-48c6-aee6-0a5135123fbb,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:08:46.480) (total time: 10002ms):
Trace[1487094068]: [10.002475077s] [10.002475077s] END
E0626 17:08:56.483737       1 timeout.go:142] post-timeout activity - time-elapsed: 3.040795ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: <nil>
E0626 17:08:56.485923       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:08:56.486028       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:56.487631       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:56.487779       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:08:56.489152       1 trace.go:236] Trace[511154729]: "Get" accept:application/json, */*,audit-id:bab416da-8eaf-4cda-acbc-58dd3f6c06ce,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:08:46.483) (total time: 10005ms):
Trace[511154729]: [10.005144975s] [10.005144975s] END
E0626 17:08:56.489697       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:08:56.489750       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:56.490145       1 timeout.go:142] post-timeout activity - time-elapsed: 4.227527ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: <nil>
E0626 17:08:56.490933       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:56.492090       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:08:56.492141       1 trace.go:236] Trace[1215781968]: "Get" accept:application/json, */*,audit-id:e68504f7-391d-4dd0-a39d-a31a7496a57a,client:10.0.0.79,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:08:46.482) (total time: 10009ms):
Trace[1215781968]: [10.009428822s] [10.009428822s] END
E0626 17:08:56.492249       1 timeout.go:142] post-timeout activity - time-elapsed: 2.596507ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: <nil>
E0626 17:08:56.500570       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:08:56.500613       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:08:56.502388       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:08:56.502433       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:08:56.503662       1 trace.go:236] Trace[1388879717]: "Get" accept:application/json, */*,audit-id:08bafb13-3d0f-4d4c-8eb3-79f7db60ad87,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:08:46.482) (total time: 10021ms):
Trace[1388879717]: [10.021554571s] [10.021554571s] END
E0626 17:08:56.503852       1 timeout.go:142] post-timeout activity - time-elapsed: 3.29819ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: <nil>
E0626 17:08:58.273643       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:08:58.273819       1 trace.go:236] Trace[396554325]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d38546ee-5a46-472e-bb39-cc94644a7ba9,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:08:51.270) (total time: 7003ms):
Trace[396554325]: ["GuaranteedUpdate etcd3" audit-id:d38546ee-5a46-472e-bb39-cc94644a7ba9,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (17:08:51.270)
Trace[396554325]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:08:58.273)]
Trace[396554325]: [7.003689146s] [7.003689146s] END
E0626 17:09:00.300257       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:00.300895       1 trace.go:236] Trace[223425812]: "Get" accept:application/json, */*,audit-id:f7ca506f-9295-4a30-85d4-b6a4ff682475,client:10.0.0.161,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:08:48.147) (total time: 12152ms):
Trace[223425812]: [12.152733757s] [12.152733757s] END
E0626 17:09:00.301203       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:00.301532       1 trace.go:236] Trace[186898985]: "Get" accept:application/json, */*,audit-id:5566eb80-9999-4852-b5ca-27a61b949719,client:10.0.0.161,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-fernet-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:08:48.148) (total time: 12153ms):
Trace[186898985]: [12.153281996s] [12.153281996s] END
E0626 17:09:00.446437       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:00.446598       1 trace.go:236] Trace[1853821240]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6aa19084-c605-446b-9b34-1bf9be39ad8e,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (26-Jun-2026 17:08:53.442) (total time: 7004ms):
Trace[1853821240]: ["GuaranteedUpdate etcd3" audit-id:6aa19084-c605-446b-9b34-1bf9be39ad8e,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (17:08:53.442)
Trace[1853821240]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:09:00.446)]
Trace[1853821240]: [7.004045923s] [7.004045923s] END
E0626 17:09:00.914247       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:00.914462       1 trace.go:236] Trace[1123773237]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7942976b-738f-4d3b-a8f1-63bf02e3b9d7,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:08:53.911) (total time: 7003ms):
Trace[1123773237]: ["GuaranteedUpdate etcd3" audit-id:7942976b-738f-4d3b-a8f1-63bf02e3b9d7,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (17:08:53.911)
Trace[1123773237]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:09:00.914)]
Trace[1123773237]: [7.003369681s] [7.003369681s] END
E0626 17:09:00.915323       1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
E0626 17:09:01.157633       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:01.157677       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:01.157707       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.31µs, panicked: false, err: context canceled, panic-reason: <nil>
E0626 17:09:01.159171       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:01.159343       1 trace.go:236] Trace[1659100443]: "Update" accept:application/json, */*,audit-id:7871db24-c5fa-46f0-bd72-25eb94a92b33,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:08:56.158) (total time: 5000ms):
Trace[1659100443]: ["GuaranteedUpdate etcd3" audit-id:7871db24-c5fa-46f0-bd72-25eb94a92b33,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (17:08:56.158)
Trace[1659100443]:  ---"Txn call failed" err:context canceled 4997ms (17:09:01.157)]
Trace[1659100443]: [5.000958587s] [5.000958587s] END
E0626 17:09:01.159725       1 timeout.go:142] post-timeout activity - time-elapsed: 1.978455ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0626 17:09:01.452460       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:01.452503       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:01.452548       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 16.731µs, panicked: false, err: context deadline exceeded, panic-reason: <nil>
E0626 17:09:01.453863       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:01.454057       1 trace.go:236] Trace[520754150]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e51a19a8-d9c8-4282-97c1-9c15a75f6b55,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 17:08:56.452) (total time: 5001ms):
Trace[520754150]: ["GuaranteedUpdate etcd3" audit-id:e51a19a8-d9c8-4282-97c1-9c15a75f6b55,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (17:08:56.453)
Trace[520754150]:  ---"Txn call failed" err:context deadline exceeded 4998ms (17:09:01.452)]
Trace[520754150]: [5.001029563s] [5.001029563s] END
E0626 17:09:01.454307       1 timeout.go:142] post-timeout activity - time-elapsed: 1.790333ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0626 17:09:02.367914       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:02.368217       1 trace.go:236] Trace[1258358962]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:722e7109-5714-405a-88c8-c9044c61dc52,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (26-Jun-2026 17:08:55.364) (total time: 7003ms):
Trace[1258358962]: ["Create etcd3" audit-id:722e7109-5714-405a-88c8-c9044c61dc52,key:/events/kube-system/kube-apiserver-instance.18bcb09a24d947e5,type:*core.Event,resource:events 7002ms (17:08:55.365)
Trace[1258358962]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:09:02.367)]
Trace[1258358962]: [7.00329287s] [7.00329287s] END
E0626 17:09:03.444727       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:03.444947       1 trace.go:236] Trace[1586001411]: "Create" accept:application/json, */*,audit-id:80b35ef2-c83e-4ee0-a8e6-3e92faf86d02,client:10.0.0.78,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (26-Jun-2026 17:08:56.441) (total time: 7003ms):
Trace[1586001411]: ["Create etcd3" audit-id:80b35ef2-c83e-4ee0-a8e6-3e92faf86d02,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18bcb09bf6a7ed78,type:*core.Event,resource:events 7003ms (17:08:56.441)
Trace[1586001411]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:09:03.444)]
Trace[1586001411]: [7.003877707s] [7.003877707s] END
E0626 17:09:03.485733       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:03.485968       1 trace.go:236] Trace[1118812838]: "Update" accept:application/json, */*,audit-id:cf34dc0e-e76f-45bd-a953-538e2e2dc59e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 17:08:56.481) (total time: 7004ms):
Trace[1118812838]: ["GuaranteedUpdate etcd3" audit-id:cf34dc0e-e76f-45bd-a953-538e2e2dc59e,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (17:08:56.482)
Trace[1118812838]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:09:03.485)]
Trace[1118812838]: [7.004244817s] [7.004244817s] END
E0626 17:09:03.490827       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:03.490994       1 trace.go:236] Trace[1153856457]: "Update" accept:application/json, */*,audit-id:d0412088-9d1c-4c4b-a443-9a6ba3427450,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 17:08:56.487) (total time: 7003ms):
Trace[1153856457]: ["GuaranteedUpdate etcd3" audit-id:d0412088-9d1c-4c4b-a443-9a6ba3427450,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (17:08:56.487)
Trace[1153856457]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:09:03.490)]
Trace[1153856457]: [7.003840739s] [7.003840739s] END
I0626 17:09:04.345864       1 trace.go:236] Trace[357738357]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3511da3d-eb60-49cc-80bb-24c3b8ed3e3a,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:08:58.276) (total time: 6069ms):
Trace[357738357]: ["GuaranteedUpdate etcd3" audit-id:3511da3d-eb60-49cc-80bb-24c3b8ed3e3a,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 6069ms (17:08:58.276)
Trace[357738357]:  ---"Txn call completed" 6067ms (17:09:04.345)]
Trace[357738357]: [6.069421485s] [6.069421485s] END
I0626 17:09:04.346868       1 trace.go:236] Trace[1850528321]: "Get" accept:application/json, */*,audit-id:aefb82c8-638e-4c06-b6d2-81d932e74114,client:10.0.0.161,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:09:02.305) (total time: 2041ms):
Trace[1850528321]: [2.041511941s] [2.041511941s] END
I0626 17:09:04.348369       1 trace.go:236] Trace[972631127]: "Get" accept:application/json, */*,audit-id:7bee7284-9105-4f59-8e4e-d14f654e79ed,client:10.0.0.161,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-fernet-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:09:02.305) (total time: 2043ms):
Trace[972631127]: [2.043176831s] [2.043176831s] END
I0626 17:09:04.348906       1 trace.go:236] Trace[1737814486]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:83aca3d4-405a-4876-9de6-a917b0a8ff4b,client:199.204.45.156,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/alertmanager-kube-prometheus-stack-alertmanager-db-alertmanager-kube-prometheus-stack-alertmanager-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 17:08:59.222) (total time: 5126ms):
Trace[1737814486]: ---"About to write a response" 5126ms (17:09:04.348)
Trace[1737814486]: [5.126367582s] [5.126367582s] END
I0626 17:09:04.348981       1 trace.go:236] Trace[1127466037]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1576566c-8dd7-4b7d-8618-188cf7433e62,client:199.204.45.156,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/ingress-nginx/services/ingress-nginx-controller,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (26-Jun-2026 17:08:58.707) (total time: 5641ms):
Trace[1127466037]: ---"About to write a response" 5640ms (17:09:04.348)
Trace[1127466037]: [5.641035202s] [5.641035202s] END
I0626 17:09:04.349625       1 trace.go:236] Trace[916143936]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1a46be3c-4d93-4656-a684-15f54f631ebe,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 17:08:54.641) (total time: 9708ms):
Trace[916143936]: ---"About to write a response" 9707ms (17:09:04.349)
Trace[916143936]: [9.708046505s] [9.708046505s] END
I0626 17:09:04.349791       1 trace.go:236] Trace[2014196690]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a376aba4-6e7d-46c7-b168-2c2fba63daa3,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (26-Jun-2026 17:09:00.449) (total time: 3900ms):
Trace[2014196690]: ---"About to write a response" 3900ms (17:09:04.349)
Trace[2014196690]: [3.900753023s] [3.900753023s] END
I0626 17:09:04.349903       1 trace.go:236] Trace[1424471904]: "Get" accept:application/json, */*,audit-id:c90514d1-aea8-4ac6-95a8-501d74170cee,client:10.0.0.158,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (26-Jun-2026 17:08:57.590) (total time: 6759ms):
Trace[1424471904]: ---"About to write a response" 6759ms (17:09:04.349)
Trace[1424471904]: [6.759784647s] [6.759784647s] END
I0626 17:09:04.349920       1 trace.go:236] Trace[1101879506]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6ca8f377-c5a0-4c4a-b79a-167499b5f94e,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:09:00.916) (total time: 3433ms):
Trace[1101879506]: ["GuaranteedUpdate etcd3" audit-id:6ca8f377-c5a0-4c4a-b79a-167499b5f94e,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 3433ms (17:09:00.916)
Trace[1101879506]:  ---"Txn call completed" 3431ms (17:09:04.349)]
Trace[1101879506]: [3.43329545s] [3.43329545s] END
E0626 17:09:04.350368       1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again"
I0626 17:09:04.351675       1 trace.go:236] Trace[1035580718]: "Get" accept:application/json, */*,audit-id:2e67f7b1-99c1-4779-9882-28df90ef245c,client:10.0.0.44,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:08:57.786) (total time: 6565ms):
Trace[1035580718]: ---"About to write a response" 6563ms (17:09:04.350)
Trace[1035580718]: [6.565498799s] [6.565498799s] END
I0626 17:09:04.582225       1 trace.go:236] Trace[1478634257]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7e846eca-f076-4fef-913b-08572ee88b7b,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bcb09a24d947e5,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 17:09:02.371) (total time: 2210ms):
Trace[1478634257]: ["GuaranteedUpdate etcd3" audit-id:7e846eca-f076-4fef-913b-08572ee88b7b,key:/events/kube-system/kube-apiserver-instance.18bcb09a24d947e5,type:*core.Event,resource:events 2210ms (17:09:02.371)
Trace[1478634257]:  ---"initial value restored" 1976ms (17:09:04.348)
Trace[1478634257]:  ---"Txn call completed" 232ms (17:09:04.581)]
Trace[1478634257]: ---"Object stored in database" 233ms (17:09:04.581)
Trace[1478634257]: [2.210582285s] [2.210582285s] END
I0626 17:09:04.596401       1 trace.go:236] Trace[1067034926]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.156,type:*v1.Endpoints,resource:apiServerIPInfo (26-Jun-2026 17:08:56.297) (total time: 8298ms):
Trace[1067034926]: ---"initial value restored" 8052ms (17:09:04.349)
Trace[1067034926]: ---"Txn call completed" 234ms (17:09:04.596)
Trace[1067034926]: [8.298887958s] [8.298887958s] END
E0626 17:09:22.977883       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:22.977934       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:22.977948       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.63µs, panicked: false, err: context deadline exceeded, panic-reason: <nil>
E0626 17:09:22.980055       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:22.980145       1 trace.go:236] Trace[1989693891]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:fb939794-1de8-4b05-805f-bb620ec252fd,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 17:09:17.977) (total time: 5002ms):
Trace[1989693891]: ["GuaranteedUpdate etcd3" audit-id:fb939794-1de8-4b05-805f-bb620ec252fd,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (17:09:17.978)
Trace[1989693891]:  ---"Txn call failed" err:context deadline exceeded 4998ms (17:09:22.977)]
Trace[1989693891]: [5.002194893s] [5.002194893s] END
E0626 17:09:22.980294       1 timeout.go:142] post-timeout activity - time-elapsed: 2.443813ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0626 17:09:24.231864       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
I0626 17:09:24.232209       1 trace.go:236] Trace[1092287016]: "Get" accept:application/json, */*,audit-id:ff36113c-8a6e-4096-9b22-f270516326fe,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:19.231) (total time: 5000ms):
Trace[1092287016]: [5.000456894s] [5.000456894s] END
E0626 17:09:24.232451       1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock?timeout=5s" audit-ID="ff36113c-8a6e-4096-9b22-f270516326fe"
E0626 17:09:24.232708       1 timeout.go:142] post-timeout activity - time-elapsed: 206.663µs, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0626 17:09:24.275044       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
I0626 17:09:24.275181       1 trace.go:236] Trace[51633729]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c343f554-0797-4e2f-af6d-7e3c03a7a46b,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:09:19.274) (total time: 5000ms):
Trace[51633729]: [5.000582822s] [5.000582822s] END
E0626 17:09:24.275298       1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager?timeout=5s" audit-ID="c343f554-0797-4e2f-af6d-7e3c03a7a46b"
E0626 17:09:24.275551       1 timeout.go:142] post-timeout activity - time-elapsed: 6.34µs, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0626 17:09:26.284428       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0626 17:09:26.285265       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:26.285931       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:26.287031       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:26.287206       1 trace.go:236] Trace[1539796064]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c66207d0-f0cd-4fc1-8409-bef5a6a88fe1,client:10.0.0.207,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:21.284) (total time: 5002ms):
Trace[1539796064]: [5.002430841s] [5.002430841s] END
E0626 17:09:26.287543       1 timeout.go:142] post-timeout activity - time-elapsed: 2.276909ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: <nil>
E0626 17:09:26.697198       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:26.697505       1 trace.go:236] Trace[834322396]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:03721ee4-ffb8-4e48-9767-4979f93377bb,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (26-Jun-2026 17:09:19.693) (total time: 7003ms):
Trace[834322396]: ["GuaranteedUpdate etcd3" audit-id:03721ee4-ffb8-4e48-9767-4979f93377bb,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (17:09:19.694)
Trace[834322396]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:09:26.697)]
Trace[834322396]: [7.003522627s] [7.003522627s] END
E0626 17:09:27.974035       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:09:27.974297       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:27.975477       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:27.975519       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:27.976742       1 trace.go:236] Trace[1327678738]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ad32b7bc-9e49-428d-815f-08681d06e4b7,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:09:24.980) (total time: 2996ms):
Trace[1327678738]: [2.99638598s] [2.99638598s] END
E0626 17:09:27.977039       1 timeout.go:142] post-timeout activity - time-elapsed: 2.955282ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0626 17:09:29.036481       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:09:29.036816       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:29.037880       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:29.037933       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:29.039371       1 trace.go:236] Trace[1960107723]: "Get" accept:application/json, */*,audit-id:7c211da4-a32f-4bb6-9328-77ccbc567f2a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:09:19.034) (total time: 10005ms):
Trace[1960107723]: [10.005018083s] [10.005018083s] END
E0626 17:09:29.039794       1 timeout.go:142] post-timeout activity - time-elapsed: 3.288127ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: <nil>
E0626 17:09:29.052612       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:09:29.052892       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:29.053798       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:29.054425       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:29.055063       1 trace.go:236] Trace[1009903783]: "Get" accept:application/json, */*,audit-id:7cd4d563-725d-4776-bda0-f629b73b22a4,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:09:19.052) (total time: 10002ms):
Trace[1009903783]: [10.002894241s] [10.002894241s] END
E0626 17:09:29.055170       1 timeout.go:142] post-timeout activity - time-elapsed: 2.459253ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: <nil>
E0626 17:09:31.622908       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:09:31.623128       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:31.624988       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:31.625053       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:31.626173       1 trace.go:236] Trace[1444758590]: "Get" accept:application/json, */*,audit-id:e206439d-6241-48ed-9551-a46a7c68296c,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:26.622) (total time: 5003ms):
Trace[1444758590]: [5.003832587s] [5.003832587s] END
E0626 17:09:31.626365       1 timeout.go:142] post-timeout activity - time-elapsed: 3.699823ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0626 17:09:31.986454       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:31.986908       1 trace.go:236] Trace[364212903]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d2dd7b9f-508e-4989-9bd8-45432bcd4a52,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:09:24.982) (total time: 7003ms):
Trace[364212903]: ["GuaranteedUpdate etcd3" audit-id:d2dd7b9f-508e-4989-9bd8-45432bcd4a52,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (17:09:24.983)
Trace[364212903]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:09:31.986)]
Trace[364212903]: [7.003855559s] [7.003855559s] END
E0626 17:09:32.125381       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:32.125572       1 trace.go:236] Trace[1518375013]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:65787fd6-c254-4cb0-b687-921444665246,client:199.204.45.156,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/prometheus-kube-prometheus-stack-prometheus-db-prometheus-kube-prometheus-stack-prometheus-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 17:09:24.206) (total time: 7919ms):
Trace[1518375013]: [7.919021399s] [7.919021399s] END
E0626 17:09:32.126955       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0626 17:09:32.127217       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:32.127285       1 trace.go:236] Trace[612995803]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ef0a9960-2629-4b48-b359-85de0abc8f72,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/pods/envoy-gateway-78446f96c9-hv9bs,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 17:09:18.871) (total time: 13255ms):
Trace[612995803]: [13.255706145s] [13.255706145s] END
E0626 17:09:32.127636       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0626 17:09:32.127959       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0626 17:09:32.128111       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:32.128326       1 trace.go:236] Trace[249468102]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1fdb38b8-238e-47c1-b11b-ecfb6cec3419,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events/envoy-gateway-78446f96c9-hv9bs.18bcb09c87a73bdf,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 17:09:18.871) (total time: 13257ms):
Trace[249468102]: ["GuaranteedUpdate etcd3" audit-id:1fdb38b8-238e-47c1-b11b-ecfb6cec3419,key:/events/envoy-gateway-system/envoy-gateway-78446f96c9-hv9bs.18bcb09c87a73bdf,type:*core.Event,resource:events 13256ms (17:09:18.871)]
Trace[249468102]: [13.257000558s] [13.257000558s] END
E0626 17:09:32.128361       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:32.128614       1 trace.go:236] Trace[812908871]: "Get" accept:application/json, */*,audit-id:64799461-8e96-44c3-b2bf-9af8e46aa8cd,client:10.0.0.161,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-fernet-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:09:18.383) (total time: 13744ms):
Trace[812908871]: [13.744638876s] [13.744638876s] END
E0626 17:09:32.128742       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0626 17:09:32.128795       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:32.128803       1 trace.go:236] Trace[658325231]: "Get" accept:application/json, */*,audit-id:5b1ac2dd-85a6-42ea-bc73-1504ba8cd229,client:10.0.0.79,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:19.862) (total time: 12266ms):
Trace[658325231]: [12.266213516s] [12.266213516s] END
I0626 17:09:32.129138       1 trace.go:236] Trace[526928838]: "Get" accept:application/json, */*,audit-id:316c8c9e-0056-42b2-8d97-95e4a7c8895c,client:10.0.0.158,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (26-Jun-2026 17:09:19.588) (total time: 12540ms):
Trace[526928838]: [12.540751164s] [12.540751164s] END
I0626 17:09:32.129365       1 trace.go:236] Trace[185311406]: "Get" accept:application/json, */*,audit-id:2cfb2fd5-f062-4cab-9b10-79053bde7791,client:10.0.0.44,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:19.598) (total time: 12531ms):
Trace[185311406]: [12.531101946s] [12.531101946s] END
I0626 17:09:32.129785       1 trace.go:236] Trace[1700456425]: "Get" accept:application/json, */*,audit-id:20df8bf1-6cf6-480f-9e3f-6b89d8494bea,client:10.0.0.161,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:09:18.383) (total time: 13745ms):
Trace[1700456425]: [13.745866248s] [13.745866248s] END
I0626 17:09:32.130104       1 trace.go:236] Trace[1199759813]: "Get" accept:application/json, */*,audit-id:61e00303-29e6-459c-abe3-b479e0f9475a,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:20.503) (total time: 11626ms):
Trace[1199759813]: [11.626202101s] [11.626202101s] END
E0626 17:09:32.347953       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:32.348197       1 trace.go:236] Trace[814048510]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:940a6dec-af23-4ca0-8231-be6291e35e8d,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:09:25.343) (total time: 7004ms):
Trace[814048510]: ["GuaranteedUpdate etcd3" audit-id:940a6dec-af23-4ca0-8231-be6291e35e8d,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (17:09:25.343)
Trace[814048510]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:09:32.347)]
Trace[814048510]: [7.004494253s] [7.004494253s] END
E0626 17:09:32.349178       1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
E0626 17:09:32.895370       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0626 17:09:32.895608       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:32.896783       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:32.896855       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:32.897922       1 trace.go:236] Trace[153380755]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:de47a171-3e1e-46ec-b7d3-998328bc8d8c,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:09:27.896) (total time: 5001ms):
Trace[153380755]: [5.001801413s] [5.001801413s] END
E0626 17:09:32.898158       1 timeout.go:142] post-timeout activity - time-elapsed: 2.863129ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0626 17:09:32.975080       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:32.975125       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:32.975162       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 10.07µs, panicked: false, err: context deadline exceeded, panic-reason: <nil>
E0626 17:09:32.976332       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:32.976431       1 trace.go:236] Trace[836968476]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f53f1c47-2b2c-4a9c-8de4-f162aedebb4a,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 17:09:27.975) (total time: 5001ms):
Trace[836968476]: ["GuaranteedUpdate etcd3" audit-id:f53f1c47-2b2c-4a9c-8de4-f162aedebb4a,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (17:09:27.975)
Trace[836968476]:  ---"Txn call failed" err:context deadline exceeded 4998ms (17:09:32.974)]
Trace[836968476]: [5.001071433s] [5.001071433s] END
E0626 17:09:32.976673       1 timeout.go:142] post-timeout activity - time-elapsed: 1.686289ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0626 17:09:34.694668       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:09:34.694904       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:34.696446       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:34.696530       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:34.697669       1 trace.go:236] Trace[742346234]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e282ea27-9d85-456d-b331-f5681bc7c12d,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (26-Jun-2026 17:09:26.700) (total time: 7997ms):
Trace[742346234]: [7.997552947s] [7.997552947s] END
E0626 17:09:34.697880       1 timeout.go:142] post-timeout activity - time-elapsed: 3.131425ms, GET "/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader" result: <nil>
E0626 17:09:35.295562       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
I0626 17:09:35.295705       1 trace.go:236] Trace[369691169]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:582db21e-137c-4ef6-9d7d-979ff3d9ccf2,client:10.0.0.207,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:30.295) (total time: 5000ms):
Trace[369691169]: [5.000031586s] [5.000031586s] END
E0626 17:09:35.295850       1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com?timeout=5s" audit-ID="582db21e-137c-4ef6-9d7d-979ff3d9ccf2"
E0626 17:09:35.295896       1 timeout.go:142] post-timeout activity - time-elapsed: 5.56µs, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: <nil>
E0626 17:09:36.041982       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:36.042160       1 trace.go:236] Trace[718493095]: "Update" accept:application/json, */*,audit-id:3504927a-eaa2-411d-ac02-021c6041a3ad,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 17:09:29.038) (total time: 7003ms):
Trace[718493095]: ["GuaranteedUpdate etcd3" audit-id:3504927a-eaa2-411d-ac02-021c6041a3ad,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (17:09:29.038)
Trace[718493095]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:09:36.041)]
Trace[718493095]: [7.003992397s] [7.003992397s] END
E0626 17:09:36.051813       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:36.051954       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:36.051858       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 168.643µs, panicked: false, err: context canceled, panic-reason: <nil>
E0626 17:09:36.053510       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:36.054043       1 trace.go:236] Trace[209753652]: "Update" accept:application/json, */*,audit-id:4d2f7e1e-0745-4117-8eb6-e86b85829e73,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 17:09:29.053) (total time: 7000ms):
Trace[209753652]: ["GuaranteedUpdate etcd3" audit-id:4d2f7e1e-0745-4117-8eb6-e86b85829e73,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7000ms (17:09:29.053)
Trace[209753652]:  ---"Txn call failed" err:context canceled 6997ms (17:09:36.051)]
Trace[209753652]: [7.00019156s] [7.00019156s] END
E0626 17:09:36.054290       1 timeout.go:142] post-timeout activity - time-elapsed: 3.50161ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: <nil>
E0626 17:09:38.964907       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:09:38.965333       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:38.966287       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:38.966508       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:38.967642       1 trace.go:236] Trace[2131319143]: "Get" accept:application/json, */*,audit-id:587034db-967f-487a-b294-c52d689493f0,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:33.965) (total time: 5002ms):
Trace[2131319143]: [5.002283197s] [5.002283197s] END
E0626 17:09:38.967862       1 timeout.go:142] post-timeout activity - time-elapsed: 2.750607ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0626 17:09:38.993721       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:38.994022       1 trace.go:236] Trace[634255587]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ad7361d6-6d70-4a9c-8bba-a787cca6948d,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:09:31.990) (total time: 7003ms):
Trace[634255587]: ["GuaranteedUpdate etcd3" audit-id:ad7361d6-6d70-4a9c-8bba-a787cca6948d,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (17:09:31.990)
Trace[634255587]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (17:09:38.993)]
Trace[634255587]: [7.003291133s] [7.003291133s] END
I0626 17:09:39.126866       1 trace.go:236] Trace[548445633]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.156,type:*v1.Endpoints,resource:apiServerIPInfo (26-Jun-2026 17:09:26.299) (total time: 12827ms):
Trace[548445633]: [12.827443152s] [12.827443152s] END
E0626 17:09:39.126906       1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out
E0626 17:09:39.354573       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:39.354825       1 trace.go:236] Trace[413381705]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7340a3a7-2922-447b-8c35-28309d2d82ac,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:09:32.350) (total time: 7004ms):
Trace[413381705]: ["GuaranteedUpdate etcd3" audit-id:7340a3a7-2922-447b-8c35-28309d2d82ac,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (17:09:32.350)
Trace[413381705]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:09:39.354)]
Trace[413381705]: [7.004364985s] [7.004364985s] END
E0626 17:09:39.355516       1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
E0626 17:09:40.337772       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0626 17:09:40.337907       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:40.339141       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:40.339226       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:40.340282       1 trace.go:236] Trace[386914034]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:02d8c860-4571-48e4-94fa-170cd6b10b38,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:09:35.338) (total time: 5001ms):
Trace[386914034]: [5.001826043s] [5.001826043s] END
E0626 17:09:40.340466       1 timeout.go:142] post-timeout activity - time-elapsed: 2.455912ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0626 17:09:41.700659       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:41.700852       1 trace.go:236] Trace[1059758045]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8cad9bcb-34e1-4717-9727-c0955a31fcc5,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (26-Jun-2026 17:09:34.696) (total time: 7004ms):
Trace[1059758045]: ["GuaranteedUpdate etcd3" audit-id:8cad9bcb-34e1-4717-9727-c0955a31fcc5,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (17:09:34.696)
Trace[1059758045]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:09:41.700)]
Trace[1059758045]: [7.004112551s] [7.004112551s] END
E0626 17:09:42.701524       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0626 17:09:42.701731       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:42.702846       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:42.702931       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:42.704146       1 trace.go:236] Trace[175660220]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4e70787f-a2fe-4a74-82dd-da7a0ceaf04d,client:10.0.0.207,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:37.701) (total time: 5002ms):
Trace[175660220]: [5.0028476s] [5.0028476s] END
E0626 17:09:42.704468       1 timeout.go:142] post-timeout activity - time-elapsed: 2.818438ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: <nil>
E0626 17:09:45.999448       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:45.999761       1 trace.go:236] Trace[1767360082]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:59725dad-6878-4e5e-8609-44c92fa6c19f,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:09:38.996) (total time: 7003ms):
Trace[1767360082]: ["GuaranteedUpdate etcd3" audit-id:59725dad-6878-4e5e-8609-44c92fa6c19f,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (17:09:38.996)
Trace[1767360082]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (17:09:45.999)]
Trace[1767360082]: [7.003101825s] [7.003101825s] END
E0626 17:09:46.127794       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0626 17:09:46.127895       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:46.127992       1 trace.go:236] Trace[872322137]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7c630892-8a1b-4c7e-b6d7-271a58c8feb1,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events/envoy-gateway-78446f96c9-hv9bs.18bcb09c87a73bdf,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 17:09:32.130) (total time: 13997ms):
Trace[872322137]: ["GuaranteedUpdate etcd3" audit-id:7c630892-8a1b-4c7e-b6d7-271a58c8feb1,key:/events/envoy-gateway-system/envoy-gateway-78446f96c9-hv9bs.18bcb09c87a73bdf,type:*core.Event,resource:events 13997ms (17:09:32.130)]
Trace[872322137]: [13.997240308s] [13.997240308s] END
E0626 17:09:46.128155       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0626 17:09:46.129436       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0626 17:09:46.129488       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0626 17:09:46.129535       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0626 17:09:46.129546       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:46.129648       1 trace.go:236] Trace[2030302084]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a31a966c-3871-4e50-8124-d104efcf1436,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 17:09:32.131) (total time: 13998ms):
Trace[2030302084]: [13.998365206s] [13.998365206s] END
I0626 17:09:46.129718       1 trace.go:236] Trace[1094576359]: "Get" accept:application/json, */*,audit-id:4a69cee3-5566-4e04-a986-aa790b80a703,client:10.0.0.161,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:09:34.133) (total time: 11996ms):
Trace[1094576359]: [11.996252893s] [11.996252893s] END
I0626 17:09:46.129896       1 trace.go:236] Trace[1428700528]: "Get" accept:application/json, */*,audit-id:c13ce504-a4c6-46c5-a841-d95c6661e6f8,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:34.793) (total time: 11336ms):
Trace[1428700528]: [11.336437012s] [11.336437012s] END
I0626 17:09:46.130936       1 trace.go:236] Trace[61582567]: "Get" accept:application/json, */*,audit-id:adfe99e3-7b84-405f-84fd-0235d0571862,client:10.0.0.161,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-fernet-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:09:34.133) (total time: 11997ms):
Trace[61582567]: [11.997282151s] [11.997282151s] END
I0626 17:09:46.131020       1 trace.go:236] Trace[801297545]: "Get" accept:application/json, */*,audit-id:f831a191-216d-4075-b184-537c32fe49ec,client:10.0.0.79,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:34.331) (total time: 11799ms):
Trace[801297545]: [11.799103628s] [11.799103628s] END
I0626 17:09:46.131294       1 trace.go:236] Trace[1972508623]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:91f7a984-9c61-48f3-b3e6-e367bae1d309,client:199.204.45.156,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-keystone-server-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 17:09:32.128) (total time: 14003ms):
Trace[1972508623]: [14.003070148s] [14.003070148s] END
E0626 17:09:46.215467       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0626 17:09:46.215575       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:46.216721       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:46.216777       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:46.218029       1 trace.go:236] Trace[1092006231]: "Get" accept:application/json, */*,audit-id:f59d0fa3-e6ad-48b4-990e-a11b1849c811,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:41.215) (total time: 5002ms):
Trace[1092006231]: [5.002159054s] [5.002159054s] END
E0626 17:09:46.218238       1 timeout.go:142] post-timeout activity - time-elapsed: 2.628474ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0626 17:09:46.358895       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:46.359116       1 trace.go:236] Trace[280657577]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8f2dcf62-8ed7-4c40-b4b9-27cbdf6d28f7,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:09:39.356) (total time: 7002ms):
Trace[280657577]: ["GuaranteedUpdate etcd3" audit-id:8f2dcf62-8ed7-4c40-b4b9-27cbdf6d28f7,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (17:09:39.356)
Trace[280657577]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (17:09:46.358)]
Trace[280657577]: [7.002608091s] [7.002608091s] END
E0626 17:09:46.359848       1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
E0626 17:09:48.190813       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:48.191256       1 trace.go:236] Trace[1381125425]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:09f48e7e-966b-4eec-a1b4-f5e2335696d9,client:199.204.45.156,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 17:09:41.179) (total time: 7011ms):
Trace[1381125425]: ["GuaranteedUpdate etcd3" audit-id:09f48e7e-966b-4eec-a1b4-f5e2335696d9,key:/minions/instance,type:*core.Node,resource:nodes 7010ms (17:09:41.180)
Trace[1381125425]:  ---"Txn call failed" err:etcdserver: request timed out 7004ms (17:09:48.190)]
Trace[1381125425]: [7.011409626s] [7.011409626s] END
E0626 17:09:49.133025       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0626 17:09:49.133147       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:49.134381       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:49.134488       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:49.135568       1 trace.go:236] Trace[875296869]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9d176b08-7074-4551-94e7-287a19f8b05f,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:09:44.133) (total time: 5001ms):
Trace[875296869]: [5.001985576s] [5.001985576s] END
E0626 17:09:49.135759       1 timeout.go:142] post-timeout activity - time-elapsed: 2.668384ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0626 17:09:50.879064       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:09:50.879162       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:50.880174       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:50.880237       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:50.881416       1 trace.go:236] Trace[680581467]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6b6861c0-c434-48b6-ac26-3903c95bad90,client:10.0.0.207,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:45.880) (total time: 5001ms):
Trace[680581467]: [5.001066558s] [5.001066558s] END
E0626 17:09:50.881600       1 timeout.go:142] post-timeout activity - time-elapsed: 2.536613ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: <nil>
E0626 17:09:53.006891       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:53.007301       1 trace.go:236] Trace[271543416]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:530e0b7e-1295-4b50-8b26-098c7c732f81,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:09:46.002) (total time: 7004ms):
Trace[271543416]: ["GuaranteedUpdate etcd3" audit-id:530e0b7e-1295-4b50-8b26-098c7c732f81,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (17:09:46.002)
Trace[271543416]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:09:53.006)]
Trace[271543416]: [7.004779782s] [7.004779782s] END
E0626 17:09:53.129371       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:53.129565       1 trace.go:236] Trace[650218504]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d926b71b-3eda-4a21-bdcf-84efe544cb83,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (26-Jun-2026 17:09:41.704) (total time: 11425ms):
Trace[650218504]: [11.425008765s] [11.425008765s] END
I0626 17:09:53.130196       1 trace.go:236] Trace[482835931]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.156,type:*v1.Endpoints,resource:apiServerIPInfo (26-Jun-2026 17:09:39.126) (total time: 14003ms):
Trace[482835931]: [14.003197036s] [14.003197036s] END
E0626 17:09:53.130277       1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out
E0626 17:09:53.364919       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:09:53.365185       1 trace.go:236] Trace[1477499947]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9f1fbbb7-d0d6-4d2b-aab8-5924ebb93a73,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:09:46.360) (total time: 7004ms):
Trace[1477499947]: ["GuaranteedUpdate etcd3" audit-id:9f1fbbb7-d0d6-4d2b-aab8-5924ebb93a73,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (17:09:46.361)
Trace[1477499947]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:09:53.364)]
Trace[1477499947]: [7.004121941s] [7.004121941s] END
E0626 17:09:53.365851       1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
E0626 17:09:54.301444       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:09:54.301588       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:54.302684       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:54.302771       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:54.303937       1 trace.go:236] Trace[975739206]: "Get" accept:application/json, */*,audit-id:d40ab8de-2387-4981-b3ee-54542778fa5d,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:49.301) (total time: 5001ms):
Trace[975739206]: [5.001937222s] [5.001937222s] END
E0626 17:09:54.304112       1 timeout.go:142] post-timeout activity - time-elapsed: 2.627925ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0626 17:09:58.193445       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:09:58.193589       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:58.194541       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:58.195240       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:58.196479       1 trace.go:236] Trace[1645183881]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fff69e3e-cf20-4850-a4dd-c6ef7b13b3d4,client:199.204.45.156,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 17:09:48.193) (total time: 10002ms):
Trace[1645183881]: [10.002714127s] [10.002714127s] END
E0626 17:09:58.196633       1 timeout.go:142] post-timeout activity - time-elapsed: 3.195973ms, GET "/api/v1/nodes/instance" result: <nil>
E0626 17:09:58.349048       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0626 17:09:58.349193       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:58.350413       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:58.350505       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:58.351625       1 trace.go:236] Trace[1119569244]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4e970908-8454-4da1-923f-c17c0c5fefc0,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 17:09:53.349) (total time: 5001ms):
Trace[1119569244]: [5.0018008s] [5.0018008s] END
E0626 17:09:58.351919       1 timeout.go:142] post-timeout activity - time-elapsed: 2.684095ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0626 17:09:59.525918       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0626 17:09:59.526101       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:59.527996       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:59.528057       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:59.529162       1 trace.go:236] Trace[978009828]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:82cab7d1-5fc2-4a23-bf8d-7be208d3dd48,client:10.0.0.207,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:54.526) (total time: 5002ms):
Trace[978009828]: [5.002925907s] [5.002925907s] END
E0626 17:09:59.529518       1 timeout.go:142] post-timeout activity - time-elapsed: 3.458659ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: <nil>
E0626 17:09:59.587618       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:09:59.587799       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:59.589275       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:59.589360       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:59.590509       1 trace.go:236] Trace[497350874]: "Get" accept:application/json, */*,audit-id:04cd7b08-28a1-4b1f-8cc4-c91296d4f017,client:10.0.0.158,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (26-Jun-2026 17:09:47.132) (total time: 12457ms):
Trace[497350874]: [12.457491777s] [12.457491777s] END
E0626 17:09:59.590718       1 timeout.go:142] post-timeout activity - time-elapsed: 3.010841ms, GET "/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller" result: <nil>
E0626 17:09:59.597996       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 17:09:59.598085       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 17:09:59.599137       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 17:09:59.599197       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 17:09:59.600219       1 trace.go:236] Trace[1892001471]: "Get" accept:application/json, */*,audit-id:144e35d8-8ca7-49ee-91eb-ec1e0066d150,client:10.0.0.44,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:47.132) (total time: 12467ms):
Trace[1892001471]: [12.467648249s] [12.467648249s] END
E0626 17:09:59.600344       1 timeout.go:142] post-timeout activity - time-elapsed: 2.307429ms, GET "/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election" result: <nil>
E0626 17:10:00.012904       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:10:00.013126       1 trace.go:236] Trace[1464141638]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:454e7375-1703-481a-a4b3-2c8bde13ea81,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:09:53.009) (total time: 7003ms):
Trace[1464141638]: ["GuaranteedUpdate etcd3" audit-id:454e7375-1703-481a-a4b3-2c8bde13ea81,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (17:09:53.009)
Trace[1464141638]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (17:10:00.012)]
Trace[1464141638]: [7.003345016s] [7.003345016s] END
E0626 17:10:00.132580       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0626 17:10:00.132580       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0626 17:10:00.132833       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0626 17:10:00.132895       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0626 17:10:00.132958       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0626 17:10:00.133184       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:10:00.133325       1 trace.go:236] Trace[412631362]: "Get" accept:application/json, */*,audit-id:db747a30-e05c-4c62-b802-92afd6aaa8ce,client:10.0.0.161,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:09:48.132) (total time: 11999ms):
Trace[412631362]: [11.999950821s] [11.999950821s] END
E0626 17:10:00.133385       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:10:00.133889       1 trace.go:236] Trace[110891763]: "Get" accept:application/json, */*,audit-id:6bfae695-9fac-4815-b51d-cd0f04e016ed,client:10.0.0.161,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-fernet-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 17:09:48.134) (total time: 11999ms):
Trace[110891763]: [11.999805927s] [11.999805927s] END
I0626 17:10:00.133929       1 trace.go:236] Trace[452435984]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f99985d5-43dd-4df7-8b99-29ed8ca76980,client:199.204.45.156,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/datadir-percona-xtradb-pxc-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 17:09:46.235) (total time: 13898ms):
Trace[452435984]: [13.898398246s] [13.898398246s] END
I0626 17:10:00.134189       1 trace.go:236] Trace[410621768]: "Get" accept:application/json, */*,audit-id:19e10bc6-f714-4bb6-b53c-3127d7ab486d,client:10.0.0.79,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:50.354) (total time: 9779ms):
Trace[410621768]: [9.779522169s] [9.779522169s] END
I0626 17:10:00.134320       1 trace.go:236] Trace[1964240866]: "Get" accept:application/json, */*,audit-id:f9b72e75-231a-4f42-879e-1c8ff5dab1cd,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:50.487) (total time: 9646ms):
Trace[1964240866]: [9.64674862s] [9.64674862s] END
I0626 17:10:00.134348       1 trace.go:236] Trace[1288757300]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3d5aa791-3b01-4931-9e69-321fbb4502cb,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/pods/envoy-gateway-78446f96c9-hv9bs,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 17:09:46.131) (total time: 14002ms):
Trace[1288757300]: [14.002633409s] [14.002633409s] END
I0626 17:10:00.134748       1 trace.go:236] Trace[510341474]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bb8044d9-2fca-4871-a8cc-fbec76954670,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bcb09a24d947e5,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 17:09:46.130) (total time: 14003ms):
Trace[510341474]: ["GuaranteedUpdate etcd3" audit-id:bb8044d9-2fca-4871-a8cc-fbec76954670,key:/events/kube-system/kube-apiserver-instance.18bcb09a24d947e5,type:*core.Event,resource:events 14003ms (17:09:46.131)]
Trace[510341474]: [14.003757688s] [14.003757688s] END
E0626 17:10:00.370718       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 17:10:00.371045       1 trace.go:236] Trace[176562638]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:356db8de-6784-41af-ad51-2c8de2b1c62e,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 17:09:53.366) (total time: 7004ms):
Trace[176562638]: ["GuaranteedUpdate etcd3" audit-id:356db8de-6784-41af-ad51-2c8de2b1c62e,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (17:09:53.367)
Trace[176562638]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (17:10:00.370)]
Trace[176562638]: [7.004015889s] [7.004015889s] END
E0626 17:10:00.371974       1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
I0626 17:10:00.372040       1 controller.go:116] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease"
I0626 17:10:00.909993       1 trace.go:236] Trace[739558217]: "Update" accept:application/json, */*,audit-id:d9135553-b6be-470d-a2dc-65cba033abd3,client:10.0.0.44,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 17:09:59.599) (total time: 1310ms):
Trace[739558217]: ["GuaranteedUpdate etcd3" audit-id:d9135553-b6be-470d-a2dc-65cba033abd3,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1309ms (17:09:59.600)
Trace[739558217]:  ---"Txn call completed" 1308ms (17:10:00.909)]
Trace[739558217]: [1.310033265s] [1.310033265s] END
I0626 17:10:00.911394       1 trace.go:236] Trace[747651694]: "Update" accept:application/json, */*,audit-id:5f825bc9-2def-4684-ae56-9e7110530b37,client:10.0.0.158,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:PUT (26-Jun-2026 17:09:59.589) (total time: 1322ms):
Trace[747651694]: ["GuaranteedUpdate etcd3" audit-id:5f825bc9-2def-4684-ae56-9e7110530b37,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 1321ms (17:09:59.589)
Trace[747651694]:  ---"Txn call completed" 1320ms (17:10:00.911)]
Trace[747651694]: [1.322218299s] [1.322218299s] END
I0626 17:10:00.911466       1 trace.go:236] Trace[195773306]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:83acf3e8-5323-49da-8982-ef8b4c4a9ff1,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 17:10:00.015) (total time: 896ms):
Trace[195773306]: ---"About to write a response" 896ms (17:10:00.911)
Trace[195773306]: [896.193672ms] [896.193672ms] END
I0626 17:10:00.913628       1 trace.go:236] Trace[1878822086]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6816c65f-e491-4d59-a0b9-d8ebe2cde8b3,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 17:10:00.372) (total time: 540ms):
Trace[1878822086]: ---"About to write a response" 540ms (17:10:00.913)
Trace[1878822086]: [540.661665ms] [540.661665ms] END
I0626 17:10:00.913956       1 trace.go:236] Trace[1280951707]: "Get" accept:application/json, */*,audit-id:24088561-27fb-40f5-93df-c1e510e62d06,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 17:09:58.292) (total time: 2621ms):
Trace[1280951707]: ---"About to write a response" 2621ms (17:10:00.913)
Trace[1280951707]: [2.621243043s] [2.621243043s] END
I0626 17:10:00.914967       1 trace.go:236] Trace[1451986279]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d497685a-10a3-476a-96eb-60f5adc92c93,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-scheduler-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 17:10:00.136) (total time: 778ms):
Trace[1451986279]: ---"About to write a response" 777ms (17:10:00.914)
Trace[1451986279]: [778.167822ms] [778.167822ms] END
I0626 17:10:00.917002       1 trace.go:236] Trace[1186565072]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4e5a76f8-d329-4940-a2b6-73769a8b1525,client:199.204.45.156,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 17:09:58.194) (total time: 2722ms):
Trace[1186565072]: ---"About to write a response" 2719ms (17:10:00.913)
Trace[1186565072]: [2.722923522s] [2.722923522s] END
I0626 17:10:00.925178       1 trace.go:236] Trace[216667147]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.156,type:*v1.Endpoints,resource:apiServerIPInfo (26-Jun-2026 17:09:53.131) (total time: 7793ms):
Trace[216667147]: ---"initial value restored" 7782ms (17:10:00.914)
Trace[216667147]: [7.793584196s] [7.793584196s] END
I0626 17:10:00.926809       1 trace.go:236] Trace[606834547]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ab74ea9e-f331-4e48-a12f-1c0d5cc12745,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bcb09a24d947e5,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 17:10:00.140) (total time: 786ms):
Trace[606834547]: ["GuaranteedUpdate etcd3" audit-id:ab74ea9e-f331-4e48-a12f-1c0d5cc12745,key:/events/kube-system/kube-apiserver-instance.18bcb09a24d947e5,type:*core.Event,resource:events 786ms (17:10:00.140)
Trace[606834547]:  ---"initial value restored" 773ms (17:10:00.914)]
Trace[606834547]: [786.40033ms] [786.40033ms] END
I0626 17:12:21.335671       1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon-int" clusterIPs={"IPv4":"10.101.123.169"}
I0626 17:12:21.346454       1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon" clusterIPs={"IPv4":"10.99.230.45"}