I0723 04:48:56.638217       1 options.go:220] external host was not specified, using 199.204.45.138
I0723 04:48:56.638922       1 server.go:148] Version: v1.28.13
I0723 04:48:56.638959       1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0723 04:48:56.922762       1 shared_informer.go:311] Waiting for caches to sync for node_authorizer
I0723 04:48:56.931521       1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
I0723 04:48:56.931534       1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.
I0723 04:48:56.931766       1 instance.go:298] Using reconciler: lease
I0723 04:48:57.254280       1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager
W0723 04:48:57.254355       1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.
I0723 04:48:57.497846       1 handler.go:275] Adding GroupVersion  v1 to ResourceManager
I0723 04:48:57.498062       1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping.
I0723 04:48:57.949369       1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping.
I0723 04:48:57.958267       1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager
W0723 04:48:57.958322       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources.
W0723 04:48:57.958329       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources.
I0723 04:48:57.958698       1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager
W0723 04:48:57.958711       1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources.
I0723 04:48:57.959350       1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager
I0723 04:48:57.959962       1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager
W0723 04:48:57.959973       1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources.
W0723 04:48:57.959980       1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources.
I0723 04:48:57.961327       1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager
W0723 04:48:57.961340       1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources.
I0723 04:48:57.961961       1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager
W0723 04:48:57.961972       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources.
W0723 04:48:57.961976       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources.
I0723 04:48:57.962365       1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager
W0723 04:48:57.962376       1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources.
W0723 04:48:57.962403       1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources.
I0723 04:48:57.962807       1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager
I0723 04:48:57.963984       1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager
W0723 04:48:57.963994       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources.
W0723 04:48:57.963998       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources.
I0723 04:48:57.964324       1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager
W0723 04:48:57.964336       1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources.
W0723 04:48:57.964340       1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources.
I0723 04:48:57.964899       1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager
W0723 04:48:57.964912       1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources.
I0723 04:48:57.966307       1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager
W0723 04:48:57.966319       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.
W0723 04:48:57.966328       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
I0723 04:48:57.966649       1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager
W0723 04:48:57.966664       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.
W0723 04:48:57.966667       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
I0723 04:48:57.968154       1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager
W0723 04:48:57.968166       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources.
W0723 04:48:57.968170       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
I0723 04:48:57.969035       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager
I0723 04:48:57.970339       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager
W0723 04:48:57.970352       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources.
W0723 04:48:57.970355       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.
I0723 04:48:57.977290       1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager
W0723 04:48:57.977308       1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources.
W0723 04:48:57.977314       1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources.
I0723 04:48:57.979492       1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager
W0723 04:48:57.979505       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.
W0723 04:48:57.979510       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources.
I0723 04:48:57.980949       1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager
W0723 04:48:57.980963       1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources.
I0723 04:48:58.015399       1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager
W0723 04:48:58.015424       1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.
I0723 04:48:58.402655       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0723 04:48:58.402717       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0723 04:48:58.402995       1 secure_serving.go:213] Serving securely on [::]:6443
I0723 04:48:58.403025       1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key"
I0723 04:48:58.403078       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0723 04:48:58.403146       1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key"
I0723 04:48:58.403210       1 handler_discovery.go:412] Starting ResourceDiscoveryManager
I0723 04:48:58.403302       1 apf_controller.go:374] Starting API Priority and Fairness config controller
I0723 04:48:58.403373       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0723 04:48:58.403568       1 available_controller.go:423] Starting AvailableConditionController
I0723 04:48:58.403603       1 system_namespaces_controller.go:67] Starting system namespaces controller
I0723 04:48:58.403611       1 controller.go:116] Starting legacy_token_tracking_controller
I0723 04:48:58.403629       1 shared_informer.go:311] Waiting for caches to sync for configmaps
I0723 04:48:58.403607       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
I0723 04:48:58.403374       1 aggregator.go:164] waiting for initial CRD sync...
I0723 04:48:58.403982       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0723 04:48:58.404028       1 apiservice_controller.go:97] Starting APIServiceRegistrationController
I0723 04:48:58.404044       1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
I0723 04:48:58.404316       1 customresource_discovery_controller.go:289] Starting DiscoveryController
I0723 04:48:58.404376       1 controller.go:80] Starting OpenAPI V3 AggregationController
I0723 04:48:58.404423       1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0723 04:48:58.404444       1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister
I0723 04:48:58.404578       1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
I0723 04:48:58.404596       1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller
I0723 04:48:58.403638       1 controller.go:78] Starting OpenAPI AggregationController
I0723 04:48:58.405142       1 controller.go:134] Starting OpenAPI controller
I0723 04:48:58.405226       1 controller.go:85] Starting OpenAPI V3 controller
I0723 04:48:58.405264       1 naming_controller.go:291] Starting NamingConditionController
I0723 04:48:58.405316       1 establishing_controller.go:76] Starting EstablishingController
I0723 04:48:58.405341       1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0723 04:48:58.405364       1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0723 04:48:58.405384       1 crd_finalizer.go:266] Starting CRDFinalizer
I0723 04:48:58.405438       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0723 04:48:58.405554       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
E0723 04:48:58.484195       1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms"
I0723 04:48:58.503574       1 apf_controller.go:379] Running API Priority and Fairness config worker
I0723 04:48:58.503599       1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process
I0723 04:48:58.503716       1 cache.go:39] Caches are synced for AvailableConditionController controller
I0723 04:48:58.503835       1 shared_informer.go:318] Caches are synced for configmaps
I0723 04:48:58.504116       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0723 04:48:58.504555       1 shared_informer.go:318] Caches are synced for crd-autoregister
I0723 04:48:58.504591       1 aggregator.go:166] initial CRD sync complete...
I0723 04:48:58.504600       1 autoregister_controller.go:141] Starting autoregister controller
I0723 04:48:58.504607       1 cache.go:32] Waiting for caches to sync for autoregister controller
I0723 04:48:58.504613       1 cache.go:39] Caches are synced for autoregister controller
I0723 04:48:58.504991       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0723 04:48:58.505772       1 controller.go:624] quota admission added evaluator for: namespaces
I0723 04:48:58.522846       1 shared_informer.go:318] Caches are synced for node_authorizer
I0723 04:48:58.691456       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0723 04:48:59.412046       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I0723 04:48:59.416590       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I0723 04:48:59.416605       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0723 04:48:59.965279       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0723 04:49:00.007330       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0723 04:49:00.116317       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W0723 04:49:00.123544       1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.138]
I0723 04:49:00.124609       1 controller.go:624] quota admission added evaluator for: endpoints
I0723 04:49:00.129182       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0723 04:49:01.695589       1 controller.go:624] quota admission added evaluator for: serviceaccounts
I0723 04:49:01.702760       1 controller.go:624] quota admission added evaluator for: deployments.apps
I0723 04:49:01.816692       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I0723 04:49:02.019946       1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I0723 04:49:06.789027       1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps
I0723 04:49:06.892145       1 controller.go:624] quota admission added evaluator for: replicasets.apps
I0723 04:49:33.822437       1 trace.go:236] Trace[450827426]: "Create" accept:application/json,audit-id:0df5604c-ac03-443b-b734-b20206713392,client:199.204.45.138,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (23-Jul-2026 04:49:33.204) (total time: 618ms):
Trace[450827426]: ["Create etcd3" audit-id:0df5604c-ac03-443b-b734-b20206713392,key:/apiextensions.k8s.io/customresourcedefinitions/referencegrants.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 615ms (04:49:33.207)
Trace[450827426]:  ---"Txn call succeeded" 610ms (04:49:33.817)]
Trace[450827426]: [618.185364ms] [618.185364ms] END
I0723 04:49:33.828073       1 trace.go:236] Trace[1697420138]: "Create" accept:application/json,audit-id:1d01fcc3-5ebe-45f3-b2c4-2cf216b5e0d3,client:199.204.45.138,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (23-Jul-2026 04:49:33.210) (total time: 617ms):
Trace[1697420138]: ["Create etcd3" audit-id:1d01fcc3-5ebe-45f3-b2c4-2cf216b5e0d3,key:/apiextensions.k8s.io/customresourcedefinitions/udproutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 598ms (04:49:33.230)
Trace[1697420138]:  ---"Txn call succeeded" 595ms (04:49:33.825)]
Trace[1697420138]: [617.053597ms] [617.053597ms] END
I0723 04:49:33.828175       1 trace.go:236] Trace[1547541678]: "Create" accept:application/json,audit-id:521b2a7c-b605-420d-8bd1-cc7ec329b8d0,client:199.204.45.138,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (23-Jul-2026 04:49:33.208) (total time: 619ms):
Trace[1547541678]: ["Create etcd3" audit-id:521b2a7c-b605-420d-8bd1-cc7ec329b8d0,key:/apiextensions.k8s.io/customresourcedefinitions/backendtlspolicies.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 594ms (04:49:33.233)
Trace[1547541678]:  ---"Txn call succeeded" 591ms (04:49:33.825)]
Trace[1547541678]: [619.623062ms] [619.623062ms] END
I0723 04:49:33.829048       1 trace.go:236] Trace[1196779566]: "Create" accept:application/json,audit-id:5acadccb-a529-4ab9-84d9-673beb8476a0,client:199.204.45.138,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (23-Jul-2026 04:49:33.207) (total time: 621ms):
Trace[1196779566]: ["Create etcd3" audit-id:5acadccb-a529-4ab9-84d9-673beb8476a0,key:/apiextensions.k8s.io/customresourcedefinitions/gatewayclasses.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 616ms (04:49:33.212)
Trace[1196779566]:  ---"Txn call succeeded" 614ms (04:49:33.827)]
Trace[1196779566]: [621.561477ms] [621.561477ms] END
I0723 04:49:33.829237       1 trace.go:236] Trace[666320228]: "Create" accept:application/json,audit-id:70c3f5ec-d896-4873-b77d-9ac5da371cf8,client:199.204.45.138,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (23-Jul-2026 04:49:33.203) (total time: 626ms):
Trace[666320228]: ["Create etcd3" audit-id:70c3f5ec-d896-4873-b77d-9ac5da371cf8,key:/apiextensions.k8s.io/customresourcedefinitions/xmeshes.gateway.networking.x-k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 618ms (04:49:33.211)
Trace[666320228]:  ---"Txn call succeeded" 616ms (04:49:33.827)]
Trace[666320228]: [626.1835ms] [626.1835ms] END
I0723 04:49:33.831119       1 trace.go:236] Trace[1509764388]: "Create" accept:application/json,audit-id:d6f5b087-37dc-4137-8cef-7e1ab03e8984,client:199.204.45.138,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (23-Jul-2026 04:49:33.204) (total time: 626ms):
Trace[1509764388]: ["Create etcd3" audit-id:d6f5b087-37dc-4137-8cef-7e1ab03e8984,key:/apiextensions.k8s.io/customresourcedefinitions/tcproutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 611ms (04:49:33.219)
Trace[1509764388]:  ---"Txn call succeeded" 608ms (04:49:33.828)]
Trace[1509764388]: [626.725328ms] [626.725328ms] END
I0723 04:49:33.832352       1 trace.go:236] Trace[285299757]: "Create" accept:application/json,audit-id:18c7fb88-7386-4d63-aa26-4bd644f45f13,client:199.204.45.138,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (23-Jul-2026 04:49:33.210) (total time: 621ms):
Trace[285299757]: ["Create etcd3" audit-id:18c7fb88-7386-4d63-aa26-4bd644f45f13,key:/apiextensions.k8s.io/customresourcedefinitions/xlistenersets.gateway.networking.x-k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 600ms (04:49:33.232)
Trace[285299757]:  ---"Txn call succeeded" 593ms (04:49:33.826)]
Trace[285299757]: [621.66483ms] [621.66483ms] END
I0723 04:49:33.833917       1 trace.go:236] Trace[2032458279]: "Create" accept:application/json,audit-id:0342b9ef-198e-47bd-b968-d53438ce11d6,client:199.204.45.138,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (23-Jul-2026 04:49:33.210) (total time: 623ms):
Trace[2032458279]: ["Create etcd3" audit-id:0342b9ef-198e-47bd-b968-d53438ce11d6,key:/apiextensions.k8s.io/customresourcedefinitions/xbackendtrafficpolicies.gateway.networking.x-k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 611ms (04:49:33.222)
Trace[2032458279]:  ---"Txn call succeeded" 608ms (04:49:33.831)]
Trace[2032458279]: [623.052366ms] [623.052366ms] END
I0723 04:49:33.833919       1 trace.go:236] Trace[270268253]: "Create" accept:application/json,audit-id:1dbd4d76-db7a-484e-8e74-737785ff0118,client:199.204.45.138,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (23-Jul-2026 04:49:33.210) (total time: 622ms):
Trace[270268253]: ["Create etcd3" audit-id:1dbd4d76-db7a-484e-8e74-737785ff0118,key:/apiextensions.k8s.io/customresourcedefinitions/gateways.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 574ms (04:49:33.259)
Trace[270268253]:  ---"Txn call succeeded" 566ms (04:49:33.826)]
Trace[270268253]: [622.898191ms] [622.898191ms] END
I0723 04:49:33.835564       1 trace.go:236] Trace[1534073425]: "Create" accept:application/json,audit-id:f81750ef-ee27-4526-b91c-f1cbdf8c028a,client:199.204.45.138,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (23-Jul-2026 04:49:33.210) (total time: 624ms):
Trace[1534073425]: ["Create etcd3" audit-id:f81750ef-ee27-4526-b91c-f1cbdf8c028a,key:/apiextensions.k8s.io/customresourcedefinitions/tlsroutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 593ms (04:49:33.242)
Trace[1534073425]:  ---"Txn call succeeded" 582ms (04:49:33.826)]
Trace[1534073425]: [624.944529ms] [624.944529ms] END
I0723 04:49:33.837423       1 trace.go:236] Trace[1042885693]: "Create" accept:application/json,audit-id:e9159d78-3be3-4e35-8b5a-6fddeb9cf180,client:199.204.45.138,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (23-Jul-2026 04:49:33.211) (total time: 625ms):
Trace[1042885693]: ["Create etcd3" audit-id:e9159d78-3be3-4e35-8b5a-6fddeb9cf180,key:/apiextensions.k8s.io/customresourcedefinitions/grpcroutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 563ms (04:49:33.273)
Trace[1042885693]:  ---"Txn call succeeded" 552ms (04:49:33.828)]
Trace[1042885693]: [625.769046ms] [625.769046ms] END
I0723 04:49:33.895498       1 trace.go:236] Trace[1469372168]: "Create" accept:application/json,audit-id:c566f976-5557-4b36-93b0-b4b8d497581a,client:199.204.45.138,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (23-Jul-2026 04:49:33.211) (total time: 683ms):
Trace[1469372168]: ---"Conversion done" 22ms (04:49:33.239)
Trace[1469372168]: ---"Writing http response done" 39ms (04:49:33.895)
Trace[1469372168]: [683.564285ms] [683.564285ms] END
I0723 04:49:33.941486       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0723 04:49:33.957822       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0723 04:49:33.966703       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0723 04:49:33.991569       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0723 04:49:34.019018       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0723 04:49:34.019071       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0723 04:49:34.052005       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0723 04:49:34.079308       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0723 04:49:34.079342       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0723 04:49:34.115994       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0723 04:49:34.116031       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0723 04:49:34.144821       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0723 04:49:34.301022       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0723 04:49:34.301284       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0723 04:49:34.326369       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0723 04:49:34.326447       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0723 04:49:34.345485       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0723 04:49:34.361624       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0723 04:49:34.393831       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0723 04:49:34.420189       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0723 04:49:34.479832       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0723 04:49:34.516075       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0723 04:49:35.083292       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0723 04:49:35.095027       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0723 04:49:35.176436       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0723 04:49:40.696571       1 trace.go:236] Trace[88271586]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f53de493-f960-4aba-95c0-de55ea7f0ca0,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (23-Jul-2026 04:49:39.827) (total time: 868ms):
Trace[88271586]: ["GuaranteedUpdate etcd3" audit-id:f53de493-f960-4aba-95c0-de55ea7f0ca0,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 868ms (04:49:39.827)
Trace[88271586]:  ---"Txn call completed" 868ms (04:49:40.696)]
Trace[88271586]: [868.924188ms] [868.924188ms] END
I0723 04:49:40.696582       1 trace.go:236] Trace[1030719744]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:05066106-ac5a-4d3c-b53c-d3eae14ad58c,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-p42zv,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 04:49:39.894) (total time: 801ms):
Trace[1030719744]: ---"About to write a response" 801ms (04:49:40.696)
Trace[1030719744]: [801.648125ms] [801.648125ms] END
I0723 04:49:42.263595       1 trace.go:236] Trace[34675895]: "Create" accept:application/json,audit-id:cc753ab3-db88-4f7c-b280-13a9c835f76c,client:199.204.45.138,protocol:HTTP/2.0,resource:mutatingwebhookconfigurations,scope:resource,url:/apis/admissionregistration.k8s.io/v1/mutatingwebhookconfigurations,user-agent:Helm/3.11.2,verb:POST (23-Jul-2026 04:49:40.216) (total time: 2047ms):
Trace[34675895]: ["Create etcd3" audit-id:cc753ab3-db88-4f7c-b280-13a9c835f76c,key:/mutatingwebhookconfigurations/envoy-gateway-topology-injector.envoy-gateway-system,type:*admissionregistration.MutatingWebhookConfiguration,resource:mutatingwebhookconfigurations.admissionregistration.k8s.io 2045ms (04:49:40.218)
Trace[34675895]:  ---"Txn call succeeded" 2044ms (04:49:42.262)]
Trace[34675895]: [2.047147421s] [2.047147421s] END
I0723 04:49:42.263641       1 trace.go:236] Trace[657214827]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:04f958ce-3999-4b8c-b795-3e875097ad7f,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 04:49:40.697) (total time: 1566ms):
Trace[657214827]: ---"About to write a response" 1566ms (04:49:42.263)
Trace[657214827]: [1.566334234s] [1.566334234s] END
I0723 04:49:42.263916       1 trace.go:236] Trace[2049672937]: "Get" accept:application/json, */*,audit-id:5dc05a2a-c16f-41dd-868a-6cc38a0d1f67,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 04:49:40.792) (total time: 1471ms):
Trace[2049672937]: ---"About to write a response" 1471ms (04:49:42.263)
Trace[2049672937]: [1.471866704s] [1.471866704s] END
I0723 04:49:42.264137       1 trace.go:236] Trace[799577962]: "Get" accept:application/json, */*,audit-id:de67e8af-5094-47d6-a94b-bf4b8eea6047,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 04:49:40.848) (total time: 1415ms):
Trace[799577962]: ---"About to write a response" 1414ms (04:49:42.263)
Trace[799577962]: [1.415138741s] [1.415138741s] END
I0723 04:49:42.264840       1 trace.go:236] Trace[629025834]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:55adb261-0999-4d09-835e-3d29ab007704,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 04:49:40.989) (total time: 1275ms):
Trace[629025834]: ---"About to write a response" 1274ms (04:49:42.264)
Trace[629025834]: [1.275019119s] [1.275019119s] END
I0723 04:49:42.266104       1 trace.go:236] Trace[1348485668]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b80b12a2-a615-45fc-a37d-a59f00e8abe9,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-p42zv/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (23-Jul-2026 04:49:40.698) (total time: 1567ms):
Trace[1348485668]: ["GuaranteedUpdate etcd3" audit-id:b80b12a2-a615-45fc-a37d-a59f00e8abe9,key:/pods/kube-system/cilium-p42zv,type:*core.Pod,resource:pods 1566ms (04:49:40.699)
Trace[1348485668]:  ---"Txn call completed" 1553ms (04:49:42.263)]
Trace[1348485668]: ---"Object stored in database" 1555ms (04:49:42.265)
Trace[1348485668]: [1.567159882s] [1.567159882s] END
I0723 04:49:42.352086       1 trace.go:236] Trace[1320306749]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.138,type:*v1.Endpoints,resource:apiServerIPInfo (23-Jul-2026 04:49:40.111) (total time: 2240ms):
Trace[1320306749]: ---"initial value restored" 2151ms (04:49:42.263)
Trace[1320306749]: ---"Transaction prepared" 58ms (04:49:42.321)
Trace[1320306749]: [2.240324498s] [2.240324498s] END
I0723 04:49:42.821717       1 controller.go:624] quota admission added evaluator for: jobs.batch
I0723 04:49:43.727528       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0723 04:49:43.736215       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0723 04:49:43.742860       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0723 04:49:43.754599       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0723 04:49:43.930779       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0723 04:49:44.327078       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0723 04:49:45.319335       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0723 04:49:46.542123       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0723 04:49:46.755770       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0723 04:49:47.376842       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0723 04:49:47.549240       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
W0723 04:49:52.012043       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
E0723 04:49:52.012106       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
I0723 04:49:52.492199       1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io
I0723 04:50:02.105176       1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.105.123.118"}
W0723 04:50:02.131900       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.105.123.118:9443: connect: connection refused
E0723 04:50:02.131942       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.105.123.118:9443: connect: connection refused
I0723 04:50:16.924947       1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager
I0723 04:50:16.946713       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0723 04:50:16.964423       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0723 04:50:16.973579       1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.106.2.152"}
I0723 04:50:16.994601       1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.97.177.74"}
I0723 04:50:17.033952       1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager
I0723 04:50:17.127689       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0723 04:50:17.167987       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
W0723 04:50:22.858914       1 dispatcher.go:217] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": dial tcp 10.106.2.152:443: connect: connection refused
I0723 04:50:27.858011       1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io
I0723 04:50:33.227363       1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io
I0723 04:50:50.429596       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.101.12.213"}
I0723 04:50:50.436550       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.106.211.126"}
I0723 04:50:50.445825       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.102.140.95"}
I0723 04:50:50.452343       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.98.110.131"}
I0723 04:50:56.834884       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0723 04:50:56.866507       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0723 04:50:56.877657       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0723 04:50:56.893241       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0723 04:50:56.913351       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0723 04:50:56.927297       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0723 04:50:56.946504       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0723 04:50:56.961920       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0723 04:50:56.988182       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0723 04:50:57.004451       1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager
I0723 04:50:57.016000       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0723 04:50:57.034402       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0723 04:50:57.050922       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0723 04:50:58.342441       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0723 04:51:03.836806       1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io
I0723 04:51:03.845404       1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy
I0723 04:51:03.906914       1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.100.151.204"}
I0723 04:51:03.932477       1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io
I0723 04:51:06.075508       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0723 04:51:06.112065       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0723 04:51:06.788747       1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager
I0723 04:51:06.788844       1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager
I0723 04:51:06.788890       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0723 04:51:13.515197       1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com
I0723 04:51:15.850557       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.107.10.68"}
I0723 04:51:16.120847       1 controller.go:624] quota admission added evaluator for: statefulsets.apps
I0723 04:51:16.274628       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.103.82.102"}
I0723 04:51:16.287674       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.99.35.18"}
I0723 04:51:19.239250       1 trace.go:236] Trace[555908880]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:25047568-32a1-42ef-966f-3bc71f8fe2c5,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-d5dcf6fe-c3a3-49d4-bf97-64c1aeacc7f6/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (23-Jul-2026 04:51:18.402) (total time: 836ms):
Trace[555908880]: ["GuaranteedUpdate etcd3" audit-id:25047568-32a1-42ef-966f-3bc71f8fe2c5,key:/pods/local-path-storage/helper-pod-create-pvc-d5dcf6fe-c3a3-49d4-bf97-64c1aeacc7f6,type:*core.Pod,resource:pods 836ms (04:51:18.402)
Trace[555908880]:  ---"Txn call completed" 832ms (04:51:19.238)]
Trace[555908880]: ---"Object stored in database" 833ms (04:51:19.238)
Trace[555908880]: [836.997996ms] [836.997996ms] END
I0723 04:51:19.412824       1 trace.go:236] Trace[1243078979]: "Get" accept:application/json,audit-id:6d78e4f0-b7fc-4bb8-9371-d85c7cb189ef,client:199.204.45.138,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.3/python,verb:GET (23-Jul-2026 04:51:18.559) (total time: 853ms):
Trace[1243078979]: ---"About to write a response" 852ms (04:51:19.412)
Trace[1243078979]: [853.194164ms] [853.194164ms] END
I0723 04:51:20.149859       1 trace.go:236] Trace[2107038215]: "Get" accept:application/json, */*,audit-id:49935976-c80c-4135-917f-f6fff388f9e5,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 04:51:19.642) (total time: 507ms):
Trace[2107038215]: ---"About to write a response" 507ms (04:51:20.149)
Trace[2107038215]: [507.283082ms] [507.283082ms] END
I0723 04:51:20.149880       1 trace.go:236] Trace[1691990824]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4fed84ce-530f-4f1f-85e5-0425daf62c28,client:10.0.0.52,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:51:19.647) (total time: 502ms):
Trace[1691990824]: ["GuaranteedUpdate etcd3" audit-id:4fed84ce-530f-4f1f-85e5-0425daf62c28,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 502ms (04:51:19.647)
Trace[1691990824]:  ---"Txn call completed" 501ms (04:51:20.149)]
Trace[1691990824]: [502.540359ms] [502.540359ms] END
I0723 04:51:35.873968       1 trace.go:236] Trace[449986489]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:48dd3709-debf-48ba-8b88-e6ab3123e18d,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/rabbitmq-messaging-topology-operator-6f465c979f-wpf5x/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (23-Jul-2026 04:51:34.870) (total time: 1003ms):
Trace[449986489]: ["GuaranteedUpdate etcd3" audit-id:48dd3709-debf-48ba-8b88-e6ab3123e18d,key:/pods/openstack/rabbitmq-messaging-topology-operator-6f465c979f-wpf5x,type:*core.Pod,resource:pods 1003ms (04:51:34.870)
Trace[449986489]:  ---"Txn call completed" 1000ms (04:51:35.873)]
Trace[449986489]: ---"Object stored in database" 1000ms (04:51:35.873)
Trace[449986489]: [1.003424531s] [1.003424531s] END
I0723 04:51:35.879931       1 trace.go:236] Trace[410647828]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c45436b6-670c-4530-9b28-62f6e570dd1b,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (23-Jul-2026 04:51:35.163) (total time: 716ms):
Trace[410647828]: ["GuaranteedUpdate etcd3" audit-id:c45436b6-670c-4530-9b28-62f6e570dd1b,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 716ms (04:51:35.163)
Trace[410647828]:  ---"Txn call completed" 715ms (04:51:35.879)]
Trace[410647828]: [716.237109ms] [716.237109ms] END
I0723 04:51:35.880002       1 trace.go:236] Trace[631740191]: "Update" accept:application/json, */*,audit-id:04d42d51-d7b9-4ae3-9764-f5546c5bea96,client:10.0.0.50,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:51:35.158) (total time: 721ms):
Trace[631740191]: ["GuaranteedUpdate etcd3" audit-id:04d42d51-d7b9-4ae3-9764-f5546c5bea96,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 721ms (04:51:35.158)
Trace[631740191]:  ---"Txn call completed" 720ms (04:51:35.879)]
Trace[631740191]: [721.536511ms] [721.536511ms] END
I0723 04:51:35.880146       1 trace.go:236] Trace[1913753077]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:88c9ba16-3f88-4fc1-b990-65f63e7fabaf,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (23-Jul-2026 04:51:34.916) (total time: 963ms):
Trace[1913753077]: ["GuaranteedUpdate etcd3" audit-id:88c9ba16-3f88-4fc1-b990-65f63e7fabaf,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 963ms (04:51:34.916)
Trace[1913753077]:  ---"Txn call completed" 962ms (04:51:35.879)]
Trace[1913753077]: [963.669242ms] [963.669242ms] END
I0723 04:51:35.880541       1 trace.go:236] Trace[1221199777]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c48ffb02-251b-4b98-90ee-5135dc7d40f0,client:199.204.45.138,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (23-Jul-2026 04:51:35.016) (total time: 863ms):
Trace[1221199777]: ["GuaranteedUpdate etcd3" audit-id:c48ffb02-251b-4b98-90ee-5135dc7d40f0,key:/minions/instance,type:*core.Node,resource:nodes 863ms (04:51:35.017)
Trace[1221199777]:  ---"Txn call completed" 857ms (04:51:35.879)]
Trace[1221199777]: ---"Object stored in database" 858ms (04:51:35.880)
Trace[1221199777]: [863.518823ms] [863.518823ms] END
I0723 04:51:58.504051       1 trace.go:236] Trace[1459229132]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6bfc395a-dd8b-4665-b392-1fee7374edb5,client:10.0.0.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:51:57.986) (total time: 517ms):
Trace[1459229132]: ["GuaranteedUpdate etcd3" audit-id:6bfc395a-dd8b-4665-b392-1fee7374edb5,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 517ms (04:51:57.986)
Trace[1459229132]:  ---"Txn call completed" 516ms (04:51:58.503)]
Trace[1459229132]: [517.55901ms] [517.55901ms] END
I0723 04:52:01.223898       1 trace.go:236] Trace[264790560]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.138,type:*v1.Endpoints,resource:apiServerIPInfo (23-Jul-2026 04:52:00.119) (total time: 1104ms):
Trace[264790560]: ---"Transaction prepared" 149ms (04:52:00.296)
Trace[264790560]: ---"Txn call completed" 927ms (04:52:01.223)
Trace[264790560]: [1.104048274s] [1.104048274s] END
I0723 04:52:02.076833       1 trace.go:236] Trace[1190749942]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:423c0c1d-734b-4f40-80e0-d28576d87e2a,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 04:52:00.779) (total time: 1297ms):
Trace[1190749942]: ---"About to write a response" 1297ms (04:52:02.076)
Trace[1190749942]: [1.297311828s] [1.297311828s] END
I0723 04:52:02.076929       1 trace.go:236] Trace[186816585]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:63c45984-5127-4786-9fbc-5892bebf6cee,client:::1,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/default/endpoints/kubernetes,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 04:52:01.224) (total time: 852ms):
Trace[186816585]: ---"About to write a response" 851ms (04:52:02.076)
Trace[186816585]: [852.011468ms] [852.011468ms] END
I0723 04:52:02.076974       1 trace.go:236] Trace[1089203068]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:760a50f8-9f1e-4887-81f3-192ddc31ee0c,client:10.0.0.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:52:00.508) (total time: 1568ms):
Trace[1089203068]: ["GuaranteedUpdate etcd3" audit-id:760a50f8-9f1e-4887-81f3-192ddc31ee0c,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1568ms (04:52:00.508)
Trace[1089203068]:  ---"Txn call completed" 1567ms (04:52:02.076)]
Trace[1089203068]: [1.568744135s] [1.568744135s] END
I0723 04:52:02.077093       1 trace.go:236] Trace[281732489]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c2cc3ca5-594c-47c5-8658-e2798abb73aa,client:10.0.0.37,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:52:00.506) (total time: 1570ms):
Trace[281732489]: ["GuaranteedUpdate etcd3" audit-id:c2cc3ca5-594c-47c5-8658-e2798abb73aa,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1570ms (04:52:00.507)
Trace[281732489]:  ---"Txn call completed" 1568ms (04:52:02.076)]
Trace[281732489]: [1.570087102s] [1.570087102s] END
I0723 04:52:02.077334       1 trace.go:236] Trace[657371269]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4527e419-4be7-4505-86cf-70394635e99a,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 04:52:00.602) (total time: 1474ms):
Trace[657371269]: ---"About to write a response" 1474ms (04:52:02.077)
Trace[657371269]: [1.474726361s] [1.474726361s] END
I0723 04:52:02.076935       1 trace.go:236] Trace[239191336]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ccd9e424-2bd3-44ab-b116-848d87357c2a,client:10.0.0.52,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:52:00.506) (total time: 1570ms):
Trace[239191336]: ["GuaranteedUpdate etcd3" audit-id:ccd9e424-2bd3-44ab-b116-848d87357c2a,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1569ms (04:52:00.507)
Trace[239191336]:  ---"Txn call completed" 1568ms (04:52:02.076)]
Trace[239191336]: [1.570028399s] [1.570028399s] END
I0723 04:52:02.077565       1 trace.go:236] Trace[2010614854]: "Get" accept:application/json, */*,audit-id:797845aa-9621-4df1-88cc-6ce2674182b0,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 04:52:00.780) (total time: 1296ms):
Trace[2010614854]: ---"About to write a response" 1296ms (04:52:02.077)
Trace[2010614854]: [1.296707126s] [1.296707126s] END
I0723 04:52:02.077646       1 trace.go:236] Trace[1958049427]: "Get" accept:application/json, */*,audit-id:cc3e2fca-34e9-451c-a9e3-440c94eea3fd,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 04:52:00.779) (total time: 1298ms):
Trace[1958049427]: ---"About to write a response" 1298ms (04:52:02.077)
Trace[1958049427]: [1.298607352s] [1.298607352s] END
I0723 04:52:02.077920       1 trace.go:236] Trace[1274612104]: "Get" accept:application/json, */*,audit-id:0db2c9ee-263d-430a-8a2e-fb17235367f6,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 04:52:00.780) (total time: 1297ms):
Trace[1274612104]: ---"About to write a response" 1297ms (04:52:02.077)
Trace[1274612104]: [1.297827546s] [1.297827546s] END
I0723 04:52:02.079567       1 trace.go:236] Trace[1513099443]: "Get" accept:application/json,audit-id:36d672e9-c12b-46e6-abf7-0528c4d30e81,client:199.204.45.138,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.3/python,verb:GET (23-Jul-2026 04:52:00.516) (total time: 1563ms):
Trace[1513099443]: ---"About to write a response" 1561ms (04:52:02.077)
Trace[1513099443]: [1.563151672s] [1.563151672s] END
I0723 04:52:02.308927       1 trace.go:236] Trace[826463074]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a41a8d8c-a630-492a-ae93-82445cb6abd6,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/percona-xtradb-haproxy-0.18c4d20d3496cadf,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (23-Jul-2026 04:52:01.506) (total time: 802ms):
Trace[826463074]: ["GuaranteedUpdate etcd3" audit-id:a41a8d8c-a630-492a-ae93-82445cb6abd6,key:/events/openstack/percona-xtradb-haproxy-0.18c4d20d3496cadf,type:*core.Event,resource:events 802ms (04:52:01.506)
Trace[826463074]:  ---"initial value restored" 569ms (04:52:02.076)
Trace[826463074]:  ---"Txn call completed" 230ms (04:52:02.308)]
Trace[826463074]: ---"Object stored in database" 230ms (04:52:02.308)
Trace[826463074]: [802.300502ms] [802.300502ms] END
I0723 04:52:03.050799       1 trace.go:236] Trace[485908313]: "Update" accept:application/json, */*,audit-id:1b0e2bca-6e7c-4553-afb4-dfaea81e5049,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:52:02.080) (total time: 970ms):
Trace[485908313]: ["GuaranteedUpdate etcd3" audit-id:1b0e2bca-6e7c-4553-afb4-dfaea81e5049,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 970ms (04:52:02.080)
Trace[485908313]:  ---"Txn call completed" 969ms (04:52:03.050)]
Trace[485908313]: [970.657265ms] [970.657265ms] END
I0723 04:52:03.051051       1 trace.go:236] Trace[547676260]: "Update" accept:application/json, */*,audit-id:f28f6f1e-3857-4e33-93fa-a16d38c27815,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (23-Jul-2026 04:52:02.079) (total time: 971ms):
Trace[547676260]: ["GuaranteedUpdate etcd3" audit-id:f28f6f1e-3857-4e33-93fa-a16d38c27815,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 971ms (04:52:02.079)
Trace[547676260]:  ---"Txn call completed" 970ms (04:52:03.050)]
Trace[547676260]: [971.544315ms] [971.544315ms] END
I0723 04:52:03.051188       1 trace.go:236] Trace[1763781855]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3a6dab49-56ba-47d9-a756-99b0b51299ea,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (23-Jul-2026 04:52:02.080) (total time: 970ms):
Trace[1763781855]: ["GuaranteedUpdate etcd3" audit-id:3a6dab49-56ba-47d9-a756-99b0b51299ea,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 970ms (04:52:02.080)
Trace[1763781855]:  ---"Txn call completed" 970ms (04:52:03.050)]
Trace[1763781855]: [970.79316ms] [970.79316ms] END
I0723 04:52:03.051660       1 trace.go:236] Trace[891868479]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:701fe73a-b449-4022-ab4c-29dfe2e0340e,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (23-Jul-2026 04:52:02.081) (total time: 969ms):
Trace[891868479]: ["GuaranteedUpdate etcd3" audit-id:701fe73a-b449-4022-ab4c-29dfe2e0340e,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 969ms (04:52:02.082)
Trace[891868479]:  ---"Txn call completed" 968ms (04:52:03.051)]
Trace[891868479]: [969.707172ms] [969.707172ms] END
I0723 04:52:03.052267       1 trace.go:236] Trace[45714267]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a84140a5-719e-4c20-a27e-e2e4296d8a74,client:10.0.0.137,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:52:02.148) (total time: 903ms):
Trace[45714267]: ["GuaranteedUpdate etcd3" audit-id:a84140a5-719e-4c20-a27e-e2e4296d8a74,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 903ms (04:52:02.149)
Trace[45714267]:  ---"Txn call completed" 902ms (04:52:03.052)]
Trace[45714267]: [903.380712ms] [903.380712ms] END
I0723 04:52:03.052666       1 trace.go:236] Trace[2110023148]: "Update" accept:application/json, */*,audit-id:5db2eef3-c946-4dc4-bb2c-dcc20a5befaa,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (23-Jul-2026 04:52:02.079) (total time: 972ms):
Trace[2110023148]: ["GuaranteedUpdate etcd3" audit-id:5db2eef3-c946-4dc4-bb2c-dcc20a5befaa,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 972ms (04:52:02.080)
Trace[2110023148]:  ---"Txn call completed" 971ms (04:52:03.052)]
Trace[2110023148]: [972.740366ms] [972.740366ms] END
I0723 04:52:03.053137       1 trace.go:236] Trace[1556927466]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:156616b3-714d-4050-82e4-963777c5ffb3,client:::1,protocol:HTTP/2.0,resource:endpointslices,scope:resource,url:/apis/discovery.k8s.io/v1/namespaces/default/endpointslices/kubernetes,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 04:52:02.310) (total time: 742ms):
Trace[1556927466]: ---"About to write a response" 742ms (04:52:03.053)
Trace[1556927466]: [742.814821ms] [742.814821ms] END
I0723 04:52:03.053671       1 trace.go:236] Trace[1995597758]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:27d3cff9-8de6-4c27-b984-6fcad6ecdcd4,client:10.0.0.52,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 04:52:02.179) (total time: 873ms):
Trace[1995597758]: ---"About to write a response" 873ms (04:52:03.053)
Trace[1995597758]: [873.782761ms] [873.782761ms] END
I0723 04:52:36.988920       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.108.215.253"}
I0723 04:52:39.091406       1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.99.171.179"}
I0723 04:52:39.896493       1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.106.254.241"}
I0723 04:52:47.590145       1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.108.91.27"}
I0723 04:52:47.605808       1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.99.171.48"}
I0723 04:53:24.087129       1 trace.go:236] Trace[2025065834]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b75faef1-c5c7-415e-9658-071d7ebf03b3,client:10.0.0.137,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:53:23.543) (total time: 543ms):
Trace[2025065834]: ["GuaranteedUpdate etcd3" audit-id:b75faef1-c5c7-415e-9658-071d7ebf03b3,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 543ms (04:53:23.543)
Trace[2025065834]:  ---"Txn call completed" 542ms (04:53:24.086)]
Trace[2025065834]: [543.689361ms] [543.689361ms] END
I0723 04:53:25.171093       1 trace.go:236] Trace[1214440793]: "Update" accept:application/json, */*,audit-id:628e95cf-8e14-4992-91b3-7be3acc504d2,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (23-Jul-2026 04:53:24.090) (total time: 1080ms):
Trace[1214440793]: ["GuaranteedUpdate etcd3" audit-id:628e95cf-8e14-4992-91b3-7be3acc504d2,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1079ms (04:53:24.091)
Trace[1214440793]:  ---"Txn call completed" 1078ms (04:53:25.170)]
Trace[1214440793]: [1.080106091s] [1.080106091s] END
I0723 04:53:25.382275       1 trace.go:236] Trace[471707018]: "Update" accept:application/json, */*,audit-id:e5bd1a77-a433-4240-88b5-6333009a3b35,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (23-Jul-2026 04:53:24.091) (total time: 1290ms):
Trace[471707018]: ["GuaranteedUpdate etcd3" audit-id:e5bd1a77-a433-4240-88b5-6333009a3b35,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1290ms (04:53:24.092)
Trace[471707018]:  ---"Txn call completed" 1289ms (04:53:25.381)]
Trace[471707018]: [1.29036145s] [1.29036145s] END
I0723 04:53:25.382864       1 trace.go:236] Trace[339551706]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5e009e63-0c96-4bea-b7b9-a0b7f9425df7,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (23-Jul-2026 04:53:24.091) (total time: 1291ms):
Trace[339551706]: ["GuaranteedUpdate etcd3" audit-id:5e009e63-0c96-4bea-b7b9-a0b7f9425df7,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1290ms (04:53:24.091)
Trace[339551706]:  ---"Txn call completed" 1289ms (04:53:25.382)]
Trace[339551706]: [1.291097586s] [1.291097586s] END
I0723 04:53:25.383048       1 trace.go:236] Trace[1576385275]: "Get" accept:application/json, */*,audit-id:83f99b57-9128-4a67-92b7-e7fa7f2ac0b0,client:199.204.45.138,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak,user-agent:Helm/3.11.2,verb:GET (23-Jul-2026 04:53:24.094) (total time: 1288ms):
Trace[1576385275]: ---"About to write a response" 1288ms (04:53:25.382)
Trace[1576385275]: [1.288933141s] [1.288933141s] END
I0723 04:53:25.383803       1 trace.go:236] Trace[1808686646]: "Update" accept:application/json, */*,audit-id:78b85662-3faf-438a-acf4-17a604939916,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:53:24.091) (total time: 1291ms):
Trace[1808686646]: ["GuaranteedUpdate etcd3" audit-id:78b85662-3faf-438a-acf4-17a604939916,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1291ms (04:53:24.092)
Trace[1808686646]:  ---"Txn call completed" 1289ms (04:53:25.382)]
Trace[1808686646]: [1.291291843s] [1.291291843s] END
I0723 04:53:25.383837       1 trace.go:236] Trace[149986161]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:baa61292-2877-4001-9fdb-0efefe9df9f3,client:10.0.0.52,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:53:24.364) (total time: 1019ms):
Trace[149986161]: ["GuaranteedUpdate etcd3" audit-id:baa61292-2877-4001-9fdb-0efefe9df9f3,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1019ms (04:53:24.364)
Trace[149986161]:  ---"Txn call completed" 1018ms (04:53:25.383)]
Trace[149986161]: [1.01968119s] [1.01968119s] END
I0723 04:53:25.384093       1 trace.go:236] Trace[460423949]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a4a3824e-c138-48a1-8289-15fc8bc8dca3,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (23-Jul-2026 04:53:24.093) (total time: 1290ms):
Trace[460423949]: ["GuaranteedUpdate etcd3" audit-id:a4a3824e-c138-48a1-8289-15fc8bc8dca3,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 1290ms (04:53:24.093)
Trace[460423949]:  ---"Txn call completed" 1289ms (04:53:25.383)]
Trace[460423949]: [1.290174144s] [1.290174144s] END
I0723 04:53:25.384370       1 trace.go:236] Trace[2063129331]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8908d598-8c26-47ad-9c3b-7bd1c034ef73,client:10.0.0.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:53:24.399) (total time: 984ms):
Trace[2063129331]: ["GuaranteedUpdate etcd3" audit-id:8908d598-8c26-47ad-9c3b-7bd1c034ef73,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 984ms (04:53:24.399)
Trace[2063129331]:  ---"Txn call completed" 983ms (04:53:25.384)]
Trace[2063129331]: [984.866106ms] [984.866106ms] END
I0723 04:53:25.384893       1 trace.go:236] Trace[1834896667]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1ca034ce-593e-433b-9f8c-a85ab6db909c,client:10.0.0.37,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:53:24.415) (total time: 969ms):
Trace[1834896667]: ["GuaranteedUpdate etcd3" audit-id:1ca034ce-593e-433b-9f8c-a85ab6db909c,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 969ms (04:53:24.415)
Trace[1834896667]:  ---"Txn call completed" 968ms (04:53:25.384)]
Trace[1834896667]: [969.70734ms] [969.70734ms] END
I0723 04:55:11.500703       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io
I0723 04:55:13.444403       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0723 04:55:13.455936       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0723 04:55:13.468649       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0723 04:55:13.482650       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0723 04:55:13.495161       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0723 04:55:13.516470       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0723 04:55:13.542381       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0723 04:55:26.028003       1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io
I0723 04:56:04.644083       1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev
I0723 04:56:18.719036       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0723 04:56:18.943575       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0723 04:56:18.965351       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0723 04:56:18.986184       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0723 04:56:19.183013       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0723 04:56:19.480742       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0723 04:56:19.480938       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0723 04:56:19.564034       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0723 04:56:19.585712       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0723 04:56:19.785099       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0723 04:57:02.408091       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.111.141.180"}
I0723 04:57:02.423406       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.106.134.112"}
I0723 04:57:02.430509       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.96.153.137"}
I0723 04:57:02.440542       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.108.92.139"}
I0723 04:57:02.453914       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.110.42.169"}
I0723 04:57:02.461340       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.109.81.58"}
I0723 04:57:02.502742       1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com
I0723 04:57:02.520426       1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com
I0723 04:57:02.559262       1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com
I0723 04:57:02.572526       1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com
I0723 04:57:02.598925       1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com
W0723 04:57:02.607592       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.607638       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.610592       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.610622       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.611164       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.611189       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.611246       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.611261       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.611562       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.611577       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.611652       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.611664       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.611848       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.611911       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.612122       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.612138       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.612383       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.612465       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.613217       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.613246       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.613629       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.613654       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.614862       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.614886       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.614920       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.614957       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.614924       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.615002       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.615682       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.615719       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
W0723 04:57:02.616617       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
E0723 04:57:02.616643       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.81.58:443: connect: connection refused
I0723 04:57:14.508642       1 trace.go:236] Trace[1301848927]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b068e27d-4bf4-4757-b51e-6ac1e1b1bca2,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (23-Jul-2026 04:57:13.903) (total time: 605ms):
Trace[1301848927]: ["GuaranteedUpdate etcd3" audit-id:b068e27d-4bf4-4757-b51e-6ac1e1b1bca2,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 605ms (04:57:13.903)
Trace[1301848927]:  ---"Txn call completed" 603ms (04:57:14.508)]
Trace[1301848927]: [605.331738ms] [605.331738ms] END
I0723 04:57:17.297309       1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com
I0723 04:57:17.591872       1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.104.165.229"}
I0723 04:57:19.827410       1 trace.go:236] Trace[1850639526]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c015b442-0e86-4975-aea9-5efbd7048e95,client:10.0.0.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:57:18.794) (total time: 1033ms):
Trace[1850639526]: ["GuaranteedUpdate etcd3" audit-id:c015b442-0e86-4975-aea9-5efbd7048e95,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1033ms (04:57:18.794)
Trace[1850639526]:  ---"Txn call completed" 1032ms (04:57:19.827)]
Trace[1850639526]: [1.033335568s] [1.033335568s] END
I0723 04:57:19.938324       1 trace.go:236] Trace[342153505]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:52c4a915-162a-4eca-94d7-a7e56bf2f2da,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/monitoring/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (23-Jul-2026 04:57:19.321) (total time: 616ms):
Trace[342153505]: ["Create etcd3" audit-id:52c4a915-162a-4eca-94d7-a7e56bf2f2da,key:/events/monitoring/kube-prometheus-stack-grafana-66b4994b69-sfqc2.18c4d25ab1fd4402,type:*core.Event,resource:events 615ms (04:57:19.322)
Trace[342153505]:  ---"Txn call succeeded" 615ms (04:57:19.938)]
Trace[342153505]: [616.52312ms] [616.52312ms] END
I0723 04:57:19.938352       1 trace.go:236] Trace[1905216688]: "Get" accept:application/json, */*,audit-id:ed283d77-673d-414c-8b94-8c2bd433140e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 04:57:18.826) (total time: 1111ms):
Trace[1905216688]: ---"About to write a response" 1111ms (04:57:19.938)
Trace[1905216688]: [1.111840683s] [1.111840683s] END
I0723 04:57:19.939152       1 trace.go:236] Trace[1579825651]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:22fc3f67-77b0-4183-9afd-9954f95c6adb,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 04:57:19.223) (total time: 715ms):
Trace[1579825651]: ---"About to write a response" 715ms (04:57:19.939)
Trace[1579825651]: [715.293101ms] [715.293101ms] END
I0723 04:57:19.939287       1 trace.go:236] Trace[326981676]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:44e6ae0c-bcee-490c-904c-c9fd8dbc9da0,client:199.204.45.138,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/datadir-percona-xtradb-pxc-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 04:57:18.842) (total time: 1096ms):
Trace[326981676]: ---"About to write a response" 1096ms (04:57:19.939)
Trace[326981676]: [1.096407937s] [1.096407937s] END
I0723 04:57:19.939577       1 trace.go:236] Trace[62993874]: "Get" accept:application/json, */*,audit-id:c41f5b61-6b35-4c7f-aef2-fc83727c1bbd,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 04:57:19.277) (total time: 662ms):
Trace[62993874]: ---"About to write a response" 662ms (04:57:19.939)
Trace[62993874]: [662.414407ms] [662.414407ms] END
I0723 04:57:19.939914       1 trace.go:236] Trace[1397292682]: "Get" accept:application/json, */*,audit-id:b8ca4594-12ec-4494-b4b6-b03e687c284f,client:10.0.0.125,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-5cc9318b-910f-4764-9426-0f78187ca414,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 04:57:18.830) (total time: 1108ms):
Trace[1397292682]: ---"About to write a response" 1108ms (04:57:19.939)
Trace[1397292682]: [1.108929414s] [1.108929414s] END
I0723 04:57:19.940286       1 trace.go:236] Trace[102486913]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1b214b9e-3a91-4c1c-b44a-582dfe8b7c43,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-5cc9318b-910f-4764-9426-0f78187ca414,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 04:57:19.323) (total time: 617ms):
Trace[102486913]: ---"About to write a response" 616ms (04:57:19.939)
Trace[102486913]: [617.125749ms] [617.125749ms] END
I0723 04:57:19.940463       1 trace.go:236] Trace[85237695]: "Get" accept:application/json, */*,audit-id:156c5de6-dc85-42c1-8556-29539a28393c,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 04:57:19.294) (total time: 645ms):
Trace[85237695]: ---"About to write a response" 645ms (04:57:19.940)
Trace[85237695]: [645.628039ms] [645.628039ms] END
I0723 04:57:19.940499       1 trace.go:236] Trace[1662912265]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6492d275-3e1e-4443-b731-b776c2b3b899,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 04:57:19.294) (total time: 646ms):
Trace[1662912265]: ---"About to write a response" 646ms (04:57:19.940)
Trace[1662912265]: [646.30493ms] [646.30493ms] END
I0723 04:57:19.942220       1 trace.go:236] Trace[309139606]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6d26e0df-ea33-4b72-9a31-ddfc28605ca6,client:10.0.0.137,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:57:19.234) (total time: 707ms):
Trace[309139606]: ["GuaranteedUpdate etcd3" audit-id:6d26e0df-ea33-4b72-9a31-ddfc28605ca6,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 707ms (04:57:19.234)
Trace[309139606]:  ---"Txn call completed" 706ms (04:57:19.942)]
Trace[309139606]: [707.83106ms] [707.83106ms] END
I0723 04:57:21.956500       1 trace.go:236] Trace[608440231]: "Update" accept:application/json, */*,audit-id:b500bf5a-92aa-49cf-b08f-af0d8a823f79,client:10.0.0.50,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:57:21.271) (total time: 685ms):
Trace[608440231]: ["GuaranteedUpdate etcd3" audit-id:b500bf5a-92aa-49cf-b08f-af0d8a823f79,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 684ms (04:57:21.271)
Trace[608440231]:  ---"Txn call completed" 683ms (04:57:21.956)]
Trace[608440231]: [685.05003ms] [685.05003ms] END
I0723 04:57:22.018195       1 trace.go:236] Trace[1390519955]: "Patch" accept:application/vnd.kubernetes.protobuf, */*,audit-id:05c74b1b-da48-4395-a601-a083b2bb6f3f,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/persistence-rabbitmq-keystone-server-0.18c4d25a57d66f17,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:persistent-volume-binder,verb:PATCH (23-Jul-2026 04:57:21.047) (total time: 970ms):
Trace[1390519955]: ["GuaranteedUpdate etcd3" audit-id:05c74b1b-da48-4395-a601-a083b2bb6f3f,key:/events/openstack/persistence-rabbitmq-keystone-server-0.18c4d25a57d66f17,type:*core.Event,resource:events 970ms (04:57:21.047)
Trace[1390519955]:  ---"initial value restored" 586ms (04:57:21.633)
Trace[1390519955]:  ---"Txn call completed" 383ms (04:57:22.017)]
Trace[1390519955]: ---"Object stored in database" 383ms (04:57:22.018)
Trace[1390519955]: [970.916778ms] [970.916778ms] END
I0723 04:57:31.484131       1 trace.go:236] Trace[1678226193]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:02a2647f-f285-48bf-81ca-4c02023d54e7,client:10.0.0.37,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:57:30.926) (total time: 557ms):
Trace[1678226193]: ["GuaranteedUpdate etcd3" audit-id:02a2647f-f285-48bf-81ca-4c02023d54e7,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 557ms (04:57:30.926)
Trace[1678226193]:  ---"Txn call completed" 555ms (04:57:31.484)]
Trace[1678226193]: [557.463216ms] [557.463216ms] END
I0723 04:57:31.484869       1 trace.go:236] Trace[835768510]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ea9e3a67-27bc-4556-8758-d606f40c5066,client:10.0.0.52,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 04:57:30.958) (total time: 525ms):
Trace[835768510]: ---"About to write a response" 525ms (04:57:31.484)
Trace[835768510]: [525.928156ms] [525.928156ms] END
I0723 04:57:37.837576       1 trace.go:236] Trace[2135073213]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9bfa5412-62a1-4b8a-a8b1-80c54846d3c8,client:10.0.0.137,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:57:36.068) (total time: 1769ms):
Trace[2135073213]: ["GuaranteedUpdate etcd3" audit-id:9bfa5412-62a1-4b8a-a8b1-80c54846d3c8,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1769ms (04:57:36.068)
Trace[2135073213]:  ---"Txn call completed" 1768ms (04:57:37.837)]
Trace[2135073213]: [1.769241845s] [1.769241845s] END
I0723 04:57:37.978412       1 trace.go:236] Trace[1662362605]: "Update" accept:application/json, */*,audit-id:edda1e39-f305-4902-94a4-6a5d801fee96,client:10.0.0.50,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:57:36.959) (total time: 1018ms):
Trace[1662362605]: ["GuaranteedUpdate etcd3" audit-id:edda1e39-f305-4902-94a4-6a5d801fee96,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1018ms (04:57:36.960)
Trace[1662362605]:  ---"Txn call completed" 1017ms (04:57:37.978)]
Trace[1662362605]: [1.01869388s] [1.01869388s] END
I0723 04:57:37.979172       1 trace.go:236] Trace[1634337317]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fb1622a3-93c2-4daa-9d76-3b81882c7183,client:10.0.0.52,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:57:36.598) (total time: 1380ms):
Trace[1634337317]: ["GuaranteedUpdate etcd3" audit-id:fb1622a3-93c2-4daa-9d76-3b81882c7183,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1380ms (04:57:36.598)
Trace[1634337317]:  ---"Txn call completed" 1379ms (04:57:37.979)]
Trace[1634337317]: [1.380770891s] [1.380770891s] END
I0723 04:57:37.979890       1 trace.go:236] Trace[913968264]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9402bcc6-1736-4f05-88bd-7296878958f6,client:10.0.0.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 04:57:36.068) (total time: 1911ms):
Trace[913968264]: ["GuaranteedUpdate etcd3" audit-id:9402bcc6-1736-4f05-88bd-7296878958f6,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1911ms (04:57:36.068)
Trace[913968264]:  ---"Txn call completed" 1909ms (04:57:37.978)]
Trace[913968264]: [1.911417057s] [1.911417057s] END
I0723 04:57:37.980229       1 trace.go:236] Trace[1004138889]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7c49f9e0-4452-489d-ac02-419036b54e31,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (23-Jul-2026 04:57:37.369) (total time: 608ms):
Trace[1004138889]: ["GuaranteedUpdate etcd3" audit-id:7c49f9e0-4452-489d-ac02-419036b54e31,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 609ms (04:57:37.370)
Trace[1004138889]:  ---"Txn call completed" 607ms (04:57:37.978)]
Trace[1004138889]: [608.426149ms] [608.426149ms] END
I0723 04:57:37.981182       1 trace.go:236] Trace[426463968]: "Get" accept:application/json, */*,audit-id:e025aa9f-290d-4980-abd1-507b72d4ef22,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 04:57:36.577) (total time: 1404ms):
Trace[426463968]: ---"About to write a response" 1403ms (04:57:37.980)
Trace[426463968]: [1.404015546s] [1.404015546s] END
I0723 04:57:37.981403       1 trace.go:236] Trace[1107440864]: "Get" accept:application/json, */*,audit-id:c44b50a2-b886-4369-aa16-97e69f455512,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 04:57:36.579) (total time: 1401ms):
Trace[1107440864]: ---"About to write a response" 1401ms (04:57:37.981)
Trace[1107440864]: [1.401530628s] [1.401530628s] END
I0723 04:57:37.981969       1 trace.go:236] Trace[1056671912]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3dbcf11d-730f-4b9b-b9b7-6e75083dfd09,client:199.204.45.138,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-keystone-server-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 04:57:36.523) (total time: 1458ms):
Trace[1056671912]: ---"About to write a response" 1458ms (04:57:37.981)
Trace[1056671912]: [1.458425011s] [1.458425011s] END
I0723 04:57:37.982039       1 trace.go:236] Trace[1826465650]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:be23d909-a8a6-436e-a522-0cbb65a66929,client:10.0.0.52,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 04:57:36.563) (total time: 1418ms):
Trace[1826465650]: ---"About to write a response" 1417ms (04:57:37.981)
Trace[1826465650]: [1.418012502s] [1.418012502s] END
I0723 04:57:37.982530       1 trace.go:236] Trace[403660853]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3f6c2560-ef3a-49f5-b4fb-72bdab9c140d,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 04:57:36.571) (total time: 1411ms):
Trace[403660853]: ---"About to write a response" 1411ms (04:57:37.982)
Trace[403660853]: [1.411273152s] [1.411273152s] END
I0723 04:57:37.982652       1 trace.go:236] Trace[917875173]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0b518c65-4a57-431e-b944-313190435cf8,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 04:57:36.575) (total time: 1407ms):
Trace[917875173]: ---"About to write a response" 1407ms (04:57:37.982)
Trace[917875173]: [1.407345969s] [1.407345969s] END
I0723 04:57:37.983234       1 trace.go:236] Trace[1313290859]: "Get" accept:application/json, */*,audit-id:6aeb0f3a-b3e5-4dae-a7f1-f20cd67ab2db,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 04:57:36.583) (total time: 1399ms):
Trace[1313290859]: ---"About to write a response" 1399ms (04:57:37.982)
Trace[1313290859]: [1.399575188s] [1.399575188s] END
I0723 04:58:13.296710       1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.97.71.251"}
I0723 04:58:13.312146       1 controller.go:624] quota admission added evaluator for: cronjobs.batch
I0723 05:01:04.631771       1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon-int" clusterIPs={"IPv4":"10.103.218.158"}
I0723 05:01:04.642737       1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon" clusterIPs={"IPv4":"10.102.175.161"}
E0723 05:07:56.570205       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 23.861µs, panicked: false, err: context canceled, panic-reason: <nil>
E0723 05:07:56.570278       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:07:56.570448       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:07:56.570525       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 40.691µs, panicked: false, err: context deadline exceeded, panic-reason: <nil>
E0723 05:07:56.571607       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:07:56.571646       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:07:56.572767       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:07:56.572841       1 trace.go:236] Trace[801311896]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b7755378-768c-4d6b-b465-9ff9519c3005,client:10.0.0.52,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 05:07:51.571) (total time: 5001ms):
Trace[801311896]: ["GuaranteedUpdate etcd3" audit-id:b7755378-768c-4d6b-b465-9ff9519c3005,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (05:07:51.571)
Trace[801311896]:  ---"Txn call failed" err:context deadline exceeded 4998ms (05:07:56.570)]
Trace[801311896]: [5.00179561s] [5.00179561s] END
E0723 05:07:56.572933       1 timeout.go:142] post-timeout activity - time-elapsed: 2.506193ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: <nil>
E0723 05:07:56.572653       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:07:56.574226       1 trace.go:236] Trace[1945166055]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b3ae850e-4fd3-4185-baf6-951e865893bb,client:10.0.0.137,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 05:07:51.570) (total time: 5003ms):
Trace[1945166055]: ["GuaranteedUpdate etcd3" audit-id:b3ae850e-4fd3-4185-baf6-951e865893bb,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5003ms (05:07:51.570)
Trace[1945166055]:  ---"Txn call failed" err:context canceled 4998ms (05:07:56.570)]
Trace[1945166055]: [5.00330234s] [5.00330234s] END
E0723 05:07:56.574386       1 timeout.go:142] post-timeout activity - time-elapsed: 4.112395ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: <nil>
I0723 05:07:56.731623       1 trace.go:236] Trace[951315034]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fc82dae8-9ad9-466e-a03f-1e221a899dcb,client:10.0.0.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 05:07:51.731) (total time: 4999ms):
Trace[951315034]: ["GuaranteedUpdate etcd3" audit-id:fc82dae8-9ad9-466e-a03f-1e221a899dcb,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 4999ms (05:07:51.731)
Trace[951315034]:  ---"Txn call failed" err:context canceled 4998ms (05:07:56.731)]
Trace[951315034]: [4.99997362s] [4.99997362s] END
E0723 05:07:56.731679       1 wrap.go:54] timeout or abort while handling: method=PUT URI="/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election?timeout=5s" audit-ID="fc82dae8-9ad9-466e-a03f-1e221a899dcb"
E0723 05:07:56.731772       1 timeout.go:142] post-timeout activity - time-elapsed: 23.97µs, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: <nil>
E0723 05:07:56.731826       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 6.15µs, panicked: false, err: context canceled, panic-reason: <nil>
E0723 05:07:56.792957       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:07:56.793054       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:07:56.794170       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:07:56.794245       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:07:56.795308       1 trace.go:236] Trace[1170872808]: "Get" accept:application/json, */*,audit-id:5bb89513-2a96-407f-804d-a64c05834929,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:07:51.792) (total time: 5002ms):
Trace[1170872808]: [5.002490673s] [5.002490673s] END
E0723 05:07:56.795539       1 timeout.go:142] post-timeout activity - time-elapsed: 2.617977ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0723 05:07:57.907409       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:07:57.907447       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:07:57.907496       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 13.141µs, panicked: false, err: context deadline exceeded, panic-reason: <nil>
E0723 05:07:57.908487       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:07:57.908718       1 trace.go:236] Trace[1661905351]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:41aa9303-ce98-4251-8ca5-fef24fc0a005,client:10.0.0.37,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 05:07:52.908) (total time: 5000ms):
Trace[1661905351]: ["GuaranteedUpdate etcd3" audit-id:41aa9303-ce98-4251-8ca5-fef24fc0a005,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (05:07:52.908)
Trace[1661905351]:  ---"Txn call failed" err:context deadline exceeded 4998ms (05:07:57.907)]
Trace[1661905351]: [5.00048964s] [5.00048964s] END
E0723 05:07:57.908947       1 timeout.go:142] post-timeout activity - time-elapsed: 1.488289ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: <nil>
E0723 05:07:58.048707       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0723 05:07:58.048996       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:07:58.050053       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:07:58.050098       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0723 05:07:58.050176       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0723 05:07:58.051501       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:07:58.051583       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
I0723 05:07:58.051528       1 trace.go:236] Trace[1256181590]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:eb7eb5eb-83bd-4f1b-83a5-99371eb2b7ad,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 05:07:53.049) (total time: 5002ms):
Trace[1256181590]: [5.002412934s] [5.002412934s] END
E0723 05:07:58.051785       1 timeout.go:142] post-timeout activity - time-elapsed: 2.885736ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0723 05:07:58.052662       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:07:58.053811       1 trace.go:236] Trace[2058210377]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:937bb41b-11e6-4d1e-b85d-ea780807a17f,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 05:07:53.050) (total time: 5003ms):
Trace[2058210377]: [5.003700606s] [5.003700606s] END
E0723 05:07:58.053981       1 timeout.go:142] post-timeout activity - time-elapsed: 3.660751ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0723 05:07:58.274807       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:07:58.274967       1 trace.go:236] Trace[1259652747]: "Update" accept:application/json, */*,audit-id:2273119d-604b-452f-82fc-b05ca47dc5d5,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (23-Jul-2026 05:07:51.272) (total time: 7002ms):
Trace[1259652747]: ["GuaranteedUpdate etcd3" audit-id:2273119d-604b-452f-82fc-b05ca47dc5d5,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:07:51.272)
Trace[1259652747]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:07:58.274)]
Trace[1259652747]: [7.002702401s] [7.002702401s] END
E0723 05:07:58.303736       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:07:58.303872       1 trace.go:236] Trace[947950551]: "Get" accept:application/json,audit-id:af65bce8-9279-4fc8-b1ee-dd24fe8416cc,client:199.204.45.138,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces/default,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:07:51.301) (total time: 7001ms):
Trace[947950551]: [7.001895674s] [7.001895674s] END
E0723 05:08:00.479662       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0723 05:08:00.479925       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:00.480115       1 trace.go:236] Trace[1275157426]: "Update" accept:application/json, */*,audit-id:10d7686d-25ad-4e79-a8e4-578c69af2caa,client:10.0.0.50,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 05:07:53.476) (total time: 7003ms):
Trace[1275157426]: ["GuaranteedUpdate etcd3" audit-id:10d7686d-25ad-4e79-a8e4-578c69af2caa,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:07:53.477)
Trace[1275157426]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:08:00.479)]
Trace[1275157426]: [7.003100088s] [7.003100088s] END
I0723 05:08:00.480838       1 trace.go:236] Trace[1805329416]: "Update" accept:application/json, */*,audit-id:9fa44237-cdff-4272-a7d1-c45c7eabcaed,client:10.0.0.67,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:PUT (23-Jul-2026 05:07:53.477) (total time: 7003ms):
Trace[1805329416]: ["GuaranteedUpdate etcd3" audit-id:9fa44237-cdff-4272-a7d1-c45c7eabcaed,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:07:53.477)
Trace[1805329416]:  ---"Txn call failed" err:etcdserver: request timed out 7000ms (05:08:00.479)]
Trace[1805329416]: [7.003198091s] [7.003198091s] END
E0723 05:08:01.368769       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:01.368938       1 trace.go:236] Trace[309034288]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:28a02806-9c09-4a4c-ab74-c7e90804421c,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (23-Jul-2026 05:07:54.366) (total time: 7002ms):
Trace[309034288]: ["GuaranteedUpdate etcd3" audit-id:28a02806-9c09-4a4c-ab74-c7e90804421c,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:07:54.366)
Trace[309034288]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:08:01.368)]
Trace[309034288]: [7.002374035s] [7.002374035s] END
E0723 05:08:01.517434       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:01.517548       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:01.518526       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:01.518816       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:01.519721       1 trace.go:236] Trace[754968720]: "Get" accept:application/json, */*,audit-id:d9a1dace-019b-4d4f-b02f-dc51cc6ed6f2,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 05:07:51.517) (total time: 10002ms):
Trace[754968720]: [10.002546003s] [10.002546003s] END
E0723 05:08:01.519992       1 timeout.go:142] post-timeout activity - time-elapsed: 2.624176ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: <nil>
E0723 05:08:01.570610       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:01.570690       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:01.571696       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:01.571756       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:01.572837       1 trace.go:236] Trace[1519077651]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b8c648d3-9bfb-4431-bb4f-344f36468435,client:10.0.0.137,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:07:56.571) (total time: 5001ms):
Trace[1519077651]: [5.001451587s] [5.001451587s] END
E0723 05:08:01.572917       1 timeout.go:142] post-timeout activity - time-elapsed: 2.232404ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: <nil>
E0723 05:08:01.731906       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:01.732027       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:01.733087       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:01.733173       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:01.734233       1 trace.go:236] Trace[109267807]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a5f75768-c08b-46c4-8670-392c90e308f3,client:10.0.0.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:07:56.732) (total time: 5001ms):
Trace[109267807]: [5.001798598s] [5.001798598s] END
E0723 05:08:01.734367       1 timeout.go:142] post-timeout activity - time-elapsed: 2.460622ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: <nil>
E0723 05:08:01.792541       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:01.792713       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:01.793683       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:01.794102       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:01.794930       1 trace.go:236] Trace[1092311587]: "Get" accept:application/json, */*,audit-id:ef6dc38b-9c97-4d56-89b5-6d801b8399e0,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:07:58.794) (total time: 3000ms):
Trace[1092311587]: [3.000253866s] [3.000253866s] END
E0723 05:08:01.795024       1 timeout.go:142] post-timeout activity - time-elapsed: 2.465961ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0723 05:08:01.987001       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:01.987164       1 trace.go:236] Trace[1064852247]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:be518df0-95d1-4961-86c3-4e86f9df1052,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (23-Jul-2026 05:07:54.983) (total time: 7003ms):
Trace[1064852247]: ["GuaranteedUpdate etcd3" audit-id:be518df0-95d1-4961-86c3-4e86f9df1052,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (05:07:54.984)
Trace[1064852247]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (05:08:01.986)]
Trace[1064852247]: [7.003230055s] [7.003230055s] END
E0723 05:08:01.988028       1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
E0723 05:08:02.364644       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:02.364965       1 trace.go:236] Trace[1487429073]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f9bafed6-21cc-4e68-92f9-655cf2a7e0fd,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (23-Jul-2026 05:07:55.362) (total time: 7002ms):
Trace[1487429073]: ["Create etcd3" audit-id:f9bafed6-21cc-4e68-92f9-655cf2a7e0fd,key:/events/kube-system/kube-apiserver-instance.18c4d2eec8f3ef9b,type:*core.Event,resource:events 7002ms (05:07:55.362)]
Trace[1487429073]: [7.002734399s] [7.002734399s] END
E0723 05:08:02.907344       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:02.907518       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:02.908510       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:02.908604       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:02.909798       1 trace.go:236] Trace[679276000]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:afab83d9-1ab5-44b6-8fdd-f57b8aaa4b25,client:10.0.0.37,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:07:57.909) (total time: 5000ms):
Trace[679276000]: [5.000244279s] [5.000244279s] END
E0723 05:08:02.910004       1 timeout.go:142] post-timeout activity - time-elapsed: 2.436951ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: <nil>
E0723 05:08:03.049630       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:03.049971       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:03.049976       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:03.051502       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:03.051536       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:03.051515       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:03.052937       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:03.053010       1 trace.go:236] Trace[828174629]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:eb3f5f0e-ab33-43a9-a0f5-de9cc95577be,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 05:08:00.050) (total time: 3002ms):
Trace[828174629]: [3.002544184s] [3.002544184s] END
E0723 05:08:03.053104       1 timeout.go:142] post-timeout activity - time-elapsed: 3.6165ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0723 05:08:03.053011       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:03.054345       1 trace.go:236] Trace[100686087]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:27310e1c-c54c-4fec-9ea7-0ac12a61dc4c,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 05:08:00.052) (total time: 3002ms):
Trace[100686087]: [3.00211871s] [3.00211871s] END
E0723 05:08:03.054563       1 timeout.go:142] post-timeout activity - time-elapsed: 4.601672ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0723 05:08:03.094549       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:03.095046       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:03.096233       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0723 05:08:03.096440       1 timeout.go:142] post-timeout activity - time-elapsed: 2.044387ms, POST "/api/v1/namespaces/kube-system/events" result: <nil>
E0723 05:08:03.148065       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:03.148276       1 trace.go:236] Trace[252545578]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4f74a764-694e-4613-b08f-67b5f18259e1,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (23-Jul-2026 05:07:56.145) (total time: 7002ms):
Trace[252545578]: ["GuaranteedUpdate etcd3" audit-id:4f74a764-694e-4613-b08f-67b5f18259e1,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:07:56.145)
Trace[252545578]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:08:03.147)]
Trace[252545578]: [7.002750403s] [7.002750403s] END
E0723 05:08:05.304999       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:05.305359       1 trace.go:236] Trace[1731067722]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:95ad56c5-30c9-4f8d-a31c-dfefa3157875,client:10.0.0.52,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 05:07:53.797) (total time: 11507ms):
Trace[1731067722]: [11.507423241s] [11.507423241s] END
E0723 05:08:05.305416       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0723 05:08:05.305905       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:05.306261       1 trace.go:236] Trace[879819026]: "Get" accept:application/json,audit-id:3608be91-8a72-44e3-b7f9-2942ec367dfc,client:199.204.45.138,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces/envoy-gateway-system,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:07:51.337) (total time: 13968ms):
Trace[879819026]: [13.968703912s] [13.968703912s] END
I0723 05:08:05.306728       1 trace.go:236] Trace[1178898298]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f3011e7d-1d32-4cb4-a59e-65a8abeb19ae,client:199.204.45.138,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/ingress-nginx/services/ingress-nginx-controller,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (23-Jul-2026 05:07:57.397) (total time: 7909ms):
Trace[1178898298]: [7.909562133s] [7.909562133s] END
E0723 05:08:06.793652       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 10.6µs, panicked: false, err: context deadline exceeded, panic-reason: <nil>
E0723 05:08:06.794249       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:06.795451       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:06.795526       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:06.796721       1 trace.go:236] Trace[412132741]: "Update" accept:application/json, */*,audit-id:624b6471-a09b-4f61-b42a-76d70e8477a1,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 05:08:01.794) (total time: 5002ms):
Trace[412132741]: ["GuaranteedUpdate etcd3" audit-id:624b6471-a09b-4f61-b42a-76d70e8477a1,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (05:08:01.794)
Trace[412132741]:  ---"Txn call failed" err:context deadline exceeded 4998ms (05:08:06.793)]
Trace[412132741]: [5.002654182s] [5.002654182s] END
E0723 05:08:06.796922       1 timeout.go:142] post-timeout activity - time-elapsed: 2.603346ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0723 05:08:08.049928       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:08.050014       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:08.050134       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 77.322µs, panicked: false, err: context canceled, panic-reason: <nil>
E0723 05:08:08.051163       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:08.051243       1 trace.go:236] Trace[893973189]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c31ea985-e47c-412b-ab38-75002e7e9515,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (23-Jul-2026 05:08:03.052) (total time: 4999ms):
Trace[893973189]: ["GuaranteedUpdate etcd3" audit-id:c31ea985-e47c-412b-ab38-75002e7e9515,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 4998ms (05:08:03.052)
Trace[893973189]:  ---"Txn call failed" err:context canceled 4996ms (05:08:08.050)]
Trace[893973189]: [4.999128716s] [4.999128716s] END
E0723 05:08:08.051359       1 timeout.go:142] post-timeout activity - time-elapsed: 1.311053ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0723 05:08:08.520782       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:08.521144       1 trace.go:236] Trace[735899704]: "Update" accept:application/json, */*,audit-id:da062071-f2b4-40a2-b9ba-7446fc9bacd3,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (23-Jul-2026 05:08:01.518) (total time: 7002ms):
Trace[735899704]: ["GuaranteedUpdate etcd3" audit-id:da062071-f2b4-40a2-b9ba-7446fc9bacd3,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:08:01.518)
Trace[735899704]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:08:08.520)]
Trace[735899704]: [7.002797232s] [7.002797232s] END
E0723 05:08:08.992617       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:08.992896       1 trace.go:236] Trace[1079246820]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a25cdc1e-b43e-49c8-b7fe-a34d9b179e28,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (23-Jul-2026 05:08:01.989) (total time: 7003ms):
Trace[1079246820]: ["GuaranteedUpdate etcd3" audit-id:a25cdc1e-b43e-49c8-b7fe-a34d9b179e28,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (05:08:01.989)
Trace[1079246820]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (05:08:08.992)]
Trace[1079246820]: [7.003226697s] [7.003226697s] END
E0723 05:08:08.993497       1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
E0723 05:08:09.366149       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:09.366331       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0723 05:08:09.366598       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
I0723 05:08:09.367421       1 trace.go:236] Trace[1113913126]: "Create" accept:application/json, */*,audit-id:bcc90853-71ea-4c9a-a5ed-c6aa22790795,client:10.0.0.137,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (23-Jul-2026 05:08:01.572) (total time: 7794ms):
Trace[1113913126]: ["Create etcd3" audit-id:bcc90853-71ea-4c9a-a5ed-c6aa22790795,key:/events/openstack/rabbitmq-cluster-operator-leader-election.18c4d2f03b12ad1d,type:*core.Event,resource:events 7793ms (05:08:01.573)]
Trace[1113913126]: [7.794816361s] [7.794816361s] END
E0723 05:08:09.367531       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:09.367736       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:09.368889       1 trace.go:236] Trace[412575954]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4c9f7d49-0d36-4b41-9635-d2bfb7b44528,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (23-Jul-2026 05:08:01.370) (total time: 7998ms):
Trace[412575954]: [7.998316992s] [7.998316992s] END
E0723 05:08:09.368959       1 timeout.go:142] post-timeout activity - time-elapsed: 2.935297ms, GET "/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader" result: <nil>
E0723 05:08:10.153277       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:10.153454       1 trace.go:236] Trace[1570949854]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0691ea36-a9f0-40b4-affe-6f6196670c74,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (23-Jul-2026 05:08:03.150) (total time: 7003ms):
Trace[1570949854]: ["GuaranteedUpdate etcd3" audit-id:0691ea36-a9f0-40b4-affe-6f6196670c74,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (05:08:03.150)
Trace[1570949854]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (05:08:10.153)]
Trace[1570949854]: [7.003369824s] [7.003369824s] END
E0723 05:08:10.517463       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:10.517493       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:10.517513       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 5.59µs, panicked: false, err: context canceled, panic-reason: <nil>
E0723 05:08:10.518629       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:10.518688       1 trace.go:236] Trace[299002026]: "Create" accept:application/json, */*,audit-id:87494924-14d7-430d-98cd-27eefdbdb309,client:10.0.0.33,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (23-Jul-2026 05:08:01.734) (total time: 8784ms):
Trace[299002026]: ["Create etcd3" audit-id:87494924-14d7-430d-98cd-27eefdbdb309,key:/events/openstack/messaging-topology-operator-leader-election.18c4d2f044ab2bcc,type:*core.Event,resource:events 8783ms (05:08:01.734)]
Trace[299002026]: [8.784627602s] [8.784627602s] END
E0723 05:08:10.518788       1 timeout.go:142] post-timeout activity - time-elapsed: 1.399096ms, POST "/api/v1/namespaces/openstack/events" result: <nil>
E0723 05:08:10.560793       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:10.560891       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:10.563893       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:10.563966       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:10.567871       1 trace.go:236] Trace[1292108022]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c668ad24-b21c-445c-8af4-aafe284ce1a4,client:10.0.0.52,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 05:08:05.319) (total time: 5248ms):
Trace[1292108022]: [5.248387852s] [5.248387852s] END
E0723 05:08:10.567955       1 timeout.go:142] post-timeout activity - time-elapsed: 7.251799ms, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: <nil>
I0723 05:08:12.293189       1 trace.go:236] Trace[1073439242]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:bf54dc9e-fbe6-4ddd-835d-309bcd7aa769,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (23-Jul-2026 05:08:08.994) (total time: 3298ms):
Trace[1073439242]: ["GuaranteedUpdate etcd3" audit-id:bf54dc9e-fbe6-4ddd-835d-309bcd7aa769,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 3298ms (05:08:08.994)
Trace[1073439242]:  ---"Txn call completed" 3296ms (05:08:12.292)]
Trace[1073439242]: [3.298730561s] [3.298730561s] END
I0723 05:08:12.293306       1 trace.go:236] Trace[1751365196]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6718e0a4-2681-4732-a120-712d6ec01753,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (23-Jul-2026 05:08:09.367) (total time: 2925ms):
Trace[1751365196]: ["GuaranteedUpdate etcd3" audit-id:6718e0a4-2681-4732-a120-712d6ec01753,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 2925ms (05:08:09.367)
Trace[1751365196]:  ---"Txn call completed" 2923ms (05:08:12.292)]
Trace[1751365196]: [2.925534615s] [2.925534615s] END
E0723 05:08:12.293719       1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again"
I0723 05:08:12.293889       1 trace.go:236] Trace[1855212878]: "Get" accept:application/json, */*,audit-id:548de7f4-9e44-459e-b66b-7a4decd99f60,client:10.0.0.50,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:08:00.482) (total time: 11811ms):
Trace[1855212878]: ---"About to write a response" 11811ms (05:08:12.293)
Trace[1855212878]: [11.81137825s] [11.81137825s] END
I0723 05:08:12.294209       1 trace.go:236] Trace[1560118555]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:69479b90-0889-40cf-ad60-b6a0d1c8dde4,client:199.204.45.138,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/ingress-nginx/services/ingress-nginx-controller,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (23-Jul-2026 05:08:05.314) (total time: 6979ms):
Trace[1560118555]: ---"About to write a response" 6979ms (05:08:12.294)
Trace[1560118555]: [6.97956905s] [6.97956905s] END
I0723 05:08:12.294426       1 trace.go:236] Trace[1864802411]: "Get" accept:application/json,audit-id:55fc1a2b-92c1-43bf-b23d-a62d25fd9fc7,client:199.204.45.138,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces/ingress-nginx,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:07:58.543) (total time: 13750ms):
Trace[1864802411]: ---"About to write a response" 13750ms (05:08:12.294)
Trace[1864802411]: [13.750463018s] [13.750463018s] END
I0723 05:08:12.294446       1 trace.go:236] Trace[659469304]: "Get" accept:application/json, */*,audit-id:f346846e-1d28-49d6-bd9e-1531b5c6229f,client:10.0.0.67,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:GET (23-Jul-2026 05:08:00.482) (total time: 11811ms):
Trace[659469304]: ---"About to write a response" 11811ms (05:08:12.294)
Trace[659469304]: [11.811523893s] [11.811523893s] END
I0723 05:08:12.297289       1 trace.go:236] Trace[755990686]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:edd7b6aa-1ba8-4dc8-858f-c20fe691db97,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:08:03.379) (total time: 8917ms):
Trace[755990686]: ---"About to write a response" 8917ms (05:08:12.297)
Trace[755990686]: [8.917279927s] [8.917279927s] END
E0723 05:08:12.297359       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.202329892s, panicked: false, err: context canceled, panic-reason: <nil>
I0723 05:08:12.299092       1 trace.go:236] Trace[1892363359]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7be8eb93-e4a9-4a04-a8fb-d2d7c49a1393,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (23-Jul-2026 05:08:10.155) (total time: 2143ms):
Trace[1892363359]: ["GuaranteedUpdate etcd3" audit-id:7be8eb93-e4a9-4a04-a8fb-d2d7c49a1393,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 2143ms (05:08:10.155)
Trace[1892363359]:  ---"Txn call completed" 2141ms (05:08:12.298)]
Trace[1892363359]: [2.143852167s] [2.143852167s] END
I0723 05:08:12.300488       1 trace.go:236] Trace[1318508681]: "Get" accept:application/json,audit-id:ed4bd8be-9e7c-4635-9c9a-12ba2425b143,client:199.204.45.138,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces/envoy-gateway-system,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:08:05.380) (total time: 6919ms):
Trace[1318508681]: ---"About to write a response" 6919ms (05:08:12.300)
Trace[1318508681]: [6.919926671s] [6.919926671s] END
I0723 05:08:12.512966       1 trace.go:236] Trace[1258166835]: "Create" accept:application/json, */*,audit-id:32b9a101-604c-4d4b-a8b0-940b888929b6,client:10.0.0.37,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (23-Jul-2026 05:08:02.910) (total time: 9602ms):
Trace[1258166835]: ["Create etcd3" audit-id:32b9a101-604c-4d4b-a8b0-940b888929b6,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18c4d2f08abf21fe,type:*core.Event,resource:events 9601ms (05:08:02.911)
Trace[1258166835]:  ---"TransformToStorage succeeded" 9385ms (05:08:12.297)
Trace[1258166835]:  ---"Txn call succeeded" 215ms (05:08:12.512)]
Trace[1258166835]: [9.602130166s] [9.602130166s] END
I0723 05:08:12.513902       1 trace.go:236] Trace[436564703]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.138,type:*v1.Endpoints,resource:apiServerIPInfo (23-Jul-2026 05:08:00.175) (total time: 12338ms):
Trace[436564703]: ---"initial value restored" 12118ms (05:08:12.293)
Trace[436564703]: ---"Txn call completed" 195ms (05:08:12.513)
Trace[436564703]: [12.338450997s] [12.338450997s] END
I0723 05:08:12.514420       1 trace.go:236] Trace[1055140189]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b41fea1d-789b-46ef-9fad-ac681ed30951,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (23-Jul-2026 05:08:02.366) (total time: 10147ms):
Trace[1055140189]: ["Create etcd3" audit-id:b41fea1d-789b-46ef-9fad-ac681ed30951,key:/events/kube-system/kube-apiserver-instance.18c4d2ef8e9b3cad,type:*core.Event,resource:events 10146ms (05:08:02.367)
Trace[1055140189]:  ---"TransformToStorage succeeded" 9929ms (05:08:12.296)
Trace[1055140189]:  ---"Txn call succeeded" 216ms (05:08:12.513)]
Trace[1055140189]: [10.147496278s] [10.147496278s] END
I0723 05:08:14.432703       1 trace.go:236] Trace[1050007702]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7be7a145-7c70-4c9a-8f16-7bdca4b22554,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (23-Jul-2026 05:08:13.755) (total time: 677ms):
Trace[1050007702]: ["Create etcd3" audit-id:7be7a145-7c70-4c9a-8f16-7bdca4b22554,key:/events/openstack/rabbitmq-messaging-topology-operator-6f465c979f-wpf5x.18c4d2f0fedcccd9,type:*core.Event,resource:events 676ms (05:08:13.756)
Trace[1050007702]:  ---"Txn call succeeded" 676ms (05:08:14.432)]
Trace[1050007702]: [677.066282ms] [677.066282ms] END
I0723 05:08:14.434076       1 trace.go:236] Trace[1203300214]: "Get" accept:application/json,audit-id:22076408-569d-4b66-8535-9d1f7dab83c6,client:199.204.45.138,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces/kube-public,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:08:13.797) (total time: 636ms):
Trace[1203300214]: ---"About to write a response" 636ms (05:08:14.433)
Trace[1203300214]: [636.803193ms] [636.803193ms] END
I0723 05:08:14.434105       1 trace.go:236] Trace[1814128591]: "Get" accept:application/json,audit-id:9e7c9635-2f71-42ca-a466-34da98a57fd4,client:199.204.45.138,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces/kube-system,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:08:13.800) (total time: 633ms):
Trace[1814128591]: ---"About to write a response" 633ms (05:08:14.433)
Trace[1814128591]: [633.98976ms] [633.98976ms] END
I0723 05:08:18.402215       1 trace.go:236] Trace[554273231]: "Get" accept:application/json, */*,audit-id:8da538d0-26e0-4492-96b1-3ae87074837e,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:08:17.861) (total time: 540ms):
Trace[554273231]: ---"About to write a response" 540ms (05:08:18.402)
Trace[554273231]: [540.287446ms] [540.287446ms] END
I0723 05:08:18.402806       1 trace.go:236] Trace[840945352]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:60b246f9-72cb-4d3b-984f-743e4179129f,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-operator-869df985b8-nxvwb/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (23-Jul-2026 05:08:17.847) (total time: 555ms):
Trace[840945352]: ["GuaranteedUpdate etcd3" audit-id:60b246f9-72cb-4d3b-984f-743e4179129f,key:/pods/kube-system/cilium-operator-869df985b8-nxvwb,type:*core.Pod,resource:pods 555ms (05:08:17.847)
Trace[840945352]:  ---"Txn call completed" 550ms (05:08:18.402)]
Trace[840945352]: ---"Object stored in database" 551ms (05:08:18.402)
Trace[840945352]: [555.259741ms] [555.259741ms] END
I0723 05:08:18.593364       1 trace.go:236] Trace[1837590959]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:81da4b70-e9ff-42e7-9205-5a84a2975d28,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/cilium-operator-869df985b8-nxvwb.18c4d1f0922b530b,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (23-Jul-2026 05:08:17.934) (total time: 659ms):
Trace[1837590959]: ["GuaranteedUpdate etcd3" audit-id:81da4b70-e9ff-42e7-9205-5a84a2975d28,key:/events/kube-system/cilium-operator-869df985b8-nxvwb.18c4d1f0922b530b,type:*core.Event,resource:events 659ms (05:08:17.934)
Trace[1837590959]:  ---"initial value restored" 467ms (05:08:18.401)
Trace[1837590959]:  ---"Txn call completed" 190ms (05:08:18.593)]
Trace[1837590959]: ---"Object stored in database" 190ms (05:08:18.593)
Trace[1837590959]: [659.192943ms] [659.192943ms] END
I0723 05:08:19.486323       1 trace.go:236] Trace[1569966901]: "Get" accept:application/json,audit-id:741ffc93-2e2e-4cfe-96a9-5a8c9f316940,client:199.204.45.138,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/auth-system/configmaps/keycloak-env-vars,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:08:18.941) (total time: 544ms):
Trace[1569966901]: ---"About to write a response" 544ms (05:08:19.486)
Trace[1569966901]: [544.387521ms] [544.387521ms] END
I0723 05:08:19.486569       1 trace.go:236] Trace[454564282]: "List" accept:application/json,audit-id:0622ab1a-a85f-4c95-8074-83248d14cc9a,client:199.204.45.138,protocol:HTTP/2.0,resource:daemonsets,scope:namespace,url:/apis/apps/v1/namespaces/auth-system/daemonsets,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (23-Jul-2026 05:08:18.939) (total time: 547ms):
Trace[454564282]: ["List(recursive=true) etcd3" audit-id:0622ab1a-a85f-4c95-8074-83248d14cc9a,key:/daemonsets/auth-system,resourceVersion:,resourceVersionMatch:,limit:500,continue: 547ms (05:08:18.939)]
Trace[454564282]: [547.123622ms] [547.123622ms] END
I0723 05:08:19.486700       1 trace.go:236] Trace[1089801614]: "List" accept:application/json,audit-id:8ac18b0a-f1b5-45d1-8b43-c4bb5a2763a0,client:199.204.45.138,protocol:HTTP/2.0,resource:daemonsets,scope:namespace,url:/apis/apps/v1/namespaces/cert-manager/daemonsets,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (23-Jul-2026 05:08:18.930) (total time: 555ms):
Trace[1089801614]: ["List(recursive=true) etcd3" audit-id:8ac18b0a-f1b5-45d1-8b43-c4bb5a2763a0,key:/daemonsets/cert-manager,resourceVersion:,resourceVersionMatch:,limit:500,continue: 555ms (05:08:18.930)]
Trace[1089801614]: [555.765768ms] [555.765768ms] END
I0723 05:08:19.487416       1 trace.go:236] Trace[629460851]: "Get" accept:application/json,audit-id:0f20beef-1206-40e7-aecc-6163ed9cc826,client:199.204.45.138,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/cert-manager/configmaps/kube-root-ca.crt,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:08:18.926) (total time: 561ms):
Trace[629460851]: ---"About to write a response" 560ms (05:08:19.487)
Trace[629460851]: [561.105593ms] [561.105593ms] END
I0723 05:08:20.316215       1 trace.go:236] Trace[799071240]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7bdc4eed-345e-4168-a0ef-dacf13fe102c,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-operator-869df985b8-nxvwb/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (23-Jul-2026 05:08:19.783) (total time: 532ms):
Trace[799071240]: ["GuaranteedUpdate etcd3" audit-id:7bdc4eed-345e-4168-a0ef-dacf13fe102c,key:/pods/kube-system/cilium-operator-869df985b8-nxvwb,type:*core.Pod,resource:pods 532ms (05:08:19.784)
Trace[799071240]:  ---"Txn call completed" 525ms (05:08:20.315)]
Trace[799071240]: ---"Object stored in database" 527ms (05:08:20.315)
Trace[799071240]: [532.322893ms] [532.322893ms] END
I0723 05:08:20.318096       1 trace.go:236] Trace[775461300]: "Update" accept:application/json, */*,audit-id:2bb49f9d-d4bb-484d-b774-98128e0d6866,client:199.204.45.138,protocol:HTTP/2.0,resource:ciliumnodes,scope:resource,url:/apis/cilium.io/v2/ciliumnodes/instance/status,user-agent:cilium-operator-generic/1.14.8 cf6e022e 2024-03-13T12:23:35-04:00 go version go1.21.8 linux/amd64,verb:PUT (23-Jul-2026 05:08:19.787) (total time: 530ms):
Trace[775461300]: ["GuaranteedUpdate etcd3" audit-id:2bb49f9d-d4bb-484d-b774-98128e0d6866,key:/cilium.io/ciliumnodes/instance,type:*unstructured.Unstructured,resource:ciliumnodes.cilium.io 527ms (05:08:19.790)]
Trace[775461300]: [530.145262ms] [530.145262ms] END
I0723 05:08:20.541383       1 trace.go:236] Trace[914316621]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c58e50fd-b413-4c96-aba4-0600b5d8e7d4,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/rabbitmq-messaging-topology-operator-6f465c979f-wpf5x.18c4d2044d7f95b9,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (23-Jul-2026 05:08:20.021) (total time: 519ms):
Trace[914316621]: ["GuaranteedUpdate etcd3" audit-id:c58e50fd-b413-4c96-aba4-0600b5d8e7d4,key:/events/openstack/rabbitmq-messaging-topology-operator-6f465c979f-wpf5x.18c4d2044d7f95b9,type:*core.Event,resource:events 519ms (05:08:20.021)
Trace[914316621]:  ---"initial value restored" 295ms (05:08:20.317)
Trace[914316621]:  ---"Txn call completed" 223ms (05:08:20.540)]
Trace[914316621]: ---"Object stored in database" 223ms (05:08:20.541)
Trace[914316621]: [519.747188ms] [519.747188ms] END
E0723 05:08:32.132022       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:32.132067       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:32.132111       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 14.93µs, panicked: false, err: context canceled, panic-reason: <nil>
E0723 05:08:32.133250       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:32.133374       1 trace.go:236] Trace[800375220]: "Update" accept:application/json, */*,audit-id:314f112b-b030-4e36-a2df-4b0657deb774,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 05:08:27.131) (total time: 5001ms):
Trace[800375220]: ["GuaranteedUpdate etcd3" audit-id:314f112b-b030-4e36-a2df-4b0657deb774,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (05:08:27.131)
Trace[800375220]:  ---"Txn call failed" err:context canceled 4999ms (05:08:32.132)]
Trace[800375220]: [5.001509964s] [5.001509964s] END
E0723 05:08:32.133598       1 timeout.go:142] post-timeout activity - time-elapsed: 1.562182ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0723 05:08:32.481659       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:32.481783       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:32.482797       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:32.482871       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:32.483980       1 trace.go:236] Trace[1264644081]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:be1ad275-69f7-477c-97e8-ae15c8b9e501,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 05:08:27.481) (total time: 5001ms):
Trace[1264644081]: [5.001963619s] [5.001963619s] END
E0723 05:08:32.484124       1 timeout.go:142] post-timeout activity - time-elapsed: 2.510533ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0723 05:08:32.898366       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0723 05:08:32.898477       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:32.899726       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:32.899839       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:32.900926       1 trace.go:236] Trace[715069338]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:dc31e598-834b-482f-ae8c-f5fb9186bc68,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 05:08:27.898) (total time: 5002ms):
Trace[715069338]: [5.002278839s] [5.002278839s] END
E0723 05:08:32.901249       1 timeout.go:142] post-timeout activity - time-elapsed: 2.821923ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0723 05:08:32.948548       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0723 05:08:32.948652       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:32.949798       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:32.949853       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:32.951005       1 trace.go:236] Trace[738473478]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9a32ec29-62b7-4458-bb66-149d332f312f,client:10.0.0.137,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:08:27.947) (total time: 5003ms):
Trace[738473478]: [5.003129058s] [5.003129058s] END
E0723 05:08:32.951199       1 timeout.go:142] post-timeout activity - time-elapsed: 2.484982ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: <nil>
E0723 05:08:34.141049       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:34.141217       1 trace.go:236] Trace[405230319]: "Get" accept:application/json, */*,audit-id:f90d3780-a113-4aa0-b0ef-493a6fde1a10,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 05:08:27.137) (total time: 7003ms):
Trace[405230319]: [7.003786296s] [7.003786296s] END
E0723 05:08:34.521304       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:34.521575       1 trace.go:236] Trace[845591915]: "Update" accept:application/json, */*,audit-id:7d5e84e9-51ce-4b82-a0bc-fa239d449618,client:10.0.0.67,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:PUT (23-Jul-2026 05:08:27.517) (total time: 7003ms):
Trace[845591915]: ["GuaranteedUpdate etcd3" audit-id:7d5e84e9-51ce-4b82-a0bc-fa239d449618,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (05:08:27.518)
Trace[845591915]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (05:08:34.521)]
Trace[845591915]: [7.003533259s] [7.003533259s] END
E0723 05:08:34.523408       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:34.523637       1 trace.go:236] Trace[987828800]: "Update" accept:application/json, */*,audit-id:cf7a4740-db3b-497d-a859-23dd5a6c4d6f,client:10.0.0.50,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 05:08:27.521) (total time: 7002ms):
Trace[987828800]: ["GuaranteedUpdate etcd3" audit-id:cf7a4740-db3b-497d-a859-23dd5a6c4d6f,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:08:27.521)
Trace[987828800]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:08:34.523)]
Trace[987828800]: [7.002327738s] [7.002327738s] END
E0723 05:08:34.578494       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0723 05:08:34.578609       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:34.580131       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:34.580199       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:34.582072       1 trace.go:236] Trace[458052977]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b6ef937f-5158-4eeb-a821-b48e889354ed,client:10.0.0.52,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:08:29.578) (total time: 5003ms):
Trace[458052977]: [5.003195142s] [5.003195142s] END
E0723 05:08:34.582262       1 timeout.go:142] post-timeout activity - time-elapsed: 3.699303ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: <nil>
E0723 05:08:35.108433       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0723 05:08:35.108878       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:35.110773       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:35.110812       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:35.112067       1 trace.go:236] Trace[158230889]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d8787891-7a08-4f50-8784-5b6d5f6f7022,client:10.0.0.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:08:30.107) (total time: 5004ms):
Trace[158230889]: [5.004202086s] [5.004202086s] END
E0723 05:08:35.112206       1 timeout.go:142] post-timeout activity - time-elapsed: 3.610229ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: <nil>
E0723 05:08:35.279173       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:35.279498       1 trace.go:236] Trace[1942103334]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:54c23d3e-2c96-4c8d-8905-e97275a1d6c1,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (23-Jul-2026 05:08:28.275) (total time: 7003ms):
Trace[1942103334]: ["GuaranteedUpdate etcd3" audit-id:54c23d3e-2c96-4c8d-8905-e97275a1d6c1,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (05:08:28.276)
Trace[1942103334]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (05:08:35.279)]
Trace[1942103334]: [7.003447977s] [7.003447977s] END
E0723 05:08:37.129780       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:37.129851       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:37.130994       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:37.131035       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:37.132227       1 trace.go:236] Trace[1959105238]: "Get" accept:application/json, */*,audit-id:75f33ddc-26a7-4f51-a9a9-09f0012722c7,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:08:34.133) (total time: 2998ms):
Trace[1959105238]: [2.998867655s] [2.998867655s] END
E0723 05:08:37.132308       1 timeout.go:142] post-timeout activity - time-elapsed: 2.490603ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0723 05:08:37.137500       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:37.137569       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:37.138679       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:37.138709       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:37.139995       1 trace.go:236] Trace[1414803779]: "Get" accept:application/json, */*,audit-id:40f1b166-f987-4921-8d5c-03bead233e87,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 05:08:36.144) (total time: 995ms):
Trace[1414803779]: [995.567168ms] [995.567168ms] END
E0723 05:08:37.140161       1 timeout.go:142] post-timeout activity - time-elapsed: 2.668868ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: <nil>
E0723 05:08:37.899285       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:37.899462       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:37.900756       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:37.900835       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:37.901968       1 trace.go:236] Trace[1785601606]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:975406ae-eb99-4fc0-90b5-0d616e083bf4,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 05:08:34.902) (total time: 2999ms):
Trace[1785601606]: [2.999842588s] [2.999842588s] END
E0723 05:08:37.902253       1 timeout.go:142] post-timeout activity - time-elapsed: 2.72681ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0723 05:08:39.017315       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:39.017436       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:39.018628       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:39.018670       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:39.020389       1 trace.go:236] Trace[309605040]: "Get" accept:application/json, */*,audit-id:0b9457b5-c8d0-4dfe-9248-06fabd3ad8fb,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (23-Jul-2026 05:08:29.016) (total time: 10004ms):
Trace[309605040]: [10.004141626s] [10.004141626s] END
E0723 05:08:39.020585       1 timeout.go:142] post-timeout activity - time-elapsed: 3.211336ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: <nil>
E0723 05:08:40.005852       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:40.006198       1 trace.go:236] Trace[687818284]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7df65d55-719d-439d-a979-ddddce83507d,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (23-Jul-2026 05:08:33.002) (total time: 7003ms):
Trace[687818284]: ["GuaranteedUpdate etcd3" audit-id:7df65d55-719d-439d-a979-ddddce83507d,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (05:08:33.003)
Trace[687818284]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:08:40.005)]
Trace[687818284]: [7.003240918s] [7.003240918s] END
E0723 05:08:40.007224       1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
E0723 05:08:40.508697       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:40.508856       1 trace.go:236] Trace[1872010356]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ab59307a-7ad2-49b8-b4c1-14f47ed5f79f,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (23-Jul-2026 05:08:33.504) (total time: 7004ms):
Trace[1872010356]: ["GuaranteedUpdate etcd3" audit-id:ab59307a-7ad2-49b8-b4c1-14f47ed5f79f,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (05:08:33.504)
Trace[1872010356]:  ---"Txn call failed" err:etcdserver: request timed out 7003ms (05:08:40.508)]
Trace[1872010356]: [7.004508981s] [7.004508981s] END
E0723 05:08:41.141521       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0723 05:08:41.141549       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0723 05:08:41.141669       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:41.141674       1 trace.go:236] Trace[1288695850]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.138,type:*v1.Endpoints,resource:apiServerIPInfo (23-Jul-2026 05:08:33.004) (total time: 8136ms):
Trace[1288695850]: [8.136878548s] [8.136878548s] END
E0723 05:08:41.141703       1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out
I0723 05:08:41.141786       1 trace.go:236] Trace[506389145]: "Get" accept:application/json,audit-id:d329c3bf-2f21-43aa-89c3-6e12532d4149,client:199.204.45.138,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/serviceaccounts/default,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:08:27.188) (total time: 13952ms):
Trace[506389145]: [13.952802614s] [13.952802614s] END
E0723 05:08:41.141811       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0723 05:08:41.141895       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0723 05:08:41.142153       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:41.142995       1 trace.go:236] Trace[1416508860]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1d466b6c-1219-4a78-9917-9901fe326229,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18c4d2eec8f3ef9b,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (23-Jul-2026 05:08:31.360) (total time: 9782ms):
Trace[1416508860]: ["GuaranteedUpdate etcd3" audit-id:1d466b6c-1219-4a78-9917-9901fe326229,key:/events/kube-system/kube-apiserver-instance.18c4d2eec8f3ef9b,type:*core.Event,resource:events 9782ms (05:08:31.360)]
Trace[1416508860]: [9.782332313s] [9.782332313s] END
I0723 05:08:41.143192       1 trace.go:236] Trace[1666338054]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:acd617ec-9159-4029-bcae-d19303b4d812,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-scheduler-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:08:29.758) (total time: 11384ms):
Trace[1666338054]: [11.384334992s] [11.384334992s] END
I0723 05:08:41.143204       1 trace.go:236] Trace[2052750348]: "List" accept:application/json,audit-id:a7ff2555-7e3f-4132-9279-31ca876ea3f5,client:199.204.45.138,protocol:HTTP/2.0,resource:roles,scope:namespace,url:/apis/rbac.authorization.k8s.io/v1/namespaces/kube-public/roles,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (23-Jul-2026 05:08:27.141) (total time: 14001ms):
Trace[2052750348]: ["List(recursive=true) etcd3" audit-id:a7ff2555-7e3f-4132-9279-31ca876ea3f5,key:/roles/kube-public,resourceVersion:,resourceVersionMatch:,limit:500,continue: 14001ms (05:08:27.141)]
Trace[2052750348]: [14.001771342s] [14.001771342s] END
I0723 05:08:41.143351       1 trace.go:236] Trace[341866735]: "List" accept:application/json,audit-id:48ebf76a-d846-496e-935c-34fd785e0e0d,client:199.204.45.138,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:namespace,url:/api/v1/namespaces/kube-system/persistentvolumeclaims,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (23-Jul-2026 05:08:27.842) (total time: 13300ms):
Trace[341866735]: ["List(recursive=true) etcd3" audit-id:48ebf76a-d846-496e-935c-34fd785e0e0d,key:/persistentvolumeclaims/kube-system,resourceVersion:,resourceVersionMatch:,limit:500,continue: 13300ms (05:08:27.842)]
Trace[341866735]: [13.300847258s] [13.300847258s] END
I0723 05:08:41.143394       1 trace.go:236] Trace[227822193]: "Get" accept:application/json,audit-id:7a95ddef-9185-468f-b7d6-7ed3f695aea2,client:199.204.45.138,protocol:HTTP/2.0,resource:roles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/namespaces/envoy-gateway-system/roles/envoy-gateway-gateway-helm-leader-election-role,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:08:27.142) (total time: 14001ms):
Trace[227822193]: [14.001131501s] [14.001131501s] END
E0723 05:08:41.303743       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0723 05:08:41.303888       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:41.305078       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:41.305150       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:41.306264       1 trace.go:236] Trace[2082524134]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:83aeee37-0a8a-4d3b-9650-1687ee29c5f5,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 05:08:36.303) (total time: 5002ms):
Trace[2082524134]: [5.002562699s] [5.002562699s] END
E0723 05:08:41.306458       1 timeout.go:142] post-timeout activity - time-elapsed: 2.672098ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0723 05:08:41.557673       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0723 05:08:41.557776       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:41.558862       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:41.559052       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:41.559999       1 trace.go:236] Trace[349773704]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:af0b52af-6338-4b89-8ba8-3276d7921f53,client:10.0.0.137,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:08:36.557) (total time: 5001ms):
Trace[349773704]: [5.001993121s] [5.001993121s] END
E0723 05:08:41.560248       1 timeout.go:142] post-timeout activity - time-elapsed: 2.441811ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: <nil>
E0723 05:08:41.793641       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0723 05:08:41.793769       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:41.794870       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:41.794946       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:41.795990       1 trace.go:236] Trace[459604873]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:adcf80be-8027-4ddb-af54-416147a5aa79,client:10.0.0.52,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:08:36.793) (total time: 5002ms):
Trace[459604873]: [5.00223424s] [5.00223424s] END
E0723 05:08:41.796180       1 timeout.go:142] post-timeout activity - time-elapsed: 2.436701ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: <nil>
E0723 05:08:42.131076       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:42.131108       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:42.131137       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 10.251µs, panicked: false, err: context deadline exceeded, panic-reason: <nil>
E0723 05:08:42.132244       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:42.132300       1 trace.go:236] Trace[1417213095]: "Update" accept:application/json, */*,audit-id:8ab5e229-2a1a-4a08-967c-85054f811cec,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 05:08:37.130) (total time: 5001ms):
Trace[1417213095]: ["GuaranteedUpdate etcd3" audit-id:8ab5e229-2a1a-4a08-967c-85054f811cec,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (05:08:37.131)
Trace[1417213095]:  ---"Txn call failed" err:context deadline exceeded 4998ms (05:08:42.130)]
Trace[1417213095]: [5.001300679s] [5.001300679s] END
E0723 05:08:42.132459       1 timeout.go:142] post-timeout activity - time-elapsed: 1.298123ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0723 05:08:42.900316       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 14.19µs, panicked: false, err: context canceled, panic-reason: <nil>
E0723 05:08:42.900367       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:42.901471       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:42.901556       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:42.902677       1 trace.go:236] Trace[27834887]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b4398917-63e2-4399-933d-8d53e317a44e,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (23-Jul-2026 05:08:37.900) (total time: 5001ms):
Trace[27834887]: ["GuaranteedUpdate etcd3" audit-id:b4398917-63e2-4399-933d-8d53e317a44e,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (05:08:37.900)
Trace[27834887]:  ---"Txn call failed" err:context canceled 4998ms (05:08:42.900)]
Trace[27834887]: [5.001896378s] [5.001896378s] END
E0723 05:08:42.902902       1 timeout.go:142] post-timeout activity - time-elapsed: 2.505743ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0723 05:08:43.277844       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0723 05:08:43.277965       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:43.279475       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:43.279558       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:43.280990       1 trace.go:236] Trace[788364121]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0a2b2c74-90dc-48f1-a9e7-e0d9bb22658e,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (23-Jul-2026 05:08:35.281) (total time: 7999ms):
Trace[788364121]: [7.999071788s] [7.999071788s] END
E0723 05:08:43.281141       1 timeout.go:142] post-timeout activity - time-elapsed: 3.142894ms, GET "/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader" result: <nil>
E0723 05:08:43.500007       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
I0723 05:08:43.500158       1 trace.go:236] Trace[999909713]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:abf5c9e0-319d-4c14-8d1c-773f1369a470,client:10.0.0.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:08:38.500) (total time: 4999ms):
Trace[999909713]: [4.999444227s] [4.999444227s] END
E0723 05:08:43.500373       1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election?timeout=5s" audit-ID="abf5c9e0-319d-4c14-8d1c-773f1369a470"
E0723 05:08:43.500426       1 timeout.go:142] post-timeout activity - time-elapsed: 10.99µs, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: <nil>
E0723 05:08:44.140929       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:44.141166       1 trace.go:236] Trace[276959154]: "Update" accept:application/json, */*,audit-id:caf49995-1fbc-42b9-a969-42b6ed86179e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (23-Jul-2026 05:08:37.137) (total time: 7003ms):
Trace[276959154]: ["GuaranteedUpdate etcd3" audit-id:caf49995-1fbc-42b9-a969-42b6ed86179e,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:08:37.138)
Trace[276959154]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:08:44.140)]
Trace[276959154]: [7.003159811s] [7.003159811s] END
E0723 05:08:44.149646       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0723 05:08:44.149675       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0723 05:08:44.149697       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 6.91µs, panicked: false, err: context canceled, panic-reason: <nil>
E0723 05:08:44.150840       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0723 05:08:44.150900       1 trace.go:236] Trace[1757493811]: "Update" accept:application/json, */*,audit-id:0f3a05ef-f1ad-4036-9e24-02111c233eef,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (23-Jul-2026 05:08:39.018) (total time: 5132ms):
Trace[1757493811]: ["GuaranteedUpdate etcd3" audit-id:0f3a05ef-f1ad-4036-9e24-02111c233eef,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5131ms (05:08:39.019)
Trace[1757493811]:  ---"Txn call failed" err:context canceled 5129ms (05:08:44.149)]
Trace[1757493811]: [5.132278677s] [5.132278677s] END
E0723 05:08:44.151079       1 timeout.go:142] post-timeout activity - time-elapsed: 1.435647ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: <nil>
E0723 05:08:47.011090       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:47.011255       1 trace.go:236] Trace[1647533033]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:fd408449-6f75-4e00-bd05-860a61e9b537,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (23-Jul-2026 05:08:40.008) (total time: 7002ms):
Trace[1647533033]: ["GuaranteedUpdate etcd3" audit-id:fd408449-6f75-4e00-bd05-860a61e9b537,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:08:40.008)
Trace[1647533033]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:08:47.011)]
Trace[1647533033]: [7.002587277s] [7.002587277s] END
E0723 05:08:47.011886       1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
E0723 05:08:47.513980       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0723 05:08:47.514169       1 trace.go:236] Trace[898100536]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2b0d283b-5f7c-4372-a731-b7e82377374e,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (23-Jul-2026 05:08:40.510) (total time: 7003ms):
Trace[898100536]: ["GuaranteedUpdate etcd3" audit-id:2b0d283b-5f7c-4372-a731-b7e82377374e,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (05:08:40.510)
Trace[898100536]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (05:08:47.513)]
Trace[898100536]: [7.003558029s] [7.003558029s] END
I0723 05:08:47.597582       1 trace.go:236] Trace[1143003015]: "Get" accept:application/json, */*,audit-id:0635aea9-dcb9-4c92-a00a-1d33e41f4bc8,client:10.0.0.67,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:GET (23-Jul-2026 05:08:34.523) (total time: 13074ms):
Trace[1143003015]: ---"About to write a response" 13074ms (05:08:47.597)
Trace[1143003015]: [13.074268903s] [13.074268903s] END
I0723 05:08:47.597972       1 trace.go:236] Trace[365425338]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:77f22f69-54ea-43c8-b77d-d77910d1d33f,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (23-Jul-2026 05:08:47.012) (total time: 585ms):
Trace[365425338]: ["GuaranteedUpdate etcd3" audit-id:77f22f69-54ea-43c8-b77d-d77910d1d33f,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 585ms (05:08:47.012)
Trace[365425338]:  ---"Txn call completed" 583ms (05:08:47.597)]
Trace[365425338]: [585.285846ms] [585.285846ms] END
E0723 05:08:47.598586       1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again"
I0723 05:08:47.599046       1 trace.go:236] Trace[495169707]: "Get" accept:application/json, */*,audit-id:5184c26d-966c-4dad-b356-ba737f3e2fd8,client:10.0.0.50,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:08:34.525) (total time: 13071ms):
Trace[495169707]: ---"About to write a response" 13071ms (05:08:47.597)
Trace[495169707]: [13.071962367s] [13.071962367s] END
I0723 05:08:47.600423       1 trace.go:236] Trace[1918550932]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2a427a6f-92e8-472f-bfc1-0d338b61c08c,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (23-Jul-2026 05:08:43.279) (total time: 4321ms):
Trace[1918550932]: ["GuaranteedUpdate etcd3" audit-id:2a427a6f-92e8-472f-bfc1-0d338b61c08c,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 4320ms (05:08:43.279)
Trace[1918550932]:  ---"Txn call completed" 4315ms (05:08:47.595)]
Trace[1918550932]: [4.321057952s] [4.321057952s] END
I0723 05:08:47.601915       1 trace.go:236] Trace[1389381573]: "List" accept:application/json,audit-id:f0d84561-1bf4-4cbd-bae4-f0cab028856f,client:199.204.45.138,protocol:HTTP/2.0,resource:secrets,scope:namespace,url:/api/v1/namespaces/kube-public/secrets,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (23-Jul-2026 05:08:41.223) (total time: 6377ms):
Trace[1389381573]: ["List(recursive=true) etcd3" audit-id:f0d84561-1bf4-4cbd-bae4-f0cab028856f,key:/secrets/kube-public,resourceVersion:,resourceVersionMatch:,limit:500,continue: 6377ms (05:08:41.223)]
Trace[1389381573]: [6.377981654s] [6.377981654s] END
I0723 05:08:47.602124       1 trace.go:236] Trace[1347489674]: "Get" accept:application/json,audit-id:1a255afa-73a2-459a-b326-11bb53bf0745,client:199.204.45.138,protocol:HTTP/2.0,resource:roles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/namespaces/envoy-gateway-system/roles/envoy-gateway-gateway-helm-leader-election-role,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:08:41.259) (total time: 6342ms):
Trace[1347489674]: ---"About to write a response" 6342ms (05:08:47.601)
Trace[1347489674]: [6.342961787s] [6.342961787s] END
I0723 05:08:47.602467       1 trace.go:236] Trace[2002853662]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:38ea7865-c901-41c5-9f56-480a2066488d,client:10.0.0.137,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:08:43.957) (total time: 3644ms):
Trace[2002853662]: ---"About to write a response" 3644ms (05:08:47.602)
Trace[2002853662]: [3.644942946s] [3.644942946s] END
I0723 05:08:47.602774       1 trace.go:236] Trace[745036920]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b62d11bc-6596-48f8-9c83-6b8908769bc3,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 05:08:43.632) (total time: 3969ms):
Trace[745036920]: ---"About to write a response" 3969ms (05:08:47.602)
Trace[745036920]: [3.969889991s] [3.969889991s] END
I0723 05:08:47.602931       1 trace.go:236] Trace[980934537]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e701253f-727c-4cd5-b753-f64deb73fb72,client:10.0.0.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:08:45.743) (total time: 1859ms):
Trace[980934537]: ---"About to write a response" 1859ms (05:08:47.602)
Trace[980934537]: [1.859848673s] [1.859848673s] END
I0723 05:08:47.603054       1 trace.go:236] Trace[1181524349]: "List" accept:application/json,audit-id:216aef09-03d3-47b2-874b-eefebc805e71,client:199.204.45.138,protocol:HTTP/2.0,resource:rolebindings,scope:namespace,url:/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (23-Jul-2026 05:08:41.217) (total time: 6385ms):
Trace[1181524349]: ["List(recursive=true) etcd3" audit-id:216aef09-03d3-47b2-874b-eefebc805e71,key:/rolebindings/kube-system,resourceVersion:,resourceVersionMatch:,limit:500,continue: 6385ms (05:08:41.217)]
Trace[1181524349]: [6.385561194s] [6.385561194s] END
I0723 05:08:47.603670       1 trace.go:236] Trace[1296910466]: "Get" accept:application/json,audit-id:af5bc33a-d405-4be4-bd2c-a8fe66874608,client:199.204.45.138,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/serviceaccounts/default,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:08:41.236) (total time: 6366ms):
Trace[1296910466]: ---"About to write a response" 6366ms (05:08:47.603)
Trace[1296910466]: [6.366904718s] [6.366904718s] END
I0723 05:08:47.605503       1 trace.go:236] Trace[265057256]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:00ed28bc-9d91-4e03-91e4-08fc76ea7946,client:10.0.0.52,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:08:44.229) (total time: 3375ms):
Trace[265057256]: ---"About to write a response" 3375ms (05:08:47.605)
Trace[265057256]: [3.375546266s] [3.375546266s] END
I0723 05:08:47.606449       1 trace.go:236] Trace[363865469]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e9884718-b4d7-4ec0-9f82-6d3af9824701,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/pods/envoy-gateway-78446f96c9-rxmd4,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:08:41.146) (total time: 6455ms):
Trace[363865469]: ---"About to write a response" 6454ms (05:08:47.601)
Trace[363865469]: [6.4556617s] [6.4556617s] END
I0723 05:08:47.628766       1 trace.go:236] Trace[227807084]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e97ff038-9ea7-40d5-9faa-d841f701f8d7,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events/envoy-gateway-78446f96c9-rxmd4.18c4d2f2c2e65425,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (23-Jul-2026 05:08:41.145) (total time: 6482ms):
Trace[227807084]: ["GuaranteedUpdate etcd3" audit-id:e97ff038-9ea7-40d5-9faa-d841f701f8d7,key:/events/envoy-gateway-system/envoy-gateway-78446f96c9-rxmd4.18c4d2f2c2e65425,type:*core.Event,resource:events 6482ms (05:08:41.146)
Trace[227807084]:  ---"initial value restored" 6455ms (05:08:47.601)]
Trace[227807084]: ---"Object stored in database" 25ms (05:08:47.627)
Trace[227807084]: [6.482845308s] [6.482845308s] END
I0723 05:08:47.635340       1 trace.go:236] Trace[1738316549]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.138,type:*v1.Endpoints,resource:apiServerIPInfo (23-Jul-2026 05:08:43.005) (total time: 4630ms):
Trace[1738316549]: ---"initial value restored" 4596ms (05:08:47.601)
Trace[1738316549]: [4.630295329s] [4.630295329s] END
I0723 05:09:18.717094       1 trace.go:236] Trace[1963473154]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4ec23bc9-2779-451f-a70c-4389342d6876,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (23-Jul-2026 05:09:18.052) (total time: 664ms):
Trace[1963473154]: ["GuaranteedUpdate etcd3" audit-id:4ec23bc9-2779-451f-a70c-4389342d6876,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 664ms (05:09:18.052)
Trace[1963473154]:  ---"Txn call completed" 663ms (05:09:18.716)]
Trace[1963473154]: [664.820927ms] [664.820927ms] END
I0723 05:09:18.757907       1 trace.go:236] Trace[892416348]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7b4aae6a-24e0-4ed0-8b78-ed789393f847,client:10.0.0.137,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (23-Jul-2026 05:09:18.085) (total time: 672ms):
Trace[892416348]: ["GuaranteedUpdate etcd3" audit-id:7b4aae6a-24e0-4ed0-8b78-ed789393f847,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 672ms (05:09:18.085)
Trace[892416348]:  ---"Txn call completed" 671ms (05:09:18.757)]
Trace[892416348]: [672.350325ms] [672.350325ms] END
I0723 05:09:18.758855       1 trace.go:236] Trace[1521871842]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fb5cdef8-f736-4f49-8cda-2d3612974f0c,client:10.0.0.37,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:09:18.043) (total time: 715ms):
Trace[1521871842]: ---"About to write a response" 715ms (05:09:18.758)
Trace[1521871842]: [715.406667ms] [715.406667ms] END
I0723 05:09:18.759153       1 trace.go:236] Trace[585517446]: "Get" accept:application/json,audit-id:b9a0436e-76c4-4892-bcdb-b0188247f8cb,client:199.204.45.138,protocol:HTTP/2.0,resource:networkpolicies,scope:resource,url:/apis/networking.k8s.io/v1/namespaces/openstack/networkpolicies/rabbitmq-cluster-operator,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (23-Jul-2026 05:09:17.932) (total time: 826ms):
Trace[585517446]: ---"About to write a response" 826ms (05:09:18.759)
Trace[585517446]: [826.515889ms] [826.515889ms] END
I0723 05:09:18.759196       1 trace.go:236] Trace[1704856459]: "Get" accept:application/json, */*,audit-id:b7931be9-ce49-4492-86a6-b955a55ad3a6,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (23-Jul-2026 05:09:18.014) (total time: 744ms):
Trace[1704856459]: ---"About to write a response" 744ms (05:09:18.759)
Trace[1704856459]: [744.564142ms] [744.564142ms] END
I0723 05:09:18.760012       1 trace.go:236] Trace[1658805714]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d98533b1-9238-44ff-8fc4-e0fc36672934,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (23-Jul-2026 05:09:18.176) (total time: 583ms):
Trace[1658805714]: ---"About to write a response" 583ms (05:09:18.759)
Trace[1658805714]: [583.287083ms] [583.287083ms] END