I0626 02:13:41.672520 1 options.go:220] external host was not specified, using 199.19.213.122 I0626 02:13:41.673891 1 server.go:148] Version: v1.28.13 I0626 02:13:41.674058 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0626 02:13:42.161559 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0626 02:13:42.176576 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0626 02:13:42.176686 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0626 02:13:42.177046 1 instance.go:298] Using reconciler: lease I0626 02:13:42.468349 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0626 02:13:42.468378 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0626 02:13:42.728932 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0626 02:13:42.729084 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0626 02:13:43.176452 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0626 02:13:43.208241 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0626 02:13:43.208276 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0626 02:13:43.208281 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0626 02:13:43.208826 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0626 02:13:43.208841 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0626 02:13:43.209627 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0626 02:13:43.210227 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0626 02:13:43.210242 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0626 02:13:43.210245 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0626 02:13:43.211388 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0626 02:13:43.211403 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0626 02:13:43.217153 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0626 02:13:43.217169 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0626 02:13:43.217174 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0626 02:13:43.217697 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0626 02:13:43.217716 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0626 02:13:43.217741 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0626 02:13:43.218159 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0626 02:13:43.224855 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0626 02:13:43.224890 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0626 02:13:43.224903 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0626 02:13:43.226611 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0626 02:13:43.226634 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0626 02:13:43.226643 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0626 02:13:43.229485 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0626 02:13:43.229514 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0626 02:13:43.233110 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0626 02:13:43.233132 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0626 02:13:43.233139 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0626 02:13:43.233738 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0626 02:13:43.233760 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0626 02:13:43.233764 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0626 02:13:43.236687 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0626 02:13:43.236705 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0626 02:13:43.236710 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0626 02:13:43.238162 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0626 02:13:43.239719 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0626 02:13:43.239737 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0626 02:13:43.239742 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0626 02:13:43.244091 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0626 02:13:43.244108 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0626 02:13:43.244112 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0626 02:13:43.245079 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0626 02:13:43.245095 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0626 02:13:43.245100 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0626 02:13:43.245694 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0626 02:13:43.245708 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0626 02:13:43.276588 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0626 02:13:43.276624 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0626 02:13:43.926146 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0626 02:13:43.926165 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0626 02:13:43.926260 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0626 02:13:43.926501 1 secure_serving.go:213] Serving securely on [::]:6443 I0626 02:13:43.926618 1 controller.go:80] Starting OpenAPI V3 AggregationController I0626 02:13:43.926693 1 system_namespaces_controller.go:67] Starting system namespaces controller I0626 02:13:43.926775 1 available_controller.go:423] Starting AvailableConditionController I0626 02:13:43.926804 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0626 02:13:43.926829 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0626 02:13:43.927242 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0626 02:13:43.927263 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0626 02:13:43.927269 1 controller.go:116] Starting legacy_token_tracking_controller I0626 02:13:43.927279 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0626 02:13:43.927280 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0626 02:13:43.927304 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0626 02:13:43.927441 1 gc_controller.go:78] Starting apiserver lease garbage collector I0626 02:13:43.927802 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0626 02:13:43.927270 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0626 02:13:43.927981 1 aggregator.go:164] waiting for initial CRD sync... I0626 02:13:43.928019 1 controller.go:78] Starting OpenAPI AggregationController I0626 02:13:43.928069 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0626 02:13:43.928579 1 controller.go:134] Starting OpenAPI controller I0626 02:13:43.928627 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0626 02:13:43.928639 1 controller.go:85] Starting OpenAPI V3 controller I0626 02:13:43.928642 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0626 02:13:43.928697 1 naming_controller.go:291] Starting NamingConditionController I0626 02:13:43.928731 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0626 02:13:43.928804 1 crd_finalizer.go:266] Starting CRDFinalizer I0626 02:13:43.928769 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0626 02:13:43.928787 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0626 02:13:43.930363 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0626 02:13:43.930856 1 gc_controller.go:78] Starting apiserver lease garbage collector I0626 02:13:43.933844 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0626 02:13:43.928739 1 establishing_controller.go:76] Starting EstablishingController I0626 02:13:44.027403 1 shared_informer.go:318] Caches are synced for configmaps I0626 02:13:44.027480 1 cache.go:39] Caches are synced for AvailableConditionController controller I0626 02:13:44.027537 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0626 02:13:44.027916 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0626 02:13:44.028149 1 apf_controller.go:379] Running API Priority and Fairness config worker I0626 02:13:44.028184 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0626 02:13:44.028707 1 shared_informer.go:318] Caches are synced for crd-autoregister I0626 02:13:44.028804 1 aggregator.go:166] initial CRD sync complete... I0626 02:13:44.028842 1 autoregister_controller.go:141] Starting autoregister controller I0626 02:13:44.028878 1 cache.go:32] Waiting for caches to sync for autoregister controller I0626 02:13:44.028917 1 cache.go:39] Caches are synced for autoregister controller I0626 02:13:44.029413 1 controller.go:624] quota admission added evaluator for: namespaces I0626 02:13:44.061715 1 shared_informer.go:318] Caches are synced for node_authorizer I0626 02:13:44.068782 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0626 02:13:44.934642 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0626 02:13:44.939950 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0626 02:13:44.939979 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0626 02:13:45.561704 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0626 02:13:45.615134 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0626 02:13:45.750061 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0626 02:13:45.762732 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.19.213.122] I0626 02:13:45.764131 1 controller.go:624] quota admission added evaluator for: endpoints I0626 02:13:45.769676 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0626 02:13:47.126600 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0626 02:13:47.525699 1 controller.go:624] quota admission added evaluator for: deployments.apps I0626 02:13:47.558991 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0626 02:13:47.764980 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0626 02:13:52.214510 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0626 02:13:52.341235 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0626 02:14:21.068247 1 trace.go:236] Trace[521364684]: "Get" accept:application/json, */*,audit-id:b53a3dda-c66c-4656-bb16-7e6aaa90b643,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:14:20.498) (total time: 569ms): Trace[521364684]: ---"About to write a response" 569ms (02:14:21.068) Trace[521364684]: [569.38302ms] [569.38302ms] END I0626 02:14:21.068260 1 trace.go:236] Trace[676072555]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:06221365-d88d-4090-a34f-e3b2231f6b9e,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:14:20.503) (total time: 564ms): Trace[676072555]: ---"About to write a response" 564ms (02:14:21.067) Trace[676072555]: [564.437426ms] [564.437426ms] END I0626 02:14:21.069143 1 trace.go:236] Trace[1047336]: "Create" accept:application/json,audit-id:cbb445ad-dd71-49c2-b0f6-3c776e4b66ca,client:199.19.213.122,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 02:14:20.433) (total time: 635ms): Trace[1047336]: ["Create etcd3" audit-id:cbb445ad-dd71-49c2-b0f6-3c776e4b66ca,key:/apiextensions.k8s.io/customresourcedefinitions/gatewayclasses.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 628ms (02:14:20.440) Trace[1047336]: ---"Txn call succeeded" 626ms (02:14:21.067)] Trace[1047336]: [635.805708ms] [635.805708ms] END I0626 02:14:21.070917 1 trace.go:236] Trace[1597591216]: "Create" accept:application/json,audit-id:8ac7dbd0-1fea-41f1-bd17-474bcc95fa57,client:199.19.213.122,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 02:14:20.439) (total time: 631ms): Trace[1597591216]: ["Create etcd3" audit-id:8ac7dbd0-1fea-41f1-bd17-474bcc95fa57,key:/apiextensions.k8s.io/customresourcedefinitions/referencegrants.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 629ms (02:14:20.440) Trace[1597591216]: ---"Txn call succeeded" 626ms (02:14:21.067)] Trace[1597591216]: [631.610532ms] [631.610532ms] END I0626 02:14:21.071892 1 trace.go:236] Trace[1103463582]: "Create" accept:application/json,audit-id:f2908886-ee9e-40f9-8034-ad67a0de30e5,client:199.19.213.122,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 02:14:20.436) (total time: 635ms): Trace[1103463582]: ["Create etcd3" audit-id:f2908886-ee9e-40f9-8034-ad67a0de30e5,key:/apiextensions.k8s.io/customresourcedefinitions/xbackendtrafficpolicies.gateway.networking.x-k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 623ms (02:14:20.448) Trace[1103463582]: ---"Txn call succeeded" 619ms (02:14:21.068)] Trace[1103463582]: [635.145693ms] [635.145693ms] END I0626 02:14:21.072588 1 trace.go:236] Trace[429173907]: "Create" accept:application/json,audit-id:0de3e552-58d5-4103-91dc-a454bc08be11,client:199.19.213.122,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 02:14:20.439) (total time: 633ms): Trace[429173907]: ["Create etcd3" audit-id:0de3e552-58d5-4103-91dc-a454bc08be11,key:/apiextensions.k8s.io/customresourcedefinitions/xlistenersets.gateway.networking.x-k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 621ms (02:14:20.450) Trace[429173907]: ---"Txn call succeeded" 618ms (02:14:21.069)] Trace[429173907]: [633.28458ms] [633.28458ms] END I0626 02:14:21.073458 1 trace.go:236] Trace[745619762]: "Create" accept:application/json,audit-id:ff390c08-61e6-416d-9721-9bd65fe7ff91,client:199.19.213.122,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 02:14:20.439) (total time: 633ms): Trace[745619762]: ["Create etcd3" audit-id:ff390c08-61e6-416d-9721-9bd65fe7ff91,key:/apiextensions.k8s.io/customresourcedefinitions/tcproutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 620ms (02:14:20.452) Trace[745619762]: ---"Txn call succeeded" 615ms (02:14:21.068)] Trace[745619762]: [633.907225ms] [633.907225ms] END I0626 02:14:21.075234 1 trace.go:236] Trace[2086692081]: "Create" accept:application/json,audit-id:7c4674d7-8ee2-4c06-99c5-179bb06f7bdb,client:199.19.213.122,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 02:14:20.435) (total time: 639ms): Trace[2086692081]: ["Create etcd3" audit-id:7c4674d7-8ee2-4c06-99c5-179bb06f7bdb,key:/apiextensions.k8s.io/customresourcedefinitions/udproutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 612ms (02:14:20.462) Trace[2086692081]: ---"Txn call succeeded" 609ms (02:14:21.072)] Trace[2086692081]: [639.402239ms] [639.402239ms] END I0626 02:14:21.075753 1 trace.go:236] Trace[625571780]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:081463ec-a2b9-4ffa-ba57-8159dd5b6543,client:::1,protocol:HTTP/2.0,resource:apiservices,scope:resource,url:/apis/apiregistration.k8s.io/v1/apiservices,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (26-Jun-2026 02:14:20.575) (total time: 500ms): Trace[625571780]: [500.036042ms] [500.036042ms] END I0626 02:14:21.075932 1 trace.go:236] Trace[128435771]: "Update" accept:application/json, */*,audit-id:a0a47114-2d0c-4284-be08-2369ef123f9d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 02:14:20.573) (total time: 502ms): Trace[128435771]: ["GuaranteedUpdate etcd3" audit-id:a0a47114-2d0c-4284-be08-2369ef123f9d,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 502ms (02:14:20.573) Trace[128435771]: ---"Txn call completed" 501ms (02:14:21.075)] Trace[128435771]: [502.54589ms] [502.54589ms] END I0626 02:14:21.076780 1 trace.go:236] Trace[801929388]: "Create" accept:application/json,audit-id:8fd24e12-f66a-446c-82ab-5228ab3b7b20,client:199.19.213.122,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 02:14:20.448) (total time: 628ms): Trace[801929388]: ["Create etcd3" audit-id:8fd24e12-f66a-446c-82ab-5228ab3b7b20,key:/apiextensions.k8s.io/customresourcedefinitions/backendtlspolicies.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 619ms (02:14:20.456) Trace[801929388]: ---"Txn call succeeded" 611ms (02:14:21.068)] Trace[801929388]: [628.48973ms] [628.48973ms] END I0626 02:14:21.080120 1 trace.go:236] Trace[1893444424]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e2d4a246-4e82-4832-a660-242b4f6af87e,client:::1,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/xmeshes.gateway.networking.x-k8s.io/status,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:14:20.575) (total time: 504ms): Trace[1893444424]: ["GuaranteedUpdate etcd3" audit-id:e2d4a246-4e82-4832-a660-242b4f6af87e,key:/apiextensions.k8s.io/customresourcedefinitions/xmeshes.gateway.networking.x-k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 503ms (02:14:20.576) Trace[1893444424]: ---"Txn call completed" 497ms (02:14:21.076)] Trace[1893444424]: [504.254028ms] [504.254028ms] END I0626 02:14:21.084718 1 trace.go:236] Trace[1692636465]: "Create" accept:application/json,audit-id:d6dbb534-f41c-47c1-a621-3caac7fb2aad,client:199.19.213.122,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 02:14:20.441) (total time: 642ms): Trace[1692636465]: ---"Conversion done" 16ms (02:14:20.459) Trace[1692636465]: ["Create etcd3" audit-id:d6dbb534-f41c-47c1-a621-3caac7fb2aad,key:/apiextensions.k8s.io/customresourcedefinitions/gateways.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 592ms (02:14:20.492) Trace[1692636465]: ---"Txn call succeeded" 574ms (02:14:21.067)] Trace[1692636465]: [642.701253ms] [642.701253ms] END I0626 02:14:21.084851 1 trace.go:236] Trace[732515019]: "Create" accept:application/json,audit-id:cdc06ad9-c193-445e-8e31-7f3b7d2554c8,client:199.19.213.122,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 02:14:20.439) (total time: 645ms): Trace[732515019]: ["Create etcd3" audit-id:cdc06ad9-c193-445e-8e31-7f3b7d2554c8,key:/apiextensions.k8s.io/customresourcedefinitions/grpcroutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 577ms (02:14:20.507) Trace[732515019]: ---"Txn call succeeded" 559ms (02:14:21.068)] Trace[732515019]: [645.721202ms] [645.721202ms] END I0626 02:14:21.092207 1 trace.go:236] Trace[1196734911]: "Create" accept:application/json,audit-id:92274e3f-c3f9-401f-9f7b-1aeff41ed4fc,client:199.19.213.122,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 02:14:20.443) (total time: 648ms): Trace[1196734911]: ["Create etcd3" audit-id:92274e3f-c3f9-401f-9f7b-1aeff41ed4fc,key:/apiextensions.k8s.io/customresourcedefinitions/tlsroutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 628ms (02:14:20.463) Trace[1196734911]: ---"Txn call succeeded" 607ms (02:14:21.071)] Trace[1196734911]: ---"Writing http response done" 15ms (02:14:21.092) Trace[1196734911]: [648.153147ms] [648.153147ms] END I0626 02:14:21.116696 1 trace.go:236] Trace[1233029568]: "Create" accept:application/json,audit-id:76c384fc-3f45-41da-9773-7b3470b11d96,client:199.19.213.122,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (26-Jun-2026 02:14:20.448) (total time: 658ms): Trace[1233029568]: ---"Writing http response done" 13ms (02:14:21.106) Trace[1233029568]: [658.094453ms] [658.094453ms] END I0626 02:14:21.138126 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0626 02:14:21.195217 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0626 02:14:21.226430 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0626 02:14:21.233688 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0626 02:14:21.267590 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0626 02:14:21.267630 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0626 02:14:21.282858 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0626 02:14:21.313819 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0626 02:14:21.313860 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0626 02:14:21.360553 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0626 02:14:21.360657 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0626 02:14:21.417663 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0626 02:14:21.501352 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0626 02:14:21.501595 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0626 02:14:21.525509 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0626 02:14:21.543654 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0626 02:14:21.543710 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0626 02:14:21.563544 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:14:22.016940 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:14:22.439743 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:14:22.515453 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:14:22.550658 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:14:22.768132 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:14:22.885479 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:14:22.955717 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:14:28.915714 1 trace.go:236] Trace[326377374]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7c521f82-165b-4828-94a3-b4687165d73b,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:14:27.902) (total time: 1012ms): Trace[326377374]: ---"About to write a response" 1012ms (02:14:28.915) Trace[326377374]: [1.012926038s] [1.012926038s] END I0626 02:14:28.974998 1 trace.go:236] Trace[543229804]: "Update" accept:application/json, */*,audit-id:c3b3a510-3d48-4e57-9dfe-148afcb481b0,client:199.19.213.122,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/secrets/sh.helm.release.v1.envoy-gateway.v1,user-agent:Helm/3.11.2,verb:PUT (26-Jun-2026 02:14:28.189) (total time: 785ms): Trace[543229804]: ---"Conversion done" 19ms (02:14:28.214) Trace[543229804]: ["GuaranteedUpdate etcd3" audit-id:c3b3a510-3d48-4e57-9dfe-148afcb481b0,key:/secrets/envoy-gateway-system/sh.helm.release.v1.envoy-gateway.v1,type:*core.Secret,resource:secrets 759ms (02:14:28.215) Trace[543229804]: ---"Txn call completed" 720ms (02:14:28.941)] Trace[543229804]: ---"Writing http response done" 32ms (02:14:28.974) Trace[543229804]: [785.85781ms] [785.85781ms] END I0626 02:14:29.169218 1 trace.go:236] Trace[711665111]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4a27a9b3-45f7-4168-aade-6415c60b3b19,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:14:28.289) (total time: 879ms): Trace[711665111]: ["GuaranteedUpdate etcd3" audit-id:4a27a9b3-45f7-4168-aade-6415c60b3b19,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 879ms (02:14:28.289) Trace[711665111]: ---"Txn call completed" 878ms (02:14:29.169)] Trace[711665111]: [879.555924ms] [879.555924ms] END I0626 02:14:29.491857 1 trace.go:236] Trace[1817353634]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:55746528-7a8c-4e9c-89b7-c40f335b5007,client:199.19.213.122,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-wgh98,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 02:14:28.738) (total time: 753ms): Trace[1817353634]: ---"About to write a response" 753ms (02:14:29.491) Trace[1817353634]: [753.374619ms] [753.374619ms] END I0626 02:14:31.332512 1 trace.go:236] Trace[1032702432]: "Update" accept:application/json, */*,audit-id:a3c376bc-1792-420a-b05c-dc7eca70f743,client:199.19.213.122,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/secrets/sh.helm.release.v1.envoy-gateway.v1,user-agent:Helm/3.11.2,verb:PUT (26-Jun-2026 02:14:29.988) (total time: 1343ms): Trace[1032702432]: ---"Conversion done" 26ms (02:14:30.019) Trace[1032702432]: ["GuaranteedUpdate etcd3" audit-id:a3c376bc-1792-420a-b05c-dc7eca70f743,key:/secrets/envoy-gateway-system/sh.helm.release.v1.envoy-gateway.v1,type:*core.Secret,resource:secrets 1312ms (02:14:30.019) Trace[1032702432]: ---"Txn call completed" 1276ms (02:14:31.300)] Trace[1032702432]: ---"Writing http response done" 30ms (02:14:31.332) Trace[1032702432]: [1.34352238s] [1.34352238s] END I0626 02:14:32.748573 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0626 02:14:33.237643 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0626 02:14:33.243991 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0626 02:14:33.266689 1 controller.go:624] quota admission added evaluator for: jobs.batch I0626 02:14:33.332055 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0626 02:14:33.529618 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0626 02:14:33.721469 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0626 02:14:33.934019 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0626 02:14:34.124318 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0626 02:14:34.449453 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0626 02:14:36.528961 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0626 02:14:36.924672 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0626 02:14:37.558962 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0626 02:14:37.559003 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0626 02:14:40.554643 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0626 02:14:50.961007 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.110.120.193"} W0626 02:14:51.001936 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.110.120.193:9443: connect: connection refused E0626 02:14:51.001980 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.110.120.193:9443: connect: connection refused I0626 02:15:06.366854 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0626 02:15:06.384187 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0626 02:15:06.412090 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0626 02:15:06.436134 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.108.66.239"} I0626 02:15:06.448306 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.100.184.64"} I0626 02:15:06.461185 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0626 02:15:06.516179 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0626 02:15:06.552263 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0626 02:15:17.746528 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0626 02:15:18.561427 1 trace.go:236] Trace[66025059]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:cd45266d-dec1-482c-b9cc-4bb6ce2cc2a2,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:15:18.055) (total time: 505ms): Trace[66025059]: ---"About to write a response" 505ms (02:15:18.561) Trace[66025059]: [505.636419ms] [505.636419ms] END I0626 02:15:24.340109 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0626 02:15:40.266595 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.99.25.95"} I0626 02:15:40.280228 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.111.109.211"} I0626 02:15:40.289709 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.106.106.149"} I0626 02:15:40.299773 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.97.227.115"} I0626 02:15:46.727656 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0626 02:15:46.747871 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0626 02:15:46.769598 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0626 02:15:46.780253 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0626 02:15:46.807290 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0626 02:15:46.829763 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0626 02:15:46.846458 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0626 02:15:46.863988 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0626 02:15:46.883815 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0626 02:15:46.900933 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0626 02:15:46.919971 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0626 02:15:46.942874 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0626 02:15:46.959654 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0626 02:15:48.218294 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0626 02:15:52.427251 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0626 02:15:52.432965 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0626 02:15:52.490144 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.111.223.163"} I0626 02:15:52.539167 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0626 02:15:54.635219 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0626 02:15:54.671741 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0626 02:15:55.279165 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0626 02:15:55.279224 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0626 02:15:55.279276 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0626 02:16:02.959997 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0626 02:16:06.932729 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.102.9.201"} I0626 02:16:07.309662 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0626 02:16:07.575950 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.98.27.101"} I0626 02:16:07.593931 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.98.34.66"} I0626 02:16:11.384043 1 trace.go:236] Trace[240859533]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b12d05c2-fc2f-4bd7-92a4-f4167d68e585,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 02:16:10.396) (total time: 987ms): Trace[240859533]: ["GuaranteedUpdate etcd3" audit-id:b12d05c2-fc2f-4bd7-92a4-f4167d68e585,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 987ms (02:16:10.396) Trace[240859533]: ---"Txn call completed" 985ms (02:16:11.383)] Trace[240859533]: [987.270537ms] [987.270537ms] END I0626 02:16:11.450990 1 trace.go:236] Trace[1349613388]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d7d897b5-6de9-4a63-ba98-502939e20c02,client:10.0.0.106,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:16:10.735) (total time: 715ms): Trace[1349613388]: ["GuaranteedUpdate etcd3" audit-id:d7d897b5-6de9-4a63-ba98-502939e20c02,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 715ms (02:16:10.735) Trace[1349613388]: ---"Txn call completed" 714ms (02:16:11.450)] Trace[1349613388]: [715.851135ms] [715.851135ms] END I0626 02:16:11.451559 1 trace.go:236] Trace[192418674]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3bdd023c-6d2c-468e-ad4e-e2da230c102e,client:10.0.0.75,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:16:10.546) (total time: 905ms): Trace[192418674]: ["GuaranteedUpdate etcd3" audit-id:3bdd023c-6d2c-468e-ad4e-e2da230c102e,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 904ms (02:16:10.546) Trace[192418674]: ---"Txn call completed" 903ms (02:16:11.451)] Trace[192418674]: [905.037713ms] [905.037713ms] END I0626 02:16:11.451705 1 trace.go:236] Trace[1310599151]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ca6524d4-a9ad-4361-9517-b86b84a5f50c,client:199.19.213.122,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-1db687ae-e5b1-4466-b768-ab78474de103/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 02:16:10.397) (total time: 1054ms): Trace[1310599151]: ["GuaranteedUpdate etcd3" audit-id:ca6524d4-a9ad-4361-9517-b86b84a5f50c,key:/pods/local-path-storage/helper-pod-create-pvc-1db687ae-e5b1-4466-b768-ab78474de103,type:*core.Pod,resource:pods 1053ms (02:16:10.397) Trace[1310599151]: ---"Txn call completed" 1049ms (02:16:11.451)] Trace[1310599151]: ---"Object stored in database" 1050ms (02:16:11.451) Trace[1310599151]: [1.054234709s] [1.054234709s] END I0626 02:16:12.381491 1 trace.go:236] Trace[142457541]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:54639046-1cd5-4b0e-8f97-88c44304ce58,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:16:11.110) (total time: 1270ms): Trace[142457541]: ["GuaranteedUpdate etcd3" audit-id:54639046-1cd5-4b0e-8f97-88c44304ce58,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1270ms (02:16:11.111) Trace[142457541]: ---"Txn call completed" 1269ms (02:16:12.381)] Trace[142457541]: [1.270357841s] [1.270357841s] END I0626 02:16:12.381695 1 trace.go:236] Trace[207547869]: "Get" accept:application/json, */*,audit-id:2c03e97d-4c81-46f4-b842-15ca0f5e0b5f,client:10.0.0.34,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:16:10.765) (total time: 1616ms): Trace[207547869]: ---"About to write a response" 1616ms (02:16:12.381) Trace[207547869]: [1.616180694s] [1.616180694s] END I0626 02:16:12.381491 1 trace.go:236] Trace[508743466]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0d167604-c2dd-4a6b-a8ba-25c278b05d8e,client:10.0.0.209,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:16:11.045) (total time: 1336ms): Trace[508743466]: ["GuaranteedUpdate etcd3" audit-id:0d167604-c2dd-4a6b-a8ba-25c278b05d8e,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1336ms (02:16:11.045) Trace[508743466]: ---"Txn call completed" 1335ms (02:16:12.381)] Trace[508743466]: [1.336343228s] [1.336343228s] END I0626 02:16:12.381985 1 trace.go:236] Trace[1216992429]: "Get" accept:application/json,audit-id:f2576684-83d2-4979-8edc-4444163635b7,client:199.19.213.122,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (26-Jun-2026 02:16:11.182) (total time: 1199ms): Trace[1216992429]: ---"About to write a response" 1199ms (02:16:12.381) Trace[1216992429]: [1.19950994s] [1.19950994s] END I0626 02:16:12.382029 1 trace.go:236] Trace[761532146]: "Get" accept:application/json, */*,audit-id:d5c0fd65-ffa2-418e-b896-79e04b4f482b,client:10.0.0.97,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-1db687ae-e5b1-4466-b768-ab78474de103,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:16:10.538) (total time: 1842ms): Trace[761532146]: ---"About to write a response" 1842ms (02:16:12.381) Trace[761532146]: [1.842986596s] [1.842986596s] END I0626 02:16:12.382997 1 trace.go:236] Trace[1310530772]: "Get" accept:application/json, */*,audit-id:8d1cfd02-64ab-4108-9674-8e2bd17c3894,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:16:11.877) (total time: 505ms): Trace[1310530772]: ---"About to write a response" 505ms (02:16:12.382) Trace[1310530772]: [505.746341ms] [505.746341ms] END I0626 02:16:12.383267 1 trace.go:236] Trace[587244777]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d2b2268b-238d-40bb-9671-b783a978d53f,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:16:11.437) (total time: 945ms): Trace[587244777]: ["GuaranteedUpdate etcd3" audit-id:d2b2268b-238d-40bb-9671-b783a978d53f,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 945ms (02:16:11.437) Trace[587244777]: ---"Txn call completed" 942ms (02:16:12.381)] Trace[587244777]: [945.440146ms] [945.440146ms] END I0626 02:16:12.383312 1 trace.go:236] Trace[814441702]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a964b0c3-3c1a-4810-bd62-a150c61287fb,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:16:11.833) (total time: 549ms): Trace[814441702]: ---"About to write a response" 549ms (02:16:12.383) Trace[814441702]: [549.919714ms] [549.919714ms] END I0626 02:16:12.383686 1 trace.go:236] Trace[1164144935]: "Get" accept:application/json, */*,audit-id:fd2a4157-7997-484d-9e7e-d60774d0fb32,client:10.0.0.92,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (26-Jun-2026 02:16:11.577) (total time: 806ms): Trace[1164144935]: ---"About to write a response" 806ms (02:16:12.383) Trace[1164144935]: [806.306002ms] [806.306002ms] END I0626 02:16:27.221735 1 trace.go:236] Trace[1981198687]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c37cead2-1396-4f2a-9208-52a787a64c2c,client:10.0.0.209,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:16:26.580) (total time: 641ms): Trace[1981198687]: ["GuaranteedUpdate etcd3" audit-id:c37cead2-1396-4f2a-9208-52a787a64c2c,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 640ms (02:16:26.580) Trace[1981198687]: ---"Txn call completed" 639ms (02:16:27.220)] Trace[1981198687]: [641.09552ms] [641.09552ms] END I0626 02:16:27.353052 1 trace.go:236] Trace[1216042219]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:096d01f0-12ed-4f82-9f66-51a3dfaca1f4,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:16:26.582) (total time: 770ms): Trace[1216042219]: ["GuaranteedUpdate etcd3" audit-id:096d01f0-12ed-4f82-9f66-51a3dfaca1f4,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 770ms (02:16:26.582) Trace[1216042219]: ---"Txn call completed" 768ms (02:16:27.352)] Trace[1216042219]: [770.383199ms] [770.383199ms] END I0626 02:16:27.355271 1 trace.go:236] Trace[1275619733]: "Get" accept:application/json, */*,audit-id:03d54534-f304-46e8-abfa-bde45276ef98,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:16:26.594) (total time: 760ms): Trace[1275619733]: ---"About to write a response" 760ms (02:16:27.355) Trace[1275619733]: [760.23171ms] [760.23171ms] END I0626 02:16:27.355299 1 trace.go:236] Trace[1869400868]: "Get" accept:application/json,audit-id:1f442e2d-6c53-4cee-b4a5-9eca0b22ac4c,client:199.19.213.122,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (26-Jun-2026 02:16:26.590) (total time: 765ms): Trace[1869400868]: ---"About to write a response" 764ms (02:16:27.354) Trace[1869400868]: [765.177693ms] [765.177693ms] END I0626 02:16:27.355303 1 trace.go:236] Trace[1552929319]: "Get" accept:application/json, */*,audit-id:be2e0ecd-8913-4314-9fe9-e4334cb6ee3e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:16:26.592) (total time: 762ms): Trace[1552929319]: ---"About to write a response" 762ms (02:16:27.355) Trace[1552929319]: [762.568615ms] [762.568615ms] END I0626 02:16:27.355322 1 trace.go:236] Trace[767834841]: "Get" accept:application/json, */*,audit-id:7f3363e5-42f5-4469-8e4c-6f70e724fc38,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:16:26.602) (total time: 753ms): Trace[767834841]: ---"About to write a response" 753ms (02:16:27.355) Trace[767834841]: [753.198418ms] [753.198418ms] END I0626 02:16:27.357328 1 trace.go:236] Trace[321129438]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d3048f35-9743-4a10-ba01-4c80ab7ed355,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:16:26.591) (total time: 766ms): Trace[321129438]: ---"About to write a response" 766ms (02:16:27.357) Trace[321129438]: [766.151038ms] [766.151038ms] END I0626 02:16:48.220224 1 trace.go:236] Trace[242851883]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6968f86e-1281-4e5d-97ac-05d15d28a9bb,client:199.19.213.122,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/percona-xtradb-haproxy-0.18bc7feab0e52ef9,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 02:16:47.700) (total time: 520ms): Trace[242851883]: ["GuaranteedUpdate etcd3" audit-id:6968f86e-1281-4e5d-97ac-05d15d28a9bb,key:/events/openstack/percona-xtradb-haproxy-0.18bc7feab0e52ef9,type:*core.Event,resource:events 519ms (02:16:47.700) Trace[242851883]: ---"initial value restored" 264ms (02:16:47.964) Trace[242851883]: ---"Txn call completed" 251ms (02:16:48.219)] Trace[242851883]: ---"Object stored in database" 253ms (02:16:48.219) Trace[242851883]: [520.013938ms] [520.013938ms] END I0626 02:16:51.042075 1 trace.go:236] Trace[1779395313]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3c857dad-abb8-4378-bdc6-cd9460721e5c,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 02:16:50.255) (total time: 786ms): Trace[1779395313]: ["GuaranteedUpdate etcd3" audit-id:3c857dad-abb8-4378-bdc6-cd9460721e5c,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 786ms (02:16:50.255) Trace[1779395313]: ---"Txn call completed" 785ms (02:16:51.041)] Trace[1779395313]: [786.428776ms] [786.428776ms] END I0626 02:16:51.042388 1 trace.go:236] Trace[2051932202]: "Update" accept:application/json, */*,audit-id:811eafa2-5c13-408f-9933-3546855f1cc1,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 02:16:50.256) (total time: 786ms): Trace[2051932202]: ["GuaranteedUpdate etcd3" audit-id:811eafa2-5c13-408f-9933-3546855f1cc1,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 785ms (02:16:50.256) Trace[2051932202]: ---"Txn call completed" 785ms (02:16:51.042)] Trace[2051932202]: [786.092211ms] [786.092211ms] END I0626 02:16:51.042475 1 trace.go:236] Trace[2133819821]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0fb1e415-5b1d-49f9-964d-5430ca0c7570,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 02:16:50.253) (total time: 788ms): Trace[2133819821]: ["GuaranteedUpdate etcd3" audit-id:0fb1e415-5b1d-49f9-964d-5430ca0c7570,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 788ms (02:16:50.253) Trace[2133819821]: ---"Txn call completed" 787ms (02:16:51.041)] Trace[2133819821]: [788.584356ms] [788.584356ms] END I0626 02:16:51.042603 1 trace.go:236] Trace[2083442128]: "Update" accept:application/json, */*,audit-id:0b12bf49-27ce-46aa-be9f-55b3306ce8ca,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 02:16:50.255) (total time: 787ms): Trace[2083442128]: ["GuaranteedUpdate etcd3" audit-id:0b12bf49-27ce-46aa-be9f-55b3306ce8ca,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 787ms (02:16:50.255) Trace[2083442128]: ---"Txn call completed" 786ms (02:16:51.042)] Trace[2083442128]: [787.191956ms] [787.191956ms] END I0626 02:16:51.043249 1 trace.go:236] Trace[934301909]: "Update" accept:application/json, */*,audit-id:4466dd72-bb55-43bc-8eaa-50dcbafb2a87,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:16:50.255) (total time: 787ms): Trace[934301909]: ["GuaranteedUpdate etcd3" audit-id:4466dd72-bb55-43bc-8eaa-50dcbafb2a87,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 787ms (02:16:50.255) Trace[934301909]: ---"Txn call completed" 786ms (02:16:51.042)] Trace[934301909]: [787.358809ms] [787.358809ms] END I0626 02:18:21.007272 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.107.190.119"} I0626 02:18:23.268728 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.99.164.102"} I0626 02:18:24.202634 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.107.55.248"} I0626 02:18:32.657758 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.105.29.205"} I0626 02:18:32.677382 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.105.84.102"} I0626 02:20:56.515815 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0626 02:20:58.460979 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0626 02:20:58.470872 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0626 02:20:58.482969 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0626 02:20:58.496839 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0626 02:20:58.507815 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0626 02:20:58.514805 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0626 02:20:58.525588 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0626 02:21:10.986036 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0626 02:21:50.017192 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0626 02:22:04.175589 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0626 02:22:04.449482 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0626 02:22:04.450045 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0626 02:22:04.464007 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0626 02:22:04.898539 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0626 02:22:05.174660 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0626 02:22:05.177047 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0626 02:22:05.253082 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0626 02:22:05.275135 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0626 02:22:05.378163 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0626 02:22:48.831451 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.105.137.176"} I0626 02:22:48.845515 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.96.100.215"} I0626 02:22:48.857942 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.97.50.37"} I0626 02:22:48.869209 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.97.206.250"} I0626 02:22:48.878965 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.99.182.223"} I0626 02:22:48.887805 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.97.81.189"} I0626 02:22:48.932956 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0626 02:22:48.963693 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0626 02:22:49.118615 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0626 02:22:49.160224 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0626 02:22:49.206085 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0626 02:22:49.218795 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.218836 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.218921 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.218942 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.219231 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.219284 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.219663 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.219686 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.220081 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.220102 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.220124 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.220139 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.220814 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.220856 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.222066 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.222096 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.222917 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.222947 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.223469 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.223501 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.224796 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.224862 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.225430 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.225530 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.225787 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.225808 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.226613 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.226637 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.227764 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.227791 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused W0626 02:22:49.229263 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused E0626 02:22:49.229293 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.100.215:443: connect: connection refused I0626 02:23:06.454873 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0626 02:23:06.626602 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.104.235.129"} I0626 02:23:47.548525 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.100.92.78"} I0626 02:23:47.568753 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0626 02:23:48.575999 1 trace.go:236] Trace[1373727678]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3496254a-b8a0-4b88-9cf5-40b47b62ac34,client:10.0.0.106,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:23:48.049) (total time: 526ms): Trace[1373727678]: ["GuaranteedUpdate etcd3" audit-id:3496254a-b8a0-4b88-9cf5-40b47b62ac34,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 525ms (02:23:48.050) Trace[1373727678]: ---"Txn call completed" 524ms (02:23:48.575)] Trace[1373727678]: [526.038834ms] [526.038834ms] END I0626 02:23:49.542665 1 trace.go:236] Trace[914951991]: "Get" accept:application/json, */*,audit-id:b2b367f7-e3c1-4767-8b50-3b5f4ea00c83,client:10.0.0.37,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/monitoring/secrets/kube-prometheus-stack-admission,user-agent:PrometheusOperator/0.74.0,verb:GET (26-Jun-2026 02:23:48.610) (total time: 932ms): Trace[914951991]: ---"About to write a response" 931ms (02:23:49.542) Trace[914951991]: [932.092873ms] [932.092873ms] END I0626 02:23:49.543156 1 trace.go:236] Trace[614744377]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0d004d77-7ad5-4498-b969-b809cf96520f,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 02:23:48.578) (total time: 964ms): Trace[614744377]: ["GuaranteedUpdate etcd3" audit-id:0d004d77-7ad5-4498-b969-b809cf96520f,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 964ms (02:23:48.578) Trace[614744377]: ---"Txn call completed" 963ms (02:23:49.542)] Trace[614744377]: [964.601877ms] [964.601877ms] END I0626 02:23:49.543808 1 trace.go:236] Trace[948384455]: "Create" accept:application/json, */*,audit-id:0aecd21e-c5e8-411f-894d-0045bb6670af,client:199.19.213.122,protocol:HTTP/2.0,resource:ciliumendpoints,scope:resource,url:/apis/cilium.io/v2/namespaces/openstack/ciliumendpoints,user-agent:cilium-agent/1.14.8 cf6e022e 2024-03-13T12:23:35-04:00 go version go1.21.8 linux/amd64,verb:POST (26-Jun-2026 02:23:48.583) (total time: 960ms): Trace[948384455]: ["Create etcd3" audit-id:0aecd21e-c5e8-411f-894d-0045bb6670af,key:/cilium.io/ciliumendpoints/openstack/keystone-credential-setup-4hrfg,type:*unstructured.Unstructured,resource:ciliumendpoints.cilium.io 958ms (02:23:48.585) Trace[948384455]: ---"Txn call succeeded" 957ms (02:23:49.542)] Trace[948384455]: [960.031074ms] [960.031074ms] END I0626 02:23:49.597685 1 trace.go:236] Trace[915256083]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1a46550d-2a95-4db2-b8e9-d1d0a742363b,client:10.0.0.75,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:23:49.090) (total time: 507ms): Trace[915256083]: ["GuaranteedUpdate etcd3" audit-id:1a46550d-2a95-4db2-b8e9-d1d0a742363b,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 507ms (02:23:49.090) Trace[915256083]: ---"Txn call completed" 506ms (02:23:49.597)] Trace[915256083]: [507.418689ms] [507.418689ms] END I0626 02:23:49.598526 1 trace.go:236] Trace[70296831]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9cd3ec56-7dc7-4151-8102-3e907e1f1125,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (26-Jun-2026 02:23:48.755) (total time: 843ms): Trace[70296831]: ["GuaranteedUpdate etcd3" audit-id:9cd3ec56-7dc7-4151-8102-3e907e1f1125,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 843ms (02:23:48.755) Trace[70296831]: ---"Txn call completed" 842ms (02:23:49.598)] Trace[70296831]: [843.343771ms] [843.343771ms] END I0626 02:23:50.879272 1 trace.go:236] Trace[1865899859]: "Update" accept:application/json, */*,audit-id:ca7d3115-a98b-4ffa-9de0-861538fb5a2f,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:23:49.618) (total time: 1260ms): Trace[1865899859]: ["GuaranteedUpdate etcd3" audit-id:ca7d3115-a98b-4ffa-9de0-861538fb5a2f,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1260ms (02:23:49.619) Trace[1865899859]: ---"Txn call completed" 1258ms (02:23:50.879)] Trace[1865899859]: [1.260207655s] [1.260207655s] END I0626 02:23:50.879561 1 trace.go:236] Trace[2033884111]: "Update" accept:application/json, */*,audit-id:2e2b903c-5cc7-44dd-b7ea-4140f08b49dc,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 02:23:49.617) (total time: 1261ms): Trace[2033884111]: ["GuaranteedUpdate etcd3" audit-id:2e2b903c-5cc7-44dd-b7ea-4140f08b49dc,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1261ms (02:23:49.617) Trace[2033884111]: ---"Txn call completed" 1259ms (02:23:50.878)] Trace[2033884111]: [1.261972384s] [1.261972384s] END I0626 02:23:50.879910 1 trace.go:236] Trace[100170032]: "Update" accept:application/json, */*,audit-id:ec93ea65-9613-4418-9595-ffa154390392,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 02:23:49.617) (total time: 1262ms): Trace[100170032]: ["GuaranteedUpdate etcd3" audit-id:ec93ea65-9613-4418-9595-ffa154390392,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1262ms (02:23:49.617) Trace[100170032]: ---"Txn call completed" 1258ms (02:23:50.879)] Trace[100170032]: [1.262515792s] [1.262515792s] END I0626 02:23:50.881176 1 trace.go:236] Trace[1686344085]: "Update" accept:application/json, */*,audit-id:83e74d6d-7560-4a77-991a-2ba45c6a1b60,client:10.0.0.37,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/monitoring/secrets/prometheus-kube-prometheus-stack-prometheus,user-agent:PrometheusOperator/0.74.0,verb:PUT (26-Jun-2026 02:23:49.618) (total time: 1262ms): Trace[1686344085]: ["GuaranteedUpdate etcd3" audit-id:83e74d6d-7560-4a77-991a-2ba45c6a1b60,key:/secrets/monitoring/prometheus-kube-prometheus-stack-prometheus,type:*core.Secret,resource:secrets 1262ms (02:23:49.618)] Trace[1686344085]: [1.262632655s] [1.262632655s] END I0626 02:23:50.892204 1 trace.go:236] Trace[475219575]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:078ce193-25e8-497e-ae05-a0f5cfb67f58,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:23:50.091) (total time: 801ms): Trace[475219575]: ["GuaranteedUpdate etcd3" audit-id:078ce193-25e8-497e-ae05-a0f5cfb67f58,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 800ms (02:23:50.091) Trace[475219575]: ---"Txn call completed" 799ms (02:23:50.891)] Trace[475219575]: [801.119481ms] [801.119481ms] END I0626 02:23:50.894296 1 trace.go:236] Trace[1119346185]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2f33f087-a197-46ea-88d0-fdf2273dcab9,client:199.19.213.122,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 02:23:50.030) (total time: 863ms): Trace[1119346185]: ["GuaranteedUpdate etcd3" audit-id:2f33f087-a197-46ea-88d0-fdf2273dcab9,key:/minions/instance,type:*core.Node,resource:nodes 863ms (02:23:50.031) Trace[1119346185]: ---"Txn call completed" 856ms (02:23:50.893)] Trace[1119346185]: ---"Object stored in database" 857ms (02:23:50.893) Trace[1119346185]: [863.421844ms] [863.421844ms] END I0626 02:24:02.372541 1 trace.go:236] Trace[137308919]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3958a7f5-fd3f-47fc-a078-592194acfa9e,client:10.0.0.75,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:23:57.873) (total time: 4499ms): Trace[137308919]: ["GuaranteedUpdate etcd3" audit-id:3958a7f5-fd3f-47fc-a078-592194acfa9e,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 4499ms (02:23:57.873) Trace[137308919]: ---"Txn call completed" 4498ms (02:24:02.372)] Trace[137308919]: [4.4992265s] [4.4992265s] END I0626 02:24:02.405148 1 trace.go:236] Trace[1873589501]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5031e23a-a1f0-46e0-85b3-16865ed80660,client:10.0.0.106,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:23:59.044) (total time: 3360ms): Trace[1873589501]: ["GuaranteedUpdate etcd3" audit-id:5031e23a-a1f0-46e0-85b3-16865ed80660,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 3359ms (02:23:59.045) Trace[1873589501]: ---"Txn call completed" 3358ms (02:24:02.404)] Trace[1873589501]: [3.360181129s] [3.360181129s] END I0626 02:24:02.405210 1 trace.go:236] Trace[681522351]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1f87c615-b50d-416d-a424-24f482658431,client:10.0.0.209,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:23:59.877) (total time: 2528ms): Trace[681522351]: ["GuaranteedUpdate etcd3" audit-id:1f87c615-b50d-416d-a424-24f482658431,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 2527ms (02:23:59.877) Trace[681522351]: ---"Txn call completed" 2526ms (02:24:02.404)] Trace[681522351]: [2.528075255s] [2.528075255s] END I0626 02:24:02.405576 1 trace.go:236] Trace[1782602937]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f56545fc-6d89-406e-b697-bbd7d26df0db,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:23:59.045) (total time: 3359ms): Trace[1782602937]: ["GuaranteedUpdate etcd3" audit-id:f56545fc-6d89-406e-b697-bbd7d26df0db,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 3359ms (02:23:59.046) Trace[1782602937]: ---"Txn call completed" 3357ms (02:24:02.405)] Trace[1782602937]: [3.359507197s] [3.359507197s] END I0626 02:24:02.547407 1 trace.go:236] Trace[1687436128]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9bdb9ba9-5de9-4155-836c-4b250085cb38,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:23:59.119) (total time: 3427ms): Trace[1687436128]: ---"About to write a response" 3427ms (02:24:02.547) Trace[1687436128]: [3.427549538s] [3.427549538s] END I0626 02:24:02.548626 1 trace.go:236] Trace[1942754996]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8936f4c1-9b4d-4ada-b51a-68c176a1b4b9,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:23:59.692) (total time: 2855ms): Trace[1942754996]: ---"About to write a response" 2855ms (02:24:02.548) Trace[1942754996]: [2.855757308s] [2.855757308s] END I0626 02:24:02.548676 1 trace.go:236] Trace[998757314]: "Get" accept:application/json, */*,audit-id:1b718c68-3d68-4e4b-b2e8-327f369f9019,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:23:59.119) (total time: 3429ms): Trace[998757314]: ---"About to write a response" 3429ms (02:24:02.548) Trace[998757314]: [3.429191763s] [3.429191763s] END I0626 02:24:02.548146 1 trace.go:236] Trace[646935806]: "Get" accept:application/json, */*,audit-id:b0438712-8cdf-4bbb-a844-f73ad3a72670,client:10.0.0.92,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (26-Jun-2026 02:23:57.874) (total time: 4673ms): Trace[646935806]: ---"About to write a response" 4673ms (02:24:02.547) Trace[646935806]: [4.673530739s] [4.673530739s] END I0626 02:24:02.548942 1 trace.go:236] Trace[60261510]: "Delete" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5d322fa8-31f2-4063-96a2-f673889c9ac1,client:10.0.0.106,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/openstack/deployments/percona-xtradb-pitr,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:DELETE (26-Jun-2026 02:23:57.941) (total time: 4607ms): Trace[60261510]: [4.607194575s] [4.607194575s] END I0626 02:24:02.548195 1 trace.go:236] Trace[1987394786]: "Get" accept:application/json, */*,audit-id:5d031690-8a47-436b-a5f2-5b4dbe9f7c48,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:23:59.119) (total time: 3428ms): Trace[1987394786]: ---"About to write a response" 3428ms (02:24:02.548) Trace[1987394786]: [3.428650064s] [3.428650064s] END I0626 02:24:02.548321 1 trace.go:236] Trace[64883272]: "Get" accept:application/json, */*,audit-id:6a779172-8b07-42aa-8815-051fcba84dc5,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:23:58.993) (total time: 3554ms): Trace[64883272]: ---"About to write a response" 3554ms (02:24:02.548) Trace[64883272]: [3.554988912s] [3.554988912s] END I0626 02:24:02.548325 1 trace.go:236] Trace[1404008202]: "Get" accept:application/json, */*,audit-id:abedf4e6-f6fe-401b-b8b3-80c577a0a3f1,client:10.0.0.33,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-fernet-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:23:58.396) (total time: 4151ms): Trace[1404008202]: [4.151787527s] [4.151787527s] END I0626 02:24:02.548471 1 trace.go:236] Trace[1509365697]: "Get" accept:application/json, */*,audit-id:eca0cd00-aadc-4abe-9008-304b575af735,client:10.0.0.34,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:23:57.920) (total time: 4627ms): Trace[1509365697]: ---"About to write a response" 4627ms (02:24:02.548) Trace[1509365697]: [4.627527036s] [4.627527036s] END I0626 02:24:02.548518 1 trace.go:236] Trace[147766796]: "Get" accept:application/json, */*,audit-id:d4a70e82-ebd6-40f1-a82a-0d5447b73f0e,client:10.0.0.33,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:23:58.396) (total time: 4152ms): Trace[147766796]: [4.152240373s] [4.152240373s] END I0626 02:24:02.548565 1 trace.go:236] Trace[577779745]: "Get" accept:application/json, */*,audit-id:70e46c58-0805-402c-a406-4869e5c21cc4,client:10.0.0.33,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-credential-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:23:58.401) (total time: 4147ms): Trace[577779745]: ---"About to write a response" 4146ms (02:24:02.547) Trace[577779745]: [4.147279905s] [4.147279905s] END I0626 02:24:10.114079 1 trace.go:236] Trace[643739877]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:95f74eaa-4724-4b0d-97b2-cfaa95fe9976,client:199.19.213.122,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (26-Jun-2026 02:24:08.647) (total time: 1466ms): Trace[643739877]: ["Create etcd3" audit-id:95f74eaa-4724-4b0d-97b2-cfaa95fe9976,key:/events/openstack/keystone-credential-setup-4hrfg.18bc80537fc8a6be,type:*core.Event,resource:events 1465ms (02:24:08.648) Trace[643739877]: ---"Txn call succeeded" 1465ms (02:24:10.113)] Trace[643739877]: [1.466465175s] [1.466465175s] END I0626 02:24:11.493627 1 trace.go:236] Trace[1082484073]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:62a2c2cf-4f53-4826-84b4-8a2c95181bf6,client:10.0.0.209,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:09.266) (total time: 2226ms): Trace[1082484073]: ["GuaranteedUpdate etcd3" audit-id:62a2c2cf-4f53-4826-84b4-8a2c95181bf6,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 2226ms (02:24:09.267) Trace[1082484073]: ---"Txn call completed" 2225ms (02:24:11.493)] Trace[1082484073]: [2.226709717s] [2.226709717s] END I0626 02:24:12.873458 1 trace.go:236] Trace[1528714939]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:11150c21-4890-4748-a7a6-0f1965a62a42,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:24:09.734) (total time: 3138ms): Trace[1528714939]: ---"About to write a response" 3138ms (02:24:12.873) Trace[1528714939]: [3.138903459s] [3.138903459s] END I0626 02:24:12.873761 1 trace.go:236] Trace[820629514]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4f2ed005-8ac8-4d32-8208-c5349e1f7733,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:09.268) (total time: 3604ms): Trace[820629514]: ["GuaranteedUpdate etcd3" audit-id:4f2ed005-8ac8-4d32-8208-c5349e1f7733,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 3604ms (02:24:09.268) Trace[820629514]: ---"Txn call completed" 3603ms (02:24:12.873)] Trace[820629514]: [3.604948452s] [3.604948452s] END I0626 02:24:12.874242 1 trace.go:236] Trace[654540255]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:208cd842-60c1-4300-b3dc-723ff8d73de4,client:199.19.213.122,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (26-Jun-2026 02:24:10.300) (total time: 2573ms): Trace[654540255]: ["Create etcd3" audit-id:208cd842-60c1-4300-b3dc-723ff8d73de4,key:/events/openstack/keystone-credential-setup-4hrfg.18bc8053e24aa9c8,type:*core.Event,resource:events 2572ms (02:24:10.301) Trace[654540255]: ---"Txn call succeeded" 2572ms (02:24:12.873)] Trace[654540255]: [2.573271413s] [2.573271413s] END I0626 02:24:12.874970 1 trace.go:236] Trace[927999767]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0e647ca4-af51-4aa4-8e29-caa1c19726fd,client:10.0.0.75,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:10.537) (total time: 2336ms): Trace[927999767]: ["GuaranteedUpdate etcd3" audit-id:0e647ca4-af51-4aa4-8e29-caa1c19726fd,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 2336ms (02:24:10.538) Trace[927999767]: ---"Txn call completed" 2336ms (02:24:12.874)] Trace[927999767]: [2.336942675s] [2.336942675s] END I0626 02:24:12.875175 1 trace.go:236] Trace[2113810200]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f4282360-50d3-4d18-954d-8f7a9f8d3e15,client:10.0.0.106,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:09.272) (total time: 3602ms): Trace[2113810200]: ["GuaranteedUpdate etcd3" audit-id:f4282360-50d3-4d18-954d-8f7a9f8d3e15,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 3602ms (02:24:09.273) Trace[2113810200]: ---"Txn call completed" 3600ms (02:24:12.874)] Trace[2113810200]: [3.602250299s] [3.602250299s] END I0626 02:24:12.875195 1 trace.go:236] Trace[1785116441]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:605b53a9-f850-4501-b6a5-2cc7786b12c2,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:24:09.322) (total time: 3552ms): Trace[1785116441]: ---"About to write a response" 3552ms (02:24:12.874) Trace[1785116441]: [3.552240605s] [3.552240605s] END I0626 02:24:13.958969 1 trace.go:236] Trace[426538158]: "Get" accept:application/json, */*,audit-id:a1de942e-5eb4-4b5b-a8ed-efec23e341b5,client:10.0.0.33,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-fernet-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:09.272) (total time: 4686ms): Trace[426538158]: [4.68664896s] [4.68664896s] END I0626 02:24:13.959508 1 trace.go:236] Trace[1415863861]: "Get" accept:application/json, */*,audit-id:3054dfd6-d954-429f-9b35-a434686f2a72,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:09.845) (total time: 4113ms): Trace[1415863861]: ---"About to write a response" 4113ms (02:24:13.959) Trace[1415863861]: [4.113503645s] [4.113503645s] END I0626 02:24:13.960485 1 trace.go:236] Trace[1275654747]: "Get" accept:application/json, */*,audit-id:c02fb6ba-bfef-4f9f-8108-c83e02281334,client:10.0.0.33,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:09.271) (total time: 4688ms): Trace[1275654747]: [4.688566371s] [4.688566371s] END I0626 02:24:13.960875 1 trace.go:236] Trace[146714293]: "Get" accept:application/json, */*,audit-id:1ddd7860-b238-4f7f-af70-36c7e35df272,client:10.0.0.33,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-credential-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:09.273) (total time: 4687ms): Trace[146714293]: ---"About to write a response" 4686ms (02:24:13.959) Trace[146714293]: [4.687498403s] [4.687498403s] END I0626 02:24:13.961054 1 trace.go:236] Trace[556520888]: "Get" accept:application/json, */*,audit-id:4ec500b0-68a1-464d-8b0e-01e71a2fc19c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:09.845) (total time: 4115ms): Trace[556520888]: ---"About to write a response" 4114ms (02:24:13.960) Trace[556520888]: [4.115070031s] [4.115070031s] END I0626 02:24:13.961102 1 trace.go:236] Trace[1427245361]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8de651b2-9ce8-4bc7-a7b1-582eaac514ab,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (26-Jun-2026 02:24:12.459) (total time: 1501ms): Trace[1427245361]: ["GuaranteedUpdate etcd3" audit-id:8de651b2-9ce8-4bc7-a7b1-582eaac514ab,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 1501ms (02:24:12.459) Trace[1427245361]: ---"Txn call completed" 1499ms (02:24:13.960)] Trace[1427245361]: [1.50138029s] [1.50138029s] END I0626 02:24:13.961524 1 trace.go:236] Trace[182566435]: "Get" accept:application/json, */*,audit-id:39bfa28e-3af2-4054-a127-5392f8859a8c,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:24:09.845) (total time: 4115ms): Trace[182566435]: ---"About to write a response" 4115ms (02:24:13.960) Trace[182566435]: [4.115921573s] [4.115921573s] END I0626 02:24:15.132146 1 trace.go:236] Trace[933060723]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:af0e7053-04d9-43f1-852b-ef83057afc78,client:199.19.213.122,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keystone-credential-setup-4hrfg,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 02:24:11.313) (total time: 3818ms): Trace[933060723]: ---"About to write a response" 3818ms (02:24:15.131) Trace[933060723]: [3.81854077s] [3.81854077s] END I0626 02:24:15.135043 1 trace.go:236] Trace[1048685428]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:cf173c7a-667b-4ede-9cce-9c965727e597,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 02:24:12.875) (total time: 2259ms): Trace[1048685428]: ["GuaranteedUpdate etcd3" audit-id:cf173c7a-667b-4ede-9cce-9c965727e597,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 2259ms (02:24:12.875) Trace[1048685428]: ---"Txn call completed" 2258ms (02:24:15.134)] Trace[1048685428]: [2.259483208s] [2.259483208s] END I0626 02:24:15.145506 1 trace.go:236] Trace[1225477675]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f12d1aeb-3e74-4830-aad4-4dd3d8c9d0ca,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 02:24:12.876) (total time: 2268ms): Trace[1225477675]: ["GuaranteedUpdate etcd3" audit-id:f12d1aeb-3e74-4830-aad4-4dd3d8c9d0ca,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 2268ms (02:24:12.877) Trace[1225477675]: ---"Txn call completed" 2267ms (02:24:15.145)] Trace[1225477675]: [2.268569392s] [2.268569392s] END I0626 02:24:16.495589 1 trace.go:236] Trace[1869045241]: "Update" accept:application/json, */*,audit-id:5618b39a-524f-4e61-890a-0aa39a1e5309,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 02:24:13.963) (total time: 2532ms): Trace[1869045241]: ["GuaranteedUpdate etcd3" audit-id:5618b39a-524f-4e61-890a-0aa39a1e5309,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 2531ms (02:24:13.963) Trace[1869045241]: ---"Txn call completed" 2530ms (02:24:16.495)] Trace[1869045241]: [2.53218744s] [2.53218744s] END I0626 02:24:16.495859 1 trace.go:236] Trace[331671644]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c3ca2c0f-8a9a-4655-a873-c0683cb10a53,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:24:14.096) (total time: 2399ms): Trace[331671644]: ["GuaranteedUpdate etcd3" audit-id:c3ca2c0f-8a9a-4655-a873-c0683cb10a53,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 2399ms (02:24:14.096) Trace[331671644]: ---"Txn call completed" 2397ms (02:24:16.495)] Trace[331671644]: [2.399284528s] [2.399284528s] END I0626 02:24:16.495959 1 trace.go:236] Trace[844528834]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5c4ba987-e541-4dff-8bee-d29d32f9d9d9,client:10.0.0.209,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:13.495) (total time: 2999ms): Trace[844528834]: ["GuaranteedUpdate etcd3" audit-id:5c4ba987-e541-4dff-8bee-d29d32f9d9d9,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 2999ms (02:24:13.496) Trace[844528834]: ---"Txn call completed" 2998ms (02:24:16.495)] Trace[844528834]: [2.999994444s] [2.999994444s] END I0626 02:24:16.496037 1 trace.go:236] Trace[208422775]: "Update" accept:application/json, */*,audit-id:bef70448-9a7f-42e4-862e-54c5195aeff7,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:13.963) (total time: 2532ms): Trace[208422775]: ["GuaranteedUpdate etcd3" audit-id:bef70448-9a7f-42e4-862e-54c5195aeff7,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 2531ms (02:24:13.964) Trace[208422775]: ---"Txn call completed" 2530ms (02:24:16.495)] Trace[208422775]: [2.532088219s] [2.532088219s] END I0626 02:24:16.496159 1 trace.go:236] Trace[1084575268]: "Update" accept:application/json, */*,audit-id:e8e62f56-5eee-48b0-a864-eef35e915bb8,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 02:24:13.964) (total time: 2531ms): Trace[1084575268]: ["GuaranteedUpdate etcd3" audit-id:e8e62f56-5eee-48b0-a864-eef35e915bb8,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 2531ms (02:24:13.964) Trace[1084575268]: ---"Txn call completed" 2530ms (02:24:16.495)] Trace[1084575268]: [2.531956178s] [2.531956178s] END I0626 02:24:16.497654 1 trace.go:236] Trace[596620416]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:89f89bcf-b7a5-4234-af87-276f68c7c96f,client:10.0.0.106,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:13.144) (total time: 3353ms): Trace[596620416]: ---"About to write a response" 3352ms (02:24:16.497) Trace[596620416]: [3.353493818s] [3.353493818s] END I0626 02:24:16.962922 1 trace.go:236] Trace[887766452]: "Get" accept:*/*,audit-id:8bea6372-9c36-4e29-a5e1-8b00d9de0a72,client:10.0.0.127,protocol:HTTP/1.1,resource:secrets,scope:resource,url:/api/v1/namespaces/openstack/secrets/keystone-credential-keys,user-agent:python-requests/2.32.4,verb:GET (26-Jun-2026 02:24:15.156) (total time: 1805ms): Trace[887766452]: ---"About to write a response" 1805ms (02:24:16.962) Trace[887766452]: [1.805957685s] [1.805957685s] END I0626 02:24:16.963312 1 trace.go:236] Trace[607455361]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0e7a38c6-cf77-43cf-aa62-b0791daabeb9,client:199.19.213.122,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keystone-credential-setup-4hrfg/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 02:24:15.135) (total time: 1828ms): Trace[607455361]: ["GuaranteedUpdate etcd3" audit-id:0e7a38c6-cf77-43cf-aa62-b0791daabeb9,key:/pods/openstack/keystone-credential-setup-4hrfg,type:*core.Pod,resource:pods 1827ms (02:24:15.135) Trace[607455361]: ---"Txn call completed" 1820ms (02:24:16.962)] Trace[607455361]: ---"Object stored in database" 1821ms (02:24:16.962) Trace[607455361]: [1.828039261s] [1.828039261s] END I0626 02:24:16.963682 1 trace.go:236] Trace[144320944]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:243e8a78-b2f4-481e-81f7-1044efd84eae,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:14.878) (total time: 2084ms): Trace[144320944]: ["GuaranteedUpdate etcd3" audit-id:243e8a78-b2f4-481e-81f7-1044efd84eae,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 2084ms (02:24:14.878) Trace[144320944]: ---"Txn call completed" 2083ms (02:24:16.963)] Trace[144320944]: [2.084980477s] [2.084980477s] END I0626 02:24:16.963757 1 trace.go:236] Trace[553929362]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3031d079-86bf-4fc5-908b-9b9ded29df30,client:10.0.0.75,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:14.877) (total time: 2086ms): Trace[553929362]: ["GuaranteedUpdate etcd3" audit-id:3031d079-86bf-4fc5-908b-9b9ded29df30,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 2085ms (02:24:14.877) Trace[553929362]: ---"Txn call completed" 2084ms (02:24:16.963)] Trace[553929362]: [2.086117336s] [2.086117336s] END I0626 02:24:16.964046 1 trace.go:236] Trace[1958964663]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:431cba39-ce13-44dd-9bde-7374f913d06c,client:10.0.0.106,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:14.878) (total time: 2085ms): Trace[1958964663]: ["GuaranteedUpdate etcd3" audit-id:431cba39-ce13-44dd-9bde-7374f913d06c,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 2085ms (02:24:14.878) Trace[1958964663]: ---"Txn call completed" 2084ms (02:24:16.963)] Trace[1958964663]: [2.085983393s] [2.085983393s] END I0626 02:24:16.964180 1 trace.go:236] Trace[951153942]: "Get" accept:application/json, */*,audit-id:9621bf93-c4db-412d-a20e-5e65b46f19ec,client:10.0.0.33,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-fernet-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:15.962) (total time: 1001ms): Trace[951153942]: [1.001279125s] [1.001279125s] END I0626 02:24:16.964758 1 trace.go:236] Trace[698207695]: "Get" accept:application/json, */*,audit-id:ab8fa520-bb45-470b-b49f-85f21516d87c,client:10.0.0.33,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:15.963) (total time: 1001ms): Trace[698207695]: [1.001063922s] [1.001063922s] END I0626 02:24:16.970462 1 trace.go:236] Trace[378967791]: "Get" accept:application/json, */*,audit-id:9b4acced-7f22-4a64-9ad6-948ee96532e1,client:10.0.0.33,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-credential-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:15.964) (total time: 1006ms): Trace[378967791]: ---"About to write a response" 1000ms (02:24:16.964) Trace[378967791]: [1.006137251s] [1.006137251s] END I0626 02:24:16.970629 1 trace.go:236] Trace[1113506871]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c17f186d-0789-490f-a7e7-d06431ce83ed,client:199.19.213.122,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bc805214620502,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 02:24:13.395) (total time: 3574ms): Trace[1113506871]: ["GuaranteedUpdate etcd3" audit-id:c17f186d-0789-490f-a7e7-d06431ce83ed,key:/events/kube-system/kube-apiserver-instance.18bc805214620502,type:*core.Event,resource:events 3574ms (02:24:13.396) Trace[1113506871]: ---"initial value restored" 3100ms (02:24:16.496) Trace[1113506871]: ---"Txn call completed" 471ms (02:24:16.970)] Trace[1113506871]: ---"Object stored in database" 472ms (02:24:16.970) Trace[1113506871]: [3.574627728s] [3.574627728s] END I0626 02:24:17.009433 1 trace.go:236] Trace[155917162]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.122,type:*v1.Endpoints,resource:apiServerIPInfo (26-Jun-2026 02:24:15.777) (total time: 1232ms): Trace[155917162]: ---"initial value restored" 1185ms (02:24:16.962) Trace[155917162]: [1.232205305s] [1.232205305s] END E0626 02:24:37.558864 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:37.558886 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 18.07µs, panicked: false, err: context deadline exceeded, panic-reason: E0626 02:24:37.558914 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:37.560593 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:37.560772 1 trace.go:236] Trace[1501814154]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:37052251-44b9-45ca-9801-1dc1ad06f1b7,client:10.0.0.209,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:32.558) (total time: 5002ms): Trace[1501814154]: ["GuaranteedUpdate etcd3" audit-id:37052251-44b9-45ca-9801-1dc1ad06f1b7,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (02:24:32.558) Trace[1501814154]: ---"Txn call failed" err:context deadline exceeded 4999ms (02:24:37.558)] Trace[1501814154]: [5.002201084s] [5.002201084s] END E0626 02:24:37.561117 1 timeout.go:142] post-timeout activity - time-elapsed: 2.252006ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0626 02:24:37.602559 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0626 02:24:37.602711 1 trace.go:236] Trace[769484737]: "Get" accept:application/json, */*,audit-id:634ede9d-3526-447b-868e-1ecc4245c66f,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:24:32.602) (total time: 4999ms): Trace[769484737]: [4.999847026s] [4.999847026s] END E0626 02:24:37.602871 1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock?timeout=5s" audit-ID="634ede9d-3526-447b-868e-1ecc4245c66f" E0626 02:24:37.602914 1 timeout.go:142] post-timeout activity - time-elapsed: 3.13µs, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0626 02:24:38.031196 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:38.031246 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:38.031337 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 46.041µs, panicked: false, err: context canceled, panic-reason: E0626 02:24:38.032286 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:38.032720 1 trace.go:236] Trace[6819631]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7f586eb9-4c29-4129-ae36-c8f048410588,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:33.032) (total time: 5000ms): Trace[6819631]: ["GuaranteedUpdate etcd3" audit-id:7f586eb9-4c29-4129-ae36-c8f048410588,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (02:24:33.032) Trace[6819631]: ---"Txn call failed" err:context canceled 4997ms (02:24:38.031)] Trace[6819631]: [5.000276187s] [5.000276187s] END E0626 02:24:38.032914 1 timeout.go:142] post-timeout activity - time-elapsed: 1.723367ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0626 02:24:38.035535 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:38.035560 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:38.035575 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 3.82µs, panicked: false, err: context deadline exceeded, panic-reason: E0626 02:24:38.037204 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:38.037263 1 trace.go:236] Trace[1654203680]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bfee15f5-a294-4122-b740-9cc2a4f1c6ab,client:10.0.0.106,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:33.035) (total time: 5001ms): Trace[1654203680]: ["GuaranteedUpdate etcd3" audit-id:bfee15f5-a294-4122-b740-9cc2a4f1c6ab,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (02:24:33.035) Trace[1654203680]: ---"Txn call failed" err:context deadline exceeded 4999ms (02:24:38.035)] Trace[1654203680]: [5.001636619s] [5.001636619s] END E0626 02:24:38.037317 1 timeout.go:142] post-timeout activity - time-elapsed: 1.84464ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0626 02:24:38.049892 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:38.049942 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:38.049999 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 46.171µs, panicked: false, err: context canceled, panic-reason: E0626 02:24:38.051068 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:38.051115 1 trace.go:236] Trace[494626232]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:41636237-1b39-4cf0-b7e7-01a651fe04d3,client:10.0.0.75,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:33.049) (total time: 5001ms): Trace[494626232]: ["GuaranteedUpdate etcd3" audit-id:41636237-1b39-4cf0-b7e7-01a651fe04d3,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (02:24:33.049) Trace[494626232]: ---"Txn call failed" err:context canceled 4999ms (02:24:38.049)] Trace[494626232]: [5.001382783s] [5.001382783s] END E0626 02:24:38.051160 1 timeout.go:142] post-timeout activity - time-elapsed: 1.131157ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0626 02:24:38.336225 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:38.336317 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:38.338201 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:38.338247 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:38.339435 1 trace.go:236] Trace[1406937674]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6f23662e-555c-422c-ae01-590699283e56,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:24:33.336) (total time: 5002ms): Trace[1406937674]: [5.002944404s] [5.002944404s] END E0626 02:24:38.339665 1 timeout.go:142] post-timeout activity - time-elapsed: 3.462764ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0626 02:24:38.376041 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0626 02:24:38.376190 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:38.377589 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:38.377653 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:38.378832 1 trace.go:236] Trace[2094839921]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4137818a-1925-4fae-8894-446cbd466910,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:24:33.375) (total time: 5003ms): Trace[2094839921]: [5.003168527s] [5.003168527s] END E0626 02:24:38.379018 1 timeout.go:142] post-timeout activity - time-elapsed: 2.660581ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0626 02:24:39.501984 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0626 02:24:39.502288 1 trace.go:236] Trace[2118363337]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1d13dab0-c5b1-4047-b996-67e57df3ecf2,client:10.0.0.106,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:32.499) (total time: 7002ms): Trace[2118363337]: [7.00293059s] [7.00293059s] END E0626 02:24:42.558993 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:42.559260 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:42.560128 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:42.560358 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:42.561769 1 trace.go:236] Trace[73796463]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f1bb7187-321f-4fb6-b02e-fcf28a14353e,client:10.0.0.209,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:24:37.560) (total time: 5001ms): Trace[73796463]: [5.001209119s] [5.001209119s] END E0626 02:24:42.562321 1 timeout.go:142] post-timeout activity - time-elapsed: 3.513825ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0626 02:24:42.598681 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:42.598785 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:42.598683 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:42.599828 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:42.599855 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0626 02:24:42.599855 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:42.601485 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:42.601520 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:42.601521 1 trace.go:236] Trace[1007747380]: "Get" accept:application/json, */*,audit-id:91f7deef-8866-4909-b824-cfdeed4abff3,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:32.598) (total time: 10002ms): Trace[1007747380]: [10.002730451s] [10.002730451s] END E0626 02:24:42.601624 1 timeout.go:142] post-timeout activity - time-elapsed: 2.967456ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: I0626 02:24:42.602746 1 trace.go:236] Trace[1788755963]: "Get" accept:application/json, */*,audit-id:5db382a2-8709-4d92-818d-304a3954d0ef,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:32.598) (total time: 10003ms): Trace[1788755963]: [10.003780887s] [10.003780887s] END E0626 02:24:42.602807 1 timeout.go:142] post-timeout activity - time-elapsed: 4.084313ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0626 02:24:42.603344 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:42.604001 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:42.604482 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:42.605606 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:42.605655 1 trace.go:236] Trace[1828407068]: "Get" accept:application/json, */*,audit-id:233f934f-db65-4d66-88c2-c6669426eb78,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:24:39.604) (total time: 3000ms): Trace[1828407068]: [3.0009548s] [3.0009548s] END E0626 02:24:42.605898 1 timeout.go:142] post-timeout activity - time-elapsed: 2.56821ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0626 02:24:43.032501 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:43.032725 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:43.034668 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:43.034755 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:43.036447 1 trace.go:236] Trace[1250044981]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c73b22d7-d8c6-4d15-b55f-0076f68fdb4a,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:24:38.031) (total time: 5004ms): Trace[1250044981]: [5.00440244s] [5.00440244s] END E0626 02:24:43.036633 1 timeout.go:142] post-timeout activity - time-elapsed: 4.196275ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0626 02:24:43.036858 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0626 02:24:43.038831 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:43.038874 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:43.040956 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:43.041377 1 trace.go:236] Trace[1813501129]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:81e87973-25ea-4da7-8a48-2c9c9d21c252,client:10.0.0.106,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:24:38.036) (total time: 5004ms): Trace[1813501129]: [5.00442308s] [5.00442308s] END E0626 02:24:43.041504 1 timeout.go:142] post-timeout activity - time-elapsed: 4.701753ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0626 02:24:43.049968 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:43.050046 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:43.051339 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:43.051383 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:43.052426 1 trace.go:236] Trace[59767970]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8138fe57-c7ab-44da-a6e0-39da09343f9b,client:10.0.0.75,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:24:38.050) (total time: 5001ms): Trace[59767970]: [5.001490174s] [5.001490174s] END E0626 02:24:43.052570 1 timeout.go:142] post-timeout activity - time-elapsed: 2.860644ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0626 02:24:43.090542 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:43.090675 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:43.092117 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:43.092164 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:43.093538 1 trace.go:236] Trace[168160450]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7771375a-7886-4a8d-a289-395b19ad2dd5,client:10.0.0.106,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:39.515) (total time: 3577ms): Trace[168160450]: [3.577800344s] [3.577800344s] END E0626 02:24:43.093681 1 timeout.go:142] post-timeout activity - time-elapsed: 3.052639ms, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: E0626 02:24:43.336547 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:43.336645 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:43.337894 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:43.337936 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:43.339720 1 trace.go:236] Trace[1814660030]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:79670468-aeba-41f0-8041-1a51783a5b47,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:24:40.338) (total time: 3001ms): Trace[1814660030]: [3.001553951s] [3.001553951s] END E0626 02:24:43.339882 1 timeout.go:142] post-timeout activity - time-elapsed: 3.420893ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0626 02:24:43.375568 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:43.375631 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:43.376837 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:43.376856 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:43.377998 1 trace.go:236] Trace[576025762]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3e9e4ca5-f4f9-4a4a-bd1c-914aea2de98c,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:24:40.378) (total time: 2999ms): Trace[576025762]: [2.999824785s] [2.999824785s] END E0626 02:24:43.378110 1 timeout.go:142] post-timeout activity - time-elapsed: 2.456178ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0626 02:24:43.483274 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0626 02:24:43.483456 1 trace.go:236] Trace[962742106]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b2b0d2bd-7f49-40a2-9b74-79f43102ba1d,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (26-Jun-2026 02:24:36.480) (total time: 7002ms): Trace[962742106]: ["GuaranteedUpdate etcd3" audit-id:b2b0d2bd-7f49-40a2-9b74-79f43102ba1d,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (02:24:36.480) Trace[962742106]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:24:43.483)] Trace[962742106]: [7.002692336s] [7.002692336s] END E0626 02:24:43.601164 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0626 02:24:43.601524 1 trace.go:236] Trace[1608472426]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:07f70c79-be97-42e1-a499-ac41eaf8f32d,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:24:36.598) (total time: 7003ms): Trace[1608472426]: ["GuaranteedUpdate etcd3" audit-id:07f70c79-be97-42e1-a499-ac41eaf8f32d,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:24:36.598) Trace[1608472426]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:24:43.601)] Trace[1608472426]: [7.003220421s] [7.003220421s] END E0626 02:24:44.748937 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0626 02:24:44.749120 1 trace.go:236] Trace[580875473]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a424afa9-66ed-472d-9e9c-94bb3e1813bd,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:24:37.746) (total time: 7002ms): Trace[580875473]: ["GuaranteedUpdate etcd3" audit-id:a424afa9-66ed-472d-9e9c-94bb3e1813bd,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (02:24:37.746) Trace[580875473]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:24:44.748)] Trace[580875473]: [7.002725367s] [7.002725367s] END E0626 02:24:44.749753 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0626 02:24:46.503291 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0626 02:24:46.503362 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0626 02:24:46.503447 1 trace.go:236] Trace[33109089]: "Get" accept:application/json, */*,audit-id:d65f9bf1-9a41-43d4-9a41-80d3b752c954,client:10.0.0.34,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:24:33.044) (total time: 13458ms): Trace[33109089]: [13.458616082s] [13.458616082s] END E0626 02:24:46.503816 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0626 02:24:46.503989 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0626 02:24:46.504018 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0626 02:24:46.504049 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0626 02:24:46.504275 1 trace.go:236] Trace[2070401200]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.122,type:*v1.Endpoints,resource:apiServerIPInfo (26-Jun-2026 02:24:35.778) (total time: 10725ms): Trace[2070401200]: [10.72582553s] [10.72582553s] END E0626 02:24:46.504312 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out I0626 02:24:46.504478 1 trace.go:236] Trace[347217925]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ddee571d-eb5e-4953-b992-568412f154ef,client:199.19.213.122,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bc805214620502,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 02:24:38.395) (total time: 8108ms): Trace[347217925]: ["GuaranteedUpdate etcd3" audit-id:ddee571d-eb5e-4953-b992-568412f154ef,key:/events/kube-system/kube-apiserver-instance.18bc805214620502,type:*core.Event,resource:events 8108ms (02:24:38.395)] Trace[347217925]: [8.108810747s] [8.108810747s] END I0626 02:24:46.504520 1 trace.go:236] Trace[1423946910]: "Get" accept:application/json, */*,audit-id:069f5bcf-4403-4c5a-ba0f-de3aa1d92cd2,client:10.0.0.92,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (26-Jun-2026 02:24:33.040) (total time: 13463ms): Trace[1423946910]: [13.46367986s] [13.46367986s] END I0626 02:24:46.504990 1 trace.go:236] Trace[380348193]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ff07e840-9d6e-4f48-a724-e733b069f632,client:199.19.213.122,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-keystone-server-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 02:24:36.637) (total time: 9867ms): Trace[380348193]: [9.867694327s] [9.867694327s] END I0626 02:24:46.505136 1 trace.go:236] Trace[1584616900]: "Get" accept:application/json, */*,audit-id:a7fa4f88-09f0-42b8-bd75-cb02e7a9ff31,client:10.0.0.33,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:33.005) (total time: 13499ms): Trace[1584616900]: [13.499703043s] [13.499703043s] END I0626 02:24:46.505233 1 trace.go:236] Trace[117384193]: "Get" accept:application/json, */*,audit-id:aec5f927-1c33-47a7-909a-ee1d513e89fe,client:10.0.0.33,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-fernet-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:33.004) (total time: 13500ms): Trace[117384193]: [13.500868681s] [13.500868681s] END E0626 02:24:47.604062 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:47.604116 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:47.604260 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 119.971µs, panicked: false, err: context canceled, panic-reason: E0626 02:24:47.605329 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:47.605421 1 trace.go:236] Trace[1673814156]: "Update" accept:application/json, */*,audit-id:4ed92c24-f2ea-4edc-bf20-b034920fb5c9,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:42.603) (total time: 5001ms): Trace[1673814156]: ["GuaranteedUpdate etcd3" audit-id:4ed92c24-f2ea-4edc-bf20-b034920fb5c9,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (02:24:42.603) Trace[1673814156]: ---"Txn call failed" err:context canceled 4999ms (02:24:47.604)] Trace[1673814156]: [5.001603572s] [5.001603572s] END E0626 02:24:47.605555 1 timeout.go:142] post-timeout activity - time-elapsed: 1.29556ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0626 02:24:48.377295 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:48.377349 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:48.377443 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 52.801µs, panicked: false, err: context deadline exceeded, panic-reason: E0626 02:24:48.378587 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:48.378687 1 trace.go:236] Trace[69472667]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e8f2c7c0-45a6-4e2f-b1b8-02d784f2c949,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 02:24:43.376) (total time: 5002ms): Trace[69472667]: ["GuaranteedUpdate etcd3" audit-id:e8f2c7c0-45a6-4e2f-b1b8-02d784f2c949,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (02:24:43.376) Trace[69472667]: ---"Txn call failed" err:context deadline exceeded 5000ms (02:24:48.377)] Trace[69472667]: [5.002480194s] [5.002480194s] END E0626 02:24:48.378830 1 timeout.go:142] post-timeout activity - time-elapsed: 1.570014ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0626 02:24:49.565150 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0626 02:24:49.565289 1 trace.go:236] Trace[434727151]: "Create" accept:application/json, */*,audit-id:dc677e2f-63da-4c1a-9fb6-45e7697aee75,client:10.0.0.209,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (26-Jun-2026 02:24:42.562) (total time: 7003ms): Trace[434727151]: ["Create etcd3" audit-id:dc677e2f-63da-4c1a-9fb6-45e7697aee75,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18bc805b65127aa1,type:*core.Event,resource:events 7002ms (02:24:42.562) Trace[434727151]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:24:49.565)] Trace[434727151]: [7.003111416s] [7.003111416s] END E0626 02:24:49.602269 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0626 02:24:49.602346 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0626 02:24:49.602471 1 trace.go:236] Trace[1046370589]: "Update" accept:application/json, */*,audit-id:f719c24c-612b-4af4-a1b6-582a3311e0e6,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 02:24:42.599) (total time: 7003ms): Trace[1046370589]: ["GuaranteedUpdate etcd3" audit-id:f719c24c-612b-4af4-a1b6-582a3311e0e6,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:24:42.599) Trace[1046370589]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:24:49.602)] Trace[1046370589]: [7.003212707s] [7.003212707s] END I0626 02:24:49.605441 1 trace.go:236] Trace[181073750]: "Update" accept:application/json, */*,audit-id:763a9378-b059-470c-8fa8-eb7c01e119f5,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 02:24:42.599) (total time: 7005ms): Trace[181073750]: ["GuaranteedUpdate etcd3" audit-id:763a9378-b059-470c-8fa8-eb7c01e119f5,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7005ms (02:24:42.599) Trace[181073750]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:24:49.602)] Trace[181073750]: [7.005740177s] [7.005740177s] END E0626 02:24:50.605255 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0626 02:24:50.605493 1 trace.go:236] Trace[38329605]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ac1289ca-1226-4fb8-a2ae-f736fc09e985,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:24:43.603) (total time: 7002ms): Trace[38329605]: ["GuaranteedUpdate etcd3" audit-id:ac1289ca-1226-4fb8-a2ae-f736fc09e985,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (02:24:43.603) Trace[38329605]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:24:50.605)] Trace[38329605]: [7.002345732s] [7.002345732s] END I0626 02:24:50.978785 1 trace.go:236] Trace[404631204]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:544d6925-5a0e-42b5-9367-cb11da114cb9,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:24:44.750) (total time: 6227ms): Trace[404631204]: ["GuaranteedUpdate etcd3" audit-id:544d6925-5a0e-42b5-9367-cb11da114cb9,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 6227ms (02:24:44.750) Trace[404631204]: ---"Txn call completed" 6226ms (02:24:50.977)] Trace[404631204]: [6.227919838s] [6.227919838s] END I0626 02:24:50.979257 1 trace.go:236] Trace[85334860]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cd61473b-542a-463b-ad2c-557a81f95e5b,client:199.19.213.122,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (26-Jun-2026 02:24:46.506) (total time: 4472ms): Trace[85334860]: ["Create etcd3" audit-id:cd61473b-542a-463b-ad2c-557a81f95e5b,key:/events/kube-system/kube-apiserver-instance.18bc805a738a9c5f,type:*core.Event,resource:events 4471ms (02:24:46.507) Trace[85334860]: ---"Txn call succeeded" 4471ms (02:24:50.978)] Trace[85334860]: [4.472211462s] [4.472211462s] END I0626 02:24:50.981496 1 trace.go:236] Trace[36093156]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2402ea79-9270-4d80-9d26-d3a4bbd4bb87,client:199.19.213.122,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/prometheus-kube-prometheus-stack-prometheus-db-prometheus-kube-prometheus-stack-prometheus-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 02:24:46.608) (total time: 4372ms): Trace[36093156]: ---"About to write a response" 4372ms (02:24:50.981) Trace[36093156]: [4.372484581s] [4.372484581s] END I0626 02:24:50.981677 1 trace.go:236] Trace[853498166]: "Get" accept:application/json, */*,audit-id:11bb0f07-c23a-488f-be5a-70aa742cca0a,client:10.0.0.33,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-fernet-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:48.509) (total time: 2472ms): Trace[853498166]: [2.47240825s] [2.47240825s] END I0626 02:24:50.981929 1 trace.go:236] Trace[1353149752]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:188c6934-0470-41bf-8e85-5ecec8470255,client:199.19.213.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (26-Jun-2026 02:24:43.485) (total time: 7496ms): Trace[1353149752]: ---"About to write a response" 7496ms (02:24:50.981) Trace[1353149752]: [7.496335076s] [7.496335076s] END I0626 02:24:50.982122 1 trace.go:236] Trace[637875661]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:11310628-d87a-4fa1-8ede-7b4efc6463eb,client:199.19.213.122,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/ingress-nginx/services/ingress-nginx-controller,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (26-Jun-2026 02:24:47.632) (total time: 3349ms): Trace[637875661]: ---"About to write a response" 3349ms (02:24:50.982) Trace[637875661]: [3.349993391s] [3.349993391s] END E0626 02:24:50.982150 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0626 02:24:50.982977 1 trace.go:236] Trace[108215438]: "Get" accept:application/json, */*,audit-id:818d1c4b-81b7-4c32-9a7c-2ef8107d650f,client:10.0.0.33,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:48.509) (total time: 2473ms): Trace[108215438]: [2.473786802s] [2.473786802s] END I0626 02:24:50.986383 1 trace.go:236] Trace[2035056105]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fd5905a1-7896-4652-a16c-0991a72d8edc,client:199.19.213.122,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 02:24:46.413) (total time: 4572ms): Trace[2035056105]: ---"About to write a response" 4571ms (02:24:50.985) Trace[2035056105]: [4.57233999s] [4.57233999s] END I0626 02:24:51.032427 1 trace.go:236] Trace[556690972]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.122,type:*v1.Endpoints,resource:apiServerIPInfo (26-Jun-2026 02:24:46.505) (total time: 4527ms): Trace[556690972]: ---"initial value restored" 4476ms (02:24:50.981) Trace[556690972]: [4.527265759s] [4.527265759s] END I0626 02:27:35.990282 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon" clusterIPs={"IPv4":"10.103.245.77"} I0626 02:27:36.005921 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon-int" clusterIPs={"IPv4":"10.105.64.32"}