I0721 05:25:28.695126 1 options.go:220] external host was not specified, using 199.19.213.242 I0721 05:25:28.696225 1 server.go:148] Version: v1.28.13 I0721 05:25:28.696292 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0721 05:25:28.917663 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0721 05:25:28.926931 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0721 05:25:28.926955 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0721 05:25:28.927228 1 instance.go:298] Using reconciler: lease I0721 05:25:29.197133 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0721 05:25:29.197205 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0721 05:25:29.497413 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0721 05:25:29.497561 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0721 05:25:29.895974 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0721 05:25:29.903781 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0721 05:25:29.903848 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0721 05:25:29.903885 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0721 05:25:29.904228 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0721 05:25:29.904260 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0721 05:25:29.904914 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0721 05:25:29.905495 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0721 05:25:29.905531 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0721 05:25:29.905546 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0721 05:25:29.906497 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0721 05:25:29.906538 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0721 05:25:29.907173 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0721 05:25:29.907207 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0721 05:25:29.907237 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0721 05:25:29.907858 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0721 05:25:29.907891 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0721 05:25:29.907949 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0721 05:25:29.908367 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0721 05:25:29.909490 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0721 05:25:29.909525 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0721 05:25:29.909539 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0721 05:25:29.909878 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0721 05:25:29.909909 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0721 05:25:29.909938 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0721 05:25:29.913100 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0721 05:25:29.913150 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0721 05:25:29.919829 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0721 05:25:29.919853 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0721 05:25:29.919861 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0721 05:25:29.921469 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0721 05:25:29.921495 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0721 05:25:29.921502 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0721 05:25:29.923972 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0721 05:25:29.923990 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0721 05:25:29.923995 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0721 05:25:29.925320 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0721 05:25:29.926507 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0721 05:25:29.926520 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0721 05:25:29.926525 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0721 05:25:29.929752 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0721 05:25:29.929765 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0721 05:25:29.929769 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0721 05:25:29.930513 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0721 05:25:29.930526 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0721 05:25:29.930530 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0721 05:25:29.930984 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0721 05:25:29.930996 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0721 05:25:29.961645 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0721 05:25:29.961680 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0721 05:25:30.335988 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0721 05:25:30.336058 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0721 05:25:30.335999 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0721 05:25:30.336274 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0721 05:25:30.336255 1 secure_serving.go:213] Serving securely on [::]:6443 I0721 05:25:30.336369 1 aggregator.go:164] waiting for initial CRD sync... I0721 05:25:30.336417 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0721 05:25:30.336562 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0721 05:25:30.336646 1 gc_controller.go:78] Starting apiserver lease garbage collector I0721 05:25:30.336746 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0721 05:25:30.336756 1 establishing_controller.go:76] Starting EstablishingController I0721 05:25:30.336770 1 gc_controller.go:78] Starting apiserver lease garbage collector I0721 05:25:30.336799 1 controller.go:134] Starting OpenAPI controller I0721 05:25:30.336844 1 controller.go:85] Starting OpenAPI V3 controller I0721 05:25:30.336872 1 naming_controller.go:291] Starting NamingConditionController I0721 05:25:30.336874 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0721 05:25:30.336947 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0721 05:25:30.337024 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0721 05:25:30.337073 1 crd_finalizer.go:266] Starting CRDFinalizer I0721 05:25:30.337129 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0721 05:25:30.337139 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0721 05:25:30.337234 1 system_namespaces_controller.go:67] Starting system namespaces controller I0721 05:25:30.337413 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0721 05:25:30.336758 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0721 05:25:30.337496 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0721 05:25:30.337752 1 controller.go:116] Starting legacy_token_tracking_controller I0721 05:25:30.337777 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0721 05:25:30.337808 1 controller.go:78] Starting OpenAPI AggregationController I0721 05:25:30.337857 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0721 05:25:30.337921 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0721 05:25:30.337935 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0721 05:25:30.337961 1 controller.go:80] Starting OpenAPI V3 AggregationController I0721 05:25:30.339168 1 available_controller.go:423] Starting AvailableConditionController I0721 05:25:30.339184 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller E0721 05:25:30.412886 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0721 05:25:30.417889 1 shared_informer.go:318] Caches are synced for node_authorizer I0721 05:25:30.436807 1 apf_controller.go:379] Running API Priority and Fairness config worker I0721 05:25:30.436832 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0721 05:25:30.437171 1 shared_informer.go:318] Caches are synced for crd-autoregister I0721 05:25:30.437238 1 aggregator.go:166] initial CRD sync complete... I0721 05:25:30.437251 1 autoregister_controller.go:141] Starting autoregister controller I0721 05:25:30.437273 1 cache.go:32] Waiting for caches to sync for autoregister controller I0721 05:25:30.437280 1 cache.go:39] Caches are synced for autoregister controller I0721 05:25:30.437660 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0721 05:25:30.437815 1 shared_informer.go:318] Caches are synced for configmaps I0721 05:25:30.437978 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0721 05:25:30.439240 1 cache.go:39] Caches are synced for AvailableConditionController controller I0721 05:25:30.439891 1 controller.go:624] quota admission added evaluator for: namespaces I0721 05:25:30.617273 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0721 05:25:31.344242 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0721 05:25:31.351162 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0721 05:25:31.351180 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0721 05:25:31.870331 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0721 05:25:31.913510 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0721 05:25:32.053076 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0721 05:25:32.061037 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.19.213.242] I0721 05:25:32.062013 1 controller.go:624] quota admission added evaluator for: endpoints I0721 05:25:32.065926 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0721 05:25:33.447908 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0721 05:25:34.308352 1 controller.go:624] quota admission added evaluator for: deployments.apps I0721 05:25:34.324961 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0721 05:25:34.335368 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0721 05:25:38.090127 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0721 05:25:38.594835 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0721 05:26:00.613632 1 trace.go:236] Trace[968997730]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7cb20151-23b8-4dab-af26-d975dfc40eab,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (21-Jul-2026 05:25:59.578) (total time: 1035ms): Trace[968997730]: ["GuaranteedUpdate etcd3" audit-id:7cb20151-23b8-4dab-af26-d975dfc40eab,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 1034ms (05:25:59.578) Trace[968997730]: ---"Txn call completed" 1033ms (05:26:00.613)] Trace[968997730]: [1.035020566s] [1.035020566s] END I0721 05:26:00.613806 1 trace.go:236] Trace[1741392599]: "Get" accept:application/json, */*,audit-id:cf97f051-f630-4b82-9714-098ba61a41f7,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (21-Jul-2026 05:25:59.584) (total time: 1029ms): Trace[1741392599]: ---"About to write a response" 1029ms (05:26:00.613) Trace[1741392599]: [1.02968485s] [1.02968485s] END I0721 05:26:00.614435 1 trace.go:236] Trace[520347369]: "Get" accept:application/json, */*,audit-id:6cd68188-243c-43cf-8713-128a72c78ab0,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (21-Jul-2026 05:25:59.584) (total time: 1030ms): Trace[520347369]: ---"About to write a response" 1029ms (05:26:00.613) Trace[520347369]: [1.030162805s] [1.030162805s] END I0721 05:26:07.570975 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0721 05:26:07.608061 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0721 05:26:07.622498 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0721 05:26:07.646432 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0721 05:26:07.646466 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0721 05:26:07.680969 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0721 05:26:07.698962 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0721 05:26:07.721513 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0721 05:26:07.750854 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0721 05:26:07.750923 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0721 05:26:07.783580 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0721 05:26:07.783640 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0721 05:26:07.799518 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0721 05:26:07.805850 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0721 05:26:07.849595 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0721 05:26:07.993886 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0721 05:26:07.993944 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0721 05:26:07.997629 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0721 05:26:08.841451 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0721 05:26:08.844032 1 trace.go:236] Trace[1374723686]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:76b91c02-8ff5-4c47-9e35-901da1cbf919,client:::1,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/backendtrafficpolicies.gateway.envoyproxy.io/status,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (21-Jul-2026 05:26:08.317) (total time: 526ms): Trace[1374723686]: ["GuaranteedUpdate etcd3" audit-id:76b91c02-8ff5-4c47-9e35-901da1cbf919,key:/apiextensions.k8s.io/customresourcedefinitions/backendtrafficpolicies.gateway.envoyproxy.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 518ms (05:26:08.325) Trace[1374723686]: ---"Txn call completed" 472ms (05:26:08.833)] Trace[1374723686]: [526.82708ms] [526.82708ms] END I0721 05:26:08.869441 1 trace.go:236] Trace[191116231]: "Create" accept:application/json,audit-id:54f9e419-e567-42f2-882e-20edaa882b9d,client:199.19.213.242,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (21-Jul-2026 05:26:08.343) (total time: 526ms): Trace[191116231]: [526.213169ms] [526.213169ms] END I0721 05:26:08.906707 1 trace.go:236] Trace[1964363389]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:daf613b1-5cdf-4c9d-81c1-041befc42418,client:::1,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/envoyproxies.gateway.envoyproxy.io/status,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (21-Jul-2026 05:26:08.271) (total time: 635ms): Trace[1964363389]: ["GuaranteedUpdate etcd3" audit-id:daf613b1-5cdf-4c9d-81c1-041befc42418,key:/apiextensions.k8s.io/customresourcedefinitions/envoyproxies.gateway.envoyproxy.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 624ms (05:26:08.282) Trace[1964363389]: ---"About to Encode" 110ms (05:26:08.406) Trace[1964363389]: ---"Txn call completed" 430ms (05:26:08.846)] Trace[1964363389]: ---"Writing http response done" 17ms (05:26:08.906) Trace[1964363389]: [635.619022ms] [635.619022ms] END I0721 05:26:08.927716 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0721 05:26:08.966407 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0721 05:26:08.981597 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0721 05:26:09.212025 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0721 05:26:09.219140 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0721 05:26:09.290908 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0721 05:26:14.200571 1 trace.go:236] Trace[1617183693]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9af4f3b4-b9ea-4758-b772-3b69e7fc5e88,client:199.19.213.242,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-x5jvw/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (21-Jul-2026 05:26:13.507) (total time: 692ms): Trace[1617183693]: ["GuaranteedUpdate etcd3" audit-id:9af4f3b4-b9ea-4758-b772-3b69e7fc5e88,key:/pods/kube-system/cilium-x5jvw,type:*core.Pod,resource:pods 692ms (05:26:13.507) Trace[1617183693]: ---"Txn call completed" 679ms (05:26:14.199)] Trace[1617183693]: ---"Object stored in database" 682ms (05:26:14.200) Trace[1617183693]: [692.72336ms] [692.72336ms] END I0721 05:26:14.745386 1 controller.go:624] quota admission added evaluator for: jobs.batch I0721 05:26:15.383609 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0721 05:26:15.393388 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0721 05:26:15.401220 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0721 05:26:15.570685 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0721 05:26:15.808880 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0721 05:26:15.974853 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0721 05:26:16.395441 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0721 05:26:18.001270 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0721 05:26:18.603064 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0721 05:26:18.958807 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0721 05:26:19.371329 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0721 05:26:20.273353 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0721 05:26:20.273386 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0721 05:26:23.245992 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0721 05:26:30.691903 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.111.31.17"} W0721 05:26:30.716899 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.111.31.17:9443: connect: connection refused E0721 05:26:30.716943 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.111.31.17:9443: connect: connection refused I0721 05:26:46.220220 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0721 05:26:46.237301 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0721 05:26:46.250585 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0721 05:26:46.273853 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.97.139.68"} I0721 05:26:46.280797 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0721 05:26:46.285913 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.111.184.46"} I0721 05:26:46.367513 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0721 05:26:46.426971 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0721 05:26:57.344472 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0721 05:27:01.605137 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0721 05:27:17.047324 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.106.239.67"} I0721 05:27:17.058998 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.98.121.235"} I0721 05:27:17.069934 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.103.35.26"} I0721 05:27:17.078103 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.98.72.147"} I0721 05:27:25.810547 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0721 05:27:25.814014 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0721 05:27:25.821407 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0721 05:27:25.829187 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0721 05:27:25.836343 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0721 05:27:25.842614 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0721 05:27:25.850451 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0721 05:27:25.859836 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0721 05:27:25.867903 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0721 05:27:25.874862 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0721 05:27:25.884356 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0721 05:27:25.890550 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0721 05:27:29.629255 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.98.48.189"} I0721 05:27:29.655261 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0721 05:27:32.537859 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0721 05:27:32.552653 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0721 05:27:32.951992 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0721 05:27:32.952050 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0721 05:27:32.952177 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0721 05:27:39.709392 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0721 05:27:40.021336 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.102.161.173"} I0721 05:27:40.342055 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0721 05:27:40.461464 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0721 05:27:40.610379 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.110.110.242"} I0721 05:27:40.625631 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.103.148.128"} I0721 05:28:52.021233 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.103.92.162"} I0721 05:28:55.202765 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.109.193.206"} I0721 05:28:56.026924 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.104.13.228"} I0721 05:29:03.568960 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.96.174.109"} I0721 05:29:03.578119 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.100.145.76"} I0721 05:30:01.426870 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0721 05:30:03.244295 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0721 05:30:03.263239 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0721 05:30:03.286841 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0721 05:30:03.301297 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0721 05:30:03.314023 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0721 05:30:03.325352 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0721 05:30:03.332653 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0721 05:30:11.526829 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0721 05:30:46.076266 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0721 05:30:47.560817 1 trace.go:236] Trace[649575210]: "Update" accept:application/json, */*,audit-id:d002f94f-60c5-4d7f-a01d-0d26aa48dc57,client:10.0.0.178,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/openstack/configmaps/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (21-Jul-2026 05:30:46.757) (total time: 803ms): Trace[649575210]: ["GuaranteedUpdate etcd3" audit-id:d002f94f-60c5-4d7f-a01d-0d26aa48dc57,key:/configmaps/openstack/messaging-topology-operator-leader-election,type:*core.ConfigMap,resource:configmaps 802ms (05:30:46.757) Trace[649575210]: ---"Txn call completed" 802ms (05:30:47.560)] Trace[649575210]: [803.086205ms] [803.086205ms] END I0721 05:30:47.573621 1 trace.go:236] Trace[1834207309]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:62910e25-82c6-4efd-85e5-c6871cb34eba,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (21-Jul-2026 05:30:46.920) (total time: 652ms): Trace[1834207309]: ["GuaranteedUpdate etcd3" audit-id:62910e25-82c6-4efd-85e5-c6871cb34eba,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 652ms (05:30:46.920) Trace[1834207309]: ---"Txn call completed" 651ms (05:30:47.573)] Trace[1834207309]: [652.913235ms] [652.913235ms] END I0721 05:30:47.676227 1 trace.go:236] Trace[1364000351]: "Get" accept:application/json, */*,audit-id:49613c0d-35a2-4f5e-8d26-3f4b247d51e8,client:10.0.0.28,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (21-Jul-2026 05:30:46.762) (total time: 913ms): Trace[1364000351]: ---"About to write a response" 913ms (05:30:47.676) Trace[1364000351]: [913.750275ms] [913.750275ms] END E0721 05:30:52.679274 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0721 05:30:52.679312 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:30:52.679395 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 27.021µs, panicked: false, err: context deadline exceeded, panic-reason: E0721 05:30:52.679399 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0721 05:30:52.679411 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 8.66µs, panicked: false, err: context deadline exceeded, panic-reason: E0721 05:30:52.679492 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0721 05:30:52.680040 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 790.467µs, panicked: false, err: context canceled, panic-reason: E0721 05:30:52.680959 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:30:52.681048 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0721 05:30:52.681103 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0721 05:30:52.681221 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:30:52.682184 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0721 05:30:52.682265 1 trace.go:236] Trace[486876301]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:71fbd903-0346-4d51-98c6-5892baf12936,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (21-Jul-2026 05:30:47.679) (total time: 5002ms): Trace[486876301]: ["GuaranteedUpdate etcd3" audit-id:71fbd903-0346-4d51-98c6-5892baf12936,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (05:30:47.679) Trace[486876301]: ---"Txn call failed" err:context deadline exceeded 4998ms (05:30:52.678)] Trace[486876301]: [5.00249396s] [5.00249396s] END I0721 05:30:52.682267 1 trace.go:236] Trace[289720572]: "Update" accept:application/json, */*,audit-id:f4812ad9-d059-49ee-ac00-9b5914b7d24b,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (21-Jul-2026 05:30:47.679) (total time: 5002ms): Trace[289720572]: ["GuaranteedUpdate etcd3" audit-id:f4812ad9-d059-49ee-ac00-9b5914b7d24b,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (05:30:47.679) Trace[289720572]: ---"Txn call failed" err:context canceled 4999ms (05:30:52.679)] Trace[289720572]: [5.002843267s] [5.002843267s] END I0721 05:30:52.682432 1 trace.go:236] Trace[1549034469]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e085173c-b206-433a-a945-87390e39f54e,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (21-Jul-2026 05:30:47.680) (total time: 5002ms): Trace[1549034469]: ["GuaranteedUpdate etcd3" audit-id:e085173c-b206-433a-a945-87390e39f54e,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (05:30:47.680) Trace[1549034469]: ---"Txn call failed" err:context deadline exceeded 4998ms (05:30:52.678)] Trace[1549034469]: [5.002241614s] [5.002241614s] END E0721 05:30:52.682527 1 timeout.go:142] post-timeout activity - time-elapsed: 2.961095ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0721 05:30:52.682573 1 timeout.go:142] post-timeout activity - time-elapsed: 3.449306ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0721 05:30:52.682683 1 timeout.go:142] post-timeout activity - time-elapsed: 3.576729ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: I0721 05:30:54.575601 1 trace.go:236] Trace[77009921]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5c512720-419d-4795-a575-86fb340305e7,client:10.0.0.252,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (21-Jul-2026 05:30:49.575) (total time: 4999ms): Trace[77009921]: ["GuaranteedUpdate etcd3" audit-id:5c512720-419d-4795-a575-86fb340305e7,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 4999ms (05:30:49.575) Trace[77009921]: ---"Txn call failed" err:context canceled 4998ms (05:30:54.575)] Trace[77009921]: [4.999751617s] [4.999751617s] END E0721 05:30:54.575777 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 7.41µs, panicked: false, err: context canceled, panic-reason: E0721 05:30:54.575812 1 wrap.go:54] timeout or abort while handling: method=PUT URI="/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io?timeout=5s" audit-ID="5c512720-419d-4795-a575-86fb340305e7" E0721 05:30:54.575873 1 timeout.go:142] post-timeout activity - time-elapsed: 7.38µs, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0721 05:30:54.682228 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0721 05:30:54.682243 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0721 05:30:54.682237 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0721 05:30:54.682348 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0721 05:30:54.682562 1 trace.go:236] Trace[682243132]: "Update" accept:application/json, */*,audit-id:ad8532a9-d35e-4ac8-b237-ef503d7b24e5,client:10.0.0.178,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (21-Jul-2026 05:30:47.679) (total time: 7002ms): Trace[682243132]: ["GuaranteedUpdate etcd3" audit-id:ad8532a9-d35e-4ac8-b237-ef503d7b24e5,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:30:47.679) Trace[682243132]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:30:54.682)] Trace[682243132]: [7.002957748s] [7.002957748s] END I0721 05:30:54.683794 1 trace.go:236] Trace[737477349]: "Update" accept:application/json, */*,audit-id:bcd8ae27-5f8c-486a-8a71-9cb2c8aa3f28,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (21-Jul-2026 05:30:47.679) (total time: 7004ms): Trace[737477349]: ["GuaranteedUpdate etcd3" audit-id:bcd8ae27-5f8c-486a-8a71-9cb2c8aa3f28,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (05:30:47.679) Trace[737477349]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (05:30:54.682)] Trace[737477349]: [7.004389609s] [7.004389609s] END I0721 05:30:54.683804 1 trace.go:236] Trace[1379144399]: "Update" accept:application/json, */*,audit-id:e5e91279-51c9-42b8-8cac-a37ad474d7fc,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (21-Jul-2026 05:30:47.679) (total time: 7004ms): Trace[1379144399]: ["GuaranteedUpdate etcd3" audit-id:e5e91279-51c9-42b8-8cac-a37ad474d7fc,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (05:30:47.679) Trace[1379144399]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (05:30:54.682)] Trace[1379144399]: [7.004700815s] [7.004700815s] END I0721 05:30:54.683817 1 trace.go:236] Trace[664944233]: "Update" accept:application/json, */*,audit-id:45a472b1-8844-44ed-8410-bbf7c445588c,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (21-Jul-2026 05:30:47.679) (total time: 7004ms): Trace[664944233]: ["GuaranteedUpdate etcd3" audit-id:45a472b1-8844-44ed-8410-bbf7c445588c,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (05:30:47.679) Trace[664944233]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (05:30:54.682)] Trace[664944233]: [7.004636374s] [7.004636374s] END E0721 05:30:56.751134 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0721 05:30:56.751362 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0721 05:30:56.752562 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:30:56.752643 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0721 05:30:56.753837 1 timeout.go:142] post-timeout activity - time-elapsed: 2.613227ms, GET "/api/v1/namespaces/openstack/configmaps/messaging-topology-operator-leader-election" result: E0721 05:30:57.207071 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0721 05:30:57.207214 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0721 05:30:57.207241 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0721 05:30:57.208464 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:30:57.208555 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0721 05:30:57.208587 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout I0721 05:30:57.209587 1 trace.go:236] Trace[1545535993]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:31638fcc-0166-476c-aa35-00f2dda69aa0,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (21-Jul-2026 05:30:54.681) (total time: 2527ms): Trace[1545535993]: [2.527740506s] [2.527740506s] END E0721 05:30:57.209654 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:30:57.209693 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0721 05:30:57.209856 1 timeout.go:142] post-timeout activity - time-elapsed: 2.810192ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: I0721 05:30:57.210941 1 trace.go:236] Trace[473258150]: "Get" accept:application/json, */*,audit-id:595f41fe-d660-485d-90f7-a5cd80c4a0b1,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (21-Jul-2026 05:30:56.687) (total time: 523ms): Trace[473258150]: [523.855861ms] [523.855861ms] END E0721 05:30:57.211156 1 timeout.go:142] post-timeout activity - time-elapsed: 3.904975ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0721 05:30:57.220137 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0721 05:30:57.220220 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0721 05:30:57.222157 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:30:57.222236 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0721 05:30:57.223276 1 trace.go:236] Trace[822237334]: "Get" accept:application/json, */*,audit-id:645eb04c-86ba-4043-9e27-02965e250935,client:10.0.0.127,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (21-Jul-2026 05:30:51.000) (total time: 6223ms): Trace[822237334]: [6.223090859s] [6.223090859s] END E0721 05:30:57.223374 1 timeout.go:142] post-timeout activity - time-elapsed: 3.211461ms, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: E0721 05:30:57.288541 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0721 05:30:57.288679 1 trace.go:236] Trace[2055948279]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2224e24a-b774-4f2e-bc8a-9a78790bd8bc,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (21-Jul-2026 05:30:54.680) (total time: 2608ms): Trace[2055948279]: [2.608441057s] [2.608441057s] END E0721 05:30:57.289177 1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager?timeout=5s" audit-ID="2224e24a-b774-4f2e-bc8a-9a78790bd8bc" E0721 05:30:57.289207 1 timeout.go:142] post-timeout activity - time-elapsed: 3.72µs, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0721 05:30:57.548171 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0721 05:30:57.548255 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0721 05:30:57.548281 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0721 05:30:57.549325 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0721 05:30:57.549366 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:30:57.549391 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:30:57.550567 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0721 05:30:57.550622 1 trace.go:236] Trace[399027441]: "Get" accept:application/json, */*,audit-id:bb7204d9-dc73-4abd-9054-784dbb88053c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (21-Jul-2026 05:30:56.685) (total time: 864ms): Trace[399027441]: [864.624499ms] [864.624499ms] END E0721 05:30:57.550649 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0721 05:30:57.550719 1 timeout.go:142] post-timeout activity - time-elapsed: 2.462232ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0721 05:30:57.551274 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0721 05:30:57.551693 1 trace.go:236] Trace[1789143596]: "Get" accept:application/json, */*,audit-id:f1271391-5a99-404f-9d8c-b3207a2f34e9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (21-Jul-2026 05:30:56.686) (total time: 865ms): Trace[1789143596]: [865.51817ms] [865.51817ms] END E0721 05:30:57.551822 1 timeout.go:142] post-timeout activity - time-elapsed: 3.67407ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0721 05:30:57.551841 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0721 05:30:57.552915 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:30:57.552955 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0721 05:30:57.554882 1 trace.go:236] Trace[598883501]: "Get" accept:application/json, */*,audit-id:091e3e2a-306f-407d-a1ff-8c6f4c7feae2,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (21-Jul-2026 05:30:54.681) (total time: 2873ms): Trace[598883501]: [2.873754618s] [2.873754618s] END E0721 05:30:57.554966 1 timeout.go:142] post-timeout activity - time-elapsed: 3.712091ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0721 05:30:57.914873 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0721 05:30:57.915047 1 trace.go:236] Trace[100365336]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:62bb49b2-a73e-434f-8c60-4fd2797135a4,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (21-Jul-2026 05:30:50.910) (total time: 7004ms): Trace[100365336]: ["GuaranteedUpdate etcd3" audit-id:62bb49b2-a73e-434f-8c60-4fd2797135a4,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (05:30:50.911) Trace[100365336]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (05:30:57.914)] Trace[100365336]: [7.00411224s] [7.00411224s] END E0721 05:30:59.576122 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0721 05:30:59.576254 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0721 05:30:59.577266 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:30:59.577338 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0721 05:30:59.578412 1 trace.go:236] Trace[194135435]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c6b46a23-a66a-4f11-9cca-86fdc0b0e231,client:10.0.0.252,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (21-Jul-2026 05:30:54.577) (total time: 5000ms): Trace[194135435]: [5.000732012s] [5.000732012s] END E0721 05:30:59.578510 1 timeout.go:142] post-timeout activity - time-elapsed: 2.415832ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0721 05:30:59.735188 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0721 05:30:59.735265 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0721 05:30:59.736494 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:30:59.736559 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0721 05:30:59.737734 1 trace.go:236] Trace[1744984569]: "Get" accept:application/json, */*,audit-id:893aecf7-ceb4-4c5d-9e7f-b4fee5d12cec,client:10.0.0.28,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/openstack/configmaps/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (21-Jul-2026 05:30:49.735) (total time: 10001ms): Trace[1744984569]: [10.001922569s] [10.001922569s] END E0721 05:30:59.737926 1 timeout.go:142] post-timeout activity - time-elapsed: 2.558186ms, GET "/api/v1/namespaces/openstack/configmaps/rabbitmq-cluster-operator-leader-election" result: E0721 05:31:00.208660 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0721 05:31:00.209078 1 trace.go:236] Trace[905763399]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f0b6c7ab-23cc-48cc-ab85-6e54f345f1f6,client:199.19.213.242,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (21-Jul-2026 05:30:53.205) (total time: 7003ms): Trace[905763399]: ["Create etcd3" audit-id:f0b6c7ab-23cc-48cc-ab85-6e54f345f1f6,key:/events/kube-system/kube-apiserver-instance.18c43706742bd5a5,type:*core.Event,resource:events 7002ms (05:30:53.206)] Trace[905763399]: [7.003515938s] [7.003515938s] END E0721 05:31:00.941003 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0721 05:31:00.941193 1 trace.go:236] Trace[561947100]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9a329f87-19f9-4cb5-bb88-32746d08505e,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (21-Jul-2026 05:30:53.937) (total time: 7003ms): Trace[561947100]: ["GuaranteedUpdate etcd3" audit-id:9a329f87-19f9-4cb5-bb88-32746d08505e,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (05:30:53.937) Trace[561947100]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (05:31:00.940)] Trace[561947100]: [7.003437295s] [7.003437295s] END E0721 05:31:02.208715 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 23.211µs, panicked: false, err: context deadline exceeded, panic-reason: E0721 05:31:02.208789 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0721 05:31:02.210346 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:31:02.210511 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0721 05:31:02.211502 1 trace.go:236] Trace[1319408616]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:836409d1-3f8a-4167-a5ca-f9df3334c98f,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (21-Jul-2026 05:30:57.208) (total time: 5002ms): Trace[1319408616]: ["GuaranteedUpdate etcd3" audit-id:836409d1-3f8a-4167-a5ca-f9df3334c98f,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (05:30:57.209) Trace[1319408616]: ---"Txn call failed" err:context deadline exceeded 4998ms (05:31:02.208)] Trace[1319408616]: [5.002556242s] [5.002556242s] END E0721 05:31:02.211714 1 timeout.go:142] post-timeout activity - time-elapsed: 3.120417ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0721 05:31:02.552430 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0721 05:31:02.552471 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:31:02.552543 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 105.412µs, panicked: false, err: context canceled, panic-reason: E0721 05:31:02.553591 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0721 05:31:02.553671 1 trace.go:236] Trace[1523841950]: "Update" accept:application/json, */*,audit-id:3a5e42e5-ec21-4f54-89c0-950e61c6a8e8,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (21-Jul-2026 05:30:57.552) (total time: 5000ms): Trace[1523841950]: ["GuaranteedUpdate etcd3" audit-id:3a5e42e5-ec21-4f54-89c0-950e61c6a8e8,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (05:30:57.552) Trace[1523841950]: ---"Txn call failed" err:context canceled 4998ms (05:31:02.552)] Trace[1523841950]: [5.000934344s] [5.000934344s] END E0721 05:31:02.553783 1 timeout.go:142] post-timeout activity - time-elapsed: 1.469012ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0721 05:31:04.551802 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0721 05:31:04.551801 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0721 05:31:04.551978 1 trace.go:236] Trace[938363448]: "Update" accept:application/json, */*,audit-id:84b1e744-b7ff-4927-8c6c-348e720b859a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (21-Jul-2026 05:30:57.549) (total time: 7002ms): Trace[938363448]: ["GuaranteedUpdate etcd3" audit-id:84b1e744-b7ff-4927-8c6c-348e720b859a,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:30:57.549) Trace[938363448]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:31:04.551)] Trace[938363448]: [7.002637053s] [7.002637053s] END I0721 05:31:04.553207 1 trace.go:236] Trace[155130366]: "Update" accept:application/json, */*,audit-id:6a9a4afa-a2c4-4192-be47-c3b8fdcacf65,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (21-Jul-2026 05:30:57.548) (total time: 7004ms): Trace[155130366]: ["GuaranteedUpdate etcd3" audit-id:6a9a4afa-a2c4-4192-be47-c3b8fdcacf65,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (05:30:57.549) Trace[155130366]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:31:04.551)] Trace[155130366]: [7.004185846s] [7.004185846s] END E0721 05:31:04.674742 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0721 05:31:04.674934 1 trace.go:236] Trace[1116424095]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d52b2910-8a47-40c0-b38c-9dc9837889ed,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (21-Jul-2026 05:30:57.671) (total time: 7003ms): Trace[1116424095]: ["GuaranteedUpdate etcd3" audit-id:d52b2910-8a47-40c0-b38c-9dc9837889ed,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (05:30:57.671) Trace[1116424095]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:31:04.674)] Trace[1116424095]: [7.00326554s] [7.00326554s] END E0721 05:31:04.675662 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0721 05:31:04.920026 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0721 05:31:04.920186 1 trace.go:236] Trace[1405848207]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:43a27b9c-caef-4592-ba60-20339a6bab12,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (21-Jul-2026 05:30:57.916) (total time: 7003ms): Trace[1405848207]: ["GuaranteedUpdate etcd3" audit-id:43a27b9c-caef-4592-ba60-20339a6bab12,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (05:30:57.917) Trace[1405848207]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:31:04.919)] Trace[1405848207]: [7.003260527s] [7.003260527s] END E0721 05:31:07.210817 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0721 05:31:07.210941 1 trace.go:236] Trace[442491492]: "Create" accept:application/json, */*,audit-id:76fa58f0-3050-404e-945e-041e2b02eda7,client:10.0.0.252,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (21-Jul-2026 05:30:59.578) (total time: 7632ms): Trace[442491492]: ["Create etcd3" audit-id:76fa58f0-3050-404e-945e-041e2b02eda7,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18c43707eff68e39,type:*core.Event,resource:events 7631ms (05:30:59.579)] Trace[442491492]: [7.632833362s] [7.632833362s] END E0721 05:31:08.937804 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0721 05:31:08.938091 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0721 05:31:08.938992 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0721 05:31:08.940090 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0721 05:31:08.940203 1 trace.go:236] Trace[10650319]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:84a50a75-0f0e-48ca-8020-3a0ce57b0919,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (21-Jul-2026 05:31:00.942) (total time: 7997ms): Trace[10650319]: [7.997481772s] [7.997481772s] END E0721 05:31:08.940449 1 timeout.go:142] post-timeout activity - time-elapsed: 2.660947ms, GET "/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader" result: I0721 05:31:10.850924 1 trace.go:236] Trace[931800110]: "Get" accept:application/json,audit-id:860a9e79-1881-489c-a3f2-767f86545ac0,client:199.19.213.242,protocol:HTTP/1.1,resource:secrettemplates,scope:resource,url:/apis/secretgen.carvel.dev/v1alpha1/namespaces/monitoring/secrettemplates/kube-prometheus-stack-alertmanager-oauth2-proxy,user-agent:OpenAPI-Generator/36.0.3/python,verb:GET (21-Jul-2026 05:30:51.100) (total time: 19750ms): Trace[931800110]: ---"About to write a response" 19750ms (05:31:10.850) Trace[931800110]: [19.750841918s] [19.750841918s] END I0721 05:31:10.851954 1 trace.go:236] Trace[1773518794]: "Get" accept:application/json, */*,audit-id:51f5ee51-f6fd-4d3b-b219-e1c71e0f86de,client:10.0.0.121,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.10 (linux/amd64) cert-manager/4131d77fe377e78a6fa562af6bdbd31532ddb1ad,verb:GET (21-Jul-2026 05:30:51.089) (total time: 19762ms): Trace[1773518794]: ---"About to write a response" 19762ms (05:31:10.851) Trace[1773518794]: [19.762579465s] [19.762579465s] END I0721 05:31:10.852161 1 trace.go:236] Trace[1442022401]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5e1a083d-02a1-4401-849e-4c17de6444ea,client:199.19.213.242,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/datadir-percona-xtradb-pxc-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (21-Jul-2026 05:31:05.424) (total time: 5427ms): Trace[1442022401]: ---"About to write a response" 5427ms (05:31:10.851) Trace[1442022401]: [5.427595937s] [5.427595937s] END I0721 05:31:10.852176 1 trace.go:236] Trace[1566009801]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2f0ee820-8646-4fec-aa46-ff10b75f7b18,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (21-Jul-2026 05:31:08.938) (total time: 1913ms): Trace[1566009801]: ["GuaranteedUpdate etcd3" audit-id:2f0ee820-8646-4fec-aa46-ff10b75f7b18,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 1913ms (05:31:08.939) Trace[1566009801]: ---"Txn call completed" 1911ms (05:31:10.851)] Trace[1566009801]: [1.913213936s] [1.913213936s] END I0721 05:31:10.853104 1 trace.go:236] Trace[1941700766]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1eb9d37b-c065-42d7-8e1d-49f298084766,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (21-Jul-2026 05:31:04.676) (total time: 6176ms): Trace[1941700766]: ["GuaranteedUpdate etcd3" audit-id:1eb9d37b-c065-42d7-8e1d-49f298084766,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 6176ms (05:31:04.676) Trace[1941700766]: ---"Txn call completed" 6174ms (05:31:10.851)] Trace[1941700766]: [6.176579956s] [6.176579956s] END I0721 05:31:10.853191 1 trace.go:236] Trace[762672767]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cf77d631-1d65-4ecb-92c2-fc736c99e2e1,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (21-Jul-2026 05:31:04.922) (total time: 5931ms): Trace[762672767]: ["GuaranteedUpdate etcd3" audit-id:cf77d631-1d65-4ecb-92c2-fc736c99e2e1,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 5930ms (05:31:04.922) Trace[762672767]: ---"Txn call completed" 5929ms (05:31:10.852)] Trace[762672767]: [5.9310306s] [5.9310306s] END E0721 05:31:10.854634 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0721 05:31:10.854688 1 trace.go:236] Trace[1761567800]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:076776dd-97a3-48fc-95cc-356a5dbd4de8,client:199.19.213.242,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18c43706742bd5a5,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (21-Jul-2026 05:31:00.211) (total time: 10643ms): Trace[1761567800]: ["GuaranteedUpdate etcd3" audit-id:076776dd-97a3-48fc-95cc-356a5dbd4de8,key:/events/kube-system/kube-apiserver-instance.18c43706742bd5a5,type:*core.Event,resource:events 10643ms (05:31:00.211) Trace[1761567800]: ---"initial value restored" 10643ms (05:31:10.854)] Trace[1761567800]: [10.6433872s] [10.6433872s] END I0721 05:31:10.855517 1 trace.go:236] Trace[1982370488]: "Get" accept:application/json, */*,audit-id:4b2ae6f8-9288-4b5d-a5e1-3af62d3da665,client:10.0.0.228,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (21-Jul-2026 05:30:49.386) (total time: 21469ms): Trace[1982370488]: ---"About to write a response" 21468ms (05:31:10.855) Trace[1982370488]: [21.469032863s] [21.469032863s] END I0721 05:31:10.855955 1 trace.go:236] Trace[1914036374]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c381d1e7-8075-4c08-bd16-557b20046c54,client:199.19.213.242,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (21-Jul-2026 05:31:01.223) (total time: 9632ms): Trace[1914036374]: ---"About to write a response" 9632ms (05:31:10.855) Trace[1914036374]: [9.632902435s] [9.632902435s] END I0721 05:31:10.877533 1 trace.go:236] Trace[898148238]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.242,type:*v1.Endpoints,resource:apiServerIPInfo (21-Jul-2026 05:30:52.106) (total time: 18770ms): Trace[898148238]: ---"initial value restored" 18742ms (05:31:10.849) Trace[898148238]: [18.770502714s] [18.770502714s] END I0721 05:31:18.200958 1 trace.go:236] Trace[1275726031]: "Create" accept:application/json,audit-id:88eb4c51-2bb6-4d69-8555-c96cb8da2c23,client:199.19.213.242,protocol:HTTP/1.1,resource:clusterissuers,scope:resource,url:/apis/cert-manager.io/v1/clusterissuers,user-agent:OpenAPI-Generator/36.0.3/python,verb:POST (21-Jul-2026 05:31:17.452) (total time: 747ms): Trace[1275726031]: ["Create etcd3" audit-id:88eb4c51-2bb6-4d69-8555-c96cb8da2c23,key:/cert-manager.io/clusterissuers/kube-prometheus-stack,type:*unstructured.Unstructured,resource:clusterissuers.cert-manager.io 741ms (05:31:17.459) Trace[1275726031]: ---"Txn call succeeded" 741ms (05:31:18.200)] Trace[1275726031]: [747.98559ms] [747.98559ms] END I0721 05:31:18.206803 1 trace.go:236] Trace[145087282]: "Update" accept:application/json, */*,audit-id:cc1373f9-d7ca-4532-9ad3-46aaca43ebed,client:10.0.0.121,protocol:HTTP/2.0,resource:certificates,scope:resource,url:/apis/cert-manager.io/v1/namespaces/cert-manager/certificates/kube-prometheus-stack-ca/status,user-agent:cert-manager-certificates-trigger/v1.12.10 (linux/amd64) cert-manager/4131d77fe377e78a6fa562af6bdbd31532ddb1ad,verb:PUT (21-Jul-2026 05:31:17.448) (total time: 757ms): Trace[145087282]: ["GuaranteedUpdate etcd3" audit-id:cc1373f9-d7ca-4532-9ad3-46aaca43ebed,key:/cert-manager.io/certificates/cert-manager/kube-prometheus-stack-ca,type:*unstructured.Unstructured,resource:certificates.cert-manager.io 757ms (05:31:17.449) Trace[145087282]: ---"Txn call completed" 744ms (05:31:18.200)] Trace[145087282]: [757.837632ms] [757.837632ms] END I0721 05:31:22.320536 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0721 05:31:22.471036 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0721 05:31:22.491798 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0721 05:31:22.531777 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0721 05:31:22.776352 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0721 05:31:23.039996 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0721 05:31:23.045335 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0721 05:31:23.120217 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0721 05:31:23.142667 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0721 05:31:23.349788 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0721 05:32:04.582811 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.106.227.67"} I0721 05:32:04.590962 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.111.1.203"} I0721 05:32:04.601165 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.103.232.48"} I0721 05:32:04.607436 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.110.96.33"} I0721 05:32:04.619845 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.97.29.26"} I0721 05:32:04.627471 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.111.174.122"} I0721 05:32:04.676084 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0721 05:32:04.692439 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0721 05:32:04.737845 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0721 05:32:04.749851 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0721 05:32:04.771287 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0721 05:32:04.783233 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.783260 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.783510 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.783573 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.784389 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.784452 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.786562 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.786594 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.786725 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.786763 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.786944 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.786988 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.787005 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.787014 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.787188 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.787196 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.787214 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.787227 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.787346 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.787393 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.787521 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.787549 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.788078 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.788099 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.788216 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.788255 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.788321 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.788356 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.789299 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.789327 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused W0721 05:32:04.792853 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused E0721 05:32:04.792916 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.232.48:443: connect: connection refused I0721 05:32:11.198361 1 trace.go:236] Trace[2056342312]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1fde1980-add4-4ba2-9b5d-4cd0d71c4f1e,client:199.19.213.242,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/monitoring/jobs/kube-prometheus-stack-admission-patch/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:PUT (21-Jul-2026 05:32:10.445) (total time: 753ms): Trace[2056342312]: ["GuaranteedUpdate etcd3" audit-id:1fde1980-add4-4ba2-9b5d-4cd0d71c4f1e,key:/jobs/monitoring/kube-prometheus-stack-admission-patch,type:*batch.Job,resource:jobs.batch 752ms (05:32:10.445) Trace[2056342312]: ---"Txn call completed" 749ms (05:32:11.198)] Trace[2056342312]: [753.175278ms] [753.175278ms] END I0721 05:32:11.198476 1 trace.go:236] Trace[1091922308]: "Get" accept:application/json, */*,audit-id:42cac90d-de86-45b4-b600-566006b1d95b,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (21-Jul-2026 05:32:10.561) (total time: 636ms): Trace[1091922308]: ---"About to write a response" 636ms (05:32:11.198) Trace[1091922308]: [636.336133ms] [636.336133ms] END I0721 05:32:11.205161 1 trace.go:236] Trace[1918443]: "Get" accept:application/json, */*,audit-id:3c243dd3-23fc-40ae-afd0-9f610330b992,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (21-Jul-2026 05:32:10.574) (total time: 630ms): Trace[1918443]: ---"About to write a response" 630ms (05:32:11.205) Trace[1918443]: [630.739068ms] [630.739068ms] END I0721 05:32:18.681030 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0721 05:32:18.835907 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.104.60.120"} I0721 05:32:43.933458 1 trace.go:236] Trace[1153309477]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a9255f5c-609f-49c1-8833-736783cb1ee4,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (21-Jul-2026 05:32:43.305) (total time: 628ms): Trace[1153309477]: ["GuaranteedUpdate etcd3" audit-id:a9255f5c-609f-49c1-8833-736783cb1ee4,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 627ms (05:32:43.305) Trace[1153309477]: ---"Txn call completed" 626ms (05:32:43.933)] Trace[1153309477]: [628.155778ms] [628.155778ms] END I0721 05:32:43.933915 1 trace.go:236] Trace[1988800777]: "Get" accept:application/json, */*,audit-id:1e269c13-84c4-426b-be6a-01f2ae212273,client:10.0.0.28,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/openstack/configmaps/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (21-Jul-2026 05:32:43.208) (total time: 725ms): Trace[1988800777]: ---"About to write a response" 725ms (05:32:43.933) Trace[1988800777]: [725.535968ms] [725.535968ms] END I0721 05:32:43.935994 1 trace.go:236] Trace[502542284]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5e5d7b16-18b3-45ad-afda-142efa39ffa0,client:199.19.213.242,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (21-Jul-2026 05:32:43.373) (total time: 562ms): Trace[502542284]: ["GuaranteedUpdate etcd3" audit-id:5e5d7b16-18b3-45ad-afda-142efa39ffa0,key:/minions/instance,type:*core.Node,resource:nodes 562ms (05:32:43.373) Trace[502542284]: ---"Txn call completed" 557ms (05:32:43.935)] Trace[502542284]: ---"Object stored in database" 558ms (05:32:43.935) Trace[502542284]: [562.250983ms] [562.250983ms] END I0721 05:32:57.316715 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.109.44.66"} I0721 05:32:57.339904 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0721 05:33:04.595894 1 trace.go:236] Trace[162751576]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2ce20aea-e853-4674-ba02-9f595f198df1,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (21-Jul-2026 05:33:04.044) (total time: 551ms): Trace[162751576]: ["GuaranteedUpdate etcd3" audit-id:2ce20aea-e853-4674-ba02-9f595f198df1,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 551ms (05:33:04.044) Trace[162751576]: ---"Txn call completed" 550ms (05:33:04.595)] Trace[162751576]: [551.810029ms] [551.810029ms] END I0721 05:33:04.600679 1 trace.go:236] Trace[1081295397]: "Get" accept:application/json, */*,audit-id:428f6f49-f3e7-4f2d-8f77-1e62d93abe74,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (21-Jul-2026 05:33:04.048) (total time: 552ms): Trace[1081295397]: ---"About to write a response" 552ms (05:33:04.600) Trace[1081295397]: [552.478721ms] [552.478721ms] END I0721 05:33:04.601021 1 trace.go:236] Trace[456707546]: "Get" accept:application/json, */*,audit-id:997765cb-76c4-4546-9cec-93b838d06c62,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (21-Jul-2026 05:33:04.090) (total time: 510ms): Trace[456707546]: ---"About to write a response" 510ms (05:33:04.600) Trace[456707546]: [510.922406ms] [510.922406ms] END I0721 05:33:04.600688 1 trace.go:236] Trace[195222984]: "Get" accept:application/json, */*,audit-id:2a14cd1a-98b7-424b-a9ed-078ae1b991d1,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (21-Jul-2026 05:33:04.049) (total time: 550ms): Trace[195222984]: ---"About to write a response" 550ms (05:33:04.600) Trace[195222984]: [550.646474ms] [550.646474ms] END E0721 05:33:48.246100 1 watch.go:287] unable to encode watch object *v1.WatchEvent: http2: stream closed (&streaming.encoderWithAllocator{writer:responsewriter.outerWithCloseNotifyAndFlush{UserProvidedDecorator:(*metrics.ResponseWriterDelegator)(0xc021bdf0e0), InnerCloseNotifierFlusher:struct { httpsnoop.Unwrapper; http.ResponseWriter; http.Flusher; http.CloseNotifier; http.Pusher }{Unwrapper:(*httpsnoop.rw)(0xc01fdda9b0), ResponseWriter:(*httpsnoop.rw)(0xc01fdda9b0), Flusher:(*httpsnoop.rw)(0xc01fdda9b0), CloseNotifier:(*httpsnoop.rw)(0xc01fdda9b0), Pusher:(*httpsnoop.rw)(0xc01fdda9b0)}}, encoder:(*versioning.codec)(0xc02d6b08c0), memAllocator:(*runtime.Allocator)(0xc00802e8d0)}) I0721 05:35:23.580175 1 trace.go:236] Trace[1434070171]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:121a9ec4-cd72-4363-8de3-487936998613,client:199.19.213.242,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keystone-domain-manage-t286z/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (21-Jul-2026 05:35:19.787) (total time: 3793ms): Trace[1434070171]: ["GuaranteedUpdate etcd3" audit-id:121a9ec4-cd72-4363-8de3-487936998613,key:/pods/openstack/keystone-domain-manage-t286z,type:*core.Pod,resource:pods 3792ms (05:35:19.787) Trace[1434070171]: ---"Txn call completed" 3788ms (05:35:23.579)] Trace[1434070171]: ---"Object stored in database" 3788ms (05:35:23.579) Trace[1434070171]: [3.793055589s] [3.793055589s] END I0721 05:35:23.580866 1 trace.go:236] Trace[1882752461]: "Get" accept:application/json, */*,audit-id:b74570b0-361b-4579-a1d4-9e44d117f20e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (21-Jul-2026 05:35:21.589) (total time: 1991ms): Trace[1882752461]: ---"About to write a response" 1991ms (05:35:23.580) Trace[1882752461]: [1.991827063s] [1.991827063s] END I0721 05:35:23.581138 1 trace.go:236] Trace[302009355]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:484bbac1-069e-46b2-88ba-3abb4853a543,client:10.0.0.252,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (21-Jul-2026 05:35:21.635) (total time: 1945ms): Trace[302009355]: ["GuaranteedUpdate etcd3" audit-id:484bbac1-069e-46b2-88ba-3abb4853a543,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1945ms (05:35:21.635) Trace[302009355]: ---"Txn call completed" 1944ms (05:35:23.581)] Trace[302009355]: [1.945805908s] [1.945805908s] END I0721 05:35:23.581189 1 trace.go:236] Trace[1633758220]: "Get" accept:application/json, */*,audit-id:3aa54f2e-f54c-4ac3-b0ee-d8d066eec9f7,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (21-Jul-2026 05:35:21.485) (total time: 2095ms): Trace[1633758220]: ---"About to write a response" 2095ms (05:35:23.581) Trace[1633758220]: [2.095712205s] [2.095712205s] END I0721 05:35:23.581359 1 trace.go:236] Trace[675770316]: "Get" accept:application/json, */*,audit-id:4bb06100-797b-47f0-b714-5b9d676e45c3,client:10.0.0.178,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/openstack/configmaps/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (21-Jul-2026 05:35:20.417) (total time: 3163ms): Trace[675770316]: ---"About to write a response" 3163ms (05:35:23.581) Trace[675770316]: [3.163476938s] [3.163476938s] END I0721 05:35:23.581518 1 trace.go:236] Trace[1994509188]: "Get" accept:application/json, */*,audit-id:61da6c1b-f335-4a1b-a06e-f07117d89e59,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (21-Jul-2026 05:35:21.599) (total time: 1981ms): Trace[1994509188]: ---"About to write a response" 1981ms (05:35:23.581) Trace[1994509188]: [1.981942469s] [1.981942469s] END I0721 05:35:23.581603 1 trace.go:236] Trace[796735538]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5af056c8-2c0c-4beb-b723-05822a22f75b,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (21-Jul-2026 05:35:21.436) (total time: 2145ms): Trace[796735538]: ---"About to write a response" 2145ms (05:35:23.581) Trace[796735538]: [2.145149684s] [2.145149684s] END I0721 05:35:23.581787 1 trace.go:236] Trace[949219562]: "Get" accept:application/json, */*,audit-id:82e28d16-34d4-4903-bb39-b8826010fccb,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (21-Jul-2026 05:35:21.580) (total time: 2001ms): Trace[949219562]: ---"About to write a response" 2001ms (05:35:23.581) Trace[949219562]: [2.001684366s] [2.001684366s] END I0721 05:35:23.581904 1 trace.go:236] Trace[164661424]: "Get" accept:application/json, */*,audit-id:38938eca-8236-498a-989c-046a2816839a,client:10.0.0.28,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/openstack/configmaps/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (21-Jul-2026 05:35:20.452) (total time: 3128ms): Trace[164661424]: ---"About to write a response" 3128ms (05:35:23.581) Trace[164661424]: [3.128870974s] [3.128870974s] END I0721 05:35:23.582438 1 trace.go:236] Trace[757683138]: "Get" accept:application/json, */*,audit-id:28e40b21-9302-48a9-a364-92081ad5604f,client:10.0.0.127,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (21-Jul-2026 05:35:21.338) (total time: 2244ms): Trace[757683138]: ---"About to write a response" 2243ms (05:35:23.581) Trace[757683138]: [2.244256126s] [2.244256126s] END I0721 05:35:23.582877 1 trace.go:236] Trace[1804110102]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2fc0f748-299b-4f9c-b221-8744fd8dec2d,client:199.19.213.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (21-Jul-2026 05:35:21.312) (total time: 2270ms): Trace[1804110102]: ---"About to write a response" 2270ms (05:35:23.582) Trace[1804110102]: [2.270125918s] [2.270125918s] END I0721 05:35:23.595883 1 trace.go:236] Trace[984796849]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.242,type:*v1.Endpoints,resource:apiServerIPInfo (21-Jul-2026 05:35:20.908) (total time: 2686ms): Trace[984796849]: ---"initial value restored" 2672ms (05:35:23.581) Trace[984796849]: [2.686910566s] [2.686910566s] END I0721 05:35:51.340784 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon-int" clusterIPs={"IPv4":"10.102.69.96"} I0721 05:35:51.348297 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon" clusterIPs={"IPv4":"10.97.24.27"}