I0622 01:55:03.032327 1 options.go:220] external host was not specified, using 199.204.45.138 I0622 01:55:03.033173 1 server.go:148] Version: v1.28.13 I0622 01:55:03.033209 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0622 01:55:03.682234 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0622 01:55:03.691493 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0622 01:55:03.691514 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0622 01:55:03.691787 1 instance.go:298] Using reconciler: lease I0622 01:55:03.741660 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0622 01:55:03.741707 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0622 01:55:03.997691 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0622 01:55:03.997825 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0622 01:55:04.443483 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0622 01:55:04.461768 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0622 01:55:04.461803 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0622 01:55:04.461810 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0622 01:55:04.462178 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0622 01:55:04.462192 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0622 01:55:04.462851 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0622 01:55:04.463435 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0622 01:55:04.463449 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0622 01:55:04.463453 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0622 01:55:04.464517 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0622 01:55:04.464531 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0622 01:55:04.465439 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0622 01:55:04.465454 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0622 01:55:04.465457 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0622 01:55:04.465939 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0622 01:55:04.465952 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0622 01:55:04.465981 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0622 01:55:04.466358 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0622 01:55:04.467593 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0622 01:55:04.467607 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0622 01:55:04.467611 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0622 01:55:04.467962 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0622 01:55:04.467975 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0622 01:55:04.467978 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0622 01:55:04.468595 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0622 01:55:04.468608 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0622 01:55:04.470180 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0622 01:55:04.470196 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0622 01:55:04.470200 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0622 01:55:04.470576 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0622 01:55:04.470589 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0622 01:55:04.470593 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0622 01:55:04.472177 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0622 01:55:04.472191 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0622 01:55:04.472195 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0622 01:55:04.473083 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0622 01:55:04.473989 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0622 01:55:04.474004 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0622 01:55:04.474008 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0622 01:55:04.478281 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0622 01:55:04.478301 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0622 01:55:04.478306 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0622 01:55:04.479027 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0622 01:55:04.479040 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0622 01:55:04.479044 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0622 01:55:04.479438 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0622 01:55:04.479450 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0622 01:55:04.506243 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0622 01:55:04.506277 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0622 01:55:04.901749 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0622 01:55:04.901761 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0622 01:55:04.901959 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0622 01:55:04.902222 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0622 01:55:04.902553 1 secure_serving.go:213] Serving securely on [::]:6443 I0622 01:55:04.902694 1 controller.go:78] Starting OpenAPI AggregationController I0622 01:55:04.902739 1 available_controller.go:423] Starting AvailableConditionController I0622 01:55:04.902761 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0622 01:55:04.902766 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0622 01:55:04.902784 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0622 01:55:04.902823 1 aggregator.go:164] waiting for initial CRD sync... I0622 01:55:04.902831 1 controller.go:85] Starting OpenAPI V3 controller I0622 01:55:04.902865 1 establishing_controller.go:76] Starting EstablishingController I0622 01:55:04.902892 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0622 01:55:04.902894 1 controller.go:80] Starting OpenAPI V3 AggregationController I0622 01:55:04.902931 1 system_namespaces_controller.go:67] Starting system namespaces controller I0622 01:55:04.902942 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0622 01:55:04.902934 1 crd_finalizer.go:266] Starting CRDFinalizer I0622 01:55:04.902918 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0622 01:55:04.902989 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0622 01:55:04.902998 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0622 01:55:04.903003 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0622 01:55:04.902921 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0622 01:55:04.902854 1 naming_controller.go:291] Starting NamingConditionController I0622 01:55:04.903063 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0622 01:55:04.903034 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0622 01:55:04.903077 1 gc_controller.go:78] Starting apiserver lease garbage collector I0622 01:55:04.902809 1 controller.go:134] Starting OpenAPI controller I0622 01:55:04.903136 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0622 01:55:04.903144 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0622 01:55:04.903154 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0622 01:55:04.903481 1 controller.go:116] Starting legacy_token_tracking_controller I0622 01:55:04.903502 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0622 01:55:04.903713 1 gc_controller.go:78] Starting apiserver lease garbage collector I0622 01:55:04.983313 1 shared_informer.go:318] Caches are synced for node_authorizer I0622 01:55:05.003008 1 cache.go:39] Caches are synced for AvailableConditionController controller I0622 01:55:05.003059 1 shared_informer.go:318] Caches are synced for crd-autoregister I0622 01:55:05.003149 1 aggregator.go:166] initial CRD sync complete... I0622 01:55:05.003172 1 autoregister_controller.go:141] Starting autoregister controller I0622 01:55:05.003181 1 cache.go:32] Waiting for caches to sync for autoregister controller I0622 01:55:05.003190 1 cache.go:39] Caches are synced for autoregister controller I0622 01:55:05.003372 1 apf_controller.go:379] Running API Priority and Fairness config worker I0622 01:55:05.003407 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0622 01:55:05.003467 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0622 01:55:05.003542 1 shared_informer.go:318] Caches are synced for configmaps I0622 01:55:05.003800 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0622 01:55:05.005885 1 controller.go:624] quota admission added evaluator for: namespaces I0622 01:55:05.174556 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0622 01:55:05.909167 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0622 01:55:05.913645 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0622 01:55:05.913665 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0622 01:55:06.930764 1 trace.go:236] Trace[1788626050]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e0d1d626-91a3-4d62-8f6e-48e21347b24b,client:::1,protocol:HTTP/2.0,resource:clusterrolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterrolebindings,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (22-Jun-2026 01:55:06.412) (total time: 518ms): Trace[1788626050]: ["Create etcd3" audit-id:e0d1d626-91a3-4d62-8f6e-48e21347b24b,key:/clusterrolebindings/system:controller:pod-garbage-collector,type:*rbac.ClusterRoleBinding,resource:clusterrolebindings.rbac.authorization.k8s.io 517ms (01:55:06.412) Trace[1788626050]: ---"Txn call succeeded" 517ms (01:55:06.930)] Trace[1788626050]: [518.313437ms] [518.313437ms] END I0622 01:55:07.278859 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0622 01:55:07.337672 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0622 01:55:07.421786 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0622 01:55:07.432719 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.138] I0622 01:55:07.433913 1 controller.go:624] quota admission added evaluator for: endpoints I0622 01:55:07.442764 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0622 01:55:08.067489 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0622 01:55:09.413219 1 controller.go:624] quota admission added evaluator for: deployments.apps I0622 01:55:09.430193 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0622 01:55:09.445701 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0622 01:55:13.129997 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0622 01:55:13.176697 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0622 01:55:17.897136 1 trace.go:236] Trace[320032066]: "Update" accept:application/json, */*,audit-id:215fd6d4-0e8e-4027-8961-906a906fe247,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (22-Jun-2026 01:55:17.367) (total time: 529ms): Trace[320032066]: ["GuaranteedUpdate etcd3" audit-id:215fd6d4-0e8e-4027-8961-906a906fe247,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 529ms (01:55:17.367) Trace[320032066]: ---"Txn call completed" 528ms (01:55:17.896)] Trace[320032066]: [529.788962ms] [529.788962ms] END I0622 01:55:17.897636 1 trace.go:236] Trace[1571695699]: "Update" accept:application/json, */*,audit-id:ec82578c-8f80-4eba-9796-f52e6ffe5544,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (22-Jun-2026 01:55:17.367) (total time: 530ms): Trace[1571695699]: ["GuaranteedUpdate etcd3" audit-id:ec82578c-8f80-4eba-9796-f52e6ffe5544,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 530ms (01:55:17.367) Trace[1571695699]: ---"Txn call completed" 528ms (01:55:17.897)] Trace[1571695699]: [530.244067ms] [530.244067ms] END I0622 01:56:24.862380 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0622 01:56:24.979011 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0622 01:56:24.979073 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0622 01:56:25.281281 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0622 01:56:25.510748 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0622 01:56:25.891059 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0622 01:56:26.204764 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0622 01:56:26.476567 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0622 01:56:26.900348 1 trace.go:236] Trace[612844159]: "Create" accept:application/json,audit-id:6bf5c949-695d-4001-a50f-11f52266b66a,client:199.204.45.138,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (22-Jun-2026 01:56:26.308) (total time: 592ms): Trace[612844159]: ---"Conversion done" 24ms (01:56:26.334) Trace[612844159]: ---"Writing http response done" 25ms (01:56:26.900) Trace[612844159]: [592.284858ms] [592.284858ms] END I0622 01:56:27.023929 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0622 01:56:27.023994 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0622 01:56:27.065024 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0622 01:56:27.065077 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0622 01:56:27.102761 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0622 01:56:27.102815 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0622 01:56:27.192888 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0622 01:56:27.280952 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0622 01:56:27.281056 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0622 01:56:27.298752 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0622 01:56:27.666290 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0622 01:56:27.698574 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0622 01:56:27.736586 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0622 01:56:27.752647 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0622 01:56:28.617600 1 trace.go:236] Trace[1841229508]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ad69f0c0-d1ca-4df9-95b9-f8900f91a8e4,client:::1,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/httproutefilters.gateway.envoyproxy.io/status,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 01:56:27.891) (total time: 726ms): Trace[1841229508]: ["GuaranteedUpdate etcd3" audit-id:ad69f0c0-d1ca-4df9-95b9-f8900f91a8e4,key:/apiextensions.k8s.io/customresourcedefinitions/httproutefilters.gateway.envoyproxy.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 725ms (01:56:27.891) Trace[1841229508]: ---"Txn call completed" 722ms (01:56:28.616)] Trace[1841229508]: [726.419851ms] [726.419851ms] END I0622 01:56:29.323235 1 trace.go:236] Trace[498624890]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ce178fe2-6cad-486a-a72e-6c6d9d7cca5f,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Jun-2026 01:56:27.932) (total time: 1390ms): Trace[498624890]: ---"About to write a response" 1390ms (01:56:29.323) Trace[498624890]: [1.390602766s] [1.390602766s] END I0622 01:56:29.336323 1 trace.go:236] Trace[881759273]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d5a6485e-f058-4f1d-93c9-797020bf5b0a,client:::1,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/securitypolicies.gateway.envoyproxy.io/status,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 01:56:28.620) (total time: 715ms): Trace[881759273]: ["GuaranteedUpdate etcd3" audit-id:d5a6485e-f058-4f1d-93c9-797020bf5b0a,key:/apiextensions.k8s.io/customresourcedefinitions/securitypolicies.gateway.envoyproxy.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 712ms (01:56:28.624) Trace[881759273]: ---"Txn call completed" 671ms (01:56:29.322)] Trace[881759273]: [715.774976ms] [715.774976ms] END I0622 01:56:29.351988 1 trace.go:236] Trace[365431964]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f6ffb300-41cb-4859-8df6-f5bfd8925ffb,client:::1,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/envoyproxies.gateway.envoyproxy.io/status,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 01:56:27.911) (total time: 1440ms): Trace[365431964]: ["GuaranteedUpdate etcd3" audit-id:f6ffb300-41cb-4859-8df6-f5bfd8925ffb,key:/apiextensions.k8s.io/customresourcedefinitions/envoyproxies.gateway.envoyproxy.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 1431ms (01:56:27.920) Trace[365431964]: ---"About to Encode" 93ms (01:56:28.025) Trace[365431964]: ---"Txn call completed" 1286ms (01:56:29.322)] Trace[365431964]: [1.440811742s] [1.440811742s] END I0622 01:56:29.369068 1 trace.go:236] Trace[1157034569]: "Get" accept:application/json,audit-id:b50f4bfc-ee50-417a-8f6a-e8f1d590b8da,client:199.204.45.138,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/envoyproxies.gateway.envoyproxy.io,user-agent:Helm/3.11.2,verb:GET (22-Jun-2026 01:56:28.069) (total time: 1299ms): Trace[1157034569]: ---"About to write a response" 1281ms (01:56:29.350) Trace[1157034569]: [1.299751705s] [1.299751705s] END I0622 01:56:29.375142 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0622 01:56:29.377707 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0622 01:56:29.462647 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0622 01:56:38.645559 1 trace.go:236] Trace[190951908]: "Delete" accept:application/json,audit-id:f3d86c70-7cb4-43d1-ac74-5a34fdcd7be2,client:199.204.45.138,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/envoy-gateway-system/jobs/envoy-gateway-gateway-helm-certgen,user-agent:Helm/3.11.2,verb:DELETE (22-Jun-2026 01:56:38.134) (total time: 510ms): Trace[190951908]: [510.766468ms] [510.766468ms] END I0622 01:56:39.862431 1 trace.go:236] Trace[1011748214]: "Update" accept:application/json, */*,audit-id:51042232-f8f6-4199-abeb-d8fe01b212ed,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (22-Jun-2026 01:56:38.647) (total time: 1215ms): Trace[1011748214]: ["GuaranteedUpdate etcd3" audit-id:51042232-f8f6-4199-abeb-d8fe01b212ed,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1215ms (01:56:38.647) Trace[1011748214]: ---"Txn call completed" 1214ms (01:56:39.862)] Trace[1011748214]: [1.215305611s] [1.215305611s] END I0622 01:56:40.329264 1 trace.go:236] Trace[495842055]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5aec6f42-418c-42ea-ba3e-79c934d70347,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Jun-2026 01:56:39.680) (total time: 649ms): Trace[495842055]: ---"About to write a response" 649ms (01:56:40.329) Trace[495842055]: [649.18006ms] [649.18006ms] END I0622 01:56:40.329504 1 trace.go:236] Trace[997801826]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2f89032f-4725-47c0-859f-de5cec99f1ab,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Jun-2026 01:56:39.604) (total time: 725ms): Trace[997801826]: ---"About to write a response" 724ms (01:56:40.329) Trace[997801826]: [725.14401ms] [725.14401ms] END I0622 01:56:40.359984 1 trace.go:236] Trace[1111016976]: "Update" accept:application/json, */*,audit-id:d0ba8abe-62b5-4f64-9e7e-1b49713d84c8,client:199.204.45.138,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/secrets/sh.helm.release.v1.envoy-gateway.v1,user-agent:Helm/3.11.2,verb:PUT (22-Jun-2026 01:56:39.030) (total time: 1329ms): Trace[1111016976]: ---"Conversion done" 22ms (01:56:39.057) Trace[1111016976]: ["GuaranteedUpdate etcd3" audit-id:d0ba8abe-62b5-4f64-9e7e-1b49713d84c8,key:/secrets/envoy-gateway-system/sh.helm.release.v1.envoy-gateway.v1,type:*core.Secret,resource:secrets 1302ms (01:56:39.057) Trace[1111016976]: ---"Txn call completed" 1266ms (01:56:40.329)] Trace[1111016976]: ---"Writing http response done" 30ms (01:56:40.359) Trace[1111016976]: [1.329739227s] [1.329739227s] END I0622 01:56:40.393251 1 controller.go:624] quota admission added evaluator for: jobs.batch I0622 01:56:42.188770 1 trace.go:236] Trace[1474346436]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:92f0c35f-e0f2-450f-965a-e95843892e3e,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (22-Jun-2026 01:56:40.331) (total time: 1856ms): Trace[1474346436]: ["GuaranteedUpdate etcd3" audit-id:92f0c35f-e0f2-450f-965a-e95843892e3e,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 1856ms (01:56:40.331) Trace[1474346436]: ---"Txn call completed" 1856ms (01:56:42.188)] Trace[1474346436]: [1.856949977s] [1.856949977s] END I0622 01:56:42.195819 1 trace.go:236] Trace[650817211]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f807d12b-5f9c-406f-8e50-028efb8aff98,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (22-Jun-2026 01:56:40.331) (total time: 1864ms): Trace[650817211]: ["GuaranteedUpdate etcd3" audit-id:f807d12b-5f9c-406f-8e50-028efb8aff98,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1863ms (01:56:40.332) Trace[650817211]: ---"Txn call completed" 1862ms (01:56:42.195)] Trace[650817211]: [1.864095698s] [1.864095698s] END I0622 01:56:42.196146 1 trace.go:236] Trace[638174743]: "Get" accept:application/json, */*,audit-id:961f008b-ec7b-4607-91d7-4534c3289fb8,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Jun-2026 01:56:40.799) (total time: 1396ms): Trace[638174743]: ---"About to write a response" 1396ms (01:56:42.196) Trace[638174743]: [1.396967862s] [1.396967862s] END I0622 01:56:42.196254 1 trace.go:236] Trace[794504957]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8efd23a4-3a48-4762-b84d-188ef21c156f,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 01:56:41.436) (total time: 759ms): Trace[794504957]: ["GuaranteedUpdate etcd3" audit-id:8efd23a4-3a48-4762-b84d-188ef21c156f,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 759ms (01:56:41.436) Trace[794504957]: ---"Txn call completed" 758ms (01:56:42.196)] Trace[794504957]: [759.860683ms] [759.860683ms] END I0622 01:56:42.196828 1 trace.go:236] Trace[1074488188]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:579ed07d-207a-4548-990b-60cdd501686d,client:199.204.45.138,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Jun-2026 01:56:41.554) (total time: 642ms): Trace[1074488188]: ["GuaranteedUpdate etcd3" audit-id:579ed07d-207a-4548-990b-60cdd501686d,key:/minions/instance,type:*core.Node,resource:nodes 642ms (01:56:41.554) Trace[1074488188]: ---"Txn call completed" 638ms (01:56:42.195)] Trace[1074488188]: ---"Object stored in database" 638ms (01:56:42.196) Trace[1074488188]: [642.632898ms] [642.632898ms] END I0622 01:56:42.197103 1 trace.go:236] Trace[22539089]: "Create" accept:application/json,audit-id:74413c01-3693-4120-82d7-d5f4a277af1c,client:199.204.45.138,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/envoy-gateway-system/jobs,user-agent:Helm/3.11.2,verb:POST (22-Jun-2026 01:56:40.391) (total time: 1805ms): Trace[22539089]: ["Create etcd3" audit-id:74413c01-3693-4120-82d7-d5f4a277af1c,key:/jobs/envoy-gateway-system/envoy-gateway-gateway-helm-certgen,type:*batch.Job,resource:jobs.batch 1803ms (01:56:40.393) Trace[22539089]: ---"Txn call succeeded" 1802ms (01:56:42.196)] Trace[22539089]: [1.805434888s] [1.805434888s] END I0622 01:56:43.719346 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0622 01:56:43.750266 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0622 01:56:43.932969 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0622 01:56:44.084105 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0622 01:56:44.426447 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0622 01:56:44.488825 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0622 01:56:44.696748 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0622 01:56:44.887186 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0622 01:56:47.147632 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0622 01:56:47.752250 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0622 01:56:47.904110 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0622 01:56:48.849703 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0622 01:56:48.849743 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0622 01:56:52.169204 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0622 01:57:06.087227 1 trace.go:236] Trace[1891197477]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8637c872-a828-478a-9f52-733b9de58689,client:199.204.45.138,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/envoy-gateway-system/jobs/envoy-gateway-gateway-helm-certgen/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:PUT (22-Jun-2026 01:57:04.840) (total time: 1246ms): Trace[1891197477]: ["GuaranteedUpdate etcd3" audit-id:8637c872-a828-478a-9f52-733b9de58689,key:/jobs/envoy-gateway-system/envoy-gateway-gateway-helm-certgen,type:*batch.Job,resource:jobs.batch 1246ms (01:57:04.840) Trace[1891197477]: ---"Txn call completed" 1243ms (01:57:06.086)] Trace[1891197477]: [1.246924964s] [1.246924964s] END I0622 01:57:06.368828 1 trace.go:236] Trace[1174345946]: "Get" accept:application/json, */*,audit-id:a0dd5025-577d-4b2f-9570-9b62c4bc03a0,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Jun-2026 01:57:04.881) (total time: 1487ms): Trace[1174345946]: ---"About to write a response" 1487ms (01:57:06.368) Trace[1174345946]: [1.487463183s] [1.487463183s] END I0622 01:57:06.368862 1 trace.go:236] Trace[1863125666]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:71cae6df-1169-4f16-84bb-309d5863d9fe,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (22-Jun-2026 01:57:04.873) (total time: 1495ms): Trace[1863125666]: ["GuaranteedUpdate etcd3" audit-id:71cae6df-1169-4f16-84bb-309d5863d9fe,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 1494ms (01:57:04.873) Trace[1863125666]: ---"Txn call completed" 1493ms (01:57:06.368)] Trace[1863125666]: [1.495031738s] [1.495031738s] END I0622 01:57:06.369009 1 trace.go:236] Trace[1867341207]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4fc85f81-4a36-4a95-92ac-12019b8c52a0,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Jun-2026 01:57:05.061) (total time: 1307ms): Trace[1867341207]: ---"About to write a response" 1307ms (01:57:06.368) Trace[1867341207]: [1.307905889s] [1.307905889s] END I0622 01:57:06.369237 1 trace.go:236] Trace[1277163298]: "Get" accept:application/json, */*,audit-id:8b7e7f44-d325-4ed4-88d0-c15e0bb80bf9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Jun-2026 01:57:04.923) (total time: 1445ms): Trace[1277163298]: ---"About to write a response" 1445ms (01:57:06.369) Trace[1277163298]: [1.445302918s] [1.445302918s] END I0622 01:57:10.053190 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.106.43.140"} W0622 01:57:10.086555 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.106.43.140:9443: connect: connection refused E0622 01:57:10.086592 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.106.43.140:9443: connect: connection refused I0622 01:57:23.700984 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0622 01:57:23.773314 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0622 01:57:23.791753 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0622 01:57:23.809703 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.96.145.85"} I0622 01:57:23.818914 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.105.111.215"} I0622 01:57:23.829463 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0622 01:57:23.896800 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0622 01:57:23.931619 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0622 01:57:34.457056 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0622 01:57:36.626885 1 trace.go:236] Trace[2036753352]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cb992ee4-aa1d-4cee-bfd3-990dd7514436,client:10.0.0.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 01:57:35.369) (total time: 1257ms): Trace[2036753352]: ["GuaranteedUpdate etcd3" audit-id:cb992ee4-aa1d-4cee-bfd3-990dd7514436,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1257ms (01:57:35.369) Trace[2036753352]: ---"Txn call completed" 1256ms (01:57:36.626)] Trace[2036753352]: [1.257537563s] [1.257537563s] END I0622 01:57:41.617047 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0622 01:57:59.235469 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.101.194.66"} I0622 01:57:59.247313 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.107.92.131"} I0622 01:57:59.254217 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.108.54.35"} I0622 01:57:59.264852 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.108.185.131"} I0622 01:58:06.129378 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0622 01:58:06.147590 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0622 01:58:06.162183 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0622 01:58:06.186612 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0622 01:58:06.204112 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0622 01:58:06.224639 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0622 01:58:06.244444 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0622 01:58:06.264475 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0622 01:58:06.286909 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0622 01:58:06.301577 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0622 01:58:06.324665 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0622 01:58:06.342196 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0622 01:58:06.384550 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0622 01:58:07.686584 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0622 01:58:10.977215 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0622 01:58:11.372747 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.105.185.213"} I0622 01:58:11.400049 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0622 01:58:13.688610 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0622 01:58:13.728177 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0622 01:58:14.294829 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0622 01:58:14.294885 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0622 01:58:14.294931 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0622 01:58:21.126444 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0622 01:58:26.541341 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.103.74.163"} I0622 01:58:26.817699 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0622 01:58:26.937523 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0622 01:58:27.072955 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.101.34.137"} I0622 01:58:27.089520 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.102.157.129"} I0622 01:58:32.611729 1 trace.go:236] Trace[640726279]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:97974ffb-5bce-427d-b12b-8cfe43a1be49,client:10.0.0.250,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 01:58:30.337) (total time: 2273ms): Trace[640726279]: ["GuaranteedUpdate etcd3" audit-id:97974ffb-5bce-427d-b12b-8cfe43a1be49,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 2273ms (01:58:30.338) Trace[640726279]: ---"Txn call completed" 2272ms (01:58:32.611)] Trace[640726279]: [2.273719643s] [2.273719643s] END I0622 01:58:32.611766 1 trace.go:236] Trace[1311566080]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:22780d5a-2b4e-4235-8951-c57b5faa34ee,client:10.0.0.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 01:58:29.563) (total time: 3048ms): Trace[1311566080]: ["GuaranteedUpdate etcd3" audit-id:22780d5a-2b4e-4235-8951-c57b5faa34ee,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 3048ms (01:58:29.563) Trace[1311566080]: ---"Txn call completed" 3046ms (01:58:32.611)] Trace[1311566080]: [3.048572721s] [3.048572721s] END I0622 01:58:32.611825 1 trace.go:236] Trace[1592734801]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5313b7b5-591e-4a9a-9e77-c8a1fb4abf48,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 01:58:29.890) (total time: 2720ms): Trace[1592734801]: ["GuaranteedUpdate etcd3" audit-id:5313b7b5-591e-4a9a-9e77-c8a1fb4abf48,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 2720ms (01:58:29.890) Trace[1592734801]: ---"Txn call completed" 2720ms (01:58:32.611)] Trace[1592734801]: [2.720997618s] [2.720997618s] END I0622 01:58:32.613057 1 trace.go:236] Trace[1309258159]: "Get" accept:application/json,audit-id:76af000b-2880-4cf2-84ef-89c80eb5c138,client:199.204.45.138,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (22-Jun-2026 01:58:29.583) (total time: 3029ms): Trace[1309258159]: ---"About to write a response" 3028ms (01:58:32.612) Trace[1309258159]: [3.029385738s] [3.029385738s] END I0622 01:58:32.653904 1 trace.go:236] Trace[1639255068]: "Get" accept:application/json, */*,audit-id:e1d44ab4-b354-40ba-ac8a-48f841690d0d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Jun-2026 01:58:30.328) (total time: 2324ms): Trace[1639255068]: ---"About to write a response" 2324ms (01:58:32.653) Trace[1639255068]: [2.324863013s] [2.324863013s] END I0622 01:58:32.653918 1 trace.go:236] Trace[2001675196]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c93d4dbc-8ab2-41b9-aa3a-ca9342686451,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Jun-2026 01:58:30.048) (total time: 2605ms): Trace[2001675196]: ---"About to write a response" 2605ms (01:58:32.653) Trace[2001675196]: [2.6058065s] [2.6058065s] END I0622 01:58:32.654030 1 trace.go:236] Trace[1942607371]: "Update" accept:application/json, */*,audit-id:75b23555-c97e-445a-a7a4-1fa918a33dfa,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 01:58:32.004) (total time: 649ms): Trace[1942607371]: ["GuaranteedUpdate etcd3" audit-id:75b23555-c97e-445a-a7a4-1fa918a33dfa,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 648ms (01:58:32.005) Trace[1942607371]: ---"Txn call completed" 648ms (01:58:32.653)] Trace[1942607371]: [649.044629ms] [649.044629ms] END I0622 01:58:32.654241 1 trace.go:236] Trace[985348233]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:011dfb1e-000b-406d-b562-adf47878948b,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Jun-2026 01:58:30.327) (total time: 2326ms): Trace[985348233]: ---"About to write a response" 2326ms (01:58:32.654) Trace[985348233]: [2.326397305s] [2.326397305s] END I0622 01:58:32.654352 1 trace.go:236] Trace[1726669868]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:966efa92-220a-4e90-a041-4d1d4aae73b9,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (22-Jun-2026 01:58:31.319) (total time: 1335ms): Trace[1726669868]: ["GuaranteedUpdate etcd3" audit-id:966efa92-220a-4e90-a041-4d1d4aae73b9,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 1335ms (01:58:31.319) Trace[1726669868]: ---"Txn call completed" 1334ms (01:58:32.654)] Trace[1726669868]: [1.335109335s] [1.335109335s] END I0622 01:58:32.654463 1 trace.go:236] Trace[298564001]: "Get" accept:application/json, */*,audit-id:17e62b56-5dd1-4052-bff2-bcf5f8331951,client:10.0.0.122,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-d9293b6f-c236-4753-b4d8-1574e33a1e9f,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Jun-2026 01:58:29.917) (total time: 2737ms): Trace[298564001]: ---"About to write a response" 2736ms (01:58:32.653) Trace[298564001]: [2.737133947s] [2.737133947s] END I0622 01:58:32.654637 1 trace.go:236] Trace[801061252]: "Get" accept:application/json, */*,audit-id:bcae464f-ca8f-490b-98f8-977d9cf4ef3a,client:10.0.0.220,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Jun-2026 01:58:29.627) (total time: 3027ms): Trace[801061252]: ---"About to write a response" 3027ms (01:58:32.654) Trace[801061252]: [3.027213435s] [3.027213435s] END I0622 01:58:32.654679 1 trace.go:236] Trace[28342545]: "Get" accept:application/json, */*,audit-id:cf9a6a3a-0f94-4c0e-9db4-265b265c89e8,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Jun-2026 01:58:30.329) (total time: 2324ms): Trace[28342545]: ---"About to write a response" 2324ms (01:58:32.654) Trace[28342545]: [2.324888674s] [2.324888674s] END I0622 01:58:32.654939 1 trace.go:236] Trace[1764654837]: "Get" accept:application/json, */*,audit-id:d8cefbda-2847-4ba9-bdac-5902501ff9fb,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Jun-2026 01:58:30.328) (total time: 2326ms): Trace[1764654837]: ---"About to write a response" 2326ms (01:58:32.654) Trace[1764654837]: [2.32654912s] [2.32654912s] END I0622 01:59:25.966587 1 trace.go:236] Trace[2023981613]: "Update" accept:application/json, */*,audit-id:1a6d930a-a665-4de2-bf14-f0dee756c8d6,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 01:59:25.449) (total time: 516ms): Trace[2023981613]: ["GuaranteedUpdate etcd3" audit-id:1a6d930a-a665-4de2-bf14-f0dee756c8d6,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 516ms (01:59:25.450) Trace[2023981613]: ---"Txn call completed" 515ms (01:59:25.966)] Trace[2023981613]: [516.579012ms] [516.579012ms] END I0622 01:59:25.966883 1 trace.go:236] Trace[152842366]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e9e2ec2e-55a8-4b09-b4f2-eccb3cf29c72,client:10.0.0.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 01:59:25.450) (total time: 516ms): Trace[152842366]: ["GuaranteedUpdate etcd3" audit-id:e9e2ec2e-55a8-4b09-b4f2-eccb3cf29c72,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 515ms (01:59:25.450) Trace[152842366]: ---"Txn call completed" 514ms (01:59:25.966)] Trace[152842366]: [516.026933ms] [516.026933ms] END I0622 01:59:51.874269 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.99.163.157"} I0622 01:59:54.304019 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.110.136.29"} I0622 01:59:54.311852 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.97.10.31"} I0622 02:00:00.704693 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.111.67.207"} I0622 02:00:00.714080 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.106.16.24"} I0622 02:00:06.950584 1 trace.go:236] Trace[2069359437]: "Update" accept:application/json, */*,audit-id:970b08d5-8485-48c6-a0cd-0f0f595fed04,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 02:00:06.104) (total time: 846ms): Trace[2069359437]: ["GuaranteedUpdate etcd3" audit-id:970b08d5-8485-48c6-a0cd-0f0f595fed04,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 845ms (02:00:06.104) Trace[2069359437]: ---"Txn call completed" 845ms (02:00:06.950)] Trace[2069359437]: [846.108103ms] [846.108103ms] END I0622 02:00:06.950634 1 trace.go:236] Trace[1969125203]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:845a23b8-22f7-439b-92f1-d08fe6546f50,client:10.0.0.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 02:00:06.094) (total time: 855ms): Trace[1969125203]: ["GuaranteedUpdate etcd3" audit-id:845a23b8-22f7-439b-92f1-d08fe6546f50,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 855ms (02:00:06.094) Trace[1969125203]: ---"Txn call completed" 854ms (02:00:06.950)] Trace[1969125203]: [855.798616ms] [855.798616ms] END I0622 02:00:22.137154 1 trace.go:236] Trace[988351250]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:eaff9e60-1537-4d69-adf2-ec1d97b0103d,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (22-Jun-2026 02:00:19.298) (total time: 2838ms): Trace[988351250]: ["GuaranteedUpdate etcd3" audit-id:eaff9e60-1537-4d69-adf2-ec1d97b0103d,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 2838ms (02:00:19.298) Trace[988351250]: ---"Txn call completed" 2837ms (02:00:22.136)] Trace[988351250]: [2.838797812s] [2.838797812s] END I0622 02:00:22.493132 1 trace.go:236] Trace[1624508763]: "Update" accept:application/json, */*,audit-id:f239b54a-effa-4743-97ef-26766cf6ef12,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (22-Jun-2026 02:00:19.299) (total time: 3194ms): Trace[1624508763]: ["GuaranteedUpdate etcd3" audit-id:f239b54a-effa-4743-97ef-26766cf6ef12,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3193ms (02:00:19.299) Trace[1624508763]: ---"Txn call completed" 3192ms (02:00:22.492)] Trace[1624508763]: [3.194059293s] [3.194059293s] END I0622 02:00:22.493201 1 trace.go:236] Trace[1192292630]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:99e362f3-054c-48a0-9352-e267a0b7099a,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (22-Jun-2026 02:00:19.300) (total time: 3192ms): Trace[1192292630]: ["GuaranteedUpdate etcd3" audit-id:99e362f3-054c-48a0-9352-e267a0b7099a,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 3192ms (02:00:19.300) Trace[1192292630]: ---"Txn call completed" 3192ms (02:00:22.493)] Trace[1192292630]: [3.192608906s] [3.192608906s] END I0622 02:00:22.493454 1 trace.go:236] Trace[2099250080]: "Update" accept:application/json, */*,audit-id:0ff74fcc-9409-40fb-8b6a-a1cc23be6654,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 02:00:19.300) (total time: 3192ms): Trace[2099250080]: ["GuaranteedUpdate etcd3" audit-id:0ff74fcc-9409-40fb-8b6a-a1cc23be6654,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3192ms (02:00:19.300) Trace[2099250080]: ---"Txn call completed" 3191ms (02:00:22.493)] Trace[2099250080]: [3.192698079s] [3.192698079s] END I0622 02:00:22.493812 1 trace.go:236] Trace[428728243]: "Update" accept:application/json, */*,audit-id:045d5471-ab8d-4c2e-8088-811baeef7049,client:10.0.0.220,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 02:00:19.302) (total time: 3191ms): Trace[428728243]: ["GuaranteedUpdate etcd3" audit-id:045d5471-ab8d-4c2e-8088-811baeef7049,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 3191ms (02:00:19.302) Trace[428728243]: ---"Txn call completed" 3190ms (02:00:22.493)] Trace[428728243]: [3.191334725s] [3.191334725s] END I0622 02:00:22.494373 1 trace.go:236] Trace[1028008444]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7e163986-96ca-4aca-a7fb-ad28baffbd46,client:10.0.0.250,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 02:00:19.885) (total time: 2608ms): Trace[1028008444]: ["GuaranteedUpdate etcd3" audit-id:7e163986-96ca-4aca-a7fb-ad28baffbd46,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 2608ms (02:00:19.885) Trace[1028008444]: ---"Txn call completed" 2607ms (02:00:22.494)] Trace[1028008444]: [2.608664499s] [2.608664499s] END I0622 02:00:22.494742 1 trace.go:236] Trace[1709020107]: "Get" accept:application/json, */*,audit-id:b2b6838d-450f-4b5d-96cb-e5743cdf0b8b,client:199.204.45.138,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak-headless,user-agent:Helm/3.11.2,verb:GET (22-Jun-2026 02:00:20.764) (total time: 1729ms): Trace[1709020107]: ---"About to write a response" 1729ms (02:00:22.494) Trace[1709020107]: [1.729936853s] [1.729936853s] END I0622 02:00:22.495747 1 trace.go:236] Trace[303733674]: "Update" accept:application/json, */*,audit-id:0a1cd555-dce6-4b5a-9a14-68bdc954bec7,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (22-Jun-2026 02:00:19.300) (total time: 3194ms): Trace[303733674]: ["GuaranteedUpdate etcd3" audit-id:0a1cd555-dce6-4b5a-9a14-68bdc954bec7,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3194ms (02:00:19.300) Trace[303733674]: ---"Txn call completed" 3191ms (02:00:22.492)] Trace[303733674]: [3.194937372s] [3.194937372s] END I0622 02:00:22.495187 1 trace.go:236] Trace[1691023044]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:68f6142b-72cb-49b0-aaa5-0a3065ca9c26,client:10.0.0.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 02:00:21.025) (total time: 1469ms): Trace[1691023044]: ["GuaranteedUpdate etcd3" audit-id:68f6142b-72cb-49b0-aaa5-0a3065ca9c26,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1469ms (02:00:21.025) Trace[1691023044]: ---"Txn call completed" 1467ms (02:00:22.494)] Trace[1691023044]: [1.469370568s] [1.469370568s] END I0622 02:00:22.495441 1 trace.go:236] Trace[238871632]: "Update" accept:application/json, */*,audit-id:df603853-77ca-431e-a6b9-fdf3f01a2520,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 02:00:21.089) (total time: 1406ms): Trace[238871632]: ["GuaranteedUpdate etcd3" audit-id:df603853-77ca-431e-a6b9-fdf3f01a2520,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1405ms (02:00:21.089) Trace[238871632]: ---"Txn call completed" 1404ms (02:00:22.495)] Trace[238871632]: [1.406083715s] [1.406083715s] END I0622 02:00:22.498154 1 trace.go:236] Trace[1691846119]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:da52724e-47c7-433c-bd6d-aa4201f36265,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/auth-system/events/keycloak-0.18bb44b3ad78a1a2,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Jun-2026 02:00:21.056) (total time: 1441ms): Trace[1691846119]: ["GuaranteedUpdate etcd3" audit-id:da52724e-47c7-433c-bd6d-aa4201f36265,key:/events/auth-system/keycloak-0.18bb44b3ad78a1a2,type:*core.Event,resource:events 1441ms (02:00:21.056) Trace[1691846119]: ---"initial value restored" 1437ms (02:00:22.494)] Trace[1691846119]: [1.441292012s] [1.441292012s] END E0622 02:00:33.156710 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0622 02:00:33.156811 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:33.158842 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:00:33.158903 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0622 02:00:33.159996 1 trace.go:236] Trace[1744404307]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c000c447-2b2a-4b14-9604-82afa64a57b8,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Jun-2026 02:00:28.156) (total time: 5003ms): Trace[1744404307]: [5.003230435s] [5.003230435s] END E0622 02:00:33.160232 1 timeout.go:142] post-timeout activity - time-elapsed: 3.668888ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: I0622 02:00:33.512564 1 trace.go:236] Trace[513667786]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:76e418ae-8762-47d5-b271-28fc4432182e,client:10.0.0.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 02:00:28.513) (total time: 4999ms): Trace[513667786]: ---"Write to database call failed" len:462,err:Timeout: request did not complete within requested timeout - context canceled 4998ms (02:00:33.512) Trace[513667786]: [4.999120681s] [4.999120681s] END E0622 02:00:33.512730 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 11.81µs, panicked: false, err: context canceled, panic-reason: E0622 02:00:33.512883 1 wrap.go:54] timeout or abort while handling: method=PUT URI="/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io?timeout=5s" audit-ID="76e418ae-8762-47d5-b271-28fc4432182e" E0622 02:00:33.512930 1 timeout.go:142] post-timeout activity - time-elapsed: 5.791µs, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0622 02:00:33.514416 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 10.67µs, panicked: false, err: context canceled, panic-reason: E0622 02:00:33.514469 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:33.515754 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:00:33.515810 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0622 02:00:33.517063 1 trace.go:236] Trace[1593255423]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bb94f1a6-5b82-49e2-aef1-eddcc871191f,client:10.0.0.250,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 02:00:28.515) (total time: 5001ms): Trace[1593255423]: ["GuaranteedUpdate etcd3" audit-id:bb94f1a6-5b82-49e2-aef1-eddcc871191f,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (02:00:28.515) Trace[1593255423]: ---"Txn call failed" err:context canceled 4997ms (02:00:33.514)] Trace[1593255423]: [5.001633352s] [5.001633352s] END E0622 02:00:33.517133 1 timeout.go:142] post-timeout activity - time-elapsed: 2.672036ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0622 02:00:33.518268 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0622 02:00:33.518378 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:33.519506 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:00:33.519567 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0622 02:00:33.519635 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0622 02:00:33.520950 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:33.520974 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0622 02:00:33.520955 1 trace.go:236] Trace[1612679373]: "Get" accept:application/json, */*,audit-id:69a7c6eb-b60b-4c19-a676-a93bb4f0ca5e,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Jun-2026 02:00:28.518) (total time: 5002ms): Trace[1612679373]: [5.002647985s] [5.002647985s] END E0622 02:00:33.521122 1 timeout.go:142] post-timeout activity - time-elapsed: 2.831471ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0622 02:00:33.522158 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0622 02:00:33.522268 1 trace.go:236] Trace[110548166]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:35c1ca25-66a4-48ef-bcd1-b2e274f7b711,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Jun-2026 02:00:28.519) (total time: 5002ms): Trace[110548166]: [5.002828161s] [5.002828161s] END E0622 02:00:33.522399 1 timeout.go:142] post-timeout activity - time-elapsed: 2.661896ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0622 02:00:34.732300 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:34.732613 1 trace.go:236] Trace[1312406719]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b38839f9-945b-49c8-beeb-5ceb83a10ee0,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 02:00:27.729) (total time: 7003ms): Trace[1312406719]: ["GuaranteedUpdate etcd3" audit-id:b38839f9-945b-49c8-beeb-5ceb83a10ee0,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:00:27.729) Trace[1312406719]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:00:34.732)] Trace[1312406719]: [7.00324619s] [7.00324619s] END E0622 02:00:35.518315 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:35.518442 1 trace.go:236] Trace[408155426]: "Update" accept:application/json, */*,audit-id:f8d2c3d5-031f-4131-9c1e-01604eab1a1b,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 02:00:28.515) (total time: 7003ms): Trace[408155426]: ["GuaranteedUpdate etcd3" audit-id:f8d2c3d5-031f-4131-9c1e-01604eab1a1b,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (02:00:28.515) Trace[408155426]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:00:35.518)] Trace[408155426]: [7.003350453s] [7.003350453s] END E0622 02:00:38.156218 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0622 02:00:38.156323 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:38.157467 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:00:38.157569 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0622 02:00:38.158712 1 trace.go:236] Trace[1120027083]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:92ba13a8-d79f-44aa-a904-316b81d895e1,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Jun-2026 02:00:35.157) (total time: 3001ms): Trace[1120027083]: [3.001098703s] [3.001098703s] END E0622 02:00:38.158839 1 timeout.go:142] post-timeout activity - time-elapsed: 2.573273ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0622 02:00:38.512307 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0622 02:00:38.512458 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:38.513763 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:00:38.513831 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0622 02:00:38.515093 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0622 02:00:38.515199 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:38.515325 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0622 02:00:38.515433 1 trace.go:236] Trace[1377851505]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1c71646b-26ce-4c65-a0a1-b1ec0dd292a3,client:10.0.0.242,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Jun-2026 02:00:33.513) (total time: 5001ms): Trace[1377851505]: [5.0019462s] [5.0019462s] END E0622 02:00:38.515537 1 timeout.go:142] post-timeout activity - time-elapsed: 3.373038ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0622 02:00:38.516189 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:00:38.518130 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0622 02:00:38.518189 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0622 02:00:38.518239 1 trace.go:236] Trace[659908027]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:361b3e5a-5aba-4eec-89fc-4dbd57dc4e86,client:10.0.0.250,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Jun-2026 02:00:33.515) (total time: 5002ms): Trace[659908027]: [5.002719765s] [5.002719765s] END E0622 02:00:38.518322 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:38.518485 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0622 02:00:38.518597 1 timeout.go:142] post-timeout activity - time-elapsed: 2.917224ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0622 02:00:38.519194 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0622 02:00:38.519280 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:00:38.519335 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:38.519378 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:38.519687 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:38.520393 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:00:38.520417 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:00:38.520895 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0622 02:00:38.520895 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0622 02:00:38.520924 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:00:38.522157 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0622 02:00:38.522201 1 trace.go:236] Trace[2041035337]: "Get" accept:application/json, */*,audit-id:894ae83a-6322-4d35-8307-eb57e1b50b55,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Jun-2026 02:00:28.517) (total time: 10005ms): Trace[2041035337]: [10.005065089s] [10.005065089s] END I0622 02:00:38.522291 1 trace.go:236] Trace[551337556]: "Get" accept:application/json, */*,audit-id:eed94f3c-19df-4f4e-8a83-75757b2c0205,client:10.0.0.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Jun-2026 02:00:35.519) (total time: 3002ms): Trace[551337556]: [3.002399378s] [3.002399378s] END E0622 02:00:38.522309 1 timeout.go:142] post-timeout activity - time-elapsed: 4.138772ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0622 02:00:38.522337 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0622 02:00:38.522371 1 trace.go:236] Trace[1971189439]: "Get" accept:application/json, */*,audit-id:ff70140e-17cc-4f19-9dd7-3d2d7b5d89c5,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Jun-2026 02:00:35.520) (total time: 3001ms): Trace[1971189439]: [3.001573072s] [3.001573072s] END E0622 02:00:38.522371 1 timeout.go:142] post-timeout activity - time-elapsed: 7.002274ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0622 02:00:38.522430 1 timeout.go:142] post-timeout activity - time-elapsed: 3.904775ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0622 02:00:38.522776 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0622 02:00:38.523880 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:38.523903 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0622 02:00:38.523927 1 trace.go:236] Trace[1868966049]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2074e299-6933-441d-844f-98619b149bf4,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Jun-2026 02:00:35.521) (total time: 3002ms): Trace[1868966049]: [3.002866103s] [3.002866103s] END E0622 02:00:38.523980 1 timeout.go:142] post-timeout activity - time-elapsed: 4.756842ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0622 02:00:38.525304 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0622 02:00:38.525652 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0622 02:00:38.526623 1 trace.go:236] Trace[167530202]: "Get" accept:application/json, */*,audit-id:0fc2107a-fc84-40da-ad4c-0daab4385174,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Jun-2026 02:00:28.518) (total time: 10006ms): Trace[167530202]: [10.006554616s] [10.006554616s] END E0622 02:00:38.526818 1 timeout.go:142] post-timeout activity - time-elapsed: 4.009889ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0622 02:00:38.526863 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:38.528001 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:00:38.528029 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0622 02:00:38.529175 1 trace.go:236] Trace[120396563]: "Get" accept:application/json, */*,audit-id:61bce93e-f5d9-4e64-bbda-b7f9893d979e,client:10.0.0.220,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Jun-2026 02:00:28.519) (total time: 10009ms): Trace[120396563]: [10.009209251s] [10.009209251s] END E0622 02:00:38.529295 1 timeout.go:142] post-timeout activity - time-elapsed: 3.662177ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0622 02:00:38.539813 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0622 02:00:38.539887 1 trace.go:236] Trace[1231942452]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8d8f2e45-86cb-4236-95a0-0892dc23c023,client:10.0.0.250,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Jun-2026 02:00:27.575) (total time: 10964ms): Trace[1231942452]: [10.964080184s] [10.964080184s] END E0622 02:00:38.540006 1 wrap.go:54] timeout or abort while handling: method=GET URI="/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" audit-ID="8d8f2e45-86cb-4236-95a0-0892dc23c023" E0622 02:00:38.540177 1 timeout.go:142] post-timeout activity - time-elapsed: 145.794µs, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: E0622 02:00:40.526791 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:40.527049 1 trace.go:236] Trace[1064205926]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a9a462ef-ee61-4008-97d8-3721fabf5bab,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (22-Jun-2026 02:00:33.523) (total time: 7003ms): Trace[1064205926]: ["GuaranteedUpdate etcd3" audit-id:a9a462ef-ee61-4008-97d8-3721fabf5bab,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:00:33.523) Trace[1064205926]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:00:40.526)] Trace[1064205926]: [7.003131954s] [7.003131954s] END E0622 02:00:41.737430 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:41.737672 1 trace.go:236] Trace[339848314]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:739a17aa-9b03-4336-aac7-2075790e540f,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 02:00:34.734) (total time: 7002ms): Trace[339848314]: ["GuaranteedUpdate etcd3" audit-id:739a17aa-9b03-4336-aac7-2075790e540f,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (02:00:34.734) Trace[339848314]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:00:41.737)] Trace[339848314]: [7.002842498s] [7.002842498s] END E0622 02:00:41.758222 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0622 02:00:41.758239 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0622 02:00:41.758283 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0622 02:00:41.758340 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:41.758408 1 trace.go:236] Trace[1423004744]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8df4ca16-c7b1-40e4-923d-bcf5d3376f6c,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/valkey-node-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Jun-2026 02:00:29.676) (total time: 12081ms): Trace[1423004744]: [12.08167723s] [12.08167723s] END E0622 02:00:41.758626 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:41.759893 1 trace.go:236] Trace[1005782636]: "Get" accept:application/json, */*,audit-id:a602bb12-d10c-4753-b2c7-e6a02f594aea,client:199.204.45.138,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak-headless,user-agent:Helm/3.11.2,verb:GET (22-Jun-2026 02:00:28.763) (total time: 12996ms): Trace[1005782636]: [12.996541512s] [12.996541512s] END I0622 02:00:41.759896 1 trace.go:236] Trace[971830654]: "Get" accept:application/json, */*,audit-id:90eb398c-f838-4938-b0a8-7adec706f88c,client:10.0.0.184,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (22-Jun-2026 02:00:28.758) (total time: 13001ms): Trace[971830654]: [13.001796981s] [13.001796981s] END I0622 02:00:41.759941 1 trace.go:236] Trace[1908940409]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5f9a31f9-c010-4dfa-b48d-69793a7d7966,client:199.204.45.138,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/valkey-data-valkey-node-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Jun-2026 02:00:29.688) (total time: 12071ms): Trace[1908940409]: [12.071490971s] [12.071490971s] END I0622 02:00:41.759989 1 trace.go:236] Trace[1663595818]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:400d70a5-6bd5-4779-a894-964e43c0cbc4,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/auth-system/events/keycloak-0.18bb44b3ad78a1a2,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Jun-2026 02:00:31.056) (total time: 10703ms): Trace[1663595818]: ["GuaranteedUpdate etcd3" audit-id:400d70a5-6bd5-4779-a894-964e43c0cbc4,key:/events/auth-system/keycloak-0.18bb44b3ad78a1a2,type:*core.Event,resource:events 10703ms (02:00:31.056)] Trace[1663595818]: [10.703708972s] [10.703708972s] END E0622 02:00:42.039220 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:42.039457 1 trace.go:236] Trace[411172573]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c95b3469-e793-46af-8770-932b3cbb93bc,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 02:00:35.035) (total time: 7003ms): Trace[411172573]: ["GuaranteedUpdate etcd3" audit-id:c95b3469-e793-46af-8770-932b3cbb93bc,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:00:35.035) Trace[411172573]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:00:42.039)] Trace[411172573]: [7.003826756s] [7.003826756s] END E0622 02:00:42.040201 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0622 02:00:43.520489 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:43.520529 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:00:43.520557 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 6.83µs, panicked: false, err: context deadline exceeded, panic-reason: E0622 02:00:43.520812 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:43.520862 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 20.44µs, panicked: false, err: context deadline exceeded, panic-reason: E0622 02:00:43.522035 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:00:43.522097 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0622 02:00:43.522266 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0622 02:00:43.523246 1 trace.go:236] Trace[1195445681]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:84e31307-1670-487f-837f-8472682a2169,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (22-Jun-2026 02:00:38.520) (total time: 5002ms): Trace[1195445681]: ["GuaranteedUpdate etcd3" audit-id:84e31307-1670-487f-837f-8472682a2169,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (02:00:38.520) Trace[1195445681]: ---"Txn call failed" err:context deadline exceeded 4999ms (02:00:43.520)] Trace[1195445681]: [5.002780558s] [5.002780558s] END E0622 02:00:43.523415 1 timeout.go:142] post-timeout activity - time-elapsed: 2.529381ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: I0622 02:00:43.523420 1 trace.go:236] Trace[1458243472]: "Update" accept:application/json, */*,audit-id:bd29eea3-7aa7-409d-8185-3df0c88a86d4,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 02:00:38.520) (total time: 5002ms): Trace[1458243472]: ["GuaranteedUpdate etcd3" audit-id:bd29eea3-7aa7-409d-8185-3df0c88a86d4,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (02:00:38.520) Trace[1458243472]: ---"Txn call failed" err:context deadline exceeded 4997ms (02:00:43.520)] Trace[1458243472]: [5.002925742s] [5.002925742s] END E0622 02:00:43.523857 1 timeout.go:142] post-timeout activity - time-elapsed: 3.264274ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0622 02:00:45.517615 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:45.518048 1 trace.go:236] Trace[1765380274]: "Create" accept:application/json, */*,audit-id:6321cf02-aaf8-4872-8847-42f1312fcbf9,client:10.0.0.242,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (22-Jun-2026 02:00:38.514) (total time: 7003ms): Trace[1765380274]: ["Create etcd3" audit-id:6321cf02-aaf8-4872-8847-42f1312fcbf9,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18bb44b8e7fe69f7,type:*core.Event,resource:events 7002ms (02:00:38.515) Trace[1765380274]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:00:45.517)] Trace[1765380274]: [7.003444609s] [7.003444609s] END E0622 02:00:45.522944 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:45.523174 1 trace.go:236] Trace[444390416]: "Update" accept:application/json, */*,audit-id:ff5a8755-0712-4842-9e21-62c1f2658f6a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (22-Jun-2026 02:00:38.519) (total time: 7004ms): Trace[444390416]: ["GuaranteedUpdate etcd3" audit-id:ff5a8755-0712-4842-9e21-62c1f2658f6a,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:00:38.519) Trace[444390416]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:00:45.522)] Trace[444390416]: [7.004007107s] [7.004007107s] END E0622 02:00:45.525859 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:45.526026 1 trace.go:236] Trace[1621544339]: "Update" accept:application/json, */*,audit-id:ff751edd-83cb-431b-96f0-de946e96c775,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (22-Jun-2026 02:00:38.523) (total time: 7002ms): Trace[1621544339]: ["GuaranteedUpdate etcd3" audit-id:ff751edd-83cb-431b-96f0-de946e96c775,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (02:00:38.523) Trace[1621544339]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:00:45.525)] Trace[1621544339]: [7.002687525s] [7.002687525s] END E0622 02:00:48.524282 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0622 02:00:48.524441 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:00:48.525853 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:00:48.525920 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0622 02:00:48.527873 1 trace.go:236] Trace[1164205849]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1822d6bf-cd78-43ab-af90-60510c4fd229,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (22-Jun-2026 02:00:40.529) (total time: 7998ms): Trace[1164205849]: [7.998242323s] [7.998242323s] END E0622 02:00:48.528071 1 timeout.go:142] post-timeout activity - time-elapsed: 3.777361ms, GET "/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader" result: E0622 02:00:48.743078 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:48.743226 1 trace.go:236] Trace[438581087]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:caf29f82-1da0-47e2-9708-8704ea982668,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 02:00:41.740) (total time: 7003ms): Trace[438581087]: ["GuaranteedUpdate etcd3" audit-id:caf29f82-1da0-47e2-9708-8704ea982668,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (02:00:41.740) Trace[438581087]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:00:48.743)] Trace[438581087]: [7.003008136s] [7.003008136s] END E0622 02:00:48.758955 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:48.758990 1 trace.go:236] Trace[2132538047]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.138,type:*v1.Endpoints,resource:apiServerIPInfo (22-Jun-2026 02:00:37.432) (total time: 11326ms): Trace[2132538047]: [11.326471908s] [11.326471908s] END E0622 02:00:48.759026 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out I0622 02:00:48.759123 1 trace.go:236] Trace[1783117744]: "Get" accept:application/json, */*,audit-id:3db51c75-a050-4f18-bd24-475799a2b93e,client:10.0.0.177,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Jun-2026 02:00:41.678) (total time: 7080ms): Trace[1783117744]: [7.080652747s] [7.080652747s] END E0622 02:00:48.765287 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:48.765478 1 trace.go:236] Trace[1621623788]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0509c179-43d7-4d88-9e2f-9f21c085697b,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (22-Jun-2026 02:00:41.762) (total time: 7002ms): Trace[1621623788]: ["Create etcd3" audit-id:0509c179-43d7-4d88-9e2f-9f21c085697b,key:/events/openstack/valkey-node-0.18bb44b731e8db18,type:*core.Event,resource:events 7001ms (02:00:41.763) Trace[1621623788]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:00:48.765)] Trace[1621623788]: [7.002717806s] [7.002717806s] END E0622 02:00:48.799551 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:48.799796 1 trace.go:236] Trace[1038186290]: "Update" accept:application/json, */*,audit-id:50cdb76b-3b73-4354-8693-cea5bcdd9bbb,client:199.204.45.138,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/auth-system/secrets/sh.helm.release.v1.keycloak.v1,user-agent:Helm/3.11.2,verb:PUT (22-Jun-2026 02:00:41.791) (total time: 7007ms): Trace[1038186290]: ["GuaranteedUpdate etcd3" audit-id:50cdb76b-3b73-4354-8693-cea5bcdd9bbb,key:/secrets/auth-system/sh.helm.release.v1.keycloak.v1,type:*core.Secret,resource:secrets 7004ms (02:00:41.795) Trace[1038186290]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:00:48.799)] Trace[1038186290]: [7.007898652s] [7.007898652s] END E0622 02:00:49.044178 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:49.044311 1 trace.go:236] Trace[1120394467]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a5355c22-9a73-4ddc-8040-e52ec43811f7,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 02:00:42.041) (total time: 7003ms): Trace[1120394467]: ["GuaranteedUpdate etcd3" audit-id:a5355c22-9a73-4ddc-8040-e52ec43811f7,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:00:42.041) Trace[1120394467]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:00:49.044)] Trace[1120394467]: [7.00314197s] [7.00314197s] END E0622 02:00:49.045010 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0622 02:00:54.131009 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:54.131256 1 trace.go:236] Trace[1735146834]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:30cdaeb6-787d-495f-9820-525f1ce8708f,client:199.204.45.138,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Jun-2026 02:00:47.125) (total time: 7005ms): Trace[1735146834]: ["GuaranteedUpdate etcd3" audit-id:30cdaeb6-787d-495f-9820-525f1ce8708f,key:/minions/instance,type:*core.Node,resource:nodes 7005ms (02:00:47.126) Trace[1735146834]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:00:54.130)] Trace[1735146834]: [7.00531552s] [7.00531552s] END E0622 02:00:55.527344 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:55.527541 1 trace.go:236] Trace[267423188]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e14b6873-f7e0-4187-9dbb-5bfce0b5404e,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (22-Jun-2026 02:00:48.525) (total time: 7002ms): Trace[267423188]: ["GuaranteedUpdate etcd3" audit-id:e14b6873-f7e0-4187-9dbb-5bfce0b5404e,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (02:00:48.525) Trace[267423188]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:00:55.527)] Trace[267423188]: [7.002449108s] [7.002449108s] END E0622 02:00:55.747720 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:55.748029 1 trace.go:236] Trace[3264246]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9650cdaa-36b2-488d-8525-b176892a1bb4,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 02:00:48.744) (total time: 7003ms): Trace[3264246]: ["GuaranteedUpdate etcd3" audit-id:9650cdaa-36b2-488d-8525-b176892a1bb4,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:00:48.744) Trace[3264246]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:00:55.747)] Trace[3264246]: [7.003152822s] [7.003152822s] END E0622 02:00:55.763044 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:55.763272 1 trace.go:236] Trace[1102584193]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c2b82fc5-1427-46d7-8784-c56c73b6d1e5,client:199.204.45.138,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/datadir-percona-xtradb-pxc-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Jun-2026 02:00:47.528) (total time: 8235ms): Trace[1102584193]: [8.235111832s] [8.235111832s] END E0622 02:00:55.764218 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:55.764353 1 trace.go:236] Trace[397340486]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:548f78f5-83cc-432a-8a7f-a7700a4e2958,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/valkey-node-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Jun-2026 02:00:41.761) (total time: 14003ms): Trace[397340486]: [14.003231273s] [14.003231273s] END E0622 02:00:56.049009 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:00:56.049193 1 trace.go:236] Trace[463873113]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:99e89bb8-7dce-4f0f-8463-bdb9030d6b78,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 02:00:49.045) (total time: 7003ms): Trace[463873113]: ["GuaranteedUpdate etcd3" audit-id:99e89bb8-7dce-4f0f-8463-bdb9030d6b78,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:00:49.045) Trace[463873113]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:00:56.048)] Trace[463873113]: [7.003320407s] [7.003320407s] END E0622 02:00:56.049743 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0622 02:01:02.753060 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:01:02.753301 1 trace.go:236] Trace[1247914500]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:28354d3c-cef0-4188-b1bd-deec83a1324a,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 02:00:55.749) (total time: 7003ms): Trace[1247914500]: ["GuaranteedUpdate etcd3" audit-id:28354d3c-cef0-4188-b1bd-deec83a1324a,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:00:55.750) Trace[1247914500]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:01:02.753)] Trace[1247914500]: [7.003311045s] [7.003311045s] END E0622 02:01:03.052529 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0622 02:01:03.052649 1 trace.go:236] Trace[1031509632]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d89bdf92-474c-43d0-bce7-2d161f4bc1e7,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 02:00:56.050) (total time: 7002ms): Trace[1031509632]: ["GuaranteedUpdate etcd3" audit-id:d89bdf92-474c-43d0-bce7-2d161f4bc1e7,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (02:00:56.050) Trace[1031509632]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:01:03.052)] Trace[1031509632]: [7.00220873s] [7.00220873s] END E0622 02:01:03.053127 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0622 02:01:04.134673 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0622 02:01:04.134810 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0622 02:01:04.136032 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0622 02:01:04.136129 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0622 02:01:04.137235 1 trace.go:236] Trace[144631515]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:dd3036dc-dde0-4a22-8f73-a9de0426a42a,client:199.204.45.138,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Jun-2026 02:00:54.133) (total time: 10003ms): Trace[144631515]: [10.003724078s] [10.003724078s] END E0622 02:01:04.137377 1 timeout.go:142] post-timeout activity - time-elapsed: 2.873962ms, GET "/api/v1/nodes/instance" result: I0622 02:01:05.027076 1 trace.go:236] Trace[345004483]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:29e7e734-e39e-41dc-bf92-5fc9a82ed58e,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (22-Jun-2026 02:00:55.530) (total time: 9496ms): Trace[345004483]: ---"About to write a response" 9496ms (02:01:05.026) Trace[345004483]: [9.496858859s] [9.496858859s] END I0622 02:01:05.027977 1 trace.go:236] Trace[960753295]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:44457cdf-25c3-4091-8ad5-5fced5e54de7,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 02:01:03.054) (total time: 1973ms): Trace[960753295]: ["GuaranteedUpdate etcd3" audit-id:44457cdf-25c3-4091-8ad5-5fced5e54de7,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1973ms (02:01:03.054) Trace[960753295]: ---"Txn call completed" 1972ms (02:01:05.027)] Trace[960753295]: [1.973925394s] [1.973925394s] END I0622 02:01:05.028576 1 trace.go:236] Trace[751239391]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7130ef30-69ad-4b5e-a471-b947e250bcd4,client:199.204.45.138,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Jun-2026 02:01:04.135) (total time: 893ms): Trace[751239391]: ---"About to write a response" 892ms (02:01:05.027) Trace[751239391]: [893.161172ms] [893.161172ms] END E0622 02:01:05.028776 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0622 02:01:05.028999 1 trace.go:236] Trace[33455404]: "Get" accept:application/json, */*,audit-id:da141ab9-7cc4-46a8-ac79-ce6e63ff8eb4,client:10.0.0.177,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Jun-2026 02:01:03.761) (total time: 1267ms): Trace[33455404]: ---"About to write a response" 1267ms (02:01:05.028) Trace[33455404]: [1.26714802s] [1.26714802s] END I0622 02:01:05.029022 1 trace.go:236] Trace[2056472262]: "Get" accept:application/json, */*,audit-id:ae9b37dd-38af-494e-bad8-06d6a32a3f09,client:10.0.0.184,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (22-Jun-2026 02:00:56.763) (total time: 8265ms): Trace[2056472262]: ---"About to write a response" 8265ms (02:01:05.028) Trace[2056472262]: [8.26592116s] [8.26592116s] END I0622 02:01:05.029021 1 trace.go:236] Trace[1875260449]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e29ad06d-5b68-4efe-978d-74ac4f78fcd4,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Jun-2026 02:01:02.755) (total time: 2273ms): Trace[1875260449]: ---"About to write a response" 2273ms (02:01:05.028) Trace[1875260449]: [2.273896487s] [2.273896487s] END I0622 02:01:05.029601 1 trace.go:236] Trace[1734313710]: "List" accept:application/json,audit-id:47de94b6-5806-4fba-878b-0e6aae856b10,client:199.204.45.138,protocol:HTTP/2.0,resource:namespaces,scope:cluster,url:/api/v1/namespaces,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (22-Jun-2026 02:00:59.267) (total time: 5761ms): Trace[1734313710]: ["List(recursive=true) etcd3" audit-id:47de94b6-5806-4fba-878b-0e6aae856b10,key:/namespaces,resourceVersion:,resourceVersionMatch:,limit:500,continue: 5761ms (02:00:59.267)] Trace[1734313710]: [5.761673854s] [5.761673854s] END I0622 02:01:05.032933 1 trace.go:236] Trace[1319730259]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:58530504-be94-4685-8173-cb6c20022946,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Jun-2026 02:00:55.765) (total time: 9267ms): Trace[1319730259]: ---"About to write a response" 9262ms (02:01:05.028) Trace[1319730259]: [9.267381467s] [9.267381467s] END I0622 02:01:05.373454 1 trace.go:236] Trace[1807401371]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d8dd8132-9f5a-4fbe-be97-2a111f8e3f6c,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bb449b9a5e6f7a,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Jun-2026 02:00:48.771) (total time: 16601ms): Trace[1807401371]: ["GuaranteedUpdate etcd3" audit-id:d8dd8132-9f5a-4fbe-be97-2a111f8e3f6c,key:/events/kube-system/kube-apiserver-instance.18bb449b9a5e6f7a,type:*core.Event,resource:events 16601ms (02:00:48.771) Trace[1807401371]: ---"initial value restored" 16255ms (02:01:05.027) Trace[1807401371]: ---"Txn call completed" 344ms (02:01:05.373)] Trace[1807401371]: ---"Object stored in database" 345ms (02:01:05.373) Trace[1807401371]: [16.601765324s] [16.601765324s] END I0622 02:01:05.374013 1 trace.go:236] Trace[1789929401]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.138,type:*v1.Endpoints,resource:apiServerIPInfo (22-Jun-2026 02:00:48.760) (total time: 16613ms): Trace[1789929401]: ---"initial value restored" 16267ms (02:01:05.027) Trace[1789929401]: ---"Transaction prepared" 71ms (02:01:05.099) Trace[1789929401]: ---"Txn call completed" 274ms (02:01:05.373) Trace[1789929401]: [16.613847922s] [16.613847922s] END I0622 02:01:05.377474 1 controller.go:116] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" I0622 02:01:08.216405 1 trace.go:236] Trace[1670556759]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ab4a8d09-e478-47a2-8b41-a45f91d71c34,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Jun-2026 02:01:05.380) (total time: 2835ms): Trace[1670556759]: ["GuaranteedUpdate etcd3" audit-id:ab4a8d09-e478-47a2-8b41-a45f91d71c34,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 2835ms (02:01:05.380) Trace[1670556759]: ---"Txn call completed" 2834ms (02:01:08.216)] Trace[1670556759]: [2.835666497s] [2.835666497s] END I0622 02:01:08.216629 1 trace.go:236] Trace[1008682001]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2337bc68-8023-43c4-9aca-028e74dae188,client:::1,protocol:HTTP/2.0,resource:endpointslices,scope:resource,url:/apis/discovery.k8s.io/v1/namespaces/default/endpointslices/kubernetes,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Jun-2026 02:01:05.380) (total time: 2836ms): Trace[1008682001]: ---"About to write a response" 2835ms (02:01:08.216) Trace[1008682001]: [2.836065461s] [2.836065461s] END I0622 02:01:08.216761 1 trace.go:236] Trace[162062126]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2c06968e-bf12-4325-a807-2010d76d0fef,client:199.204.45.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (22-Jun-2026 02:01:05.377) (total time: 2839ms): Trace[162062126]: ["GuaranteedUpdate etcd3" audit-id:2c06968e-bf12-4325-a807-2010d76d0fef,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 2839ms (02:01:05.377) Trace[162062126]: ---"Txn call completed" 2838ms (02:01:08.216)] Trace[162062126]: [2.839274173s] [2.839274173s] END I0622 02:01:08.216833 1 trace.go:236] Trace[301851398]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4c827a48-a7c5-438b-93ac-56747647c73a,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/auth-system/events/keycloak-0.18bb44b3ad78a1a2,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Jun-2026 02:01:05.376) (total time: 2840ms): Trace[301851398]: ["GuaranteedUpdate etcd3" audit-id:4c827a48-a7c5-438b-93ac-56747647c73a,key:/events/auth-system/keycloak-0.18bb44b3ad78a1a2,type:*core.Event,resource:events 2840ms (02:01:05.376) Trace[301851398]: ---"Txn call completed" 2837ms (02:01:08.216)] Trace[301851398]: ---"Object stored in database" 2837ms (02:01:08.216) Trace[301851398]: [2.840452131s] [2.840452131s] END I0622 02:01:08.218029 1 trace.go:236] Trace[2065814957]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:47f461a8-608b-4ec0-93c5-459fc1e65ad8,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/valkey-node-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Jun-2026 02:01:05.381) (total time: 2836ms): Trace[2065814957]: ---"About to write a response" 2835ms (02:01:08.217) Trace[2065814957]: [2.836550436s] [2.836550436s] END I0622 02:01:08.219181 1 trace.go:236] Trace[1961142034]: "List" accept:application/json, */*,audit-id:69ce628b-39db-4e9f-842b-267fd9abe9e5,client:199.204.45.138,protocol:HTTP/2.0,resource:secrets,scope:namespace,url:/api/v1/namespaces/auth-system/secrets,user-agent:Helm/3.11.2,verb:LIST (22-Jun-2026 02:01:05.452) (total time: 2766ms): Trace[1961142034]: ["List(recursive=true) etcd3" audit-id:69ce628b-39db-4e9f-842b-267fd9abe9e5,key:/secrets/auth-system,resourceVersion:,resourceVersionMatch:,limit:0,continue: 2766ms (02:01:05.452)] Trace[1961142034]: [2.766530681s] [2.766530681s] END I0622 02:01:09.298263 1 trace.go:236] Trace[1386489271]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f6769dc8-de0b-4698-a82e-35f5fef4a947,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/valkey-node-0/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Jun-2026 02:01:08.219) (total time: 1078ms): Trace[1386489271]: ["GuaranteedUpdate etcd3" audit-id:f6769dc8-de0b-4698-a82e-35f5fef4a947,key:/pods/openstack/valkey-node-0,type:*core.Pod,resource:pods 1078ms (02:01:08.219) Trace[1386489271]: ---"Txn call completed" 1067ms (02:01:09.296)] Trace[1386489271]: ---"Object stored in database" 1069ms (02:01:09.297) Trace[1386489271]: [1.078291s] [1.078291s] END I0622 02:01:09.300883 1 trace.go:236] Trace[2136267124]: "List" accept:application/json, */*,audit-id:c783f881-e9b4-4493-bb04-11490d786920,client:199.204.45.138,protocol:HTTP/2.0,resource:secrets,scope:namespace,url:/api/v1/namespaces/auth-system/secrets,user-agent:Helm/3.11.2,verb:LIST (22-Jun-2026 02:01:08.293) (total time: 1007ms): Trace[2136267124]: ["List(recursive=true) etcd3" audit-id:c783f881-e9b4-4493-bb04-11490d786920,key:/secrets/auth-system,resourceVersion:,resourceVersionMatch:,limit:0,continue: 1006ms (02:01:08.293)] Trace[2136267124]: [1.007024984s] [1.007024984s] END I0622 02:01:11.967609 1 trace.go:236] Trace[1135383029]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.138,type:*v1.Endpoints,resource:apiServerIPInfo (22-Jun-2026 02:01:08.217) (total time: 3750ms): Trace[1135383029]: ---"Transaction prepared" 579ms (02:01:08.797) Trace[1135383029]: ---"Txn call completed" 3169ms (02:01:11.967) Trace[1135383029]: [3.750246567s] [3.750246567s] END I0622 02:01:11.969892 1 trace.go:236] Trace[72934529]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8ba08fcf-2e0f-4062-8980-533bace69fdf,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bb449b9a5e6f7a,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Jun-2026 02:01:08.219) (total time: 3750ms): Trace[72934529]: ["GuaranteedUpdate etcd3" audit-id:8ba08fcf-2e0f-4062-8980-533bace69fdf,key:/events/kube-system/kube-apiserver-instance.18bb449b9a5e6f7a,type:*core.Event,resource:events 3750ms (02:01:08.219) Trace[72934529]: ---"initial value restored" 579ms (02:01:08.798) Trace[72934529]: ---"Txn call completed" 3169ms (02:01:11.969)] Trace[72934529]: ---"Object stored in database" 3170ms (02:01:11.969) Trace[72934529]: [3.7503279s] [3.7503279s] END I0622 02:01:11.970176 1 trace.go:236] Trace[805916799]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:41113367-4746-43be-9735-ed1a36883f30,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/pods/envoy-gateway-78446f96c9-mmvnn,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Jun-2026 02:01:09.299) (total time: 2670ms): Trace[805916799]: ---"About to write a response" 2669ms (02:01:11.969) Trace[805916799]: [2.670193191s] [2.670193191s] END I0622 02:01:11.978199 1 trace.go:236] Trace[382002750]: "List" accept:application/json, */*,audit-id:c5f27e5c-ab45-4d50-a99b-4e9d1e4a2f3b,client:199.204.45.138,protocol:HTTP/2.0,resource:secrets,scope:namespace,url:/api/v1/namespaces/cert-manager/secrets,user-agent:Helm/3.11.2,verb:LIST (22-Jun-2026 02:01:09.380) (total time: 2597ms): Trace[382002750]: ["List(recursive=true) etcd3" audit-id:c5f27e5c-ab45-4d50-a99b-4e9d1e4a2f3b,key:/secrets/cert-manager,resourceVersion:,resourceVersionMatch:,limit:0,continue: 2597ms (02:01:09.380)] Trace[382002750]: [2.597497028s] [2.597497028s] END I0622 02:01:12.554462 1 trace.go:236] Trace[525884037]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:eef9b58b-fde8-4abd-8dbb-bd87fbb8a275,client:::1,protocol:HTTP/2.0,resource:endpointslices,scope:resource,url:/apis/discovery.k8s.io/v1/namespaces/default/endpointslices/kubernetes,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Jun-2026 02:01:11.975) (total time: 579ms): Trace[525884037]: ---"About to write a response" 579ms (02:01:12.554) Trace[525884037]: [579.292463ms] [579.292463ms] END I0622 02:01:12.554741 1 trace.go:236] Trace[183694827]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:79e84dd4-b1ba-4838-a6c3-e6c5270a0461,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (22-Jun-2026 02:01:11.971) (total time: 583ms): Trace[183694827]: ["Create etcd3" audit-id:79e84dd4-b1ba-4838-a6c3-e6c5270a0461,key:/events/kube-system/kube-apiserver-instance.18bb44b8bb542445,type:*core.Event,resource:events 581ms (02:01:11.973) Trace[183694827]: ---"Txn call succeeded" 581ms (02:01:12.554)] Trace[183694827]: [583.300832ms] [583.300832ms] END I0622 02:01:13.436416 1 trace.go:236] Trace[414802477]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:371efa92-cbf3-4a99-83c3-04e0c9add3db,client:199.204.45.138,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/pods/envoy-gateway-78446f96c9-mmvnn/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Jun-2026 02:01:11.972) (total time: 1464ms): Trace[414802477]: ["GuaranteedUpdate etcd3" audit-id:371efa92-cbf3-4a99-83c3-04e0c9add3db,key:/pods/envoy-gateway-system/envoy-gateway-78446f96c9-mmvnn,type:*core.Pod,resource:pods 1463ms (02:01:11.972) Trace[414802477]: ---"Txn call completed" 1458ms (02:01:13.435)] Trace[414802477]: ---"Object stored in database" 1458ms (02:01:13.436) Trace[414802477]: [1.464260273s] [1.464260273s] END I0622 02:01:13.458953 1 trace.go:236] Trace[1028457099]: "List" accept:application/json, */*,audit-id:eda55c67-1528-4db9-88c6-e4afc1696070,client:199.204.45.138,protocol:HTTP/2.0,resource:secrets,scope:namespace,url:/api/v1/namespaces/cert-manager/secrets,user-agent:Helm/3.11.2,verb:LIST (22-Jun-2026 02:01:12.081) (total time: 1377ms): Trace[1028457099]: ["List(recursive=true) etcd3" audit-id:eda55c67-1528-4db9-88c6-e4afc1696070,key:/secrets/cert-manager,resourceVersion:,resourceVersionMatch:,limit:0,continue: 1377ms (02:01:12.081)] Trace[1028457099]: [1.377689885s] [1.377689885s] END I0622 02:01:13.841912 1 trace.go:236] Trace[1768244230]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8f1ef13f-fe63-4102-a847-fd6a8933dfdc,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bb449b9a5e6f7a,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Jun-2026 02:01:12.556) (total time: 1285ms): Trace[1768244230]: ["GuaranteedUpdate etcd3" audit-id:8f1ef13f-fe63-4102-a847-fd6a8933dfdc,key:/events/kube-system/kube-apiserver-instance.18bb449b9a5e6f7a,type:*core.Event,resource:events 1285ms (02:01:12.556) Trace[1768244230]: ---"initial value restored" 897ms (02:01:13.453) Trace[1768244230]: ---"Txn call completed" 385ms (02:01:13.840)] Trace[1768244230]: ---"Object stored in database" 387ms (02:01:13.841) Trace[1768244230]: [1.28526795s] [1.28526795s] END I0622 02:01:20.886915 1 trace.go:236] Trace[2014186043]: "Update" accept:application/json, */*,audit-id:8ffd7f82-5bf1-4d49-b99c-1e28afde85a2,client:10.0.0.184,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:PUT (22-Jun-2026 02:01:20.383) (total time: 503ms): Trace[2014186043]: ["GuaranteedUpdate etcd3" audit-id:8ffd7f82-5bf1-4d49-b99c-1e28afde85a2,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 503ms (02:01:20.383) Trace[2014186043]: ---"Txn call completed" 502ms (02:01:20.886)] Trace[2014186043]: [503.42488ms] [503.42488ms] END I0622 02:01:20.888334 1 trace.go:236] Trace[1924021053]: "Update" accept:application/json, */*,audit-id:c78d1e32-a75a-411d-a67c-88f017066e94,client:10.0.0.177,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Jun-2026 02:01:20.383) (total time: 504ms): Trace[1924021053]: ["GuaranteedUpdate etcd3" audit-id:c78d1e32-a75a-411d-a67c-88f017066e94,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 504ms (02:01:20.383) Trace[1924021053]: ---"Txn call completed" 503ms (02:01:20.888)] Trace[1924021053]: [504.703331ms] [504.703331ms] END I0622 02:01:20.892838 1 trace.go:236] Trace[81237099]: "Get" accept:application/json,audit-id:69a50a15-9a80-4c65-a619-07a60664bc4d,client:199.204.45.138,protocol:HTTP/2.0,resource:clusterroles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterroles/cert-manager-cainjector,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Jun-2026 02:01:20.385) (total time: 507ms): Trace[81237099]: ---"About to write a response" 507ms (02:01:20.892) Trace[81237099]: [507.149189ms] [507.149189ms] END I0622 02:01:20.898284 1 trace.go:236] Trace[1567890553]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:dbbbab86-5ee2-4172-a175-1346c558fdfd,client:199.204.45.138,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events/envoy-gateway-78446f96c9-mmvnn.18bb44b95838ecf1,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Jun-2026 02:01:20.396) (total time: 501ms): Trace[1567890553]: ["GuaranteedUpdate etcd3" audit-id:dbbbab86-5ee2-4172-a175-1346c558fdfd,key:/events/envoy-gateway-system/envoy-gateway-78446f96c9-mmvnn.18bb44b95838ecf1,type:*core.Event,resource:events 501ms (02:01:20.396) Trace[1567890553]: ---"initial value restored" 497ms (02:01:20.894)] Trace[1567890553]: [501.779007ms] [501.779007ms] END