I0714 05:16:15.312906 1 options.go:220] external host was not specified, using 199.204.45.22 I0714 05:16:15.313715 1 server.go:148] Version: v1.28.13 I0714 05:16:15.313757 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0714 05:16:15.493837 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0714 05:16:15.508782 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0714 05:16:15.508808 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0714 05:16:15.509116 1 instance.go:298] Using reconciler: lease I0714 05:16:15.557871 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0714 05:16:15.557897 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0714 05:16:15.828064 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0714 05:16:15.828214 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0714 05:16:16.275474 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0714 05:16:16.296035 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0714 05:16:16.296064 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0714 05:16:16.296072 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0714 05:16:16.296573 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0714 05:16:16.296580 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0714 05:16:16.297685 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0714 05:16:16.298587 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0714 05:16:16.298605 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0714 05:16:16.298611 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0714 05:16:16.300187 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0714 05:16:16.300206 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0714 05:16:16.301171 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0714 05:16:16.301205 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0714 05:16:16.301211 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0714 05:16:16.301874 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0714 05:16:16.301890 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0714 05:16:16.301928 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0714 05:16:16.302707 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0714 05:16:16.304295 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0714 05:16:16.304310 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0714 05:16:16.304314 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0714 05:16:16.304666 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0714 05:16:16.304677 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0714 05:16:16.304681 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0714 05:16:16.305522 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0714 05:16:16.305535 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0714 05:16:16.306907 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0714 05:16:16.306919 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0714 05:16:16.306924 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0714 05:16:16.307320 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0714 05:16:16.307332 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0714 05:16:16.307336 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0714 05:16:16.308956 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0714 05:16:16.308967 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0714 05:16:16.308972 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0714 05:16:16.309789 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0714 05:16:16.310650 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0714 05:16:16.310662 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0714 05:16:16.310666 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0714 05:16:16.313725 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0714 05:16:16.313738 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0714 05:16:16.313742 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0714 05:16:16.314562 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0714 05:16:16.314580 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0714 05:16:16.314584 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0714 05:16:16.315102 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0714 05:16:16.315114 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0714 05:16:16.355562 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0714 05:16:16.355594 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0714 05:16:16.766037 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0714 05:16:16.766057 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0714 05:16:16.766364 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0714 05:16:16.766714 1 secure_serving.go:213] Serving securely on [::]:6443 I0714 05:16:16.766839 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0714 05:16:16.766894 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0714 05:16:16.766944 1 controller.go:80] Starting OpenAPI V3 AggregationController I0714 05:16:16.766998 1 aggregator.go:164] waiting for initial CRD sync... I0714 05:16:16.767025 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0714 05:16:16.767169 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0714 05:16:16.767191 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0714 05:16:16.767036 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0714 05:16:16.767273 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0714 05:16:16.767208 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0714 05:16:16.767540 1 controller.go:134] Starting OpenAPI controller I0714 05:16:16.767560 1 controller.go:85] Starting OpenAPI V3 controller I0714 05:16:16.767574 1 naming_controller.go:291] Starting NamingConditionController I0714 05:16:16.767591 1 establishing_controller.go:76] Starting EstablishingController I0714 05:16:16.767604 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0714 05:16:16.767641 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0714 05:16:16.767662 1 crd_finalizer.go:266] Starting CRDFinalizer I0714 05:16:16.767689 1 system_namespaces_controller.go:67] Starting system namespaces controller I0714 05:16:16.767240 1 controller.go:116] Starting legacy_token_tracking_controller I0714 05:16:16.767742 1 available_controller.go:423] Starting AvailableConditionController I0714 05:16:16.767752 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0714 05:16:16.767769 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0714 05:16:16.767720 1 gc_controller.go:78] Starting apiserver lease garbage collector I0714 05:16:16.768103 1 gc_controller.go:78] Starting apiserver lease garbage collector I0714 05:16:16.768623 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0714 05:16:16.768643 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0714 05:16:16.768711 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0714 05:16:16.768856 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0714 05:16:16.767193 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0714 05:16:16.773370 1 controller.go:78] Starting OpenAPI AggregationController I0714 05:16:16.796158 1 shared_informer.go:318] Caches are synced for node_authorizer E0714 05:16:16.855104 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0714 05:16:16.867004 1 apf_controller.go:379] Running API Priority and Fairness config worker I0714 05:16:16.867031 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0714 05:16:16.868328 1 shared_informer.go:318] Caches are synced for configmaps I0714 05:16:16.868370 1 cache.go:39] Caches are synced for AvailableConditionController controller I0714 05:16:16.868335 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0714 05:16:16.868719 1 shared_informer.go:318] Caches are synced for crd-autoregister I0714 05:16:16.868754 1 aggregator.go:166] initial CRD sync complete... I0714 05:16:16.868764 1 autoregister_controller.go:141] Starting autoregister controller I0714 05:16:16.868772 1 cache.go:32] Waiting for caches to sync for autoregister controller I0714 05:16:16.868781 1 cache.go:39] Caches are synced for autoregister controller I0714 05:16:16.869009 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0714 05:16:16.870564 1 controller.go:624] quota admission added evaluator for: namespaces I0714 05:16:17.060270 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0714 05:16:17.775657 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0714 05:16:17.779788 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0714 05:16:17.779822 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0714 05:16:18.301578 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0714 05:16:18.347238 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0714 05:16:18.482409 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0714 05:16:18.493178 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.22] I0714 05:16:18.494654 1 controller.go:624] quota admission added evaluator for: endpoints I0714 05:16:18.500471 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0714 05:16:19.365002 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0714 05:16:20.056172 1 controller.go:624] quota admission added evaluator for: deployments.apps http2: server: error reading preface from client 199.204.45.22:38302: read tcp 199.204.45.22:6443->199.204.45.22:38302: read: connection reset by peer I0714 05:16:20.139913 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0714 05:16:20.355357 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0714 05:16:24.458414 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0714 05:16:24.606064 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0714 05:16:49.713897 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0714 05:16:49.740781 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0714 05:16:49.835827 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0714 05:16:49.848203 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0714 05:16:49.858762 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0714 05:16:49.873504 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0714 05:16:49.873557 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0714 05:16:49.911491 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0714 05:16:49.954323 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0714 05:16:49.954399 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0714 05:16:49.990414 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0714 05:16:49.990470 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0714 05:16:49.995037 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0714 05:16:49.995074 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0714 05:16:50.046013 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0714 05:16:50.103231 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0714 05:16:50.199502 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0714 05:16:50.349685 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0714 05:16:50.349870 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0714 05:16:50.387977 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0714 05:16:50.423246 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0714 05:16:50.439718 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0714 05:16:51.039901 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0714 05:16:51.123977 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0714 05:16:56.258847 1 controller.go:624] quota admission added evaluator for: jobs.batch I0714 05:16:57.455922 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0714 05:16:57.577243 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0714 05:16:57.771087 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0714 05:16:57.969291 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0714 05:16:58.161842 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0714 05:16:58.359349 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0714 05:16:58.562347 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0714 05:16:58.760383 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0714 05:16:58.996469 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0714 05:17:01.155627 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0714 05:17:01.599551 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0714 05:17:01.973579 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0714 05:17:01.973615 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0714 05:17:04.893120 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0714 05:17:13.411839 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.105.219.108"} W0714 05:17:13.440346 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.105.219.108:9443: connect: connection refused E0714 05:17:13.440387 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.105.219.108:9443: connect: connection refused I0714 05:18:19.415297 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.104.22.9"} I0714 05:18:19.425684 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.110.137.131"} I0714 05:20:01.802483 1 trace.go:236] Trace[735187716]: "Update" accept:application/json, */*,audit-id:110161ab-dd61-4b24-b2b1-6b11cd55bc36,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (14-Jul-2026 05:20:01.300) (total time: 501ms): Trace[735187716]: ["GuaranteedUpdate etcd3" audit-id:110161ab-dd61-4b24-b2b1-6b11cd55bc36,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 501ms (05:20:01.301) Trace[735187716]: ---"Txn call completed" 500ms (05:20:01.802)] Trace[735187716]: [501.459825ms] [501.459825ms] END E0714 05:20:07.020051 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0714 05:20:07.020169 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:07.021568 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:07.021638 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:07.022729 1 trace.go:236] Trace[1963347410]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:555b4f51-a97c-4495-9f26-8c9af420ac62,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-Jul-2026 05:20:02.019) (total time: 5002ms): Trace[1963347410]: [5.002824453s] [5.002824453s] END E0714 05:20:07.022905 1 timeout.go:142] post-timeout activity - time-elapsed: 2.557512ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0714 05:20:07.598471 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0714 05:20:07.598568 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:07.599693 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:07.599850 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:07.601041 1 trace.go:236] Trace[1348750507]: "Get" accept:application/json, */*,audit-id:7e75437f-f8c2-4a32-baaa-145c4a92be33,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-Jul-2026 05:20:02.599) (total time: 5001ms): Trace[1348750507]: [5.001960761s] [5.001960761s] END E0714 05:20:07.601171 1 timeout.go:142] post-timeout activity - time-elapsed: 2.687336ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: I0714 05:20:07.654834 1 trace.go:236] Trace[1697712650]: "Get" accept:application/json, */*,audit-id:5d729b40-5987-4e06-be3e-cedb2fdf63cf,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com,user-agent:csi-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:20:02.769) (total time: 4885ms): Trace[1697712650]: ---"About to write a response" 4885ms (05:20:07.654) Trace[1697712650]: [4.885701595s] [4.885701595s] END I0714 05:20:07.656075 1 trace.go:236] Trace[1110515339]: "Get" accept:application/json, */*,audit-id:eae075af-bcd1-4953-b763-fc049633a4e2,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:20:02.448) (total time: 5207ms): Trace[1110515339]: ---"About to write a response" 5207ms (05:20:07.655) Trace[1110515339]: [5.207762081s] [5.207762081s] END I0714 05:20:07.656076 1 trace.go:236] Trace[555313712]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:dc8f854e-fb0d-4537-859c-12f76e0c7c79,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-Jul-2026 05:20:02.869) (total time: 4786ms): Trace[555313712]: ---"About to write a response" 4786ms (05:20:07.655) Trace[555313712]: [4.786373538s] [4.786373538s] END I0714 05:20:07.656549 1 trace.go:236] Trace[804982352]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:73df0ed5-ec28-4fcf-827a-9ccf7940264f,client:10.0.0.114,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (14-Jul-2026 05:20:03.191) (total time: 4465ms): Trace[804982352]: ["GuaranteedUpdate etcd3" audit-id:73df0ed5-ec28-4fcf-827a-9ccf7940264f,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 4465ms (05:20:03.191) Trace[804982352]: ---"Txn call completed" 4464ms (05:20:07.656)] Trace[804982352]: [4.465193653s] [4.465193653s] END I0714 05:20:07.657219 1 trace.go:236] Trace[566365974]: "Get" accept:application/json, */*,audit-id:151e6d16-01c2-4fa8-a255-cc151c11396c,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-Jul-2026 05:20:02.775) (total time: 4881ms): Trace[566365974]: ---"About to write a response" 4880ms (05:20:07.656) Trace[566365974]: [4.881589553s] [4.881589553s] END I0714 05:20:07.661850 1 trace.go:236] Trace[1458353410]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:982f5a50-58f1-4676-83ca-5c384d03b07d,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-Jul-2026 05:20:04.664) (total time: 2997ms): Trace[1458353410]: ["GuaranteedUpdate etcd3" audit-id:982f5a50-58f1-4676-83ca-5c384d03b07d,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 2996ms (05:20:04.664) Trace[1458353410]: ---"Txn call completed" 2995ms (05:20:07.661)] Trace[1458353410]: [2.997090855s] [2.997090855s] END I0714 05:20:07.664244 1 trace.go:236] Trace[1906376335]: "Get" accept:application/json, */*,audit-id:0cd30152-0899-47b6-aafa-8f29fb74a703,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:20:03.804) (total time: 3859ms): Trace[1906376335]: ---"About to write a response" 3859ms (05:20:07.664) Trace[1906376335]: [3.859645603s] [3.859645603s] END I0714 05:20:07.665025 1 trace.go:236] Trace[178968070]: "Get" accept:application/json, */*,audit-id:6280b603-ec1f-4d53-b4ac-ad304d25d0d3,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:20:03.996) (total time: 3668ms): Trace[178968070]: ---"About to write a response" 3667ms (05:20:07.664) Trace[178968070]: [3.668109256s] [3.668109256s] END I0714 05:20:07.665103 1 trace.go:236] Trace[1693056726]: "Get" accept:application/json, */*,audit-id:f38596d5-f800-4d17-8733-7815785e267d,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:20:05.320) (total time: 2344ms): Trace[1693056726]: ---"About to write a response" 2344ms (05:20:07.664) Trace[1693056726]: [2.344303559s] [2.344303559s] END I0714 05:20:07.665229 1 trace.go:236] Trace[1835433838]: "Get" accept:application/json, */*,audit-id:acd60329-bd6a-4f3a-85a5-3fb6f0604b7a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:20:03.894) (total time: 3770ms): Trace[1835433838]: ---"About to write a response" 3770ms (05:20:07.665) Trace[1835433838]: [3.770308933s] [3.770308933s] END E0714 05:20:38.729624 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:38.729659 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:38.729790 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 113.353µs, panicked: false, err: context deadline exceeded, panic-reason: E0714 05:20:38.731421 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:38.731494 1 trace.go:236] Trace[1031875995]: "Update" accept:application/json, */*,audit-id:5f581f6c-80f8-4ce9-97ae-aa584d4db0f1,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (14-Jul-2026 05:20:33.729) (total time: 5002ms): Trace[1031875995]: ["GuaranteedUpdate etcd3" audit-id:5f581f6c-80f8-4ce9-97ae-aa584d4db0f1,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (05:20:33.729) Trace[1031875995]: ---"Txn call failed" err:context deadline exceeded 4999ms (05:20:38.729)] Trace[1031875995]: [5.002267602s] [5.002267602s] END E0714 05:20:38.731641 1 timeout.go:142] post-timeout activity - time-elapsed: 1.959658ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0714 05:20:38.732560 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:38.732720 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:38.733009 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 404.22µs, panicked: false, err: context canceled, panic-reason: E0714 05:20:38.733707 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:38.735038 1 trace.go:236] Trace[635488848]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:33ee6ab2-d04b-45d7-b96b-cc08767df4e1,client:10.0.0.114,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (14-Jul-2026 05:20:33.732) (total time: 5002ms): Trace[635488848]: ["GuaranteedUpdate etcd3" audit-id:33ee6ab2-d04b-45d7-b96b-cc08767df4e1,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (05:20:33.732) Trace[635488848]: ---"Txn call failed" err:context canceled 4999ms (05:20:38.732)] Trace[635488848]: [5.002475128s] [5.002475128s] END E0714 05:20:38.735147 1 timeout.go:142] post-timeout activity - time-elapsed: 2.685767ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0714 05:20:38.759632 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0714 05:20:38.759835 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:38.760879 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:38.760933 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:38.762143 1 trace.go:236] Trace[413572391]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:40661993-c2fb-43a6-b2de-c28ab1ade3f8,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-Jul-2026 05:20:33.759) (total time: 5002ms): Trace[413572391]: [5.002259292s] [5.002259292s] END E0714 05:20:38.762319 1 timeout.go:142] post-timeout activity - time-elapsed: 2.595754ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0714 05:20:40.514640 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0714 05:20:40.514736 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:40.515973 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:40.516025 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:40.517328 1 trace.go:236] Trace[999888685]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2d848f80-3dd7-44b2-a98e-f770657b488d,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-Jul-2026 05:20:35.514) (total time: 5002ms): Trace[999888685]: [5.002671613s] [5.002671613s] END E0714 05:20:40.517499 1 timeout.go:142] post-timeout activity - time-elapsed: 2.660236ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0714 05:20:43.725662 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0714 05:20:43.725880 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:43.726967 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:43.727024 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:43.728094 1 trace.go:236] Trace[1400234630]: "Get" accept:application/json, */*,audit-id:11e8c859-6088-4d67-87d0-dd3f2eca4a8b,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-Jul-2026 05:20:40.732) (total time: 2995ms): Trace[1400234630]: [2.995668384s] [2.995668384s] END E0714 05:20:43.728189 1 timeout.go:142] post-timeout activity - time-elapsed: 2.639626ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0714 05:20:43.732144 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0714 05:20:43.732178 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:43.733246 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:43.733312 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:43.734535 1 trace.go:236] Trace[1731651827]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e580c5d3-7108-4ed1-9985-377213520fd8,client:10.0.0.114,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-Jul-2026 05:20:38.733) (total time: 5001ms): Trace[1731651827]: [5.001116223s] [5.001116223s] END E0714 05:20:43.734678 1 timeout.go:142] post-timeout activity - time-elapsed: 2.4779ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0714 05:20:43.759713 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0714 05:20:43.759778 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:43.761743 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:43.761840 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:43.762900 1 trace.go:236] Trace[1790261800]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:864b5403-010b-4873-8af9-76a55a56c5ec,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-Jul-2026 05:20:40.761) (total time: 3001ms): Trace[1790261800]: [3.001122699s] [3.001122699s] END E0714 05:20:43.763040 1 timeout.go:142] post-timeout activity - time-elapsed: 3.525118ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0714 05:20:43.770148 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0714 05:20:43.770357 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:43.771335 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:43.771668 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:43.772479 1 trace.go:236] Trace[299702947]: "Get" accept:application/json, */*,audit-id:8c4f0bb3-af6a-42af-9c69-6349056ebf0b,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:20:33.769) (total time: 10003ms): Trace[299702947]: [10.003425256s] [10.003425256s] END E0714 05:20:43.772727 1 timeout.go:142] post-timeout activity - time-elapsed: 2.583344ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0714 05:20:43.778252 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0714 05:20:43.778425 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:43.779594 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:43.779654 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:43.780827 1 trace.go:236] Trace[1062921704]: "Get" accept:application/json, */*,audit-id:afa64105-0c1d-484f-8b3f-cb809bf70dba,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:20:33.778) (total time: 10002ms): Trace[1062921704]: [10.002485014s] [10.002485014s] END E0714 05:20:43.781020 1 timeout.go:142] post-timeout activity - time-elapsed: 2.766988ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0714 05:20:43.793310 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0714 05:20:43.793414 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:43.794861 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:43.794957 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:43.796007 1 trace.go:236] Trace[1591604382]: "Get" accept:application/json, */*,audit-id:434fff80-a880-4a35-8716-815deaef438b,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-Jul-2026 05:20:33.792) (total time: 10003ms): Trace[1591604382]: [10.00315105s] [10.00315105s] END E0714 05:20:43.796157 1 timeout.go:142] post-timeout activity - time-elapsed: 3.516677ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system" result: E0714 05:20:45.462342 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0714 05:20:45.462520 1 trace.go:236] Trace[1515663567]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d90a14fd-09a1-4a81-bffa-a95a7057a2b4,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-Jul-2026 05:20:38.459) (total time: 7003ms): Trace[1515663567]: ["GuaranteedUpdate etcd3" audit-id:d90a14fd-09a1-4a81-bffa-a95a7057a2b4,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (05:20:38.459) Trace[1515663567]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:20:45.462)] Trace[1515663567]: [7.00317364s] [7.00317364s] END E0714 05:20:45.514756 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0714 05:20:45.514894 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:45.515841 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:45.516854 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:45.516922 1 trace.go:236] Trace[1437678719]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9b190946-24f7-4032-b17e-111d5303f668,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-Jul-2026 05:20:42.516) (total time: 3000ms): Trace[1437678719]: [3.000041733s] [3.000041733s] END E0714 05:20:45.517057 1 timeout.go:142] post-timeout activity - time-elapsed: 2.318997ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0714 05:20:47.730229 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0714 05:20:47.730394 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:47.731374 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:47.731536 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:47.732798 1 trace.go:236] Trace[1117891908]: "Get" accept:application/json, */*,audit-id:f05f7184-973e-42e7-aaad-0ea682f04bf5,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com,user-agent:csi-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:20:37.729) (total time: 10002ms): Trace[1117891908]: [10.002858722s] [10.002858722s] END E0714 05:20:47.733042 1 timeout.go:142] post-timeout activity - time-elapsed: 2.794489ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com" result: E0714 05:20:47.746919 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0714 05:20:47.747153 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:47.748598 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:47.748652 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0714 05:20:47.748995 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:47.749447 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 416.352µs, panicked: false, err: context canceled, panic-reason: I0714 05:20:47.749998 1 trace.go:236] Trace[401090153]: "Get" accept:application/json, */*,audit-id:40b67cf0-36be-42c1-9584-31d96d3736b4,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:20:37.746) (total time: 10003ms): Trace[401090153]: [10.003159939s] [10.003159939s] END E0714 05:20:47.750098 1 timeout.go:142] post-timeout activity - time-elapsed: 3.249151ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com" result: E0714 05:20:47.750230 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:47.751250 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0714 05:20:47.751340 1 timeout.go:142] post-timeout activity - time-elapsed: 2.297837ms, POST "/api/v1/namespaces/kube-system/events" result: E0714 05:20:47.763340 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0714 05:20:47.763417 1 trace.go:236] Trace[937889071]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.22,type:*v1.Endpoints,resource:apiServerIPInfo (14-Jul-2026 05:20:38.488) (total time: 9275ms): Trace[937889071]: [9.27514845s] [9.27514845s] END E0714 05:20:47.763456 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0714 05:20:47.763489 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0714 05:20:47.763520 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0714 05:20:47.763548 1 trace.go:236] Trace[926629151]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b7bea22d-20e3-40c2-8ef0-5bfbdd3c6c99,client:199.204.45.22,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18c210601f2616ed,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (14-Jul-2026 05:20:37.418) (total time: 10344ms): Trace[926629151]: ["GuaranteedUpdate etcd3" audit-id:b7bea22d-20e3-40c2-8ef0-5bfbdd3c6c99,key:/events/kube-system/kube-apiserver-instance.18c210601f2616ed,type:*core.Event,resource:events 10344ms (05:20:37.418)] Trace[926629151]: [10.344581235s] [10.344581235s] END I0714 05:20:47.764859 1 trace.go:236] Trace[875141240]: "Get" accept:application/json, */*,audit-id:cf59c081-e85f-4684-8620-4f18dbddf4d3,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:20:37.810) (total time: 9954ms): Trace[875141240]: [9.954500765s] [9.954500765s] END I0714 05:20:47.764896 1 trace.go:236] Trace[360008096]: "Get" accept:application/json, */*,audit-id:799c911b-ad31-4cbd-a97c-438e2f2b472e,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:20:37.810) (total time: 9954ms): Trace[360008096]: [9.954458725s] [9.954458725s] END E0714 05:20:48.563296 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0714 05:20:48.563465 1 trace.go:236] Trace[2035030459]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a7c6aaec-9ed1-4d77-bdf1-9ba6bea400fa,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-Jul-2026 05:20:41.560) (total time: 7002ms): Trace[2035030459]: ["GuaranteedUpdate etcd3" audit-id:a7c6aaec-9ed1-4d77-bdf1-9ba6bea400fa,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:20:41.561) Trace[2035030459]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:20:48.563)] Trace[2035030459]: [7.002474231s] [7.002474231s] END E0714 05:20:48.564228 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0714 05:20:48.726579 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:48.726618 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:48.726762 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 100.892µs, panicked: false, err: context canceled, panic-reason: E0714 05:20:48.727915 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:48.728018 1 trace.go:236] Trace[1359160269]: "Update" accept:application/json, */*,audit-id:2a2b3609-6c19-4d97-a8e0-f601e3c8adc1,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (14-Jul-2026 05:20:43.726) (total time: 5001ms): Trace[1359160269]: ["GuaranteedUpdate etcd3" audit-id:2a2b3609-6c19-4d97-a8e0-f601e3c8adc1,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (05:20:43.727) Trace[1359160269]: ---"Txn call failed" err:context canceled 4998ms (05:20:48.726)] Trace[1359160269]: [5.001059522s] [5.001059522s] END E0714 05:20:48.728148 1 timeout.go:142] post-timeout activity - time-elapsed: 1.55982ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0714 05:20:50.515882 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:50.515925 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:50.515943 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 11.08µs, panicked: false, err: context canceled, panic-reason: E0714 05:20:50.517293 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:50.517387 1 trace.go:236] Trace[499731610]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e345bda5-06d7-4ef2-a4e8-d68f83d73155,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (14-Jul-2026 05:20:45.516) (total time: 5000ms): Trace[499731610]: ["GuaranteedUpdate etcd3" audit-id:e345bda5-06d7-4ef2-a4e8-d68f83d73155,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (05:20:45.516) Trace[499731610]: ---"Txn call failed" err:context canceled 4998ms (05:20:50.515)] Trace[499731610]: [5.000760356s] [5.000760356s] END E0714 05:20:50.517530 1 timeout.go:142] post-timeout activity - time-elapsed: 1.62679ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0714 05:20:50.737176 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0714 05:20:50.737444 1 trace.go:236] Trace[1164577821]: "Create" accept:application/json, */*,audit-id:a67ee1db-d401-4167-9678-20cb5bd53f3b,client:10.0.0.114,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (14-Jul-2026 05:20:43.733) (total time: 7003ms): Trace[1164577821]: ["Create etcd3" audit-id:a67ee1db-d401-4167-9678-20cb5bd53f3b,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18c2106893a6d1f6,type:*core.Event,resource:events 7002ms (05:20:43.735) Trace[1164577821]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (05:20:50.737)] Trace[1164577821]: [7.003988608s] [7.003988608s] END E0714 05:20:50.774091 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0714 05:20:50.774276 1 trace.go:236] Trace[1977483220]: "Update" accept:application/json, */*,audit-id:2a96c3cf-dc20-431a-a071-56516c10078f,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (14-Jul-2026 05:20:43.771) (total time: 7002ms): Trace[1977483220]: ["GuaranteedUpdate etcd3" audit-id:2a96c3cf-dc20-431a-a071-56516c10078f,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:20:43.771) Trace[1977483220]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:20:50.774)] Trace[1977483220]: [7.002660555s] [7.002660555s] END E0714 05:20:50.779170 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:20:50.779207 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:20:50.779243 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 8.12µs, panicked: false, err: context canceled, panic-reason: E0714 05:20:50.780522 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:20:50.780627 1 trace.go:236] Trace[328227005]: "Update" accept:application/json, */*,audit-id:77852389-c0ff-4d6f-abc8-96dd92ae2e17,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (14-Jul-2026 05:20:43.778) (total time: 7001ms): Trace[328227005]: ["GuaranteedUpdate etcd3" audit-id:77852389-c0ff-4d6f-abc8-96dd92ae2e17,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7001ms (05:20:43.778) Trace[328227005]: ---"Txn call failed" err:context canceled 6999ms (05:20:50.778)] Trace[328227005]: [7.001715773s] [7.001715773s] END E0714 05:20:50.780769 1 timeout.go:142] post-timeout activity - time-elapsed: 1.58376ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0714 05:20:52.467185 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0714 05:20:52.467366 1 trace.go:236] Trace[404948312]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4e625d33-c181-4dbc-b892-39a4756541ed,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-Jul-2026 05:20:45.464) (total time: 7002ms): Trace[404948312]: ["GuaranteedUpdate etcd3" audit-id:4e625d33-c181-4dbc-b892-39a4756541ed,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:20:45.464) Trace[404948312]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:20:52.467)] Trace[404948312]: [7.002974583s] [7.002974583s] END E0714 05:20:55.568130 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0714 05:20:55.568364 1 trace.go:236] Trace[2018967786]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b8a11063-eb1d-43f5-8799-348671035524,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-Jul-2026 05:20:48.565) (total time: 7003ms): Trace[2018967786]: ["GuaranteedUpdate etcd3" audit-id:b8a11063-eb1d-43f5-8799-348671035524,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (05:20:48.565) Trace[2018967786]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (05:20:55.568)] Trace[2018967786]: [7.003002895s] [7.003002895s] END E0714 05:20:55.569294 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" I0714 05:20:57.376591 1 trace.go:236] Trace[483880326]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3a3049d2-1821-4719-870b-27059cb0541b,client:199.204.45.22,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (14-Jul-2026 05:20:46.348) (total time: 11028ms): Trace[483880326]: ---"About to write a response" 11027ms (05:20:57.376) Trace[483880326]: [11.028237666s] [11.028237666s] END I0714 05:20:57.377517 1 trace.go:236] Trace[798534870]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f7d1969d-d765-4921-88d6-4d425f3a4ccb,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-Jul-2026 05:20:55.570) (total time: 1807ms): Trace[798534870]: ["GuaranteedUpdate etcd3" audit-id:f7d1969d-d765-4921-88d6-4d425f3a4ccb,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1807ms (05:20:55.570) Trace[798534870]: ---"Txn call completed" 1805ms (05:20:57.377)] Trace[798534870]: [1.807197094s] [1.807197094s] END I0714 05:20:57.377964 1 trace.go:236] Trace[1955783651]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7e4fdb9b-a1a1-4ff0-b5d1-0263d52edb7b,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-Jul-2026 05:20:52.469) (total time: 4908ms): Trace[1955783651]: ["GuaranteedUpdate etcd3" audit-id:7e4fdb9b-a1a1-4ff0-b5d1-0263d52edb7b,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 4908ms (05:20:52.469) Trace[1955783651]: ---"Txn call completed" 4907ms (05:20:57.377)] Trace[1955783651]: [4.908603296s] [4.908603296s] END E0714 05:20:57.378516 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0714 05:20:57.384692 1 trace.go:236] Trace[77319150]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:29321ada-4578-4b07-9a02-47447387c006,client:199.204.45.22,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18c2106019dc721a,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (14-Jul-2026 05:20:47.765) (total time: 9618ms): Trace[77319150]: ["GuaranteedUpdate etcd3" audit-id:29321ada-4578-4b07-9a02-47447387c006,key:/events/kube-system/kube-apiserver-instance.18c2106019dc721a,type:*core.Event,resource:events 9618ms (05:20:47.765) Trace[77319150]: ---"initial value restored" 9611ms (05:20:57.377)] Trace[77319150]: [9.618833154s] [9.618833154s] END I0714 05:20:57.404254 1 trace.go:236] Trace[686019681]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.22,type:*v1.Endpoints,resource:apiServerIPInfo (14-Jul-2026 05:20:48.488) (total time: 8915ms): Trace[686019681]: ---"initial value restored" 8889ms (05:20:57.377) Trace[686019681]: [8.915809005s] [8.915809005s] END I0714 05:22:09.277395 1 trace.go:236] Trace[1973819613]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:492b2806-9a1c-4547-9007-397851a36d1e,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-Jul-2026 05:22:08.592) (total time: 684ms): Trace[1973819613]: ["GuaranteedUpdate etcd3" audit-id:492b2806-9a1c-4547-9007-397851a36d1e,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 684ms (05:22:08.592) Trace[1973819613]: ---"Txn call completed" 683ms (05:22:09.277)] Trace[1973819613]: [684.524227ms] [684.524227ms] END I0714 05:22:09.277610 1 trace.go:236] Trace[1507718612]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:204ed400-ad1d-4327-ba2e-34ca5cbe9857,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-Jul-2026 05:22:08.404) (total time: 872ms): Trace[1507718612]: ---"About to write a response" 872ms (05:22:09.277) Trace[1507718612]: [872.619267ms] [872.619267ms] END I0714 05:22:09.277767 1 trace.go:236] Trace[716170756]: "Get" accept:application/json, */*,audit-id:4f605a8b-9f1c-44c5-8fab-b34a665438c3,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:22:08.765) (total time: 512ms): Trace[716170756]: ---"About to write a response" 512ms (05:22:09.277) Trace[716170756]: [512.47338ms] [512.47338ms] END I0714 05:22:09.281095 1 trace.go:236] Trace[295491049]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.22,type:*v1.Endpoints,resource:apiServerIPInfo (14-Jul-2026 05:22:08.492) (total time: 788ms): Trace[295491049]: ---"initial value restored" 783ms (05:22:09.275) Trace[295491049]: [788.316196ms] [788.316196ms] END I0714 05:22:16.410363 1 trace.go:236] Trace[1612715693]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:cf7987d7-cece-453b-9c56-9cf826423ca0,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-Jul-2026 05:22:15.303) (total time: 1106ms): Trace[1612715693]: ---"About to write a response" 1106ms (05:22:16.410) Trace[1612715693]: [1.106894357s] [1.106894357s] END I0714 05:22:16.410743 1 trace.go:236] Trace[1656172646]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d45baf9e-93a4-49a5-b3d1-7a77350c540c,client:10.0.0.114,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (14-Jul-2026 05:22:15.296) (total time: 1113ms): Trace[1656172646]: ["GuaranteedUpdate etcd3" audit-id:d45baf9e-93a4-49a5-b3d1-7a77350c540c,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1113ms (05:22:15.297) Trace[1656172646]: ---"Txn call completed" 1112ms (05:22:16.410)] Trace[1656172646]: [1.113729723s] [1.113729723s] END I0714 05:22:16.411124 1 trace.go:236] Trace[1321960612]: "Get" accept:application/json, */*,audit-id:6a8932e2-4d2d-4d6d-a0fe-1d40a80d7fde,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-Jul-2026 05:22:15.377) (total time: 1033ms): Trace[1321960612]: ---"About to write a response" 1033ms (05:22:16.410) Trace[1321960612]: [1.033289946s] [1.033289946s] END I0714 05:22:16.411222 1 trace.go:236] Trace[1012287622]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:cac048a6-08c3-4e31-aed7-d8332f5fa8f2,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-Jul-2026 05:22:15.304) (total time: 1106ms): Trace[1012287622]: ---"About to write a response" 1106ms (05:22:16.411) Trace[1012287622]: [1.106589609s] [1.106589609s] END I0714 05:22:16.411596 1 trace.go:236] Trace[1239519472]: "Update" accept:application/json, */*,audit-id:f72d2dba-60f6-4572-87d1-6f01146497cf,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (14-Jul-2026 05:22:14.378) (total time: 2032ms): Trace[1239519472]: ["GuaranteedUpdate etcd3" audit-id:f72d2dba-60f6-4572-87d1-6f01146497cf,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 2032ms (05:22:14.378) Trace[1239519472]: ---"Txn call completed" 2031ms (05:22:16.411)] Trace[1239519472]: [2.032891818s] [2.032891818s] END E0714 05:22:51.515644 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:22:51.515694 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:22:51.515710 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 18.361µs, panicked: false, err: context canceled, panic-reason: E0714 05:22:51.516849 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:22:51.516921 1 trace.go:236] Trace[662423065]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a83934de-d829-4d10-8635-787b6228235c,client:10.0.0.114,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (14-Jul-2026 05:22:46.515) (total time: 5001ms): Trace[662423065]: ["GuaranteedUpdate etcd3" audit-id:a83934de-d829-4d10-8635-787b6228235c,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (05:22:46.515) Trace[662423065]: ---"Txn call failed" err:context canceled 4998ms (05:22:51.515)] Trace[662423065]: [5.001238949s] [5.001238949s] END E0714 05:22:51.517050 1 timeout.go:142] post-timeout activity - time-elapsed: 1.520126ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0714 05:22:51.543983 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0714 05:22:51.544054 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:22:51.545293 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:22:51.545360 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:22:51.546429 1 trace.go:236] Trace[1149375850]: "Get" accept:application/json, */*,audit-id:ff2d929e-306e-4623-bdd8-bc83b662d941,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-Jul-2026 05:22:46.544) (total time: 5002ms): Trace[1149375850]: [5.002356858s] [5.002356858s] END E0714 05:22:51.546573 1 timeout.go:142] post-timeout activity - time-elapsed: 2.516661ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0714 05:22:51.561678 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0714 05:22:51.561763 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:22:51.562887 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:22:51.562924 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:22:51.564102 1 trace.go:236] Trace[1920074645]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8712e8dd-84d5-4c17-8f0c-68a80d747475,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-Jul-2026 05:22:46.562) (total time: 5001ms): Trace[1920074645]: [5.001953938s] [5.001953938s] END E0714 05:22:51.564215 1 timeout.go:142] post-timeout activity - time-elapsed: 2.506491ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0714 05:22:51.804631 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0714 05:22:51.804725 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0714 05:22:51.806202 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0714 05:22:51.806237 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0714 05:22:51.807321 1 trace.go:236] Trace[1860927133]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:93624c0d-fd34-4fc0-92c7-9e0d4e49e55a,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (14-Jul-2026 05:22:46.804) (total time: 5002ms): Trace[1860927133]: [5.002580233s] [5.002580233s] END E0714 05:22:51.807452 1 timeout.go:142] post-timeout activity - time-elapsed: 2.716036ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: I0714 05:22:53.294494 1 trace.go:236] Trace[930087465]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b3637542-6d9e-426b-994d-6e0a2eea0a36,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-Jul-2026 05:22:50.018) (total time: 3275ms): Trace[930087465]: ["GuaranteedUpdate etcd3" audit-id:b3637542-6d9e-426b-994d-6e0a2eea0a36,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 3275ms (05:22:50.018) Trace[930087465]: ---"Txn call completed" 3274ms (05:22:53.294)] Trace[930087465]: [3.275630644s] [3.275630644s] END I0714 05:22:53.295858 1 trace.go:236] Trace[82623742]: "Get" accept:application/json, */*,audit-id:2981f15a-9c10-4c42-b42d-46ba55dbd0b9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:22:46.827) (total time: 6468ms): Trace[82623742]: ---"About to write a response" 6467ms (05:22:53.295) Trace[82623742]: [6.468058734s] [6.468058734s] END I0714 05:22:53.295906 1 trace.go:236] Trace[376956910]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:89b180b6-803b-4833-97a7-4ac570fa3546,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (14-Jul-2026 05:22:50.596) (total time: 2699ms): Trace[376956910]: ["GuaranteedUpdate etcd3" audit-id:89b180b6-803b-4833-97a7-4ac570fa3546,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 2699ms (05:22:50.596) Trace[376956910]: ---"Txn call completed" 2697ms (05:22:53.295)] Trace[376956910]: [2.699352982s] [2.699352982s] END I0714 05:22:53.296121 1 trace.go:236] Trace[1856384620]: "Get" accept:application/json, */*,audit-id:d75fdcd6-adb5-4787-b528-c3eab4211294,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:22:49.419) (total time: 3876ms): Trace[1856384620]: ---"About to write a response" 3876ms (05:22:53.295) Trace[1856384620]: [3.876818726s] [3.876818726s] END I0714 05:22:53.296495 1 trace.go:236] Trace[1577315793]: "Get" accept:application/json, */*,audit-id:56ade0c2-9516-430e-a2d0-1f7159ddf754,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com,user-agent:csi-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:22:47.707) (total time: 5588ms): Trace[1577315793]: ---"About to write a response" 5588ms (05:22:53.296) Trace[1577315793]: [5.588804627s] [5.588804627s] END I0714 05:22:53.296599 1 trace.go:236] Trace[643540622]: "Get" accept:application/json, */*,audit-id:7f5e7695-947d-4903-ba7b-f7ebb8e651f1,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-Jul-2026 05:22:46.825) (total time: 6471ms): Trace[643540622]: ---"About to write a response" 6471ms (05:22:53.296) Trace[643540622]: [6.471155341s] [6.471155341s] END I0714 05:22:53.296781 1 trace.go:236] Trace[1849518241]: "Get" accept:application/json, */*,audit-id:4ba327c0-8743-4e5c-b3e9-81a2d7bf4f92,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:22:49.516) (total time: 3780ms): Trace[1849518241]: ---"About to write a response" 3779ms (05:22:53.296) Trace[1849518241]: [3.780227265s] [3.780227265s] END I0714 05:22:53.296797 1 trace.go:236] Trace[379737039]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0aebff46-def6-4ea6-9047-d2ee3e760620,client:10.0.0.114,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (14-Jul-2026 05:22:51.516) (total time: 1779ms): Trace[379737039]: ---"About to write a response" 1779ms (05:22:53.296) Trace[379737039]: [1.779961253s] [1.779961253s] END I0714 05:22:53.296841 1 trace.go:236] Trace[345017650]: "Get" accept:application/json, */*,audit-id:9177a90b-d9af-4071-9287-bb10c694ccf9,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:22:49.452) (total time: 3844ms): Trace[345017650]: ---"About to write a response" 3844ms (05:22:53.296) Trace[345017650]: [3.844780483s] [3.844780483s] END I0714 05:22:53.297525 1 trace.go:236] Trace[101303266]: "Get" accept:application/json, */*,audit-id:6be1e731-caed-40f7-bc98-cd5a08246a28,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (14-Jul-2026 05:22:46.824) (total time: 6472ms): Trace[101303266]: ---"About to write a response" 6472ms (05:22:53.296) Trace[101303266]: [6.472920065s] [6.472920065s] END I0714 05:22:53.372506 1 trace.go:236] Trace[1503204782]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.22,type:*v1.Endpoints,resource:apiServerIPInfo (14-Jul-2026 05:22:48.495) (total time: 4877ms): Trace[1503204782]: ---"initial value restored" 4800ms (05:22:53.295) Trace[1503204782]: [4.877262718s] [4.877262718s] END I0714 05:22:53.379906 1 trace.go:236] Trace[579662221]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4a71eeb2-c623-4a3f-a2f6-0166969abd36,client:199.204.45.22,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18c2106019dc721a,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (14-Jul-2026 05:22:51.329) (total time: 2050ms): Trace[579662221]: ["GuaranteedUpdate etcd3" audit-id:4a71eeb2-c623-4a3f-a2f6-0166969abd36,key:/events/kube-system/kube-apiserver-instance.18c2106019dc721a,type:*core.Event,resource:events 2050ms (05:22:51.329) Trace[579662221]: ---"initial value restored" 1965ms (05:22:53.295) Trace[579662221]: ---"Transaction prepared" 70ms (05:22:53.366)] Trace[579662221]: ---"Object stored in database" 83ms (05:22:53.379) Trace[579662221]: [2.050579529s] [2.050579529s] END