I0420 08:10:39.519777 1 options.go:220] external host was not specified, using 199.19.213.236 I0420 08:10:39.521941 1 server.go:148] Version: v1.28.13 I0420 08:10:39.522027 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0420 08:10:39.976695 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0420 08:10:39.990317 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0420 08:10:39.990348 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0420 08:10:39.990650 1 instance.go:298] Using reconciler: lease I0420 08:10:40.329107 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0420 08:10:40.329134 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0420 08:10:40.572001 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0420 08:10:40.572153 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0420 08:10:41.006065 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0420 08:10:41.014117 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0420 08:10:41.014144 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0420 08:10:41.014150 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0420 08:10:41.014582 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0420 08:10:41.014597 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0420 08:10:41.015431 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0420 08:10:41.016245 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0420 08:10:41.016260 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0420 08:10:41.016265 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0420 08:10:41.017777 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0420 08:10:41.017794 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0420 08:10:41.018870 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0420 08:10:41.018888 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0420 08:10:41.018893 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0420 08:10:41.019470 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0420 08:10:41.019484 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0420 08:10:41.019526 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0420 08:10:41.020081 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0420 08:10:41.021846 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0420 08:10:41.021864 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0420 08:10:41.021869 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0420 08:10:41.022308 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0420 08:10:41.022325 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0420 08:10:41.022330 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0420 08:10:41.023061 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0420 08:10:41.023077 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0420 08:10:41.024839 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0420 08:10:41.024857 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0420 08:10:41.024863 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0420 08:10:41.025271 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0420 08:10:41.025284 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0420 08:10:41.025288 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0420 08:10:41.026978 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0420 08:10:41.026996 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0420 08:10:41.027007 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0420 08:10:41.028044 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0420 08:10:41.028918 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0420 08:10:41.028934 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0420 08:10:41.028937 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0420 08:10:41.031730 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0420 08:10:41.031744 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0420 08:10:41.031748 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0420 08:10:41.032479 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0420 08:10:41.032492 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0420 08:10:41.032497 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0420 08:10:41.032946 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0420 08:10:41.032960 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0420 08:10:41.072139 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0420 08:10:41.072268 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0420 08:10:41.465016 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0420 08:10:41.465021 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0420 08:10:41.465374 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0420 08:10:41.465662 1 secure_serving.go:213] Serving securely on [::]:6443 I0420 08:10:41.465761 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0420 08:10:41.465875 1 controller.go:78] Starting OpenAPI AggregationController I0420 08:10:41.465914 1 available_controller.go:423] Starting AvailableConditionController I0420 08:10:41.465934 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0420 08:10:41.465965 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0420 08:10:41.466023 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0420 08:10:41.466060 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0420 08:10:41.466085 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0420 08:10:41.466105 1 controller.go:80] Starting OpenAPI V3 AggregationController I0420 08:10:41.466214 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0420 08:10:41.466247 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0420 08:10:41.466545 1 gc_controller.go:78] Starting apiserver lease garbage collector I0420 08:10:41.466614 1 gc_controller.go:78] Starting apiserver lease garbage collector I0420 08:10:41.466682 1 system_namespaces_controller.go:67] Starting system namespaces controller I0420 08:10:41.466743 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0420 08:10:41.467065 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0420 08:10:41.467119 1 aggregator.go:164] waiting for initial CRD sync... I0420 08:10:41.466556 1 controller.go:116] Starting legacy_token_tracking_controller I0420 08:10:41.467156 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0420 08:10:41.466221 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0420 08:10:41.467535 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0420 08:10:41.467557 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0420 08:10:41.468706 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0420 08:10:41.468823 1 controller.go:134] Starting OpenAPI controller I0420 08:10:41.468870 1 controller.go:85] Starting OpenAPI V3 controller I0420 08:10:41.469017 1 naming_controller.go:291] Starting NamingConditionController I0420 08:10:41.469094 1 establishing_controller.go:76] Starting EstablishingController I0420 08:10:41.469129 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0420 08:10:41.469189 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0420 08:10:41.469228 1 crd_finalizer.go:266] Starting CRDFinalizer I0420 08:10:41.566058 1 cache.go:39] Caches are synced for AvailableConditionController controller I0420 08:10:41.566112 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0420 08:10:41.566122 1 apf_controller.go:379] Running API Priority and Fairness config worker I0420 08:10:41.566251 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0420 08:10:41.566401 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0420 08:10:41.567253 1 shared_informer.go:318] Caches are synced for configmaps I0420 08:10:41.567865 1 shared_informer.go:318] Caches are synced for crd-autoregister I0420 08:10:41.567913 1 aggregator.go:166] initial CRD sync complete... I0420 08:10:41.567923 1 autoregister_controller.go:141] Starting autoregister controller I0420 08:10:41.567932 1 cache.go:32] Waiting for caches to sync for autoregister controller I0420 08:10:41.567964 1 cache.go:39] Caches are synced for autoregister controller I0420 08:10:41.569056 1 controller.go:624] quota admission added evaluator for: namespaces I0420 08:10:41.576801 1 shared_informer.go:318] Caches are synced for node_authorizer I0420 08:10:41.589188 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0420 08:10:42.471955 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0420 08:10:42.478028 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0420 08:10:42.478046 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0420 08:10:43.007646 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0420 08:10:43.055420 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0420 08:10:43.185233 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0420 08:10:43.195573 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.19.213.236] I0420 08:10:43.196883 1 controller.go:624] quota admission added evaluator for: endpoints I0420 08:10:43.201739 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0420 08:10:44.207872 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0420 08:10:44.696368 1 controller.go:624] quota admission added evaluator for: deployments.apps I0420 08:10:44.711479 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0420 08:10:44.876590 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0420 08:10:49.252413 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0420 08:10:49.403494 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0420 08:11:09.136964 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0420 08:11:09.136997 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0420 08:11:09.155030 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0420 08:11:09.177805 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0420 08:11:09.197488 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0420 08:11:09.219838 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0420 08:11:09.247243 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0420 08:11:09.247297 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0420 08:11:09.287921 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0420 08:11:09.288004 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0420 08:11:09.310720 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0420 08:11:09.330786 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0420 08:11:09.365873 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0420 08:11:09.365938 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0420 08:11:09.426426 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0420 08:11:09.601975 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0420 08:11:09.602144 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0420 08:11:09.610287 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0420 08:11:09.671789 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0420 08:11:09.684891 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0420 08:11:09.726707 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0420 08:11:09.745332 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0420 08:11:10.436718 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0420 08:11:10.441645 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0420 08:11:10.529735 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0420 08:11:16.435317 1 controller.go:624] quota admission added evaluator for: jobs.batch I0420 08:11:17.253138 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0420 08:11:17.261167 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0420 08:11:17.267342 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0420 08:11:17.272726 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0420 08:11:18.060127 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0420 08:11:18.252976 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0420 08:11:19.738702 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0420 08:11:19.887841 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0420 08:11:20.056475 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0420 08:11:20.487972 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0420 08:11:20.847721 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0420 08:11:29.469168 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0420 08:11:29.469239 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0420 08:11:29.897887 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0420 08:11:38.052687 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.108.223.113"} W0420 08:11:38.082201 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.108.223.113:9443: connect: connection refused E0420 08:11:38.082235 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.108.223.113:9443: connect: connection refused I0420 08:12:40.273402 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.106.168.2"} I0420 08:12:40.281535 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.107.67.119"} E0420 08:17:01.329554 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0420 08:17:01.329654 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0420 08:17:01.329666 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 28.061µs, panicked: false, err: context canceled, panic-reason: E0420 08:17:01.330746 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0420 08:17:01.330890 1 trace.go:236] Trace[712869837]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ab5d32a0-5e8c-4b1b-b7ba-408ff1dc8e63,client:10.0.0.45,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Apr-2026 08:16:56.329) (total time: 5001ms): Trace[712869837]: ["GuaranteedUpdate etcd3" audit-id:ab5d32a0-5e8c-4b1b-b7ba-408ff1dc8e63,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (08:16:56.329) Trace[712869837]: ---"Txn call failed" err:context canceled 4999ms (08:17:01.329)] Trace[712869837]: [5.001385617s] [5.001385617s] END E0420 08:17:01.331036 1 timeout.go:142] post-timeout activity - time-elapsed: 1.50391ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0420 08:17:01.374456 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0420 08:17:01.374608 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0420 08:17:01.375324 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0420 08:17:01.376485 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0420 08:17:01.376518 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0420 08:17:01.376524 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0420 08:17:01.377661 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0420 08:17:01.377717 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0420 08:17:01.377799 1 trace.go:236] Trace[976975317]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6f4a5306-5af6-4e1e-a3c7-a88cbaf08ad6,client:199.19.213.236,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (20-Apr-2026 08:16:56.374) (total time: 5003ms): Trace[976975317]: [5.003754095s] [5.003754095s] END E0420 08:17:01.377929 1 timeout.go:142] post-timeout activity - time-elapsed: 3.498ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: I0420 08:17:01.378955 1 trace.go:236] Trace[338389534]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c4850a27-7098-4567-af07-631f1ad1f188,client:199.19.213.236,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (20-Apr-2026 08:16:56.375) (total time: 5003ms): Trace[338389534]: [5.003622862s] [5.003622862s] END E0420 08:17:01.379038 1 timeout.go:142] post-timeout activity - time-elapsed: 3.662273ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0420 08:17:02.155494 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0420 08:17:02.155619 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0420 08:17:02.157182 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0420 08:17:02.157405 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0420 08:17:02.158347 1 trace.go:236] Trace[828947674]: "Get" accept:application/json, */*,audit-id:bda951ca-7a09-4040-bb52-c92b91389864,client:199.19.213.236,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (20-Apr-2026 08:16:57.155) (total time: 5002ms): Trace[828947674]: [5.002589873s] [5.002589873s] END E0420 08:17:02.158539 1 timeout.go:142] post-timeout activity - time-elapsed: 2.878718ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0420 08:17:02.779541 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0420 08:17:02.779814 1 trace.go:236] Trace[1351656879]: "Update" accept:application/json, */*,audit-id:5a2121a3-6e3f-4b1c-810e-47e8fb0efaf1,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (20-Apr-2026 08:16:55.776) (total time: 7003ms): Trace[1351656879]: ["GuaranteedUpdate etcd3" audit-id:5a2121a3-6e3f-4b1c-810e-47e8fb0efaf1,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (08:16:55.776) Trace[1351656879]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (08:17:02.779)] Trace[1351656879]: [7.003299305s] [7.003299305s] END I0420 08:17:03.558048 1 trace.go:236] Trace[271830016]: "Get" accept:application/json, */*,audit-id:3e035a24-c691-4c87-96e4-9665b192cef2,client:10.0.0.244,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Apr-2026 08:16:55.837) (total time: 7720ms): Trace[271830016]: ---"About to write a response" 7719ms (08:17:03.557) Trace[271830016]: [7.72008245s] [7.72008245s] END I0420 08:17:03.578890 1 trace.go:236] Trace[884658150]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ca5b8d93-b828-4c7a-91d8-b9583b56aa16,client:199.19.213.236,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (20-Apr-2026 08:17:00.029) (total time: 3549ms): Trace[884658150]: ["Create etcd3" audit-id:ca5b8d93-b828-4c7a-91d8-b9583b56aa16,key:/events/kube-system/kube-apiserver-instance.18a802b2d0ca3822,type:*core.Event,resource:events 3548ms (08:17:00.030) Trace[884658150]: ---"Txn call succeeded" 3548ms (08:17:03.578)] Trace[884658150]: [3.549387138s] [3.549387138s] END I0420 08:17:03.579571 1 trace.go:236] Trace[677654484]: "Get" accept:application/json,audit-id:ef990fff-82f8-48fb-9dcd-9404fb4b73d3,client:199.19.213.236,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/kube-system/serviceaccounts/ceph-csi-rbd-nodeplugin,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (20-Apr-2026 08:16:55.855) (total time: 7724ms): Trace[677654484]: ---"About to write a response" 7723ms (08:17:03.579) Trace[677654484]: [7.724169752s] [7.724169752s] END I0420 08:17:03.579895 1 trace.go:236] Trace[1350988371]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:abddb773-ec6f-449d-8085-1416410441a9,client:199.19.213.236,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (20-Apr-2026 08:17:02.660) (total time: 919ms): Trace[1350988371]: ["GuaranteedUpdate etcd3" audit-id:abddb773-ec6f-449d-8085-1416410441a9,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 919ms (08:17:02.660) Trace[1350988371]: ---"Txn call completed" 917ms (08:17:03.579)] Trace[1350988371]: [919.394196ms] [919.394196ms] END I0420 08:17:03.583761 1 trace.go:236] Trace[2084801674]: "Get" accept:application/json,audit-id:42074a64-f453-46e8-8085-dddfeaf791a1,client:199.19.213.236,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/kube-system/secrets/kubeadm-certs,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (20-Apr-2026 08:16:55.869) (total time: 7714ms): Trace[2084801674]: ---"About to write a response" 7714ms (08:17:03.583) Trace[2084801674]: [7.714557647s] [7.714557647s] END I0420 08:17:03.583804 1 trace.go:236] Trace[943850620]: "Get" accept:application/json, */*,audit-id:a46677c7-0928-48f0-a250-f018de364e9a,client:10.0.0.244,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Apr-2026 08:16:59.595) (total time: 3987ms): Trace[943850620]: ---"About to write a response" 3987ms (08:17:03.583) Trace[943850620]: [3.987832051s] [3.987832051s] END I0420 08:17:03.583987 1 trace.go:236] Trace[1648049454]: "Get" accept:application/json, */*,audit-id:43312b0b-6695-4795-ac80-c5db4ac2b0c2,client:10.0.0.244,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (20-Apr-2026 08:16:56.521) (total time: 7062ms): Trace[1648049454]: ---"About to write a response" 7062ms (08:17:03.583) Trace[1648049454]: [7.06293774s] [7.06293774s] END I0420 08:17:03.584075 1 trace.go:236] Trace[1189977893]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e684d97d-57e1-431a-b116-f028ad81399c,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (20-Apr-2026 08:16:59.380) (total time: 4203ms): Trace[1189977893]: ["GuaranteedUpdate etcd3" audit-id:e684d97d-57e1-431a-b116-f028ad81399c,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 4203ms (08:16:59.380) Trace[1189977893]: ---"Txn call completed" 4202ms (08:17:03.583)] Trace[1189977893]: [4.203396165s] [4.203396165s] END I0420 08:17:03.584221 1 trace.go:236] Trace[1143810453]: "Get" accept:application/json, */*,audit-id:039e9cf8-3f13-4e6c-bfc1-1bc05cfacc5b,client:10.0.0.244,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Apr-2026 08:16:58.480) (total time: 5103ms): Trace[1143810453]: ---"About to write a response" 5103ms (08:17:03.583) Trace[1143810453]: [5.103761406s] [5.103761406s] END I0420 08:17:03.584322 1 trace.go:236] Trace[1526745135]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fac19ae0-41a2-4d74-9bfb-944d45aed733,client:10.0.0.45,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (20-Apr-2026 08:17:01.330) (total time: 2253ms): Trace[1526745135]: ---"About to write a response" 2253ms (08:17:03.584) Trace[1526745135]: [2.253821326s] [2.253821326s] END I0420 08:17:03.584530 1 trace.go:236] Trace[1072758403]: "Get" accept:application/json, */*,audit-id:5b35f022-9347-488d-b333-82234b5dc042,client:10.0.0.244,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com,user-agent:csi-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Apr-2026 08:16:57.205) (total time: 6378ms): Trace[1072758403]: ---"About to write a response" 6378ms (08:17:03.584) Trace[1072758403]: [6.378831814s] [6.378831814s] END I0420 08:17:03.586890 1 trace.go:236] Trace[43204465]: "Get" accept:application/json, */*,audit-id:d6588a57-af1c-49f8-8531-7285c44c15e4,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Apr-2026 08:16:57.777) (total time: 5809ms): Trace[43204465]: ---"About to write a response" 5805ms (08:17:03.583) Trace[43204465]: [5.809025428s] [5.809025428s] END