I0626 02:21:28.398143 1 options.go:220] external host was not specified, using 199.19.213.102 I0626 02:21:28.398957 1 server.go:148] Version: v1.28.13 I0626 02:21:28.398998 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0626 02:21:28.650946 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0626 02:21:28.659183 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0626 02:21:28.659207 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0626 02:21:28.659450 1 instance.go:298] Using reconciler: lease I0626 02:21:29.183568 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0626 02:21:29.183593 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0626 02:21:29.469629 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0626 02:21:29.469860 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0626 02:21:29.995183 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0626 02:21:30.017850 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0626 02:21:30.017891 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0626 02:21:30.017899 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0626 02:21:30.018573 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0626 02:21:30.018589 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0626 02:21:30.019620 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0626 02:21:30.020456 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0626 02:21:30.020474 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0626 02:21:30.020479 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0626 02:21:30.022229 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0626 02:21:30.022247 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0626 02:21:30.023338 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0626 02:21:30.023356 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0626 02:21:30.023360 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0626 02:21:30.024023 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0626 02:21:30.024041 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0626 02:21:30.024086 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0626 02:21:30.024750 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0626 02:21:30.032925 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0626 02:21:30.032942 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0626 02:21:30.032946 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0626 02:21:30.033525 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0626 02:21:30.033542 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0626 02:21:30.033546 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0626 02:21:30.034340 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0626 02:21:30.034356 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0626 02:21:30.036057 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0626 02:21:30.036073 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0626 02:21:30.036077 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0626 02:21:30.036532 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0626 02:21:30.036552 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0626 02:21:30.036556 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0626 02:21:30.038630 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0626 02:21:30.038647 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0626 02:21:30.038651 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0626 02:21:30.045326 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0626 02:21:30.046462 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0626 02:21:30.046480 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0626 02:21:30.046484 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0626 02:21:30.055164 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0626 02:21:30.055180 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0626 02:21:30.055185 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0626 02:21:30.056027 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0626 02:21:30.056043 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0626 02:21:30.056047 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0626 02:21:30.056521 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0626 02:21:30.056538 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0626 02:21:30.096430 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0626 02:21:30.096451 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0626 02:21:30.810246 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0626 02:21:30.810239 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0626 02:21:30.810762 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0626 02:21:30.811433 1 secure_serving.go:213] Serving securely on [::]:6443 I0626 02:21:30.811500 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0626 02:21:30.811641 1 controller.go:80] Starting OpenAPI V3 AggregationController I0626 02:21:30.811564 1 available_controller.go:423] Starting AvailableConditionController I0626 02:21:30.811695 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0626 02:21:30.811723 1 system_namespaces_controller.go:67] Starting system namespaces controller I0626 02:21:30.811851 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0626 02:21:30.811891 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0626 02:21:30.812157 1 gc_controller.go:78] Starting apiserver lease garbage collector I0626 02:21:30.812232 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0626 02:21:30.812305 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0626 02:21:30.811727 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0626 02:21:30.812448 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0626 02:21:30.812454 1 aggregator.go:164] waiting for initial CRD sync... I0626 02:21:30.811587 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0626 02:21:30.812877 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0626 02:21:30.813064 1 gc_controller.go:78] Starting apiserver lease garbage collector I0626 02:21:30.813177 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0626 02:21:30.813459 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0626 02:21:30.813924 1 controller.go:116] Starting legacy_token_tracking_controller I0626 02:21:30.813947 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0626 02:21:30.811739 1 controller.go:78] Starting OpenAPI AggregationController I0626 02:21:30.814154 1 controller.go:85] Starting OpenAPI V3 controller I0626 02:21:30.814230 1 naming_controller.go:291] Starting NamingConditionController I0626 02:21:30.814297 1 establishing_controller.go:76] Starting EstablishingController I0626 02:21:30.814367 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0626 02:21:30.814416 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0626 02:21:30.814124 1 controller.go:134] Starting OpenAPI controller I0626 02:21:30.815645 1 crd_finalizer.go:266] Starting CRDFinalizer I0626 02:21:30.834636 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0626 02:21:30.834655 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0626 02:21:30.851641 1 shared_informer.go:318] Caches are synced for node_authorizer I0626 02:21:30.912337 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0626 02:21:30.912439 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0626 02:21:30.912492 1 cache.go:39] Caches are synced for AvailableConditionController controller I0626 02:21:30.912598 1 apf_controller.go:379] Running API Priority and Fairness config worker I0626 02:21:30.912690 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0626 02:21:30.914086 1 shared_informer.go:318] Caches are synced for configmaps I0626 02:21:30.914837 1 controller.go:624] quota admission added evaluator for: namespaces I0626 02:21:30.924185 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0626 02:21:30.937390 1 shared_informer.go:318] Caches are synced for crd-autoregister I0626 02:21:30.938293 1 aggregator.go:166] initial CRD sync complete... I0626 02:21:30.938318 1 autoregister_controller.go:141] Starting autoregister controller I0626 02:21:30.938524 1 cache.go:32] Waiting for caches to sync for autoregister controller I0626 02:21:30.938574 1 cache.go:39] Caches are synced for autoregister controller I0626 02:21:31.819483 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0626 02:21:31.826371 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0626 02:21:31.826396 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0626 02:21:32.641778 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0626 02:21:32.694881 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0626 02:21:32.829265 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0626 02:21:32.838581 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.19.213.102] I0626 02:21:32.840503 1 controller.go:624] quota admission added evaluator for: endpoints I0626 02:21:32.846654 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0626 02:21:33.666353 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0626 02:21:34.504979 1 controller.go:624] quota admission added evaluator for: deployments.apps I0626 02:21:34.520575 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0626 02:21:34.726115 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0626 02:21:38.755013 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0626 02:21:38.806436 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0626 02:22:11.543102 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0626 02:22:11.601090 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0626 02:22:11.601136 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0626 02:22:11.760553 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0626 02:22:11.780983 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0626 02:22:11.808833 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0626 02:22:11.826832 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0626 02:22:11.910737 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0626 02:22:11.913458 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0626 02:22:11.929130 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0626 02:22:11.963578 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0626 02:22:11.963631 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0626 02:22:12.003637 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0626 02:22:12.003802 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0626 02:22:12.102798 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0626 02:22:12.174622 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:22:12.305789 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:22:12.483876 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0626 02:22:12.484013 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0626 02:22:12.605252 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:22:12.712391 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0626 02:22:12.712537 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0626 02:22:12.770252 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0626 02:22:12.825489 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:22:12.881705 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:22:12.922263 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0626 02:22:12.943550 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0626 02:22:13.496477 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:22:13.522153 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0626 02:22:13.541063 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0626 02:22:14.093400 1 trace.go:236] Trace[1757937283]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b939b6eb-442f-4c05-b55c-188cba7625e8,client:::1,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/securitypolicies.gateway.envoyproxy.io/status,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:22:13.544) (total time: 548ms): Trace[1757937283]: ["GuaranteedUpdate etcd3" audit-id:b939b6eb-442f-4c05-b55c-188cba7625e8,key:/apiextensions.k8s.io/customresourcedefinitions/securitypolicies.gateway.envoyproxy.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 544ms (02:22:13.549) Trace[1757937283]: ---"Txn call completed" 479ms (02:22:14.073)] Trace[1757937283]: [548.993018ms] [548.993018ms] END I0626 02:22:14.102177 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0626 02:22:14.987301 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0626 02:22:15.431144 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0626 02:22:16.013386 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0626 02:22:16.365234 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0626 02:22:22.130053 1 trace.go:236] Trace[1266268523]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7342c83c-c014-4c93-9a8d-9590b16f443b,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:22:21.610) (total time: 519ms): Trace[1266268523]: ---"About to write a response" 519ms (02:22:22.129) Trace[1266268523]: [519.639065ms] [519.639065ms] END I0626 02:22:22.154174 1 trace.go:236] Trace[1791007641]: "Update" accept:application/json, */*,audit-id:14259b18-6f16-4500-a56f-6b115a6c5f88,client:199.19.213.102,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/secrets/sh.helm.release.v1.envoy-gateway.v1,user-agent:Helm/3.11.2,verb:PUT (26-Jun-2026 02:22:21.511) (total time: 642ms): Trace[1791007641]: ---"Conversion done" 19ms (02:22:21.536) Trace[1791007641]: ["GuaranteedUpdate etcd3" audit-id:14259b18-6f16-4500-a56f-6b115a6c5f88,key:/secrets/envoy-gateway-system/sh.helm.release.v1.envoy-gateway.v1,type:*core.Secret,resource:secrets 617ms (02:22:21.536) Trace[1791007641]: ---"Txn call completed" 580ms (02:22:22.126)] Trace[1791007641]: ---"Writing http response done" 27ms (02:22:22.154) Trace[1791007641]: [642.168832ms] [642.168832ms] END I0626 02:22:23.128094 1 controller.go:624] quota admission added evaluator for: jobs.batch I0626 02:22:24.371150 1 trace.go:236] Trace[909640323]: "Get" accept:application/json, */*,audit-id:5341b61e-d142-4829-b689-d6dbe70d0801,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:22:23.847) (total time: 523ms): Trace[909640323]: ---"About to write a response" 522ms (02:22:24.370) Trace[909640323]: [523.224282ms] [523.224282ms] END I0626 02:22:24.371320 1 trace.go:236] Trace[375261506]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:bb0d0b0b-2946-4f2e-803c-082a5ebf50e8,client:199.19.213.102,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/pods,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:POST (26-Jun-2026 02:22:23.160) (total time: 1210ms): Trace[375261506]: ["Create etcd3" audit-id:bb0d0b0b-2946-4f2e-803c-082a5ebf50e8,key:/pods/envoy-gateway-system/envoy-gateway-gateway-helm-certgen-9m8zm,type:*core.Pod,resource:pods 1207ms (02:22:23.164) Trace[375261506]: ---"Txn call succeeded" 1206ms (02:22:24.370)] Trace[375261506]: [1.210956851s] [1.210956851s] END W0626 02:22:35.571638 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0626 02:22:35.572362 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0626 02:22:36.317861 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0626 02:22:41.675076 1 trace.go:236] Trace[1711991112]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b21740d1-27fc-4127-a0d7-e0945bd1491c,client:199.19.213.102,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/pods/envoy-gateway-gateway-helm-certgen-9m8zm/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 02:22:41.157) (total time: 517ms): Trace[1711991112]: ["GuaranteedUpdate etcd3" audit-id:b21740d1-27fc-4127-a0d7-e0945bd1491c,key:/pods/envoy-gateway-system/envoy-gateway-gateway-helm-certgen-9m8zm,type:*core.Pod,resource:pods 517ms (02:22:41.157) Trace[1711991112]: ---"Txn call completed" 511ms (02:22:41.674)] Trace[1711991112]: ---"Object stored in database" 511ms (02:22:41.674) Trace[1711991112]: [517.830581ms] [517.830581ms] END I0626 02:22:45.059575 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.108.40.218"} W0626 02:22:45.090890 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.108.40.218:9443: connect: connection refused E0626 02:22:45.090926 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.108.40.218:9443: connect: connection refused I0626 02:23:17.582095 1 trace.go:236] Trace[262666724]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:eada2007-1c31-465d-9d27-2f84ad627b38,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 02:23:16.878) (total time: 703ms): Trace[262666724]: ["GuaranteedUpdate etcd3" audit-id:eada2007-1c31-465d-9d27-2f84ad627b38,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 703ms (02:23:16.878) Trace[262666724]: ---"Txn call completed" 702ms (02:23:17.581)] Trace[262666724]: [703.734116ms] [703.734116ms] END I0626 02:23:18.761424 1 trace.go:236] Trace[1010296041]: "Update" accept:application/json, */*,audit-id:5d5fd108-2c6a-48c7-92c5-412f23c5646e,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:23:17.584) (total time: 1177ms): Trace[1010296041]: ["GuaranteedUpdate etcd3" audit-id:5d5fd108-2c6a-48c7-92c5-412f23c5646e,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1176ms (02:23:17.584) Trace[1010296041]: ---"Txn call completed" 1175ms (02:23:18.760)] Trace[1010296041]: [1.17710845s] [1.17710845s] END I0626 02:23:19.124650 1 trace.go:236] Trace[1533316233]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ffa4b1bf-78d4-4686-88c1-eb538a5f1c77,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:23:18.253) (total time: 871ms): Trace[1533316233]: ["GuaranteedUpdate etcd3" audit-id:ffa4b1bf-78d4-4686-88c1-eb538a5f1c77,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 871ms (02:23:18.253) Trace[1533316233]: ---"Txn call completed" 869ms (02:23:19.124)] Trace[1533316233]: [871.412418ms] [871.412418ms] END I0626 02:23:48.690516 1 trace.go:236] Trace[358110681]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f97729c8-624a-4a77-b633-81f0335031e2,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:23:48.145) (total time: 545ms): Trace[358110681]: ["GuaranteedUpdate etcd3" audit-id:f97729c8-624a-4a77-b633-81f0335031e2,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 545ms (02:23:48.145) Trace[358110681]: ---"Txn call completed" 544ms (02:23:48.690)] Trace[358110681]: [545.245765ms] [545.245765ms] END I0626 02:23:49.670593 1 trace.go:236] Trace[1094011475]: "Get" accept:application/json, */*,audit-id:d076f7c0-6306-4b98-a874-571331b4fc15,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:23:48.983) (total time: 686ms): Trace[1094011475]: ---"About to write a response" 686ms (02:23:49.670) Trace[1094011475]: [686.992974ms] [686.992974ms] END I0626 02:23:52.921171 1 trace.go:236] Trace[1372242576]: "Update" accept:application/json, */*,audit-id:7ddaeb62-6452-4616-bb99-f6ce796628b7,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:23:52.323) (total time: 597ms): Trace[1372242576]: ["GuaranteedUpdate etcd3" audit-id:7ddaeb62-6452-4616-bb99-f6ce796628b7,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 596ms (02:23:52.324) Trace[1372242576]: ---"Txn call completed" 594ms (02:23:52.920)] Trace[1372242576]: [597.132618ms] [597.132618ms] END I0626 02:23:52.921597 1 trace.go:236] Trace[1765343749]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c51980d2-16fb-4db8-ad5b-6cacc0fc59cf,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 02:23:52.324) (total time: 596ms): Trace[1765343749]: ["GuaranteedUpdate etcd3" audit-id:c51980d2-16fb-4db8-ad5b-6cacc0fc59cf,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 596ms (02:23:52.325) Trace[1765343749]: ---"Txn call completed" 594ms (02:23:52.921)] Trace[1765343749]: [596.652798ms] [596.652798ms] END I0626 02:23:52.921610 1 trace.go:236] Trace[82254435]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3161283a-fc7c-4896-8d04-9ecd9384b3ce,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 02:23:52.324) (total time: 596ms): Trace[82254435]: ["GuaranteedUpdate etcd3" audit-id:3161283a-fc7c-4896-8d04-9ecd9384b3ce,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 596ms (02:23:52.324) Trace[82254435]: ---"Txn call completed" 595ms (02:23:52.921)] Trace[82254435]: [596.963004ms] [596.963004ms] END I0626 02:23:52.922283 1 trace.go:236] Trace[156546226]: "Update" accept:application/json, */*,audit-id:21a9adbe-987d-4e34-9877-fbe8e6f7ad5d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 02:23:52.324) (total time: 597ms): Trace[156546226]: ["GuaranteedUpdate etcd3" audit-id:21a9adbe-987d-4e34-9877-fbe8e6f7ad5d,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 597ms (02:23:52.324) Trace[156546226]: ---"Txn call completed" 595ms (02:23:52.921)] Trace[156546226]: [597.735272ms] [597.735272ms] END I0626 02:24:02.336035 1 trace.go:236] Trace[861248316]: "Update" accept:application/json, */*,audit-id:d9ba758c-b298-4967-a4ba-9f81c8412453,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 02:23:58.503) (total time: 3832ms): Trace[861248316]: ["GuaranteedUpdate etcd3" audit-id:d9ba758c-b298-4967-a4ba-9f81c8412453,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3831ms (02:23:58.504) Trace[861248316]: ---"Txn call completed" 3830ms (02:24:02.335)] Trace[861248316]: [3.832083374s] [3.832083374s] END I0626 02:24:02.874887 1 trace.go:236] Trace[1835553926]: "Get" accept:application/json, */*,audit-id:2a5936a2-eee2-4bba-aa0a-c5926e083150,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:23:58.950) (total time: 3924ms): Trace[1835553926]: ---"About to write a response" 3924ms (02:24:02.874) Trace[1835553926]: [3.92469506s] [3.92469506s] END I0626 02:24:02.875214 1 trace.go:236] Trace[262442308]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0a314027-3b8c-4b16-98a9-ac7442c0779d,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:23:58.952) (total time: 3922ms): Trace[262442308]: ---"About to write a response" 3922ms (02:24:02.874) Trace[262442308]: [3.922730166s] [3.922730166s] END I0626 02:24:02.875448 1 trace.go:236] Trace[1251014758]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b2498784-db7d-43f0-bdf3-429ba1173b42,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:00.085) (total time: 2789ms): Trace[1251014758]: ["GuaranteedUpdate etcd3" audit-id:b2498784-db7d-43f0-bdf3-429ba1173b42,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 2789ms (02:24:00.086) Trace[1251014758]: ---"Txn call completed" 2787ms (02:24:02.875)] Trace[1251014758]: [2.78943493s] [2.78943493s] END I0626 02:24:02.876034 1 trace.go:236] Trace[108195701]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4f5dbb59-441b-4b21-9414-695ca9d7e055,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:23:59.055) (total time: 3820ms): Trace[108195701]: ["GuaranteedUpdate etcd3" audit-id:4f5dbb59-441b-4b21-9414-695ca9d7e055,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 3820ms (02:23:59.055) Trace[108195701]: ---"Txn call completed" 3818ms (02:24:02.875)] Trace[108195701]: [3.820943661s] [3.820943661s] END I0626 02:24:02.876524 1 trace.go:236] Trace[1335203275]: "Get" accept:application/json, */*,audit-id:91760c23-491a-492a-a069-7e0449ce397f,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:23:58.951) (total time: 3925ms): Trace[1335203275]: ---"About to write a response" 3925ms (02:24:02.876) Trace[1335203275]: [3.925453658s] [3.925453658s] END I0626 02:24:02.876542 1 trace.go:236] Trace[1002548781]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:cab0bd39-be49-43be-9151-19515be3f207,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:23:58.945) (total time: 3930ms): Trace[1002548781]: ---"About to write a response" 3930ms (02:24:02.876) Trace[1002548781]: [3.930766568s] [3.930766568s] END I0626 02:24:04.118696 1 trace.go:236] Trace[388556232]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.102,type:*v1.Endpoints,resource:apiServerIPInfo (26-Jun-2026 02:24:02.832) (total time: 1286ms): Trace[388556232]: ---"Transaction prepared" 451ms (02:24:03.325) Trace[388556232]: ---"Txn call completed" 792ms (02:24:04.118) Trace[388556232]: [1.286405283s] [1.286405283s] END I0626 02:24:04.469239 1 trace.go:236] Trace[88999196]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5b7c7a57-2ec3-409d-9832-9f4c09447a76,client:199.19.213.102,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (26-Jun-2026 02:24:02.881) (total time: 1587ms): Trace[88999196]: ["Create etcd3" audit-id:5b7c7a57-2ec3-409d-9832-9f4c09447a76,key:/events/kube-system/kube-apiserver-instance.18bc80522812c944,type:*core.Event,resource:events 1587ms (02:24:02.881) Trace[88999196]: ---"TransformToStorage succeeded" 444ms (02:24:03.326) Trace[88999196]: ---"Txn call succeeded" 1142ms (02:24:04.468)] Trace[88999196]: [1.587903658s] [1.587903658s] END I0626 02:24:04.835455 1 trace.go:236] Trace[1094959523]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:13591233-146d-4ac7-8cf4-e38194544a00,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:24:04.136) (total time: 699ms): Trace[1094959523]: ["GuaranteedUpdate etcd3" audit-id:13591233-146d-4ac7-8cf4-e38194544a00,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 698ms (02:24:04.136) Trace[1094959523]: ---"Txn call completed" 697ms (02:24:04.835)] Trace[1094959523]: [699.040256ms] [699.040256ms] END I0626 02:24:04.836226 1 trace.go:236] Trace[2085797923]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:bea75be0-d9c3-42d1-8457-6fbc92c7cff2,client:::1,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/default/endpoints/kubernetes,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 02:24:04.119) (total time: 716ms): Trace[2085797923]: ---"About to write a response" 716ms (02:24:04.836) Trace[2085797923]: [716.264836ms] [716.264836ms] END I0626 02:24:23.106495 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.97.240.128"} I0626 02:24:23.117644 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.103.208.69"} I0626 02:24:27.643167 1 trace.go:236] Trace[2082323077]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d0802c58-1956-44e1-b24d-9354ef76a215,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 02:24:26.992) (total time: 650ms): Trace[2082323077]: ["GuaranteedUpdate etcd3" audit-id:d0802c58-1956-44e1-b24d-9354ef76a215,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 650ms (02:24:26.992) Trace[2082323077]: ---"Txn call completed" 649ms (02:24:27.642)] Trace[2082323077]: [650.845615ms] [650.845615ms] END I0626 02:24:28.184853 1 trace.go:236] Trace[837635832]: "Update" accept:application/json, */*,audit-id:91ebc69c-07c3-40b4-8d21-d1cbe5f3ca7b,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:26.995) (total time: 1189ms): Trace[837635832]: ["GuaranteedUpdate etcd3" audit-id:91ebc69c-07c3-40b4-8d21-d1cbe5f3ca7b,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1189ms (02:24:26.995) Trace[837635832]: ---"Txn call completed" 1188ms (02:24:28.184)] Trace[837635832]: [1.189601111s] [1.189601111s] END E0626 02:24:38.671146 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0626 02:24:38.671341 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:38.672316 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:38.672491 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:38.673819 1 trace.go:236] Trace[1083979751]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:710aeb9f-f254-4f76-a281-cc9e7d936bbd,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:24:33.670) (total time: 5002ms): Trace[1083979751]: [5.002835289s] [5.002835289s] END E0626 02:24:38.674109 1 timeout.go:142] post-timeout activity - time-elapsed: 2.801883ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0626 02:24:39.214110 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:39.214170 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:39.214207 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 11.801µs, panicked: false, err: context deadline exceeded, panic-reason: E0626 02:24:39.215585 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:39.215681 1 trace.go:236] Trace[1057923003]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:90cd33fb-ea77-4bac-923f-18ab510f294f,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:34.214) (total time: 5001ms): Trace[1057923003]: ["GuaranteedUpdate etcd3" audit-id:90cd33fb-ea77-4bac-923f-18ab510f294f,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (02:24:34.214) Trace[1057923003]: ---"Txn call failed" err:context deadline exceeded 4998ms (02:24:39.213)] Trace[1057923003]: [5.001594212s] [5.001594212s] END E0626 02:24:39.215828 1 timeout.go:142] post-timeout activity - time-elapsed: 1.595477ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0626 02:24:39.222205 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:39.222320 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:39.224317 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:39.224414 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:39.225621 1 trace.go:236] Trace[864508452]: "Get" accept:application/json, */*,audit-id:ccfb461d-8938-47ab-9880-af0287140887,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:24:34.222) (total time: 5003ms): Trace[864508452]: [5.003246228s] [5.003246228s] END E0626 02:24:39.225748 1 timeout.go:142] post-timeout activity - time-elapsed: 3.55021ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0626 02:24:39.814471 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0626 02:24:39.814633 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:39.815803 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:39.815880 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:39.817112 1 trace.go:236] Trace[683546767]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0d0b73c3-76dd-41c8-bce3-02c4ff5d245e,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:24:34.815) (total time: 5001ms): Trace[683546767]: [5.001902547s] [5.001902547s] END E0626 02:24:39.817351 1 timeout.go:142] post-timeout activity - time-elapsed: 2.712891ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: I0626 02:24:39.842528 1 trace.go:236] Trace[1220562473]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.102,type:*v1.Endpoints,resource:apiServerIPInfo (26-Jun-2026 02:24:32.835) (total time: 7007ms): Trace[1220562473]: [7.007463333s] [7.007463333s] END E0626 02:24:39.842568 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0626 02:24:40.914936 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0626 02:24:40.915169 1 trace.go:236] Trace[1606425653]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:52ab0b6d-e1e8-42af-8a98-18383099e85f,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:24:33.911) (total time: 7003ms): Trace[1606425653]: ["GuaranteedUpdate etcd3" audit-id:52ab0b6d-e1e8-42af-8a98-18383099e85f,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:24:33.911) Trace[1606425653]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:24:40.914)] Trace[1606425653]: [7.003607987s] [7.003607987s] END E0626 02:24:42.615361 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0626 02:24:42.615590 1 trace.go:236] Trace[953750148]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:222cffdd-f042-4dea-94fe-f6b9d964afdc,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:24:35.611) (total time: 7003ms): Trace[953750148]: ["GuaranteedUpdate etcd3" audit-id:222cffdd-f042-4dea-94fe-f6b9d964afdc,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:24:35.611) Trace[953750148]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:24:42.615)] Trace[953750148]: [7.0037419s] [7.0037419s] END E0626 02:24:42.616257 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0626 02:24:42.833365 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0626 02:24:42.833681 1 trace.go:236] Trace[439905040]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2674be70-9e6f-4332-a35a-2f60fdfc25e9,client:199.19.213.102,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (26-Jun-2026 02:24:35.829) (total time: 7003ms): Trace[439905040]: ["Create etcd3" audit-id:2674be70-9e6f-4332-a35a-2f60fdfc25e9,key:/events/kube-system/kube-apiserver-instance.18bc8059d3f8022d,type:*core.Event,resource:events 7003ms (02:24:35.830) Trace[439905040]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:24:42.833)] Trace[439905040]: [7.003869513s] [7.003869513s] END E0626 02:24:43.671559 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:43.672338 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:43.673546 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:43.673609 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:43.674754 1 trace.go:236] Trace[1331537052]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:07096605-a4fa-4452-a326-80a798a0dbc2,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:24:40.673) (total time: 3001ms): Trace[1331537052]: [3.00113306s] [3.00113306s] END E0626 02:24:43.675117 1 timeout.go:142] post-timeout activity - time-elapsed: 3.10042ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0626 02:24:44.213939 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:44.214109 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:44.215544 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:44.215622 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:44.216923 1 trace.go:236] Trace[1078691425]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7e0e1207-251d-43bf-8f1f-5e62597779e3,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:24:39.214) (total time: 5002ms): Trace[1078691425]: [5.002138592s] [5.002138592s] END E0626 02:24:44.217079 1 timeout.go:142] post-timeout activity - time-elapsed: 3.169201ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0626 02:24:44.221702 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:44.221814 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:44.221929 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:44.222848 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:44.222992 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0626 02:24:44.223309 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:44.224052 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0626 02:24:44.224082 1 trace.go:236] Trace[1659996296]: "Get" accept:application/json, */*,audit-id:397ee5c6-4f96-4d80-aab6-11739f12ba2a,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:24:41.223) (total time: 3000ms): Trace[1659996296]: [3.000177807s] [3.000177807s] END E0626 02:24:44.224254 1 timeout.go:142] post-timeout activity - time-elapsed: 2.516496ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0626 02:24:44.225243 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:44.225492 1 trace.go:236] Trace[188064257]: "Get" accept:application/json, */*,audit-id:f1fae352-a300-440c-bfd6-ec0c5e9c8f1d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:34.221) (total time: 10003ms): Trace[188064257]: [10.003528648s] [10.003528648s] END E0626 02:24:44.225605 1 timeout.go:142] post-timeout activity - time-elapsed: 3.654082ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0626 02:24:44.505458 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:44.505574 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:44.506879 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:44.506949 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:44.508045 1 trace.go:236] Trace[1904027633]: "Get" accept:application/json, */*,audit-id:5f1b7505-c7b4-475d-a3f8-c8ff207e7f2b,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:24:34.505) (total time: 10002ms): Trace[1904027633]: [10.002154068s] [10.002154068s] END E0626 02:24:44.508299 1 timeout.go:142] post-timeout activity - time-elapsed: 2.804583ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0626 02:24:44.814652 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0626 02:24:44.814811 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:44.816149 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:44.816192 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:44.817466 1 trace.go:236] Trace[1493859723]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b0a42c13-0e56-449b-bb27-bef5f3a53543,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:24:41.816) (total time: 3001ms): Trace[1493859723]: [3.001068375s] [3.001068375s] END E0626 02:24:44.817651 1 timeout.go:142] post-timeout activity - time-elapsed: 2.973287ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0626 02:24:47.921633 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0626 02:24:47.921829 1 trace.go:236] Trace[1474223770]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8b87c881-f821-4d3d-aea6-869a56c1f427,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:24:40.917) (total time: 7004ms): Trace[1474223770]: ["GuaranteedUpdate etcd3" audit-id:8b87c881-f821-4d3d-aea6-869a56c1f427,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (02:24:40.917) Trace[1474223770]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:24:47.921)] Trace[1474223770]: [7.004308836s] [7.004308836s] END E0626 02:24:49.222563 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:49.222606 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:49.222633 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 6.84µs, panicked: false, err: context deadline exceeded, panic-reason: E0626 02:24:49.224092 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:49.224240 1 trace.go:236] Trace[1794169369]: "Update" accept:application/json, */*,audit-id:9c7f16af-a5f6-408f-a17f-0274586fcbea,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:24:44.222) (total time: 5001ms): Trace[1794169369]: ["GuaranteedUpdate etcd3" audit-id:9c7f16af-a5f6-408f-a17f-0274586fcbea,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (02:24:44.223) Trace[1794169369]: ---"Txn call failed" err:context deadline exceeded 4998ms (02:24:49.222)] Trace[1794169369]: [5.001303338s] [5.001303338s] END E0626 02:24:49.224478 1 timeout.go:142] post-timeout activity - time-elapsed: 1.753429ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0626 02:24:49.621049 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0626 02:24:49.621272 1 trace.go:236] Trace[1850053539]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:bb6e8734-3184-4e0d-a001-ab6cd79e402f,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:24:42.617) (total time: 7003ms): Trace[1850053539]: ["GuaranteedUpdate etcd3" audit-id:bb6e8734-3184-4e0d-a001-ab6cd79e402f,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:24:42.617) Trace[1850053539]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:24:49.620)] Trace[1850053539]: [7.003983017s] [7.003983017s] END E0626 02:24:49.622145 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0626 02:24:49.816398 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0626 02:24:49.816434 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0626 02:24:49.816599 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 108.533µs, panicked: false, err: context canceled, panic-reason: E0626 02:24:49.818251 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0626 02:24:49.818515 1 trace.go:236] Trace[166859016]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:903ee797-c621-4008-b3d2-2b6fecdd21db,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (26-Jun-2026 02:24:44.816) (total time: 5002ms): Trace[166859016]: ["GuaranteedUpdate etcd3" audit-id:903ee797-c621-4008-b3d2-2b6fecdd21db,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (02:24:44.816) Trace[166859016]: ---"Txn call failed" err:context canceled 4999ms (02:24:49.816)] Trace[166859016]: [5.002144188s] [5.002144188s] END E0626 02:24:49.818719 1 timeout.go:142] post-timeout activity - time-elapsed: 2.393033ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: I0626 02:24:50.934155 1 trace.go:236] Trace[635317723]: "Create" accept:application/json, */*,audit-id:ed0cc4b0-fd70-489f-a6c8-b9a2b9b0b96f,client:10.0.0.76,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (26-Jun-2026 02:24:44.216) (total time: 6717ms): Trace[635317723]: ["Create etcd3" audit-id:ed0cc4b0-fd70-489f-a6c8-b9a2b9b0b96f,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18bc805bc7c22454,type:*core.Event,resource:events 6716ms (02:24:44.217) Trace[635317723]: ---"Txn call succeeded" 6716ms (02:24:50.933)] Trace[635317723]: [6.717835274s] [6.717835274s] END I0626 02:24:50.935610 1 trace.go:236] Trace[1857564380]: "Update" accept:application/json, */*,audit-id:d6695d37-df35-4a0b-b06e-974fa38947c9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 02:24:44.223) (total time: 6711ms): Trace[1857564380]: ["GuaranteedUpdate etcd3" audit-id:d6695d37-df35-4a0b-b06e-974fa38947c9,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 6711ms (02:24:44.223) Trace[1857564380]: ---"Txn call completed" 6710ms (02:24:50.935)] Trace[1857564380]: [6.711782308s] [6.711782308s] END I0626 02:24:50.936096 1 trace.go:236] Trace[1412063122]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ec1faf46-5efd-42fd-876c-9be6ccffead7,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:24:49.623) (total time: 1312ms): Trace[1412063122]: ["GuaranteedUpdate etcd3" audit-id:ec1faf46-5efd-42fd-876c-9be6ccffead7,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1312ms (02:24:49.623) Trace[1412063122]: ---"Txn call completed" 1311ms (02:24:50.935)] Trace[1412063122]: [1.312757693s] [1.312757693s] END I0626 02:24:50.936300 1 trace.go:236] Trace[757978165]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bc4bb23b-2d85-4600-9838-4635bfe9677a,client:199.19.213.102,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:24:47.924) (total time: 3012ms): Trace[757978165]: ["GuaranteedUpdate etcd3" audit-id:bc4bb23b-2d85-4600-9838-4635bfe9677a,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 3011ms (02:24:47.924) Trace[757978165]: ---"Txn call completed" 3009ms (02:24:50.935)] Trace[757978165]: [3.012024661s] [3.012024661s] END I0626 02:24:50.936591 1 trace.go:236] Trace[861124244]: "Update" accept:application/json, */*,audit-id:98942343-09e0-47dc-bbed-a5e1052f3866,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (26-Jun-2026 02:24:44.506) (total time: 6430ms): Trace[861124244]: ["GuaranteedUpdate etcd3" audit-id:98942343-09e0-47dc-bbed-a5e1052f3866,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 6429ms (02:24:44.506) Trace[861124244]: ---"Txn call completed" 6428ms (02:24:50.936)] Trace[861124244]: [6.430219988s] [6.430219988s] END E0626 02:24:50.936960 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0626 02:24:51.373569 1 trace.go:236] Trace[784941410]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4c4e8434-4795-4285-b931-72f1faa5165d,client:199.19.213.102,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (26-Jun-2026 02:24:44.474) (total time: 6899ms): Trace[784941410]: ---"About to write a response" 6898ms (02:24:51.373) Trace[784941410]: [6.899398173s] [6.899398173s] END I0626 02:24:51.388425 1 trace.go:236] Trace[1646047814]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:88ee72df-6377-4aee-9da6-2c0b97a57ab0,client:199.19.213.102,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bc80522812c944,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 02:24:42.835) (total time: 8552ms): Trace[1646047814]: ["GuaranteedUpdate etcd3" audit-id:88ee72df-6377-4aee-9da6-2c0b97a57ab0,key:/events/kube-system/kube-apiserver-instance.18bc80522812c944,type:*core.Event,resource:events 8552ms (02:24:42.835) Trace[1646047814]: ---"initial value restored" 8536ms (02:24:51.372)] Trace[1646047814]: ---"Object stored in database" 15ms (02:24:51.388) Trace[1646047814]: [8.552546289s] [8.552546289s] END I0626 02:24:51.453761 1 trace.go:236] Trace[1378769978]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.102,type:*v1.Endpoints,resource:apiServerIPInfo (26-Jun-2026 02:24:42.835) (total time: 8618ms): Trace[1378769978]: ---"initial value restored" 8537ms (02:24:51.372) Trace[1378769978]: ---"Transaction prepared" 72ms (02:24:51.444) Trace[1378769978]: [8.618507034s] [8.618507034s] END