I0318 12:46:09.852545       1 options.go:220] external host was not specified, using 199.19.213.187
I0318 12:46:09.853396       1 server.go:148] Version: v1.28.13
I0318 12:46:09.853449       1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0318 12:46:10.305371       1 shared_informer.go:311] Waiting for caches to sync for node_authorizer
I0318 12:46:10.313905       1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
I0318 12:46:10.313947       1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.
I0318 12:46:10.314124       1 instance.go:298] Using reconciler: lease
I0318 12:46:10.765919       1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager
W0318 12:46:10.765944       1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.
I0318 12:46:11.033144       1 handler.go:275] Adding GroupVersion  v1 to ResourceManager
I0318 12:46:11.033288       1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping.
I0318 12:46:11.496272       1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping.
I0318 12:46:11.506091       1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager
W0318 12:46:11.506116       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources.
W0318 12:46:11.506125       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources.
I0318 12:46:11.506654       1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager
W0318 12:46:11.506670       1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources.
I0318 12:46:11.507604       1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager
I0318 12:46:11.508911       1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager
W0318 12:46:11.508929       1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources.
W0318 12:46:11.508936       1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources.
I0318 12:46:11.510613       1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager
W0318 12:46:11.510631       1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources.
I0318 12:46:11.511635       1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager
W0318 12:46:11.511655       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources.
W0318 12:46:11.511663       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources.
I0318 12:46:11.512293       1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager
W0318 12:46:11.512309       1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources.
W0318 12:46:11.512389       1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources.
I0318 12:46:11.513061       1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager
I0318 12:46:11.515007       1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager
W0318 12:46:11.515020       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources.
W0318 12:46:11.515025       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources.
I0318 12:46:11.515541       1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager
W0318 12:46:11.515553       1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources.
W0318 12:46:11.515558       1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources.
I0318 12:46:11.516364       1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager
W0318 12:46:11.516378       1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources.
I0318 12:46:11.517932       1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager
W0318 12:46:11.517945       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.
W0318 12:46:11.517950       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
I0318 12:46:11.518342       1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager
W0318 12:46:11.518356       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.
W0318 12:46:11.518361       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
I0318 12:46:11.520120       1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager
W0318 12:46:11.520133       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources.
W0318 12:46:11.520136       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
I0318 12:46:11.521070       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager
I0318 12:46:11.521966       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager
W0318 12:46:11.521979       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources.
W0318 12:46:11.521983       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.
I0318 12:46:11.524846       1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager
W0318 12:46:11.524859       1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources.
W0318 12:46:11.524862       1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources.
I0318 12:46:11.525548       1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager
W0318 12:46:11.525560       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.
W0318 12:46:11.525565       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources.
I0318 12:46:11.525974       1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager
W0318 12:46:11.525984       1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources.
I0318 12:46:11.560928       1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager
W0318 12:46:11.561004       1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.
I0318 12:46:11.971697       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0318 12:46:11.971736       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0318 12:46:11.971982       1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key"
I0318 12:46:11.972054       1 secure_serving.go:213] Serving securely on [::]:6443
I0318 12:46:11.972128       1 aggregator.go:164] waiting for initial CRD sync...
I0318 12:46:11.972158       1 available_controller.go:423] Starting AvailableConditionController
I0318 12:46:11.972164       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
I0318 12:46:11.972335       1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
I0318 12:46:11.972346       1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller
I0318 12:46:11.972539       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0318 12:46:11.972599       1 controller.go:116] Starting legacy_token_tracking_controller
I0318 12:46:11.972607       1 shared_informer.go:311] Waiting for caches to sync for configmaps
I0318 12:46:11.972613       1 system_namespaces_controller.go:67] Starting system namespaces controller
I0318 12:46:11.972631       1 controller.go:80] Starting OpenAPI V3 AggregationController
I0318 12:46:11.972657       1 apf_controller.go:374] Starting API Priority and Fairness config controller
I0318 12:46:11.972673       1 controller.go:78] Starting OpenAPI AggregationController
I0318 12:46:11.972792       1 customresource_discovery_controller.go:289] Starting DiscoveryController
I0318 12:46:11.972836       1 handler_discovery.go:412] Starting ResourceDiscoveryManager
I0318 12:46:11.973050       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0318 12:46:11.973133       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0318 12:46:11.972620       1 apiservice_controller.go:97] Starting APIServiceRegistrationController
I0318 12:46:11.973267       1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
I0318 12:46:11.973335       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0318 12:46:11.973638       1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0318 12:46:11.973649       1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister
I0318 12:46:11.974912       1 controller.go:134] Starting OpenAPI controller
I0318 12:46:11.974943       1 controller.go:85] Starting OpenAPI V3 controller
I0318 12:46:11.974970       1 naming_controller.go:291] Starting NamingConditionController
I0318 12:46:11.974986       1 establishing_controller.go:76] Starting EstablishingController
I0318 12:46:11.975003       1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0318 12:46:11.975023       1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0318 12:46:11.975039       1 crd_finalizer.go:266] Starting CRDFinalizer
I0318 12:46:11.975218       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0318 12:46:11.982890       1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key"
I0318 12:46:12.006839       1 shared_informer.go:318] Caches are synced for node_authorizer
E0318 12:46:12.054199       1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms"
I0318 12:46:12.073238       1 apf_controller.go:379] Running API Priority and Fairness config worker
I0318 12:46:12.073267       1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process
I0318 12:46:12.073405       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0318 12:46:12.073555       1 cache.go:39] Caches are synced for AvailableConditionController controller
I0318 12:46:12.073626       1 shared_informer.go:318] Caches are synced for configmaps
I0318 12:46:12.073632       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0318 12:46:12.073723       1 shared_informer.go:318] Caches are synced for crd-autoregister
I0318 12:46:12.073782       1 aggregator.go:166] initial CRD sync complete...
I0318 12:46:12.073799       1 autoregister_controller.go:141] Starting autoregister controller
I0318 12:46:12.073809       1 cache.go:32] Waiting for caches to sync for autoregister controller
I0318 12:46:12.073818       1 cache.go:39] Caches are synced for autoregister controller
I0318 12:46:12.075836       1 controller.go:624] quota admission added evaluator for: namespaces
I0318 12:46:12.097642       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0318 12:46:12.982035       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I0318 12:46:12.988067       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I0318 12:46:12.988086       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0318 12:46:13.657308       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0318 12:46:13.713153       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0318 12:46:13.789078       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W0318 12:46:13.797566       1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.19.213.187]
I0318 12:46:13.798832       1 controller.go:624] quota admission added evaluator for: endpoints
I0318 12:46:13.804262       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0318 12:46:15.766963       1 controller.go:624] quota admission added evaluator for: serviceaccounts
I0318 12:46:15.774659       1 controller.go:624] quota admission added evaluator for: deployments.apps
I0318 12:46:15.794397       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I0318 12:46:16.000400       1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I0318 12:46:21.251772       1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps
I0318 12:46:21.350618       1 controller.go:624] quota admission added evaluator for: replicasets.apps
I0318 12:46:48.670811       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0318 12:46:48.681820       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0318 12:46:49.061040       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0318 12:46:49.261047       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0318 12:46:49.457071       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0318 12:46:49.658768       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0318 12:46:49.858192       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0318 12:46:50.080754       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0318 12:46:50.676222       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0318 12:46:52.276731       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0318 12:46:52.691046       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0318 12:46:57.665298       1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io
I0318 12:47:41.837801       1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.101.201.183"}
I0318 12:47:41.846048       1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.100.15.140"}
I0318 12:49:04.818024       1 trace.go:236] Trace[171171563]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ccfb2a4e-d359-4f1a-9579-ea163ea0ff37,client:199.19.213.187,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (18-Mar-2026 12:49:03.886) (total time: 931ms):
Trace[171171563]: ["GuaranteedUpdate etcd3" audit-id:ccfb2a4e-d359-4f1a-9579-ea163ea0ff37,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 931ms (12:49:03.886)
Trace[171171563]:  ---"Txn call completed" 930ms (12:49:04.817)]
Trace[171171563]: [931.259628ms] [931.259628ms] END
I0318 12:49:04.825185       1 trace.go:236] Trace[1555596244]: "Get" accept:application/json, */*,audit-id:26750145-e9de-45e1-a5e5-a26b207aff38,client:10.0.0.119,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (18-Mar-2026 12:49:03.889) (total time: 935ms):
Trace[1555596244]: ---"About to write a response" 935ms (12:49:04.825)
Trace[1555596244]: [935.570186ms] [935.570186ms] END
I0318 12:49:04.825307       1 trace.go:236] Trace[1739811753]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6110c5a7-2e64-47fe-a96e-009c5caaa52c,client:199.19.213.187,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (18-Mar-2026 12:49:03.893) (total time: 931ms):
Trace[1739811753]: ---"About to write a response" 931ms (12:49:04.825)
Trace[1739811753]: [931.763456ms] [931.763456ms] END
I0318 12:49:04.825354       1 trace.go:236] Trace[1429890620]: "Get" accept:application/json, */*,audit-id:71d89d46-088b-4b64-b292-75121f27b1cd,client:199.19.213.187,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (18-Mar-2026 12:49:03.907) (total time: 917ms):
Trace[1429890620]: ---"About to write a response" 917ms (12:49:04.825)
Trace[1429890620]: [917.482807ms] [917.482807ms] END
I0318 12:49:04.825946       1 trace.go:236] Trace[137895056]: "Update" accept:application/json, */*,audit-id:8fc62ab8-e611-4d20-bcba-dbf7e86feea7,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (18-Mar-2026 12:49:03.888) (total time: 937ms):
Trace[137895056]: ["GuaranteedUpdate etcd3" audit-id:8fc62ab8-e611-4d20-bcba-dbf7e86feea7,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 937ms (12:49:03.888)
Trace[137895056]:  ---"Txn call completed" 936ms (12:49:04.825)]
Trace[137895056]: [937.507071ms] [937.507071ms] END
E0318 12:49:09.826896       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0318 12:49:09.827004       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 59.831µs, panicked: false, err: context canceled, panic-reason: <nil>
E0318 12:49:09.826919       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0318 12:49:09.826987       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 23.271µs, panicked: false, err: context canceled, panic-reason: <nil>
E0318 12:49:09.827082       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0318 12:49:09.828753       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0318 12:49:09.828837       1 trace.go:236] Trace[30871851]: "Update" accept:application/json, */*,audit-id:1a93562c-5e2f-4396-8cc5-63f67d5e6d2d,client:199.19.213.187,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (18-Mar-2026 12:49:04.827) (total time: 5001ms):
Trace[30871851]: ["GuaranteedUpdate etcd3" audit-id:1a93562c-5e2f-4396-8cc5-63f67d5e6d2d,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (12:49:04.828)
Trace[30871851]:  ---"Txn call failed" err:context canceled 4998ms (12:49:09.826)]
Trace[30871851]: [5.001005103s] [5.001005103s] END
E0318 12:49:09.828882       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0318 12:49:09.829029       1 timeout.go:142] post-timeout activity - time-elapsed: 2.195351ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0318 12:49:09.829997       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0318 12:49:09.831109       1 trace.go:236] Trace[69480375]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ab41cdef-5d49-404b-9c38-5e630f2a9d00,client:199.19.213.187,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (18-Mar-2026 12:49:04.826) (total time: 5004ms):
Trace[69480375]: ["GuaranteedUpdate etcd3" audit-id:ab41cdef-5d49-404b-9c38-5e630f2a9d00,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5004ms (12:49:04.826)
Trace[69480375]:  ---"Txn call failed" err:context canceled 4999ms (12:49:09.826)]
Trace[69480375]: [5.004386224s] [5.004386224s] END
E0318 12:49:09.831189       1 timeout.go:142] post-timeout activity - time-elapsed: 4.253987ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
I0318 12:49:10.646295       1 trace.go:236] Trace[110278555]: "Get" accept:application/json, */*,audit-id:d78ede1b-2c77-47d5-b015-fc44edbe7b47,client:10.0.0.119,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 12:49:04.832) (total time: 5814ms):
Trace[110278555]: ---"About to write a response" 5813ms (12:49:10.646)
Trace[110278555]: [5.814066909s] [5.814066909s] END
I0318 12:49:10.646452       1 trace.go:236] Trace[817790385]: "Update" accept:application/json, */*,audit-id:2fed9395-8ef8-4916-bf85-722dd4b8f6af,client:10.0.0.119,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (18-Mar-2026 12:49:04.826) (total time: 5819ms):
Trace[817790385]: ["GuaranteedUpdate etcd3" audit-id:2fed9395-8ef8-4916-bf85-722dd4b8f6af,key:/leases/kube-system/rbd.csi.ceph.com-kube-system,type:*coordination.Lease,resource:leases.coordination.k8s.io 5819ms (12:49:04.826)
Trace[817790385]:  ---"Txn call completed" 5818ms (12:49:10.646)]
Trace[817790385]: [5.819550159s] [5.819550159s] END
I0318 12:49:10.646668       1 trace.go:236] Trace[632749358]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b571a993-842c-40c9-bdc2-a529e8e4a023,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (18-Mar-2026 12:49:06.334) (total time: 4312ms):
Trace[632749358]: ["GuaranteedUpdate etcd3" audit-id:b571a993-842c-40c9-bdc2-a529e8e4a023,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 4312ms (12:49:06.334)
Trace[632749358]:  ---"Txn call completed" 4310ms (12:49:10.646)]
Trace[632749358]: [4.312335349s] [4.312335349s] END
I0318 12:49:10.655760       1 trace.go:236] Trace[1871505150]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1666406e-ba4e-4d1f-a006-4aaaab975bfd,client:199.19.213.187,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (18-Mar-2026 12:49:06.820) (total time: 3834ms):
Trace[1871505150]: ---"About to write a response" 3834ms (12:49:10.655)
Trace[1871505150]: [3.834944951s] [3.834944951s] END
I0318 12:49:10.655877       1 trace.go:236] Trace[1324621205]: "Get" accept:application/json, */*,audit-id:49d06460-b1c6-49b8-812a-7f33d1581b14,client:10.0.0.119,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 12:49:07.665) (total time: 2990ms):
Trace[1324621205]: ---"About to write a response" 2990ms (12:49:10.655)
Trace[1324621205]: [2.990777638s] [2.990777638s] END
I0318 12:49:10.655883       1 trace.go:236] Trace[1227439150]: "Get" accept:application/json, */*,audit-id:272638ac-ab55-4a63-8637-6c74e8d5fef8,client:10.0.0.119,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 12:49:06.314) (total time: 4341ms):
Trace[1227439150]: ---"About to write a response" 4341ms (12:49:10.655)
Trace[1227439150]: [4.341217785s] [4.341217785s] END
I0318 12:49:10.656843       1 trace.go:236] Trace[1698596953]: "Get" accept:application/json, */*,audit-id:42111754-560d-4e9f-ad2e-640e2ea145ca,client:10.0.0.119,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com,user-agent:csi-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 12:49:07.972) (total time: 2684ms):
Trace[1698596953]: ---"About to write a response" 2684ms (12:49:10.656)
Trace[1698596953]: [2.684432603s] [2.684432603s] END
I0318 12:49:10.657530       1 trace.go:236] Trace[852745205]: "Get" accept:application/json, */*,audit-id:6b37dd57-8192-481b-8858-f57be78da140,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 12:49:05.773) (total time: 4883ms):
Trace[852745205]: ---"About to write a response" 4883ms (12:49:10.657)
Trace[852745205]: [4.883440703s] [4.883440703s] END
I0318 12:49:10.657561       1 trace.go:236] Trace[1563764753]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:99de096d-591f-4ff2-aec4-b98a32215cd9,client:199.19.213.187,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (18-Mar-2026 12:49:10.052) (total time: 604ms):
Trace[1563764753]: ["GuaranteedUpdate etcd3" audit-id:99de096d-591f-4ff2-aec4-b98a32215cd9,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 604ms (12:49:10.052)
Trace[1563764753]:  ---"Txn call completed" 603ms (12:49:10.657)]
Trace[1563764753]: [604.98058ms] [604.98058ms] END
I0318 12:49:10.657885       1 trace.go:236] Trace[1896930022]: "Get" accept:application/json, */*,audit-id:d2ae382d-e74a-411d-8ea5-c5978000f040,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (18-Mar-2026 12:49:06.828) (total time: 3829ms):
Trace[1896930022]: ---"About to write a response" 3829ms (12:49:10.657)
Trace[1896930022]: [3.829549742s] [3.829549742s] END
I0318 12:49:10.671046       1 trace.go:236] Trace[197051714]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:86f7b9ed-a7ff-45cf-8b7b-30fae236aca3,client:199.19.213.187,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (18-Mar-2026 12:49:09.489) (total time: 1181ms):
Trace[197051714]: ["Create etcd3" audit-id:86f7b9ed-a7ff-45cf-8b7b-30fae236aca3,key:/events/kube-system/kube-apiserver-instance.189df066154930cc,type:*core.Event,resource:events 1180ms (12:49:09.490)
Trace[197051714]:  ---"TransformToStorage succeeded" 1165ms (12:49:10.655)]
Trace[197051714]: [1.181341238s] [1.181341238s] END
I0318 12:49:38.489180       1 trace.go:236] Trace[1401951557]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:898f31e2-e126-4d3b-af31-6d4da67c1cba,client:199.19.213.187,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (18-Mar-2026 12:49:37.988) (total time: 500ms):
Trace[1401951557]: ["GuaranteedUpdate etcd3" audit-id:898f31e2-e126-4d3b-af31-6d4da67c1cba,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 500ms (12:49:37.988)
Trace[1401951557]:  ---"Txn call completed" 499ms (12:49:38.488)]
Trace[1401951557]: [500.402258ms] [500.402258ms] END