I0407 09:33:52.116572 1 options.go:220] external host was not specified, using 199.204.45.116 I0407 09:33:52.118040 1 server.go:148] Version: v1.28.13 I0407 09:33:52.118103 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0407 09:33:52.752775 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0407 09:33:52.763678 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0407 09:33:52.763703 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0407 09:33:52.763983 1 instance.go:298] Using reconciler: lease I0407 09:33:52.826105 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0407 09:33:52.826126 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0407 09:33:53.065333 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0407 09:33:53.065511 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0407 09:33:53.500787 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0407 09:33:53.516201 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0407 09:33:53.516232 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0407 09:33:53.516240 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0407 09:33:53.516755 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0407 09:33:53.516771 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0407 09:33:53.517545 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0407 09:33:53.518302 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0407 09:33:53.518313 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0407 09:33:53.518317 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0407 09:33:53.519329 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0407 09:33:53.519341 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0407 09:33:53.519952 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0407 09:33:53.519964 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0407 09:33:53.519968 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0407 09:33:53.520401 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0407 09:33:53.520414 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0407 09:33:53.520473 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0407 09:33:53.520884 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0407 09:33:53.522010 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0407 09:33:53.522022 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0407 09:33:53.522026 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0407 09:33:53.522548 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0407 09:33:53.522560 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0407 09:33:53.522564 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0407 09:33:53.523156 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0407 09:33:53.523169 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0407 09:33:53.524380 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0407 09:33:53.524393 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0407 09:33:53.524398 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0407 09:33:53.524760 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0407 09:33:53.524775 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0407 09:33:53.524779 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0407 09:33:53.528027 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0407 09:33:53.528059 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0407 09:33:53.528070 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0407 09:33:53.529670 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0407 09:33:53.530842 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0407 09:33:53.530858 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0407 09:33:53.530862 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0407 09:33:53.534739 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0407 09:33:53.534755 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0407 09:33:53.534760 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0407 09:33:53.535603 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0407 09:33:53.535618 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0407 09:33:53.535623 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0407 09:33:53.536309 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0407 09:33:53.536322 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0407 09:33:53.570961 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0407 09:33:53.570995 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0407 09:33:53.975227 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0407 09:33:53.975238 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0407 09:33:53.975581 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0407 09:33:53.975884 1 secure_serving.go:213] Serving securely on [::]:6443 I0407 09:33:53.975990 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0407 09:33:53.976221 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0407 09:33:53.976305 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0407 09:33:53.976319 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0407 09:33:53.976507 1 gc_controller.go:78] Starting apiserver lease garbage collector I0407 09:33:53.976659 1 controller.go:78] Starting OpenAPI AggregationController I0407 09:33:53.976696 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0407 09:33:53.976712 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0407 09:33:53.976693 1 available_controller.go:423] Starting AvailableConditionController I0407 09:33:53.976813 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0407 09:33:53.976821 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0407 09:33:53.977082 1 controller.go:116] Starting legacy_token_tracking_controller I0407 09:33:53.977096 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0407 09:33:53.977146 1 gc_controller.go:78] Starting apiserver lease garbage collector I0407 09:33:53.977192 1 aggregator.go:164] waiting for initial CRD sync... I0407 09:33:53.977219 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0407 09:33:53.977710 1 controller.go:134] Starting OpenAPI controller I0407 09:33:53.977753 1 controller.go:85] Starting OpenAPI V3 controller I0407 09:33:53.977781 1 naming_controller.go:291] Starting NamingConditionController I0407 09:33:53.977809 1 establishing_controller.go:76] Starting EstablishingController I0407 09:33:53.977833 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0407 09:33:53.977869 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0407 09:33:53.977893 1 crd_finalizer.go:266] Starting CRDFinalizer I0407 09:33:53.977935 1 controller.go:80] Starting OpenAPI V3 AggregationController I0407 09:33:53.978029 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0407 09:33:53.978155 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0407 09:33:53.978174 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0407 09:33:53.978675 1 system_namespaces_controller.go:67] Starting system namespaces controller I0407 09:33:53.978732 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0407 09:33:53.978818 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0407 09:33:54.053793 1 shared_informer.go:318] Caches are synced for node_authorizer E0407 09:33:54.058098 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0407 09:33:54.076491 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0407 09:33:54.076534 1 apf_controller.go:379] Running API Priority and Fairness config worker I0407 09:33:54.076545 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0407 09:33:54.076836 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0407 09:33:54.076933 1 cache.go:39] Caches are synced for AvailableConditionController controller I0407 09:33:54.077173 1 shared_informer.go:318] Caches are synced for configmaps I0407 09:33:54.079576 1 shared_informer.go:318] Caches are synced for crd-autoregister I0407 09:33:54.079705 1 aggregator.go:166] initial CRD sync complete... I0407 09:33:54.079738 1 autoregister_controller.go:141] Starting autoregister controller I0407 09:33:54.079769 1 cache.go:32] Waiting for caches to sync for autoregister controller I0407 09:33:54.079807 1 cache.go:39] Caches are synced for autoregister controller I0407 09:33:54.080372 1 controller.go:624] quota admission added evaluator for: namespaces I0407 09:33:54.262724 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0407 09:33:54.984247 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0407 09:33:54.994053 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0407 09:33:54.994080 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0407 09:33:55.553257 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0407 09:33:55.605295 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0407 09:33:55.695124 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0407 09:33:55.708798 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.116] I0407 09:33:55.710018 1 controller.go:624] quota admission added evaluator for: endpoints I0407 09:33:55.715156 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0407 09:33:57.122977 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0407 09:33:57.131738 1 controller.go:624] quota admission added evaluator for: deployments.apps I0407 09:33:57.227076 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0407 09:33:57.427723 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0407 09:34:02.293148 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0407 09:34:02.392904 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0407 09:34:21.506536 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 09:34:21.633382 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:34:21.633415 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:34:21.644753 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:34:21.766886 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 09:34:21.801130 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 09:34:21.820981 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 09:34:21.850317 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:34:21.850421 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0407 09:34:21.877559 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 09:34:21.910567 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 09:34:21.910702 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0407 09:34:21.950987 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:34:21.951066 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:34:21.999502 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:34:22.149472 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:34:22.149520 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:34:22.171490 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:34:22.287478 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:34:22.333655 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:34:22.379360 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:34:22.392086 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:34:22.928496 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:34:22.938866 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:34:23.089733 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:34:28.790074 1 controller.go:624] quota admission added evaluator for: jobs.batch I0407 09:34:30.318552 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:34:30.525018 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:34:30.745987 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:34:30.904062 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:34:31.112967 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:34:31.306993 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:34:31.505716 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:34:32.850649 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:34:32.975798 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:34:34.123764 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:34:34.504100 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0407 09:34:35.076231 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0407 09:34:35.076864 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0407 09:34:38.084675 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0407 09:34:46.490712 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.98.187.29"} W0407 09:34:46.524984 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.98.187.29:9443: connect: connection refused E0407 09:34:46.525037 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.98.187.29:9443: connect: connection refused I0407 09:35:00.071708 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0407 09:35:00.083829 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0407 09:35:00.104993 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0407 09:35:00.113928 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.102.168.124"} I0407 09:35:00.126881 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.104.141.68"} I0407 09:35:00.165626 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0407 09:35:00.218778 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0407 09:35:00.248094 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager W0407 09:35:20.544665 1 dispatcher.go:225] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/mutate?timeout=10s": context deadline exceeded I0407 09:35:20.545137 1 trace.go:236] Trace[2117819030]: "Create" accept:application/json, */*,audit-id:2618bcbc-5205-442d-b409-fc4096e3398b,client:10.0.0.67,protocol:HTTP/2.0,resource:certificates,scope:resource,url:/apis/cert-manager.io/v1/namespaces/cert-manager/certificates,user-agent:Go-http-client/2.0,verb:POST (07-Apr-2026 09:35:10.543) (total time: 10001ms): Trace[2117819030]: ["Call mutating webhook" configuration:cert-manager-webhook,webhook:webhook.cert-manager.io,resource:cert-manager.io/v1, Resource=certificates,subresource:,operation:CREATE,UID:11cd5d7e-2ff7-44cf-96b5-402f58c133ea 10001ms (09:35:10.544)] Trace[2117819030]: [10.00150654s] [10.00150654s] END I0407 09:35:20.564996 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0407 09:35:26.668637 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0407 09:35:41.821508 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.108.149.29"} I0407 09:35:41.832010 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.97.243.80"} I0407 09:35:41.842298 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.111.96.33"} I0407 09:35:41.854689 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.104.107.131"} I0407 09:35:48.291798 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:35:48.316957 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:35:48.345992 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:35:48.359845 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:35:48.383400 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:35:48.410904 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:35:48.428931 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:35:48.446880 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:35:48.471920 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:35:48.491849 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0407 09:35:48.518477 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:35:48.540432 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:35:48.557171 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:35:49.855614 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:35:54.162116 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0407 09:35:54.168440 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0407 09:35:54.226324 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.107.165.39"} I0407 09:35:54.259588 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0407 09:35:56.434554 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0407 09:35:56.459732 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0407 09:35:57.119365 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0407 09:35:57.119423 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0407 09:35:57.119645 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0407 09:36:04.081653 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0407 09:36:06.894516 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.109.80.33"} I0407 09:36:07.165057 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0407 09:36:07.420912 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.104.162.139"} I0407 09:36:07.436397 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.109.191.208"} I0407 09:37:26.325885 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.103.244.7"} I0407 09:37:28.420696 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.108.238.10"} I0407 09:37:29.237917 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.107.196.197"} I0407 09:37:36.750455 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.111.207.82"} I0407 09:37:36.759397 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.105.230.59"} I0407 09:39:56.639479 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0407 09:39:58.614307 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0407 09:39:58.628894 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0407 09:39:58.648274 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0407 09:39:58.657767 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0407 09:39:58.673724 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0407 09:39:58.686239 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0407 09:39:58.698283 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0407 09:40:11.740005 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0407 09:40:50.423414 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0407 09:41:04.415328 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0407 09:41:04.646841 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0407 09:41:04.673768 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0407 09:41:04.679732 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0407 09:41:04.909281 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0407 09:41:05.203542 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0407 09:41:05.267454 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0407 09:41:05.335587 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0407 09:41:05.365872 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0407 09:41:05.488769 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0407 09:41:45.496351 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.106.228.209"} I0407 09:41:45.506550 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.102.21.197"} I0407 09:41:45.520197 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.106.209.244"} I0407 09:41:45.530622 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.101.239.143"} I0407 09:41:45.536662 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.108.173.107"} I0407 09:41:45.544560 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.104.114.32"} I0407 09:41:45.586032 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0407 09:41:45.598365 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0407 09:41:45.640967 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0407 09:41:45.659596 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0407 09:41:45.683371 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0407 09:41:45.692491 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.692528 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.693371 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.693400 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.693811 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.693841 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.693922 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.693941 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.694028 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.694200 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.694512 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.694537 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.695001 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.695029 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.695105 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.695124 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.695192 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.695209 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.695316 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.695405 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.695626 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.695633 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.695646 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.695652 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.695797 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.695849 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.696701 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.696727 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.696863 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.696891 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused W0407 09:41:45.696966 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused E0407 09:41:45.696985 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.106.228.209:443: connect: connection refused I0407 09:41:58.917140 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0407 09:41:59.075302 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.103.80.72"} I0407 09:42:39.056386 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.108.78.29"} I0407 09:42:39.072300 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0407 09:47:55.199174 1 trace.go:236] Trace[1006713633]: "Update" accept:application/json, */*,audit-id:2b07740e-1f3c-410f-986e-b6e8e09b572e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 09:47:52.929) (total time: 2269ms): Trace[1006713633]: ["GuaranteedUpdate etcd3" audit-id:2b07740e-1f3c-410f-986e-b6e8e09b572e,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 2268ms (09:47:52.930) Trace[1006713633]: ---"Txn call completed" 2267ms (09:47:55.198)] Trace[1006713633]: [2.269135098s] [2.269135098s] END I0407 09:47:55.846925 1 trace.go:236] Trace[299398923]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9b1c599b-db85-4508-9780-d4f56fdfb45e,client:10.0.0.147,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:47:53.502) (total time: 2344ms): Trace[299398923]: ["GuaranteedUpdate etcd3" audit-id:9b1c599b-db85-4508-9780-d4f56fdfb45e,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 2344ms (09:47:53.502) Trace[299398923]: ---"Txn call completed" 2343ms (09:47:55.846)] Trace[299398923]: [2.34463347s] [2.34463347s] END I0407 09:47:55.847154 1 trace.go:236] Trace[287910642]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7d13bbf9-bf29-44fb-99da-861aef070d10,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:47:54.438) (total time: 1408ms): Trace[287910642]: ["GuaranteedUpdate etcd3" audit-id:7d13bbf9-bf29-44fb-99da-861aef070d10,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1408ms (09:47:54.438) Trace[287910642]: ---"Txn call completed" 1406ms (09:47:55.846)] Trace[287910642]: [1.408367254s] [1.408367254s] END I0407 09:47:55.847324 1 trace.go:236] Trace[1774101218]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f30d7451-e41b-4de6-900b-9a207dcc56a8,client:10.0.0.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:47:54.215) (total time: 1631ms): Trace[1774101218]: ["GuaranteedUpdate etcd3" audit-id:f30d7451-e41b-4de6-900b-9a207dcc56a8,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1631ms (09:47:54.215) Trace[1774101218]: ---"Txn call completed" 1630ms (09:47:55.847)] Trace[1774101218]: [1.631462758s] [1.631462758s] END I0407 09:47:55.847908 1 trace.go:236] Trace[915950495]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1fa98a99-1574-44df-a15e-2cc9e96416a1,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 09:47:54.447) (total time: 1400ms): Trace[915950495]: ["GuaranteedUpdate etcd3" audit-id:1fa98a99-1574-44df-a15e-2cc9e96416a1,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 1400ms (09:47:54.447) Trace[915950495]: ---"Txn call completed" 1399ms (09:47:55.847)] Trace[915950495]: [1.400818126s] [1.400818126s] END I0407 09:47:55.848741 1 trace.go:236] Trace[190589932]: "Get" accept:application/json, */*,audit-id:06a0bee5-8f6a-4d8d-b15d-d8bb74f14616,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:47:54.731) (total time: 1117ms): Trace[190589932]: ---"About to write a response" 1116ms (09:47:55.848) Trace[190589932]: [1.117336332s] [1.117336332s] END I0407 09:47:55.849887 1 trace.go:236] Trace[1282428243]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c8dcf638-e6b8-49b2-81e2-98b89deb02d5,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:47:53.284) (total time: 2565ms): Trace[1282428243]: ---"About to write a response" 2565ms (09:47:55.849) Trace[1282428243]: [2.565164994s] [2.565164994s] END I0407 09:47:55.849981 1 trace.go:236] Trace[1622583290]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cec9ef84-e0b6-4f02-a00d-738d0475b7b6,client:10.0.0.160,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:47:54.522) (total time: 1327ms): Trace[1622583290]: ["GuaranteedUpdate etcd3" audit-id:cec9ef84-e0b6-4f02-a00d-738d0475b7b6,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1327ms (09:47:54.522) Trace[1622583290]: ---"Txn call completed" 1326ms (09:47:55.849)] Trace[1622583290]: [1.327230742s] [1.327230742s] END I0407 09:47:55.850356 1 trace.go:236] Trace[983829693]: "Get" accept:application/json, */*,audit-id:3c6ec7f3-1b78-42a5-bb40-51882b8791b8,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:47:54.735) (total time: 1115ms): Trace[983829693]: ---"About to write a response" 1114ms (09:47:55.849) Trace[983829693]: [1.11502329s] [1.11502329s] END I0407 09:47:55.851258 1 trace.go:236] Trace[1555444363]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0ec57f77-a7fe-4f9b-ad24-0349a89e12a2,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:47:53.392) (total time: 2458ms): Trace[1555444363]: ---"About to write a response" 2457ms (09:47:55.850) Trace[1555444363]: [2.458421216s] [2.458421216s] END E0407 09:48:00.852952 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:48:00.852999 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:48:00.853113 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 87.082µs, panicked: false, err: context canceled, panic-reason: E0407 09:48:00.853181 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:48:00.853230 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:48:00.853251 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 10.11µs, panicked: false, err: context canceled, panic-reason: E0407 09:48:00.853430 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 107.282µs, panicked: false, err: context deadline exceeded, panic-reason: E0407 09:48:00.854109 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0407 09:48:00.854393 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:48:00.854397 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:48:00.855507 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:48:00.855616 1 trace.go:236] Trace[1806666367]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b28cdede-29c5-4c33-96a1-6b093d39876e,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 09:47:55.852) (total time: 5003ms): Trace[1806666367]: ["GuaranteedUpdate etcd3" audit-id:b28cdede-29c5-4c33-96a1-6b093d39876e,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 5003ms (09:47:55.852) Trace[1806666367]: ---"Txn call failed" err:context canceled 5000ms (09:48:00.853)] Trace[1806666367]: [5.003030641s] [5.003030641s] END I0407 09:48:00.855771 1 trace.go:236] Trace[1169856651]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8e15d8d5-db25-4e2b-8270-4e79e9d12272,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 09:47:55.852) (total time: 5003ms): Trace[1169856651]: ["GuaranteedUpdate etcd3" audit-id:8e15d8d5-db25-4e2b-8270-4e79e9d12272,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5003ms (09:47:55.852) Trace[1169856651]: ---"Txn call failed" err:context canceled 5000ms (09:48:00.853)] Trace[1169856651]: [5.003652085s] [5.003652085s] END E0407 09:48:00.855868 1 timeout.go:142] post-timeout activity - time-elapsed: 2.763141ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0407 09:48:00.855877 1 timeout.go:142] post-timeout activity - time-elapsed: 2.776202ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0407 09:48:00.856017 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:48:00.857012 1 trace.go:236] Trace[1272158968]: "Update" accept:application/json, */*,audit-id:7667e5ff-fa33-4b2d-a445-ba98d2e59ef5,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:47:55.852) (total time: 5004ms): Trace[1272158968]: ["GuaranteedUpdate etcd3" audit-id:7667e5ff-fa33-4b2d-a445-ba98d2e59ef5,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5004ms (09:47:55.852) Trace[1272158968]: ---"Txn call failed" err:context deadline exceeded 5000ms (09:48:00.853)] Trace[1272158968]: [5.004552666s] [5.004552666s] END E0407 09:48:00.857061 1 timeout.go:142] post-timeout activity - time-elapsed: 3.965809ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0407 09:48:02.849935 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:48:02.849987 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:48:02.850016 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 8.201µs, panicked: false, err: context deadline exceeded, panic-reason: E0407 09:48:02.850194 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:48:02.850219 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 5.66µs, panicked: false, err: context deadline exceeded, panic-reason: I0407 09:48:02.850390 1 trace.go:236] Trace[552204746]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.116,type:*v1.Endpoints,resource:apiServerIPInfo (07-Apr-2026 09:47:55.728) (total time: 7121ms): Trace[552204746]: ---"initial value restored" 118ms (09:47:55.847) Trace[552204746]: [7.121983605s] [7.121983605s] END E0407 09:48:02.850424 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0407 09:48:02.851350 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:48:02.851396 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0407 09:48:02.851525 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:48:02.851555 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 4.7µs, panicked: false, err: context deadline exceeded, panic-reason: E0407 09:48:02.851578 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0407 09:48:02.852269 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:48:02.852322 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 4.12µs, panicked: false, err: context deadline exceeded, panic-reason: I0407 09:48:02.852426 1 trace.go:236] Trace[296325901]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4ef0faa8-42a9-4063-9feb-283e8224beb9,client:10.0.0.147,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:47:57.849) (total time: 5002ms): Trace[296325901]: ["GuaranteedUpdate etcd3" audit-id:4ef0faa8-42a9-4063-9feb-283e8224beb9,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (09:47:57.850) Trace[296325901]: ---"Txn call failed" err:context deadline exceeded 4999ms (09:48:02.849)] Trace[296325901]: [5.002442063s] [5.002442063s] END E0407 09:48:02.852519 1 timeout.go:142] post-timeout activity - time-elapsed: 2.506196ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0407 09:48:02.852548 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:48:02.852650 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0407 09:48:02.852669 1 trace.go:236] Trace[1917756749]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2e3e30ca-347e-48ee-b054-4286034132d3,client:10.0.0.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:47:57.850) (total time: 5002ms): Trace[1917756749]: ["GuaranteedUpdate etcd3" audit-id:2e3e30ca-347e-48ee-b054-4286034132d3,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (09:47:57.850) Trace[1917756749]: ---"Txn call failed" err:context deadline exceeded 4998ms (09:48:02.850)] Trace[1917756749]: [5.002111884s] [5.002111884s] END E0407 09:48:02.852755 1 timeout.go:142] post-timeout activity - time-elapsed: 2.507126ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0407 09:48:02.852916 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0407 09:48:02.853646 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0407 09:48:02.853690 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0407 09:48:02.853690 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:48:02.854807 1 trace.go:236] Trace[813152827]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:921f9a3d-bdd8-403f-bef3-287b08ddf2df,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:47:57.851) (total time: 5002ms): Trace[813152827]: ["GuaranteedUpdate etcd3" audit-id:921f9a3d-bdd8-403f-bef3-287b08ddf2df,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (09:47:57.851) Trace[813152827]: ---"Txn call failed" err:context deadline exceeded 4998ms (09:48:02.851)] Trace[813152827]: [5.002964973s] [5.002964973s] END I0407 09:48:02.854906 1 trace.go:236] Trace[1172462058]: "Update" accept:application/json, */*,audit-id:37c5be02-173b-4bd1-be5b-b667b9478224,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 09:47:55.851) (total time: 7002ms): Trace[1172462058]: ["GuaranteedUpdate etcd3" audit-id:37c5be02-173b-4bd1-be5b-b667b9478224,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:47:55.852) Trace[1172462058]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:48:02.853)] Trace[1172462058]: [7.00291191s] [7.00291191s] END E0407 09:48:02.854950 1 timeout.go:142] post-timeout activity - time-elapsed: 3.401256ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: I0407 09:48:02.855105 1 trace.go:236] Trace[512039838]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6941e01a-d67d-4ffb-9f00-ddee1be50aa7,client:10.0.0.160,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:47:57.852) (total time: 5002ms): Trace[512039838]: ["GuaranteedUpdate etcd3" audit-id:6941e01a-d67d-4ffb-9f00-ddee1be50aa7,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (09:47:57.852) Trace[512039838]: ---"Txn call failed" err:context deadline exceeded 4999ms (09:48:02.852)] Trace[512039838]: [5.002960714s] [5.002960714s] END E0407 09:48:02.855163 1 timeout.go:142] post-timeout activity - time-elapsed: 2.823183ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: I0407 09:48:02.855170 1 trace.go:236] Trace[234354092]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f890de27-9c14-48b7-9634-d0c48d3c294c,client:199.204.45.116,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (07-Apr-2026 09:47:55.850) (total time: 7004ms): Trace[234354092]: ["Create etcd3" audit-id:f890de27-9c14-48b7-9634-d0c48d3c294c,key:/events/kube-system/kube-apiserver-instance.18a40a1db80f1c0b,type:*core.Event,resource:events 7003ms (09:47:55.851)] Trace[234354092]: [7.004484764s] [7.004484764s] END E0407 09:48:03.168359 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:48:03.168569 1 trace.go:236] Trace[1186141014]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:36f6123e-67ac-4802-9c18-1568cb634676,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (07-Apr-2026 09:47:56.164) (total time: 7003ms): Trace[1186141014]: ["GuaranteedUpdate etcd3" audit-id:36f6123e-67ac-4802-9c18-1568cb634676,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:47:56.164) Trace[1186141014]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:48:03.168)] Trace[1186141014]: [7.003700642s] [7.003700642s] END E0407 09:48:03.284781 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:48:03.284899 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:48:03.285984 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:48:03.286040 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0407 09:48:03.287194 1 timeout.go:142] post-timeout activity - time-elapsed: 2.541667ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0407 09:48:03.392683 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:48:03.392815 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:48:03.393854 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:48:03.393959 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:48:03.395496 1 trace.go:236] Trace[700391172]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:67c488d0-353c-4098-b4be-162199b44fc1,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:48:02.855) (total time: 540ms): Trace[700391172]: [540.026216ms] [540.026216ms] END E0407 09:48:03.395678 1 timeout.go:142] post-timeout activity - time-elapsed: 3.101479ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: I0407 09:48:04.375757 1 metrics.go:285] "Failed to get storage metrics" storage_cluster_id="etcd-0" err="context deadline exceeded" I0407 09:48:04.589182 1 trace.go:236] Trace[1827095598]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:32d3d29a-f312-4d06-82b2-6b60eb020015,client:10.0.0.147,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:48:02.851) (total time: 1737ms): Trace[1827095598]: ---"About to write a response" 1737ms (09:48:04.589) Trace[1827095598]: [1.737423755s] [1.737423755s] END I0407 09:48:04.590138 1 trace.go:236] Trace[69226648]: "Get" accept:application/json, */*,audit-id:2fdd0f8b-7780-44f1-aaee-bf21a97b387d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:47:57.201) (total time: 7388ms): Trace[69226648]: ---"About to write a response" 7388ms (09:48:04.589) Trace[69226648]: [7.388548014s] [7.388548014s] END I0407 09:48:04.591158 1 trace.go:236] Trace[759600859]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1bc7a893-d0df-4e9e-8d90-c97a5ee89f72,client:199.204.45.116,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18a40a1db80f1c0b,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (07-Apr-2026 09:48:02.857) (total time: 1734ms): Trace[759600859]: ["GuaranteedUpdate etcd3" audit-id:1bc7a893-d0df-4e9e-8d90-c97a5ee89f72,key:/events/kube-system/kube-apiserver-instance.18a40a1db80f1c0b,type:*core.Event,resource:events 1733ms (09:48:02.857) Trace[759600859]: ---"initial value restored" 1733ms (09:48:04.591)] Trace[759600859]: [1.73403873s] [1.73403873s] END I0407 09:48:04.591948 1 trace.go:236] Trace[1064443521]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:91bbf1ea-4404-467b-b15a-1a7cdb18f0d4,client:10.0.0.147,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:47:56.708) (total time: 7883ms): Trace[1064443521]: ---"About to write a response" 7883ms (09:48:04.591) Trace[1064443521]: [7.883868637s] [7.883868637s] END I0407 09:48:04.592140 1 trace.go:236] Trace[1081806396]: "Get" accept:application/json, */*,audit-id:a3676f5a-1160-41b9-8e5f-a75aabe3a8ec,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:48:02.855) (total time: 1736ms): Trace[1081806396]: ---"About to write a response" 1736ms (09:48:04.592) Trace[1081806396]: [1.736886094s] [1.736886094s] END I0407 09:48:04.592272 1 trace.go:236] Trace[825354311]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:072e2d2d-eaf4-4619-ac79-09eda5bc6655,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 09:48:02.703) (total time: 1888ms): Trace[825354311]: ["GuaranteedUpdate etcd3" audit-id:072e2d2d-eaf4-4619-ac79-09eda5bc6655,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1888ms (09:48:02.703) Trace[825354311]: ---"Txn call completed" 1887ms (09:48:04.592)] Trace[825354311]: [1.888833851s] [1.888833851s] END I0407 09:48:04.592678 1 trace.go:236] Trace[254134221]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:079b48ea-a98e-45dd-b9e1-d4a85f89ea44,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 09:48:03.285) (total time: 1306ms): Trace[254134221]: ["GuaranteedUpdate etcd3" audit-id:079b48ea-a98e-45dd-b9e1-d4a85f89ea44,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1306ms (09:48:03.285) Trace[254134221]: ---"Txn call completed" 1305ms (09:48:04.592)] Trace[254134221]: [1.30682443s] [1.30682443s] END I0407 09:48:04.593761 1 trace.go:236] Trace[2074015593]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b2c1c204-70d1-4d4a-ad79-deade12b5276,client:199.204.45.116,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (07-Apr-2026 09:48:03.864) (total time: 729ms): Trace[2074015593]: ---"About to write a response" 727ms (09:48:04.591) Trace[2074015593]: [729.41864ms] [729.41864ms] END I0407 09:48:04.601462 1 trace.go:236] Trace[945485707]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cca0510a-20f1-4f7c-ae62-2381daa0a5e1,client:10.0.0.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:48:02.852) (total time: 1749ms): Trace[945485707]: ---"About to write a response" 1748ms (09:48:04.601) Trace[945485707]: [1.749043644s] [1.749043644s] END I0407 09:48:04.601553 1 trace.go:236] Trace[1556407773]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:99252f95-a159-4dbd-be26-b31bda3cfbde,client:199.204.45.116,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (07-Apr-2026 09:48:03.170) (total time: 1431ms): Trace[1556407773]: ---"About to write a response" 1431ms (09:48:04.601) Trace[1556407773]: [1.431060081s] [1.431060081s] END I0407 09:48:04.601583 1 trace.go:236] Trace[1872122757]: "Get" accept:application/json, */*,audit-id:f1dc03c2-51f2-47e6-916d-8e3594a835d8,client:10.0.0.50,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (07-Apr-2026 09:48:03.533) (total time: 1068ms): Trace[1872122757]: ---"About to write a response" 1068ms (09:48:04.601) Trace[1872122757]: [1.068508474s] [1.068508474s] END I0407 09:48:04.601494 1 trace.go:236] Trace[167150953]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:54780d6e-dc5a-43e1-9336-303174f17b3a,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:48:02.852) (total time: 1749ms): Trace[167150953]: ---"About to write a response" 1749ms (09:48:04.601) Trace[167150953]: [1.749343861s] [1.749343861s] END I0407 09:48:04.602795 1 trace.go:236] Trace[853728344]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:574a6b7f-24b4-400f-9094-89ca118032da,client:10.0.0.160,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:48:02.853) (total time: 1749ms): Trace[853728344]: ---"About to write a response" 1749ms (09:48:04.602) Trace[853728344]: [1.749184667s] [1.749184667s] END